2026-04-03 04:24:59.431419 | Job console starting 2026-04-03 04:24:59.446351 | Updating git repos 2026-04-03 04:24:59.563949 | Cloning repos into workspace 2026-04-03 04:24:59.826516 | Restoring repo states 2026-04-03 04:24:59.851376 | Merging changes 2026-04-03 04:24:59.851401 | Checking out repos 2026-04-03 04:25:00.268031 | Preparing playbooks 2026-04-03 04:25:01.011135 | Running Ansible setup 2026-04-03 04:25:06.947923 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-04-03 04:25:07.743338 | 2026-04-03 04:25:07.743499 | PLAY [Base pre] 2026-04-03 04:25:07.760380 | 2026-04-03 04:25:07.760530 | TASK [Setup log path fact] 2026-04-03 04:25:07.790590 | orchestrator | ok 2026-04-03 04:25:07.808560 | 2026-04-03 04:25:07.808732 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-03 04:25:07.850185 | orchestrator | ok 2026-04-03 04:25:07.862238 | 2026-04-03 04:25:07.862366 | TASK [emit-job-header : Print job information] 2026-04-03 04:25:07.918905 | # Job Information 2026-04-03 04:25:07.919209 | Ansible Version: 2.16.14 2026-04-03 04:25:07.919273 | Job: testbed-upgrade-stable-ubuntu-24.04 2026-04-03 04:25:07.919333 | Pipeline: periodic-midnight 2026-04-03 04:25:07.919375 | Executor: 521e9411259a 2026-04-03 04:25:07.919413 | Triggered by: https://github.com/osism/testbed 2026-04-03 04:25:07.919453 | Event ID: fa837ceba21e453d89941a1517f3d753 2026-04-03 04:25:07.929249 | 2026-04-03 04:25:07.929397 | LOOP [emit-job-header : Print node information] 2026-04-03 04:25:08.059739 | orchestrator | ok: 2026-04-03 04:25:08.059946 | orchestrator | # Node Information 2026-04-03 04:25:08.059981 | orchestrator | Inventory Hostname: orchestrator 2026-04-03 04:25:08.060007 | orchestrator | Hostname: zuul-static-regiocloud-infra-1 2026-04-03 04:25:08.060030 | orchestrator | Username: zuul-testbed02 2026-04-03 04:25:08.060051 | orchestrator | Distro: Debian 12.13 2026-04-03 04:25:08.060076 | orchestrator | Provider: static-testbed 2026-04-03 04:25:08.060116 | orchestrator | Region: 2026-04-03 04:25:08.060137 | orchestrator | Label: testbed-orchestrator 2026-04-03 04:25:08.060156 | orchestrator | Product Name: OpenStack Nova 2026-04-03 04:25:08.060176 | orchestrator | Interface IP: 81.163.193.140 2026-04-03 04:25:08.094430 | 2026-04-03 04:25:08.094618 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-03 04:25:08.585938 | orchestrator -> localhost | changed 2026-04-03 04:25:08.602349 | 2026-04-03 04:25:08.602521 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-03 04:25:09.687937 | orchestrator -> localhost | changed 2026-04-03 04:25:09.707596 | 2026-04-03 04:25:09.707752 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-03 04:25:10.006544 | orchestrator -> localhost | ok 2026-04-03 04:25:10.024693 | 2026-04-03 04:25:10.024886 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-03 04:25:10.065985 | orchestrator | ok 2026-04-03 04:25:10.089337 | orchestrator | included: /var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-03 04:25:10.099473 | 2026-04-03 04:25:10.099620 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-03 04:25:10.967234 | orchestrator -> localhost | Generating public/private rsa key pair. 2026-04-03 04:25:10.967473 | orchestrator -> localhost | Your identification has been saved in /var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/b8f72da348914bada7bcedc63b69f7e9_id_rsa 2026-04-03 04:25:10.967517 | orchestrator -> localhost | Your public key has been saved in /var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/b8f72da348914bada7bcedc63b69f7e9_id_rsa.pub 2026-04-03 04:25:10.967865 | orchestrator -> localhost | The key fingerprint is: 2026-04-03 04:25:10.967898 | orchestrator -> localhost | SHA256:Jy4S82dHSXPdocJltECrZ/0FBfMLusRZ7SDaA4xxrzk zuul-build-sshkey 2026-04-03 04:25:10.967924 | orchestrator -> localhost | The key's randomart image is: 2026-04-03 04:25:10.967962 | orchestrator -> localhost | +---[RSA 3072]----+ 2026-04-03 04:25:10.967986 | orchestrator -> localhost | | . ..o.+oo.| 2026-04-03 04:25:10.968008 | orchestrator -> localhost | | = o =.+=.| 2026-04-03 04:25:10.968029 | orchestrator -> localhost | | . oo*.*o.o| 2026-04-03 04:25:10.968050 | orchestrator -> localhost | | .O+B +..| 2026-04-03 04:25:10.968071 | orchestrator -> localhost | | o SE+X . o.| 2026-04-03 04:25:10.968150 | orchestrator -> localhost | | + . += o . .| 2026-04-03 04:25:10.968173 | orchestrator -> localhost | | . o + .. . | 2026-04-03 04:25:10.968194 | orchestrator -> localhost | | . + . | 2026-04-03 04:25:10.968216 | orchestrator -> localhost | | | 2026-04-03 04:25:10.968236 | orchestrator -> localhost | +----[SHA256]-----+ 2026-04-03 04:25:10.968297 | orchestrator -> localhost | ok: Runtime: 0:00:00.347678 2026-04-03 04:25:10.976463 | 2026-04-03 04:25:10.976599 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-03 04:25:11.005774 | orchestrator | ok 2026-04-03 04:25:11.016106 | orchestrator | included: /var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-03 04:25:11.025647 | 2026-04-03 04:25:11.025772 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-03 04:25:11.050035 | orchestrator | skipping: Conditional result was False 2026-04-03 04:25:11.060569 | 2026-04-03 04:25:11.060715 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-03 04:25:11.726647 | orchestrator | changed 2026-04-03 04:25:11.739361 | 2026-04-03 04:25:11.739512 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-03 04:25:12.043540 | orchestrator | ok 2026-04-03 04:25:12.051685 | 2026-04-03 04:25:12.051833 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-03 04:25:12.517994 | orchestrator | ok 2026-04-03 04:25:12.525150 | 2026-04-03 04:25:12.525268 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-03 04:25:12.961815 | orchestrator | ok 2026-04-03 04:25:12.969104 | 2026-04-03 04:25:12.969221 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-03 04:25:13.003580 | orchestrator | skipping: Conditional result was False 2026-04-03 04:25:13.011074 | 2026-04-03 04:25:13.011232 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-03 04:25:13.469720 | orchestrator -> localhost | changed 2026-04-03 04:25:13.493545 | 2026-04-03 04:25:13.493692 | TASK [add-build-sshkey : Add back temp key] 2026-04-03 04:25:13.885258 | orchestrator -> localhost | Identity added: /var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/b8f72da348914bada7bcedc63b69f7e9_id_rsa (zuul-build-sshkey) 2026-04-03 04:25:13.885517 | orchestrator -> localhost | ok: Runtime: 0:00:00.010441 2026-04-03 04:25:13.892942 | 2026-04-03 04:25:13.893072 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-03 04:25:14.348689 | orchestrator | ok 2026-04-03 04:25:14.358548 | 2026-04-03 04:25:14.358692 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-03 04:25:14.393332 | orchestrator | skipping: Conditional result was False 2026-04-03 04:25:14.451602 | 2026-04-03 04:25:14.451738 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-04-03 04:25:14.886994 | orchestrator | ok 2026-04-03 04:25:14.902935 | 2026-04-03 04:25:14.903126 | TASK [validate-host : Define zuul_info_dir fact] 2026-04-03 04:25:14.950347 | orchestrator | ok 2026-04-03 04:25:14.961561 | 2026-04-03 04:25:14.961712 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-04-03 04:25:15.272137 | orchestrator -> localhost | ok 2026-04-03 04:25:15.281231 | 2026-04-03 04:25:15.281370 | TASK [validate-host : Collect information about the host] 2026-04-03 04:25:16.814419 | orchestrator | ok 2026-04-03 04:25:16.831547 | 2026-04-03 04:25:16.831674 | TASK [validate-host : Sanitize hostname] 2026-04-03 04:25:16.899520 | orchestrator | ok 2026-04-03 04:25:16.911067 | 2026-04-03 04:25:16.911227 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-04-03 04:25:17.494345 | orchestrator -> localhost | changed 2026-04-03 04:25:17.501291 | 2026-04-03 04:25:17.501425 | TASK [validate-host : Collect information about zuul worker] 2026-04-03 04:25:17.968055 | orchestrator | ok 2026-04-03 04:25:17.973518 | 2026-04-03 04:25:17.973636 | TASK [validate-host : Write out all zuul information for each host] 2026-04-03 04:25:18.596637 | orchestrator -> localhost | changed 2026-04-03 04:25:18.618237 | 2026-04-03 04:25:18.618385 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-04-03 04:25:18.907010 | orchestrator | ok 2026-04-03 04:25:18.916924 | 2026-04-03 04:25:18.917106 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-04-03 04:25:36.756641 | orchestrator | changed: 2026-04-03 04:25:36.756959 | orchestrator | .d..t...... src/ 2026-04-03 04:25:36.757031 | orchestrator | .d..t...... src/github.com/ 2026-04-03 04:25:36.757133 | orchestrator | .d..t...... src/github.com/osism/ 2026-04-03 04:25:36.757182 | orchestrator | .d..t...... src/github.com/osism/ansible-collection-commons/ 2026-04-03 04:25:36.757220 | orchestrator | RedHat.yml 2026-04-03 04:25:36.790895 | orchestrator | .L..t...... src/github.com/osism/ansible-collection-commons/roles/repository/tasks/CentOS.yml -> RedHat.yml 2026-04-03 04:25:36.790918 | orchestrator | RedHat.yml 2026-04-03 04:25:36.790985 | orchestrator | = 1.53.0"... 2026-04-03 04:25:49.009184 | orchestrator | - Finding hashicorp/local versions matching ">= 2.2.0"... 2026-04-03 04:25:49.448531 | orchestrator | - Installing hashicorp/null v3.2.4... 2026-04-03 04:25:50.107700 | orchestrator | - Installed hashicorp/null v3.2.4 (signed, key ID 0C0AF313E5FD9F80) 2026-04-03 04:25:50.711840 | orchestrator | - Installing terraform-provider-openstack/openstack v3.4.0... 2026-04-03 04:25:51.693414 | orchestrator | - Installed terraform-provider-openstack/openstack v3.4.0 (signed, key ID 4F80527A391BEFD2) 2026-04-03 04:25:52.777916 | orchestrator | - Installing hashicorp/local v2.8.0... 2026-04-03 04:25:53.536579 | orchestrator | - Installed hashicorp/local v2.8.0 (signed, key ID 0C0AF313E5FD9F80) 2026-04-03 04:25:53.536679 | orchestrator | 2026-04-03 04:25:53.536695 | orchestrator | Providers are signed by their developers. 2026-04-03 04:25:53.536709 | orchestrator | If you'd like to know more about provider signing, you can read about it here: 2026-04-03 04:25:53.536720 | orchestrator | https://opentofu.org/docs/cli/plugins/signing/ 2026-04-03 04:25:53.536735 | orchestrator | 2026-04-03 04:25:53.536746 | orchestrator | OpenTofu has created a lock file .terraform.lock.hcl to record the provider 2026-04-03 04:25:53.536756 | orchestrator | selections it made above. Include this file in your version control repository 2026-04-03 04:25:53.536786 | orchestrator | so that OpenTofu can guarantee to make the same selections by default when 2026-04-03 04:25:53.536797 | orchestrator | you run "tofu init" in the future. 2026-04-03 04:25:53.536887 | orchestrator | 2026-04-03 04:25:53.536919 | orchestrator | OpenTofu has been successfully initialized! 2026-04-03 04:25:53.536929 | orchestrator | 2026-04-03 04:25:53.536940 | orchestrator | You may now begin working with OpenTofu. Try running "tofu plan" to see 2026-04-03 04:25:53.536950 | orchestrator | any changes that are required for your infrastructure. All OpenTofu commands 2026-04-03 04:25:53.536960 | orchestrator | should now work. 2026-04-03 04:25:53.536970 | orchestrator | 2026-04-03 04:25:53.536980 | orchestrator | If you ever set or change modules or backend configuration for OpenTofu, 2026-04-03 04:25:53.536990 | orchestrator | rerun this command to reinitialize your working directory. If you forget, other 2026-04-03 04:25:53.537001 | orchestrator | commands will detect it and remind you to do so if necessary. 2026-04-03 04:25:53.724394 | orchestrator | Created and switched to workspace "ci"! 2026-04-03 04:25:53.724448 | orchestrator | 2026-04-03 04:25:53.724454 | orchestrator | You're now on a new, empty workspace. Workspaces isolate their state, 2026-04-03 04:25:53.724460 | orchestrator | so if you run "tofu plan" OpenTofu will not see any existing state 2026-04-03 04:25:53.724480 | orchestrator | for this configuration. 2026-04-03 04:25:53.879147 | orchestrator | ci.auto.tfvars 2026-04-03 04:25:53.883066 | orchestrator | default_custom.tf 2026-04-03 04:25:54.960021 | orchestrator | data.openstack_networking_network_v2.public: Reading... 2026-04-03 04:25:55.519299 | orchestrator | data.openstack_networking_network_v2.public: Read complete after 1s [id=e6be7364-bfd8-4de7-8120-8f41c69a139a] 2026-04-03 04:25:55.755278 | orchestrator | 2026-04-03 04:25:55.755366 | orchestrator | OpenTofu used the selected providers to generate the following execution 2026-04-03 04:25:55.755379 | orchestrator | plan. Resource actions are indicated with the following symbols: 2026-04-03 04:25:55.755388 | orchestrator | + create 2026-04-03 04:25:55.755407 | orchestrator | <= read (data resources) 2026-04-03 04:25:55.755416 | orchestrator | 2026-04-03 04:25:55.755424 | orchestrator | OpenTofu will perform the following actions: 2026-04-03 04:25:55.755432 | orchestrator | 2026-04-03 04:25:55.755441 | orchestrator | # data.openstack_images_image_v2.image will be read during apply 2026-04-03 04:25:55.755448 | orchestrator | # (config refers to values not yet known) 2026-04-03 04:25:55.755456 | orchestrator | <= data "openstack_images_image_v2" "image" { 2026-04-03 04:25:55.755464 | orchestrator | + checksum = (known after apply) 2026-04-03 04:25:55.755472 | orchestrator | + created_at = (known after apply) 2026-04-03 04:25:55.755479 | orchestrator | + file = (known after apply) 2026-04-03 04:25:55.755503 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.755545 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.755553 | orchestrator | + min_disk_gb = (known after apply) 2026-04-03 04:25:55.755561 | orchestrator | + min_ram_mb = (known after apply) 2026-04-03 04:25:55.755569 | orchestrator | + most_recent = true 2026-04-03 04:25:55.755576 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.755584 | orchestrator | + protected = (known after apply) 2026-04-03 04:25:55.755591 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.755601 | orchestrator | + schema = (known after apply) 2026-04-03 04:25:55.755609 | orchestrator | + size_bytes = (known after apply) 2026-04-03 04:25:55.755616 | orchestrator | + tags = (known after apply) 2026-04-03 04:25:55.755623 | orchestrator | + updated_at = (known after apply) 2026-04-03 04:25:55.755631 | orchestrator | } 2026-04-03 04:25:55.755638 | orchestrator | 2026-04-03 04:25:55.755645 | orchestrator | # data.openstack_images_image_v2.image_node will be read during apply 2026-04-03 04:25:55.755653 | orchestrator | # (config refers to values not yet known) 2026-04-03 04:25:55.755660 | orchestrator | <= data "openstack_images_image_v2" "image_node" { 2026-04-03 04:25:55.755668 | orchestrator | + checksum = (known after apply) 2026-04-03 04:25:55.755675 | orchestrator | + created_at = (known after apply) 2026-04-03 04:25:55.755682 | orchestrator | + file = (known after apply) 2026-04-03 04:25:55.755689 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.755697 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.755704 | orchestrator | + min_disk_gb = (known after apply) 2026-04-03 04:25:55.755711 | orchestrator | + min_ram_mb = (known after apply) 2026-04-03 04:25:55.755718 | orchestrator | + most_recent = true 2026-04-03 04:25:55.755726 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.755733 | orchestrator | + protected = (known after apply) 2026-04-03 04:25:55.755740 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.755747 | orchestrator | + schema = (known after apply) 2026-04-03 04:25:55.755755 | orchestrator | + size_bytes = (known after apply) 2026-04-03 04:25:55.755762 | orchestrator | + tags = (known after apply) 2026-04-03 04:25:55.755769 | orchestrator | + updated_at = (known after apply) 2026-04-03 04:25:55.755776 | orchestrator | } 2026-04-03 04:25:55.755788 | orchestrator | 2026-04-03 04:25:55.755796 | orchestrator | # local_file.MANAGER_ADDRESS will be created 2026-04-03 04:25:55.755803 | orchestrator | + resource "local_file" "MANAGER_ADDRESS" { 2026-04-03 04:25:55.755811 | orchestrator | + content = (known after apply) 2026-04-03 04:25:55.755819 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-03 04:25:55.755826 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-03 04:25:55.755834 | orchestrator | + content_md5 = (known after apply) 2026-04-03 04:25:55.755841 | orchestrator | + content_sha1 = (known after apply) 2026-04-03 04:25:55.755848 | orchestrator | + content_sha256 = (known after apply) 2026-04-03 04:25:55.755855 | orchestrator | + content_sha512 = (known after apply) 2026-04-03 04:25:55.755863 | orchestrator | + directory_permission = "0777" 2026-04-03 04:25:55.755870 | orchestrator | + file_permission = "0644" 2026-04-03 04:25:55.755877 | orchestrator | + filename = ".MANAGER_ADDRESS.ci" 2026-04-03 04:25:55.755884 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.755892 | orchestrator | } 2026-04-03 04:25:55.755899 | orchestrator | 2026-04-03 04:25:55.755906 | orchestrator | # local_file.id_rsa_pub will be created 2026-04-03 04:25:55.755914 | orchestrator | + resource "local_file" "id_rsa_pub" { 2026-04-03 04:25:55.755921 | orchestrator | + content = (known after apply) 2026-04-03 04:25:55.755929 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-03 04:25:55.755936 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-03 04:25:55.755943 | orchestrator | + content_md5 = (known after apply) 2026-04-03 04:25:55.755950 | orchestrator | + content_sha1 = (known after apply) 2026-04-03 04:25:55.755958 | orchestrator | + content_sha256 = (known after apply) 2026-04-03 04:25:55.755965 | orchestrator | + content_sha512 = (known after apply) 2026-04-03 04:25:55.755972 | orchestrator | + directory_permission = "0777" 2026-04-03 04:25:55.755980 | orchestrator | + file_permission = "0644" 2026-04-03 04:25:55.755993 | orchestrator | + filename = ".id_rsa.ci.pub" 2026-04-03 04:25:55.756000 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756008 | orchestrator | } 2026-04-03 04:25:55.756015 | orchestrator | 2026-04-03 04:25:55.756031 | orchestrator | # local_file.inventory will be created 2026-04-03 04:25:55.756038 | orchestrator | + resource "local_file" "inventory" { 2026-04-03 04:25:55.756046 | orchestrator | + content = (known after apply) 2026-04-03 04:25:55.756053 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-03 04:25:55.756060 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-03 04:25:55.756068 | orchestrator | + content_md5 = (known after apply) 2026-04-03 04:25:55.756075 | orchestrator | + content_sha1 = (known after apply) 2026-04-03 04:25:55.756083 | orchestrator | + content_sha256 = (known after apply) 2026-04-03 04:25:55.756090 | orchestrator | + content_sha512 = (known after apply) 2026-04-03 04:25:55.756097 | orchestrator | + directory_permission = "0777" 2026-04-03 04:25:55.756104 | orchestrator | + file_permission = "0644" 2026-04-03 04:25:55.756112 | orchestrator | + filename = "inventory.ci" 2026-04-03 04:25:55.756119 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756126 | orchestrator | } 2026-04-03 04:25:55.756134 | orchestrator | 2026-04-03 04:25:55.756141 | orchestrator | # local_sensitive_file.id_rsa will be created 2026-04-03 04:25:55.756149 | orchestrator | + resource "local_sensitive_file" "id_rsa" { 2026-04-03 04:25:55.756156 | orchestrator | + content = (sensitive value) 2026-04-03 04:25:55.756163 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-03 04:25:55.756170 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-03 04:25:55.756177 | orchestrator | + content_md5 = (known after apply) 2026-04-03 04:25:55.756185 | orchestrator | + content_sha1 = (known after apply) 2026-04-03 04:25:55.756192 | orchestrator | + content_sha256 = (known after apply) 2026-04-03 04:25:55.756199 | orchestrator | + content_sha512 = (known after apply) 2026-04-03 04:25:55.756206 | orchestrator | + directory_permission = "0700" 2026-04-03 04:25:55.756213 | orchestrator | + file_permission = "0600" 2026-04-03 04:25:55.756221 | orchestrator | + filename = ".id_rsa.ci" 2026-04-03 04:25:55.756228 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756235 | orchestrator | } 2026-04-03 04:25:55.756242 | orchestrator | 2026-04-03 04:25:55.756249 | orchestrator | # null_resource.node_semaphore will be created 2026-04-03 04:25:55.756257 | orchestrator | + resource "null_resource" "node_semaphore" { 2026-04-03 04:25:55.756264 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756271 | orchestrator | } 2026-04-03 04:25:55.756278 | orchestrator | 2026-04-03 04:25:55.756286 | orchestrator | # openstack_blockstorage_volume_v3.manager_base_volume[0] will be created 2026-04-03 04:25:55.756293 | orchestrator | + resource "openstack_blockstorage_volume_v3" "manager_base_volume" { 2026-04-03 04:25:55.756300 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756308 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.756315 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756322 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.756329 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.756336 | orchestrator | + name = "testbed-volume-manager-base" 2026-04-03 04:25:55.756343 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.756350 | orchestrator | + size = 80 2026-04-03 04:25:55.756358 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.756365 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.756372 | orchestrator | } 2026-04-03 04:25:55.756379 | orchestrator | 2026-04-03 04:25:55.756386 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[0] will be created 2026-04-03 04:25:55.756396 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.756407 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756420 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.756432 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756460 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.756472 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.756574 | orchestrator | + name = "testbed-volume-0-node-base" 2026-04-03 04:25:55.756592 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.756604 | orchestrator | + size = 80 2026-04-03 04:25:55.756616 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.756626 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.756634 | orchestrator | } 2026-04-03 04:25:55.756641 | orchestrator | 2026-04-03 04:25:55.756649 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[1] will be created 2026-04-03 04:25:55.756656 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.756664 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756678 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.756686 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756693 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.756700 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.756708 | orchestrator | + name = "testbed-volume-1-node-base" 2026-04-03 04:25:55.756715 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.756722 | orchestrator | + size = 80 2026-04-03 04:25:55.756730 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.756737 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.756745 | orchestrator | } 2026-04-03 04:25:55.756752 | orchestrator | 2026-04-03 04:25:55.756759 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[2] will be created 2026-04-03 04:25:55.756767 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.756774 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756781 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.756789 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756796 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.756803 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.756811 | orchestrator | + name = "testbed-volume-2-node-base" 2026-04-03 04:25:55.756818 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.756825 | orchestrator | + size = 80 2026-04-03 04:25:55.756832 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.756840 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.756847 | orchestrator | } 2026-04-03 04:25:55.756854 | orchestrator | 2026-04-03 04:25:55.756862 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[3] will be created 2026-04-03 04:25:55.756869 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.756876 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756884 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.756891 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.756898 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.756905 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.756919 | orchestrator | + name = "testbed-volume-3-node-base" 2026-04-03 04:25:55.756926 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.756934 | orchestrator | + size = 80 2026-04-03 04:25:55.756941 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.756949 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.756956 | orchestrator | } 2026-04-03 04:25:55.756963 | orchestrator | 2026-04-03 04:25:55.756970 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[4] will be created 2026-04-03 04:25:55.756978 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.756985 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.756992 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757000 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757014 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.757021 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757028 | orchestrator | + name = "testbed-volume-4-node-base" 2026-04-03 04:25:55.757036 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757043 | orchestrator | + size = 80 2026-04-03 04:25:55.757050 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757057 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757065 | orchestrator | } 2026-04-03 04:25:55.757072 | orchestrator | 2026-04-03 04:25:55.757079 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[5] will be created 2026-04-03 04:25:55.757087 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-03 04:25:55.757094 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757101 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757109 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757116 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.757123 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757131 | orchestrator | + name = "testbed-volume-5-node-base" 2026-04-03 04:25:55.757138 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757145 | orchestrator | + size = 80 2026-04-03 04:25:55.757153 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757160 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757167 | orchestrator | } 2026-04-03 04:25:55.757175 | orchestrator | 2026-04-03 04:25:55.757182 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[0] will be created 2026-04-03 04:25:55.757190 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757197 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757205 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757212 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757220 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757227 | orchestrator | + name = "testbed-volume-0-node-3" 2026-04-03 04:25:55.757235 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757242 | orchestrator | + size = 20 2026-04-03 04:25:55.757249 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757256 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757264 | orchestrator | } 2026-04-03 04:25:55.757330 | orchestrator | 2026-04-03 04:25:55.757337 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[1] will be created 2026-04-03 04:25:55.757345 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757352 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757360 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757367 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757374 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757381 | orchestrator | + name = "testbed-volume-1-node-4" 2026-04-03 04:25:55.757389 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757396 | orchestrator | + size = 20 2026-04-03 04:25:55.757403 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757411 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757418 | orchestrator | } 2026-04-03 04:25:55.757425 | orchestrator | 2026-04-03 04:25:55.757433 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[2] will be created 2026-04-03 04:25:55.757440 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757452 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757460 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757467 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757474 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757482 | orchestrator | + name = "testbed-volume-2-node-5" 2026-04-03 04:25:55.757526 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757540 | orchestrator | + size = 20 2026-04-03 04:25:55.757547 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757554 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757562 | orchestrator | } 2026-04-03 04:25:55.757569 | orchestrator | 2026-04-03 04:25:55.757576 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[3] will be created 2026-04-03 04:25:55.757583 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757591 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757598 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757605 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757613 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757620 | orchestrator | + name = "testbed-volume-3-node-3" 2026-04-03 04:25:55.757627 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757634 | orchestrator | + size = 20 2026-04-03 04:25:55.757642 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757649 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757656 | orchestrator | } 2026-04-03 04:25:55.757663 | orchestrator | 2026-04-03 04:25:55.757671 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[4] will be created 2026-04-03 04:25:55.757678 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757685 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757692 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757700 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757707 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757714 | orchestrator | + name = "testbed-volume-4-node-4" 2026-04-03 04:25:55.757721 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757733 | orchestrator | + size = 20 2026-04-03 04:25:55.757741 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757748 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757756 | orchestrator | } 2026-04-03 04:25:55.757763 | orchestrator | 2026-04-03 04:25:55.757770 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[5] will be created 2026-04-03 04:25:55.757778 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757785 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757792 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757800 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757807 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757814 | orchestrator | + name = "testbed-volume-5-node-5" 2026-04-03 04:25:55.757821 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757829 | orchestrator | + size = 20 2026-04-03 04:25:55.757836 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757843 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757851 | orchestrator | } 2026-04-03 04:25:55.757858 | orchestrator | 2026-04-03 04:25:55.757865 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[6] will be created 2026-04-03 04:25:55.757873 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757880 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757887 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757895 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.757902 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.757909 | orchestrator | + name = "testbed-volume-6-node-3" 2026-04-03 04:25:55.757916 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.757924 | orchestrator | + size = 20 2026-04-03 04:25:55.757931 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.757938 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.757946 | orchestrator | } 2026-04-03 04:25:55.757953 | orchestrator | 2026-04-03 04:25:55.757960 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[7] will be created 2026-04-03 04:25:55.757968 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.757980 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.757988 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.757995 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.758002 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.758010 | orchestrator | + name = "testbed-volume-7-node-4" 2026-04-03 04:25:55.758046 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.758053 | orchestrator | + size = 20 2026-04-03 04:25:55.758061 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.758068 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.758076 | orchestrator | } 2026-04-03 04:25:55.758083 | orchestrator | 2026-04-03 04:25:55.758090 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[8] will be created 2026-04-03 04:25:55.758098 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-03 04:25:55.758105 | orchestrator | + attachment = (known after apply) 2026-04-03 04:25:55.758111 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.758118 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.758125 | orchestrator | + metadata = (known after apply) 2026-04-03 04:25:55.758132 | orchestrator | + name = "testbed-volume-8-node-5" 2026-04-03 04:25:55.758138 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.758145 | orchestrator | + size = 20 2026-04-03 04:25:55.758152 | orchestrator | + volume_retype_policy = "never" 2026-04-03 04:25:55.758159 | orchestrator | + volume_type = "ssd" 2026-04-03 04:25:55.758165 | orchestrator | } 2026-04-03 04:25:55.758172 | orchestrator | 2026-04-03 04:25:55.758179 | orchestrator | # openstack_compute_instance_v2.manager_server will be created 2026-04-03 04:25:55.758186 | orchestrator | + resource "openstack_compute_instance_v2" "manager_server" { 2026-04-03 04:25:55.758200 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.758207 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.758213 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.758220 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.758227 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.758246 | orchestrator | + config_drive = true 2026-04-03 04:25:55.758265 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.758272 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.758279 | orchestrator | + flavor_name = "OSISM-4V-16" 2026-04-03 04:25:55.758286 | orchestrator | + force_delete = false 2026-04-03 04:25:55.758293 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.758299 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.758306 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.758313 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.758320 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.758326 | orchestrator | + name = "testbed-manager" 2026-04-03 04:25:55.758333 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.758339 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.758346 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.758353 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.758359 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.758366 | orchestrator | + user_data = (sensitive value) 2026-04-03 04:25:55.758373 | orchestrator | 2026-04-03 04:25:55.758380 | orchestrator | + block_device { 2026-04-03 04:25:55.758387 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.758393 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.758405 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.758412 | orchestrator | + multiattach = false 2026-04-03 04:25:55.758418 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.758425 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.758437 | orchestrator | } 2026-04-03 04:25:55.758444 | orchestrator | 2026-04-03 04:25:55.758451 | orchestrator | + network { 2026-04-03 04:25:55.758458 | orchestrator | + access_network = false 2026-04-03 04:25:55.758465 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.758472 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.758478 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.758499 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.758506 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.758513 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.758519 | orchestrator | } 2026-04-03 04:25:55.758598 | orchestrator | } 2026-04-03 04:25:55.758607 | orchestrator | 2026-04-03 04:25:55.758614 | orchestrator | # openstack_compute_instance_v2.node_server[0] will be created 2026-04-03 04:25:55.758620 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.758627 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.758634 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.758640 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.758647 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.758654 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.758660 | orchestrator | + config_drive = true 2026-04-03 04:25:55.758667 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.758674 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.758680 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.758687 | orchestrator | + force_delete = false 2026-04-03 04:25:55.758693 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.758700 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.758707 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.758713 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.758720 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.758727 | orchestrator | + name = "testbed-node-0" 2026-04-03 04:25:55.758733 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.758740 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.758747 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.758753 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.758760 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.758767 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.758773 | orchestrator | 2026-04-03 04:25:55.758780 | orchestrator | + block_device { 2026-04-03 04:25:55.758787 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.758793 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.758800 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.758807 | orchestrator | + multiattach = false 2026-04-03 04:25:55.758813 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.758820 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.758827 | orchestrator | } 2026-04-03 04:25:55.758833 | orchestrator | 2026-04-03 04:25:55.758843 | orchestrator | + network { 2026-04-03 04:25:55.758854 | orchestrator | + access_network = false 2026-04-03 04:25:55.758869 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.758887 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.758898 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.758909 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.758920 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.758930 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.758940 | orchestrator | } 2026-04-03 04:25:55.758996 | orchestrator | } 2026-04-03 04:25:55.759069 | orchestrator | 2026-04-03 04:25:55.759077 | orchestrator | # openstack_compute_instance_v2.node_server[1] will be created 2026-04-03 04:25:55.759084 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.759091 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.759106 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.759113 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.759120 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.759126 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.759133 | orchestrator | + config_drive = true 2026-04-03 04:25:55.759140 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.759146 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.759153 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.759160 | orchestrator | + force_delete = false 2026-04-03 04:25:55.759166 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.759198 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.759205 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.759212 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.759219 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.759243 | orchestrator | + name = "testbed-node-1" 2026-04-03 04:25:55.759257 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.759264 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.759271 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.759277 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.759284 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.759291 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.759298 | orchestrator | 2026-04-03 04:25:55.759305 | orchestrator | + block_device { 2026-04-03 04:25:55.759312 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.759318 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.759325 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.759332 | orchestrator | + multiattach = false 2026-04-03 04:25:55.759338 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.759345 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.759352 | orchestrator | } 2026-04-03 04:25:55.759358 | orchestrator | 2026-04-03 04:25:55.759365 | orchestrator | + network { 2026-04-03 04:25:55.759372 | orchestrator | + access_network = false 2026-04-03 04:25:55.759379 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.759385 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.759392 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.759399 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.759405 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.759412 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.759419 | orchestrator | } 2026-04-03 04:25:55.759425 | orchestrator | } 2026-04-03 04:25:55.759432 | orchestrator | 2026-04-03 04:25:55.759439 | orchestrator | # openstack_compute_instance_v2.node_server[2] will be created 2026-04-03 04:25:55.759446 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.759453 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.759459 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.759467 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.759474 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.759538 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.759556 | orchestrator | + config_drive = true 2026-04-03 04:25:55.759567 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.759578 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.759589 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.759599 | orchestrator | + force_delete = false 2026-04-03 04:25:55.759609 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.759619 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.759630 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.759649 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.759660 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.759671 | orchestrator | + name = "testbed-node-2" 2026-04-03 04:25:55.759683 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.759694 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.759705 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.759717 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.759725 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.759760 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.759770 | orchestrator | 2026-04-03 04:25:55.759777 | orchestrator | + block_device { 2026-04-03 04:25:55.759783 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.759790 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.759797 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.759803 | orchestrator | + multiattach = false 2026-04-03 04:25:55.759810 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.759817 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.759824 | orchestrator | } 2026-04-03 04:25:55.759831 | orchestrator | 2026-04-03 04:25:55.759837 | orchestrator | + network { 2026-04-03 04:25:55.759863 | orchestrator | + access_network = false 2026-04-03 04:25:55.759870 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.759877 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.759883 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.759890 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.759897 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.759904 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.759911 | orchestrator | } 2026-04-03 04:25:55.759918 | orchestrator | } 2026-04-03 04:25:55.759924 | orchestrator | 2026-04-03 04:25:55.759931 | orchestrator | # openstack_compute_instance_v2.node_server[3] will be created 2026-04-03 04:25:55.759938 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.759945 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.759952 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.759958 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.759965 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.759972 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.759979 | orchestrator | + config_drive = true 2026-04-03 04:25:55.759985 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.759992 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.759999 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.760006 | orchestrator | + force_delete = false 2026-04-03 04:25:55.760013 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.760019 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.760026 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.760033 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.760063 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.760070 | orchestrator | + name = "testbed-node-3" 2026-04-03 04:25:55.760077 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.760084 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.760090 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.760096 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.760102 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.760108 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.760114 | orchestrator | 2026-04-03 04:25:55.760120 | orchestrator | + block_device { 2026-04-03 04:25:55.760140 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.760154 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.760165 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.760190 | orchestrator | + multiattach = false 2026-04-03 04:25:55.760200 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.760210 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760220 | orchestrator | } 2026-04-03 04:25:55.760229 | orchestrator | 2026-04-03 04:25:55.760239 | orchestrator | + network { 2026-04-03 04:25:55.760249 | orchestrator | + access_network = false 2026-04-03 04:25:55.760259 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.760267 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.760273 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.760279 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.760285 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.760290 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760296 | orchestrator | } 2026-04-03 04:25:55.760302 | orchestrator | } 2026-04-03 04:25:55.760308 | orchestrator | 2026-04-03 04:25:55.760314 | orchestrator | # openstack_compute_instance_v2.node_server[4] will be created 2026-04-03 04:25:55.760320 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.760326 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.760331 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.760337 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.760343 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.760349 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.760355 | orchestrator | + config_drive = true 2026-04-03 04:25:55.760360 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.760366 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.760372 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.760378 | orchestrator | + force_delete = false 2026-04-03 04:25:55.760384 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.760390 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.760395 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.760401 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.760407 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.760413 | orchestrator | + name = "testbed-node-4" 2026-04-03 04:25:55.760418 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.760424 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.760430 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.760437 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.760447 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.760461 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.760471 | orchestrator | 2026-04-03 04:25:55.760480 | orchestrator | + block_device { 2026-04-03 04:25:55.760505 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.760514 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.760523 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.760532 | orchestrator | + multiattach = false 2026-04-03 04:25:55.760542 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.760552 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760562 | orchestrator | } 2026-04-03 04:25:55.760571 | orchestrator | 2026-04-03 04:25:55.760580 | orchestrator | + network { 2026-04-03 04:25:55.760590 | orchestrator | + access_network = false 2026-04-03 04:25:55.760597 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.760602 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.760608 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.760614 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.760620 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.760626 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760632 | orchestrator | } 2026-04-03 04:25:55.760638 | orchestrator | } 2026-04-03 04:25:55.760650 | orchestrator | 2026-04-03 04:25:55.760656 | orchestrator | # openstack_compute_instance_v2.node_server[5] will be created 2026-04-03 04:25:55.760662 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-03 04:25:55.760668 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-03 04:25:55.760674 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-03 04:25:55.760680 | orchestrator | + all_metadata = (known after apply) 2026-04-03 04:25:55.760685 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.760691 | orchestrator | + availability_zone = "nova" 2026-04-03 04:25:55.760697 | orchestrator | + config_drive = true 2026-04-03 04:25:55.760703 | orchestrator | + created = (known after apply) 2026-04-03 04:25:55.760709 | orchestrator | + flavor_id = (known after apply) 2026-04-03 04:25:55.760715 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-03 04:25:55.760721 | orchestrator | + force_delete = false 2026-04-03 04:25:55.760731 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-03 04:25:55.760737 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.760743 | orchestrator | + image_id = (known after apply) 2026-04-03 04:25:55.760749 | orchestrator | + image_name = (known after apply) 2026-04-03 04:25:55.760755 | orchestrator | + key_pair = "testbed" 2026-04-03 04:25:55.760761 | orchestrator | + name = "testbed-node-5" 2026-04-03 04:25:55.760766 | orchestrator | + power_state = "active" 2026-04-03 04:25:55.760772 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.760778 | orchestrator | + security_groups = (known after apply) 2026-04-03 04:25:55.760784 | orchestrator | + stop_before_destroy = false 2026-04-03 04:25:55.760790 | orchestrator | + updated = (known after apply) 2026-04-03 04:25:55.760796 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-03 04:25:55.760801 | orchestrator | 2026-04-03 04:25:55.760807 | orchestrator | + block_device { 2026-04-03 04:25:55.760813 | orchestrator | + boot_index = 0 2026-04-03 04:25:55.760819 | orchestrator | + delete_on_termination = false 2026-04-03 04:25:55.760825 | orchestrator | + destination_type = "volume" 2026-04-03 04:25:55.760831 | orchestrator | + multiattach = false 2026-04-03 04:25:55.760837 | orchestrator | + source_type = "volume" 2026-04-03 04:25:55.760842 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760848 | orchestrator | } 2026-04-03 04:25:55.760854 | orchestrator | 2026-04-03 04:25:55.760860 | orchestrator | + network { 2026-04-03 04:25:55.760866 | orchestrator | + access_network = false 2026-04-03 04:25:55.760872 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-03 04:25:55.760878 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-03 04:25:55.760884 | orchestrator | + mac = (known after apply) 2026-04-03 04:25:55.760890 | orchestrator | + name = (known after apply) 2026-04-03 04:25:55.760903 | orchestrator | + port = (known after apply) 2026-04-03 04:25:55.760910 | orchestrator | + uuid = (known after apply) 2026-04-03 04:25:55.760916 | orchestrator | } 2026-04-03 04:25:55.760922 | orchestrator | } 2026-04-03 04:25:55.760928 | orchestrator | 2026-04-03 04:25:55.760934 | orchestrator | # openstack_compute_keypair_v2.key will be created 2026-04-03 04:25:55.760940 | orchestrator | + resource "openstack_compute_keypair_v2" "key" { 2026-04-03 04:25:55.760946 | orchestrator | + fingerprint = (known after apply) 2026-04-03 04:25:55.760952 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.760958 | orchestrator | + name = "testbed" 2026-04-03 04:25:55.760963 | orchestrator | + private_key = (sensitive value) 2026-04-03 04:25:55.760969 | orchestrator | + public_key = (known after apply) 2026-04-03 04:25:55.760975 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.760981 | orchestrator | + user_id = (known after apply) 2026-04-03 04:25:55.760987 | orchestrator | } 2026-04-03 04:25:55.760993 | orchestrator | 2026-04-03 04:25:55.760999 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[0] will be created 2026-04-03 04:25:55.761005 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761015 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761021 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761027 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761032 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761038 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761044 | orchestrator | } 2026-04-03 04:25:55.761050 | orchestrator | 2026-04-03 04:25:55.761056 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[1] will be created 2026-04-03 04:25:55.761062 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761068 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761073 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761079 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761085 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761091 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761097 | orchestrator | } 2026-04-03 04:25:55.761102 | orchestrator | 2026-04-03 04:25:55.761108 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[2] will be created 2026-04-03 04:25:55.761114 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761120 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761126 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761132 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761138 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761143 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761149 | orchestrator | } 2026-04-03 04:25:55.761155 | orchestrator | 2026-04-03 04:25:55.761161 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[3] will be created 2026-04-03 04:25:55.761167 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761173 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761178 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761184 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761190 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761196 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761202 | orchestrator | } 2026-04-03 04:25:55.761208 | orchestrator | 2026-04-03 04:25:55.761214 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[4] will be created 2026-04-03 04:25:55.761219 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761225 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761231 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761237 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761246 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761252 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761258 | orchestrator | } 2026-04-03 04:25:55.761264 | orchestrator | 2026-04-03 04:25:55.761270 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[5] will be created 2026-04-03 04:25:55.761275 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761281 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761287 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761293 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761299 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761305 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761310 | orchestrator | } 2026-04-03 04:25:55.761316 | orchestrator | 2026-04-03 04:25:55.761322 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[6] will be created 2026-04-03 04:25:55.761328 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761334 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761340 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761345 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761351 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761362 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761368 | orchestrator | } 2026-04-03 04:25:55.761373 | orchestrator | 2026-04-03 04:25:55.761379 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[7] will be created 2026-04-03 04:25:55.761385 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761391 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761397 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761403 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761409 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761414 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761420 | orchestrator | } 2026-04-03 04:25:55.761426 | orchestrator | 2026-04-03 04:25:55.761432 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[8] will be created 2026-04-03 04:25:55.761438 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-03 04:25:55.761444 | orchestrator | + device = (known after apply) 2026-04-03 04:25:55.761450 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761455 | orchestrator | + instance_id = (known after apply) 2026-04-03 04:25:55.761461 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761467 | orchestrator | + volume_id = (known after apply) 2026-04-03 04:25:55.761473 | orchestrator | } 2026-04-03 04:25:55.761479 | orchestrator | 2026-04-03 04:25:55.761497 | orchestrator | # openstack_networking_floatingip_associate_v2.manager_floating_ip_association will be created 2026-04-03 04:25:55.761504 | orchestrator | + resource "openstack_networking_floatingip_associate_v2" "manager_floating_ip_association" { 2026-04-03 04:25:55.761510 | orchestrator | + fixed_ip = (known after apply) 2026-04-03 04:25:55.761521 | orchestrator | + floating_ip = (known after apply) 2026-04-03 04:25:55.761527 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761533 | orchestrator | + port_id = (known after apply) 2026-04-03 04:25:55.761539 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761545 | orchestrator | } 2026-04-03 04:25:55.761551 | orchestrator | 2026-04-03 04:25:55.761556 | orchestrator | # openstack_networking_floatingip_v2.manager_floating_ip will be created 2026-04-03 04:25:55.761563 | orchestrator | + resource "openstack_networking_floatingip_v2" "manager_floating_ip" { 2026-04-03 04:25:55.761569 | orchestrator | + address = (known after apply) 2026-04-03 04:25:55.761574 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.761580 | orchestrator | + dns_domain = (known after apply) 2026-04-03 04:25:55.761586 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.761592 | orchestrator | + fixed_ip = (known after apply) 2026-04-03 04:25:55.761597 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761603 | orchestrator | + pool = "public" 2026-04-03 04:25:55.761609 | orchestrator | + port_id = (known after apply) 2026-04-03 04:25:55.761615 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761621 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.761626 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.761632 | orchestrator | } 2026-04-03 04:25:55.761638 | orchestrator | 2026-04-03 04:25:55.761644 | orchestrator | # openstack_networking_network_v2.net_management will be created 2026-04-03 04:25:55.761650 | orchestrator | + resource "openstack_networking_network_v2" "net_management" { 2026-04-03 04:25:55.761655 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.761661 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.761667 | orchestrator | + availability_zone_hints = [ 2026-04-03 04:25:55.761673 | orchestrator | + "nova", 2026-04-03 04:25:55.761679 | orchestrator | ] 2026-04-03 04:25:55.761684 | orchestrator | + dns_domain = (known after apply) 2026-04-03 04:25:55.761690 | orchestrator | + external = (known after apply) 2026-04-03 04:25:55.761696 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761702 | orchestrator | + mtu = (known after apply) 2026-04-03 04:25:55.761708 | orchestrator | + name = "net-testbed-management" 2026-04-03 04:25:55.761713 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.761723 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.761729 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761735 | orchestrator | + shared = (known after apply) 2026-04-03 04:25:55.761740 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.761746 | orchestrator | + transparent_vlan = (known after apply) 2026-04-03 04:25:55.761752 | orchestrator | 2026-04-03 04:25:55.761758 | orchestrator | + segments (known after apply) 2026-04-03 04:25:55.761764 | orchestrator | } 2026-04-03 04:25:55.761769 | orchestrator | 2026-04-03 04:25:55.761775 | orchestrator | # openstack_networking_port_v2.manager_port_management will be created 2026-04-03 04:25:55.761781 | orchestrator | + resource "openstack_networking_port_v2" "manager_port_management" { 2026-04-03 04:25:55.761787 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.761793 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.761798 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.761808 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.761814 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.761819 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.761825 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.761831 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.761837 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.761843 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.761848 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.761854 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.761860 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.761866 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.761872 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.761877 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.761883 | orchestrator | 2026-04-03 04:25:55.761889 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.761895 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.761901 | orchestrator | } 2026-04-03 04:25:55.761907 | orchestrator | 2026-04-03 04:25:55.761912 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.761918 | orchestrator | 2026-04-03 04:25:55.761924 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.761930 | orchestrator | + ip_address = "192.168.16.5" 2026-04-03 04:25:55.761936 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.761942 | orchestrator | } 2026-04-03 04:25:55.761948 | orchestrator | } 2026-04-03 04:25:55.761954 | orchestrator | 2026-04-03 04:25:55.761960 | orchestrator | # openstack_networking_port_v2.node_port_management[0] will be created 2026-04-03 04:25:55.761966 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.761971 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.761977 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.761983 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.761989 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.761995 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.762001 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.762006 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.762032 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.762039 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.762045 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.762051 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.762057 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.762062 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.762068 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.762078 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.762084 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.762090 | orchestrator | 2026-04-03 04:25:55.762096 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762102 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.762108 | orchestrator | } 2026-04-03 04:25:55.762114 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762123 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.762129 | orchestrator | } 2026-04-03 04:25:55.762135 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762141 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.762147 | orchestrator | } 2026-04-03 04:25:55.762153 | orchestrator | 2026-04-03 04:25:55.762159 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.762165 | orchestrator | 2026-04-03 04:25:55.762171 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.762177 | orchestrator | + ip_address = "192.168.16.10" 2026-04-03 04:25:55.762182 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.762188 | orchestrator | } 2026-04-03 04:25:55.762194 | orchestrator | } 2026-04-03 04:25:55.762200 | orchestrator | 2026-04-03 04:25:55.762206 | orchestrator | # openstack_networking_port_v2.node_port_management[1] will be created 2026-04-03 04:25:55.762212 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.762218 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.762224 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.762230 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.762235 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.762241 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.762247 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.762253 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.762259 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.762264 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.762270 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.762276 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.762282 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.762288 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.762293 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.762299 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.762305 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.762311 | orchestrator | 2026-04-03 04:25:55.762317 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762323 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.762328 | orchestrator | } 2026-04-03 04:25:55.762334 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762340 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.762346 | orchestrator | } 2026-04-03 04:25:55.762352 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762357 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.762363 | orchestrator | } 2026-04-03 04:25:55.762369 | orchestrator | 2026-04-03 04:25:55.762375 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.762381 | orchestrator | 2026-04-03 04:25:55.762387 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.762393 | orchestrator | + ip_address = "192.168.16.11" 2026-04-03 04:25:55.762399 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.762404 | orchestrator | } 2026-04-03 04:25:55.762410 | orchestrator | } 2026-04-03 04:25:55.762416 | orchestrator | 2026-04-03 04:25:55.762422 | orchestrator | # openstack_networking_port_v2.node_port_management[2] will be created 2026-04-03 04:25:55.762428 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.762434 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.762440 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.762446 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.762451 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.762461 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.762467 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.762473 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.762479 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.762525 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.762532 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.762538 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.762544 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.762550 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.762556 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.762562 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.762568 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.762574 | orchestrator | 2026-04-03 04:25:55.762580 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762586 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.762592 | orchestrator | } 2026-04-03 04:25:55.762598 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762603 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.762609 | orchestrator | } 2026-04-03 04:25:55.762615 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762621 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.762627 | orchestrator | } 2026-04-03 04:25:55.762633 | orchestrator | 2026-04-03 04:25:55.762639 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.762645 | orchestrator | 2026-04-03 04:25:55.762650 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.762656 | orchestrator | + ip_address = "192.168.16.12" 2026-04-03 04:25:55.762662 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.762668 | orchestrator | } 2026-04-03 04:25:55.762674 | orchestrator | } 2026-04-03 04:25:55.762680 | orchestrator | 2026-04-03 04:25:55.762686 | orchestrator | # openstack_networking_port_v2.node_port_management[3] will be created 2026-04-03 04:25:55.762692 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.762698 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.762704 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.762710 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.762715 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.762721 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.762727 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.762733 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.762739 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.762745 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.762751 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.762757 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.762762 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.762768 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.762774 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.762780 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.762786 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.762792 | orchestrator | 2026-04-03 04:25:55.762802 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762808 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.762814 | orchestrator | } 2026-04-03 04:25:55.762820 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762826 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.762831 | orchestrator | } 2026-04-03 04:25:55.762837 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.762843 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.762849 | orchestrator | } 2026-04-03 04:25:55.762855 | orchestrator | 2026-04-03 04:25:55.762865 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.762871 | orchestrator | 2026-04-03 04:25:55.762877 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.762883 | orchestrator | + ip_address = "192.168.16.13" 2026-04-03 04:25:55.762889 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.762894 | orchestrator | } 2026-04-03 04:25:55.762900 | orchestrator | } 2026-04-03 04:25:55.762906 | orchestrator | 2026-04-03 04:25:55.762912 | orchestrator | # openstack_networking_port_v2.node_port_management[4] will be created 2026-04-03 04:25:55.762918 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.762924 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.762930 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.762939 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.762949 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.762959 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.762968 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.762978 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.762986 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.762996 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763004 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.763014 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.763023 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.763033 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.763043 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763052 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.763060 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763071 | orchestrator | 2026-04-03 04:25:55.763076 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763081 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.763086 | orchestrator | } 2026-04-03 04:25:55.763091 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763097 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.763102 | orchestrator | } 2026-04-03 04:25:55.763107 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763112 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.763117 | orchestrator | } 2026-04-03 04:25:55.763122 | orchestrator | 2026-04-03 04:25:55.763127 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.763132 | orchestrator | 2026-04-03 04:25:55.763138 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.763143 | orchestrator | + ip_address = "192.168.16.14" 2026-04-03 04:25:55.763148 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.763153 | orchestrator | } 2026-04-03 04:25:55.763158 | orchestrator | } 2026-04-03 04:25:55.763163 | orchestrator | 2026-04-03 04:25:55.763168 | orchestrator | # openstack_networking_port_v2.node_port_management[5] will be created 2026-04-03 04:25:55.763174 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-03 04:25:55.763179 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.763184 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-03 04:25:55.763189 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-03 04:25:55.763194 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.763199 | orchestrator | + device_id = (known after apply) 2026-04-03 04:25:55.763204 | orchestrator | + device_owner = (known after apply) 2026-04-03 04:25:55.763209 | orchestrator | + dns_assignment = (known after apply) 2026-04-03 04:25:55.763215 | orchestrator | + dns_name = (known after apply) 2026-04-03 04:25:55.763220 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763225 | orchestrator | + mac_address = (known after apply) 2026-04-03 04:25:55.763230 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.763235 | orchestrator | + port_security_enabled = (known after apply) 2026-04-03 04:25:55.763240 | orchestrator | + qos_policy_id = (known after apply) 2026-04-03 04:25:55.763250 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763255 | orchestrator | + security_group_ids = (known after apply) 2026-04-03 04:25:55.763260 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763265 | orchestrator | 2026-04-03 04:25:55.763270 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763276 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-03 04:25:55.763281 | orchestrator | } 2026-04-03 04:25:55.763286 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763291 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-03 04:25:55.763296 | orchestrator | } 2026-04-03 04:25:55.763301 | orchestrator | + allowed_address_pairs { 2026-04-03 04:25:55.763306 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-03 04:25:55.763311 | orchestrator | } 2026-04-03 04:25:55.763317 | orchestrator | 2026-04-03 04:25:55.763325 | orchestrator | + binding (known after apply) 2026-04-03 04:25:55.763330 | orchestrator | 2026-04-03 04:25:55.763336 | orchestrator | + fixed_ip { 2026-04-03 04:25:55.763341 | orchestrator | + ip_address = "192.168.16.15" 2026-04-03 04:25:55.763346 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.763351 | orchestrator | } 2026-04-03 04:25:55.763356 | orchestrator | } 2026-04-03 04:25:55.763361 | orchestrator | 2026-04-03 04:25:55.763367 | orchestrator | # openstack_networking_router_interface_v2.router_interface will be created 2026-04-03 04:25:55.763372 | orchestrator | + resource "openstack_networking_router_interface_v2" "router_interface" { 2026-04-03 04:25:55.763377 | orchestrator | + force_destroy = false 2026-04-03 04:25:55.763382 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763387 | orchestrator | + port_id = (known after apply) 2026-04-03 04:25:55.763392 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763398 | orchestrator | + router_id = (known after apply) 2026-04-03 04:25:55.763403 | orchestrator | + subnet_id = (known after apply) 2026-04-03 04:25:55.763408 | orchestrator | } 2026-04-03 04:25:55.763413 | orchestrator | 2026-04-03 04:25:55.763459 | orchestrator | # openstack_networking_router_v2.router will be created 2026-04-03 04:25:55.763464 | orchestrator | + resource "openstack_networking_router_v2" "router" { 2026-04-03 04:25:55.763469 | orchestrator | + admin_state_up = (known after apply) 2026-04-03 04:25:55.763475 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.763480 | orchestrator | + availability_zone_hints = [ 2026-04-03 04:25:55.763498 | orchestrator | + "nova", 2026-04-03 04:25:55.763503 | orchestrator | ] 2026-04-03 04:25:55.763509 | orchestrator | + distributed = (known after apply) 2026-04-03 04:25:55.763514 | orchestrator | + enable_snat = (known after apply) 2026-04-03 04:25:55.763519 | orchestrator | + external_network_id = "e6be7364-bfd8-4de7-8120-8f41c69a139a" 2026-04-03 04:25:55.763529 | orchestrator | + external_qos_policy_id = (known after apply) 2026-04-03 04:25:55.763535 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763540 | orchestrator | + name = "testbed" 2026-04-03 04:25:55.763545 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763550 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763555 | orchestrator | 2026-04-03 04:25:55.763561 | orchestrator | + external_fixed_ip (known after apply) 2026-04-03 04:25:55.763566 | orchestrator | } 2026-04-03 04:25:55.763571 | orchestrator | 2026-04-03 04:25:55.763576 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule1 will be created 2026-04-03 04:25:55.763582 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule1" { 2026-04-03 04:25:55.763588 | orchestrator | + description = "ssh" 2026-04-03 04:25:55.763593 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763598 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.763603 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763608 | orchestrator | + port_range_max = 22 2026-04-03 04:25:55.763614 | orchestrator | + port_range_min = 22 2026-04-03 04:25:55.763619 | orchestrator | + protocol = "tcp" 2026-04-03 04:25:55.763624 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763636 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.763641 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.763646 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.763651 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.763657 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763662 | orchestrator | } 2026-04-03 04:25:55.763667 | orchestrator | 2026-04-03 04:25:55.763672 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule2 will be created 2026-04-03 04:25:55.763677 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule2" { 2026-04-03 04:25:55.763682 | orchestrator | + description = "wireguard" 2026-04-03 04:25:55.763688 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763693 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.763698 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763703 | orchestrator | + port_range_max = 51820 2026-04-03 04:25:55.763708 | orchestrator | + port_range_min = 51820 2026-04-03 04:25:55.763713 | orchestrator | + protocol = "udp" 2026-04-03 04:25:55.763718 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763723 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.763728 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.763733 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.763738 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.763744 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763749 | orchestrator | } 2026-04-03 04:25:55.763754 | orchestrator | 2026-04-03 04:25:55.763759 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule3 will be created 2026-04-03 04:25:55.763764 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule3" { 2026-04-03 04:25:55.763769 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763774 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.763779 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763785 | orchestrator | + protocol = "tcp" 2026-04-03 04:25:55.763790 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763795 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.763800 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.763805 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-03 04:25:55.763810 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.763815 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763820 | orchestrator | } 2026-04-03 04:25:55.763825 | orchestrator | 2026-04-03 04:25:55.763831 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule4 will be created 2026-04-03 04:25:55.763836 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule4" { 2026-04-03 04:25:55.763841 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763846 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.763851 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763856 | orchestrator | + protocol = "udp" 2026-04-03 04:25:55.763861 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763866 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.763871 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.763876 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-03 04:25:55.763881 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.763886 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763891 | orchestrator | } 2026-04-03 04:25:55.763897 | orchestrator | 2026-04-03 04:25:55.763902 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule5 will be created 2026-04-03 04:25:55.763911 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule5" { 2026-04-03 04:25:55.763916 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763921 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.763926 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.763931 | orchestrator | + protocol = "icmp" 2026-04-03 04:25:55.763937 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.763942 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.763947 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.763952 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.763957 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.763962 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.763967 | orchestrator | } 2026-04-03 04:25:55.763972 | orchestrator | 2026-04-03 04:25:55.763977 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule1 will be created 2026-04-03 04:25:55.763985 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule1" { 2026-04-03 04:25:55.763991 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.763996 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.764001 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764006 | orchestrator | + protocol = "tcp" 2026-04-03 04:25:55.764011 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764016 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.764025 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.764030 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.764036 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.764041 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764046 | orchestrator | } 2026-04-03 04:25:55.764051 | orchestrator | 2026-04-03 04:25:55.764056 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule2 will be created 2026-04-03 04:25:55.764062 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule2" { 2026-04-03 04:25:55.764067 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.764072 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.764077 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764082 | orchestrator | + protocol = "udp" 2026-04-03 04:25:55.764088 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764093 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.764098 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.764103 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.764108 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.764113 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764118 | orchestrator | } 2026-04-03 04:25:55.764124 | orchestrator | 2026-04-03 04:25:55.764129 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule3 will be created 2026-04-03 04:25:55.764134 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule3" { 2026-04-03 04:25:55.764139 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.764147 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.764152 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764157 | orchestrator | + protocol = "icmp" 2026-04-03 04:25:55.764162 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764167 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.764173 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.764178 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.764183 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.764188 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764198 | orchestrator | } 2026-04-03 04:25:55.764203 | orchestrator | 2026-04-03 04:25:55.764208 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_rule_vrrp will be created 2026-04-03 04:25:55.764213 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_rule_vrrp" { 2026-04-03 04:25:55.764219 | orchestrator | + description = "vrrp" 2026-04-03 04:25:55.764224 | orchestrator | + direction = "ingress" 2026-04-03 04:25:55.764229 | orchestrator | + ethertype = "IPv4" 2026-04-03 04:25:55.764234 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764240 | orchestrator | + protocol = "112" 2026-04-03 04:25:55.764245 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764250 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-03 04:25:55.764255 | orchestrator | + remote_group_id = (known after apply) 2026-04-03 04:25:55.764260 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-03 04:25:55.764265 | orchestrator | + security_group_id = (known after apply) 2026-04-03 04:25:55.764270 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764275 | orchestrator | } 2026-04-03 04:25:55.764281 | orchestrator | 2026-04-03 04:25:55.764286 | orchestrator | # openstack_networking_secgroup_v2.security_group_management will be created 2026-04-03 04:25:55.764291 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_management" { 2026-04-03 04:25:55.764296 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.764302 | orchestrator | + description = "management security group" 2026-04-03 04:25:55.764307 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764312 | orchestrator | + name = "testbed-management" 2026-04-03 04:25:55.764317 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764322 | orchestrator | + stateful = (known after apply) 2026-04-03 04:25:55.764327 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764332 | orchestrator | } 2026-04-03 04:25:55.764337 | orchestrator | 2026-04-03 04:25:55.764342 | orchestrator | # openstack_networking_secgroup_v2.security_group_node will be created 2026-04-03 04:25:55.764348 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_node" { 2026-04-03 04:25:55.764353 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.764358 | orchestrator | + description = "node security group" 2026-04-03 04:25:55.764363 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764368 | orchestrator | + name = "testbed-node" 2026-04-03 04:25:55.764373 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764378 | orchestrator | + stateful = (known after apply) 2026-04-03 04:25:55.764383 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764388 | orchestrator | } 2026-04-03 04:25:55.764394 | orchestrator | 2026-04-03 04:25:55.764399 | orchestrator | # openstack_networking_subnet_v2.subnet_management will be created 2026-04-03 04:25:55.764404 | orchestrator | + resource "openstack_networking_subnet_v2" "subnet_management" { 2026-04-03 04:25:55.764409 | orchestrator | + all_tags = (known after apply) 2026-04-03 04:25:55.764414 | orchestrator | + cidr = "192.168.16.0/20" 2026-04-03 04:25:55.764419 | orchestrator | + dns_nameservers = [ 2026-04-03 04:25:55.764424 | orchestrator | + "8.8.8.8", 2026-04-03 04:25:55.764430 | orchestrator | + "9.9.9.9", 2026-04-03 04:25:55.764435 | orchestrator | ] 2026-04-03 04:25:55.764440 | orchestrator | + enable_dhcp = true 2026-04-03 04:25:55.764445 | orchestrator | + gateway_ip = (known after apply) 2026-04-03 04:25:55.764450 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764456 | orchestrator | + ip_version = 4 2026-04-03 04:25:55.764461 | orchestrator | + ipv6_address_mode = (known after apply) 2026-04-03 04:25:55.764466 | orchestrator | + ipv6_ra_mode = (known after apply) 2026-04-03 04:25:55.764474 | orchestrator | + name = "subnet-testbed-management" 2026-04-03 04:25:55.764479 | orchestrator | + network_id = (known after apply) 2026-04-03 04:25:55.764518 | orchestrator | + no_gateway = false 2026-04-03 04:25:55.764524 | orchestrator | + region = (known after apply) 2026-04-03 04:25:55.764529 | orchestrator | + service_types = (known after apply) 2026-04-03 04:25:55.764539 | orchestrator | + tenant_id = (known after apply) 2026-04-03 04:25:55.764544 | orchestrator | 2026-04-03 04:25:55.764549 | orchestrator | + allocation_pool { 2026-04-03 04:25:55.764554 | orchestrator | + end = "192.168.31.250" 2026-04-03 04:25:55.764560 | orchestrator | + start = "192.168.31.200" 2026-04-03 04:25:55.764565 | orchestrator | } 2026-04-03 04:25:55.764570 | orchestrator | } 2026-04-03 04:25:55.764575 | orchestrator | 2026-04-03 04:25:55.764580 | orchestrator | # terraform_data.image will be created 2026-04-03 04:25:55.764585 | orchestrator | + resource "terraform_data" "image" { 2026-04-03 04:25:55.764590 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764595 | orchestrator | + input = "Ubuntu 24.04" 2026-04-03 04:25:55.764601 | orchestrator | + output = (known after apply) 2026-04-03 04:25:55.764606 | orchestrator | } 2026-04-03 04:25:55.764611 | orchestrator | 2026-04-03 04:25:55.764616 | orchestrator | # terraform_data.image_node will be created 2026-04-03 04:25:55.764621 | orchestrator | + resource "terraform_data" "image_node" { 2026-04-03 04:25:55.764626 | orchestrator | + id = (known after apply) 2026-04-03 04:25:55.764631 | orchestrator | + input = "Ubuntu 24.04" 2026-04-03 04:25:55.764637 | orchestrator | + output = (known after apply) 2026-04-03 04:25:55.764642 | orchestrator | } 2026-04-03 04:25:55.764647 | orchestrator | 2026-04-03 04:25:55.764652 | orchestrator | Plan: 64 to add, 0 to change, 0 to destroy. 2026-04-03 04:25:55.764657 | orchestrator | 2026-04-03 04:25:55.764662 | orchestrator | Changes to Outputs: 2026-04-03 04:25:55.764667 | orchestrator | + manager_address = (sensitive value) 2026-04-03 04:25:55.764672 | orchestrator | + private_key = (sensitive value) 2026-04-03 04:25:56.044447 | orchestrator | terraform_data.image: Creating... 2026-04-03 04:25:56.044973 | orchestrator | terraform_data.image: Creation complete after 0s [id=7167aac2-899b-4e33-8ad4-e36569c5930d] 2026-04-03 04:25:56.045872 | orchestrator | terraform_data.image_node: Creating... 2026-04-03 04:25:56.050866 | orchestrator | terraform_data.image_node: Creation complete after 0s [id=0f32f03f-cf91-ac6a-3a43-52ae6bbcc571] 2026-04-03 04:25:56.066332 | orchestrator | data.openstack_images_image_v2.image: Reading... 2026-04-03 04:25:56.066843 | orchestrator | data.openstack_images_image_v2.image_node: Reading... 2026-04-03 04:25:56.074566 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creating... 2026-04-03 04:25:56.076474 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creating... 2026-04-03 04:25:56.078822 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creating... 2026-04-03 04:25:56.079130 | orchestrator | openstack_compute_keypair_v2.key: Creating... 2026-04-03 04:25:56.079700 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creating... 2026-04-03 04:25:56.079933 | orchestrator | openstack_networking_network_v2.net_management: Creating... 2026-04-03 04:25:56.080777 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creating... 2026-04-03 04:25:56.082449 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creating... 2026-04-03 04:25:56.578664 | orchestrator | data.openstack_images_image_v2.image: Read complete after 1s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-03 04:25:56.584735 | orchestrator | data.openstack_images_image_v2.image_node: Read complete after 1s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-03 04:25:56.587552 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creating... 2026-04-03 04:25:56.592718 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creating... 2026-04-03 04:25:56.618309 | orchestrator | openstack_compute_keypair_v2.key: Creation complete after 1s [id=testbed] 2026-04-03 04:25:56.627256 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creating... 2026-04-03 04:25:57.058837 | orchestrator | openstack_networking_network_v2.net_management: Creation complete after 1s [id=2e04bfa1-4e91-4dba-9661-dd9cfb09a637] 2026-04-03 04:25:57.069555 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creating... 2026-04-03 04:25:59.690260 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creation complete after 4s [id=ed3cd219-4944-484e-a6c4-5c14d036f42d] 2026-04-03 04:25:59.700192 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creating... 2026-04-03 04:25:59.709738 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creation complete after 4s [id=7cc69c6f-db35-4918-9d0a-70ecc89938b4] 2026-04-03 04:25:59.722963 | orchestrator | local_sensitive_file.id_rsa: Creating... 2026-04-03 04:25:59.727563 | orchestrator | local_sensitive_file.id_rsa: Creation complete after 0s [id=8a8c1d863ff9eb378e68ac5418f9cdd5fcad28bd] 2026-04-03 04:25:59.730159 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creation complete after 4s [id=9ac243a5-e044-41c7-a018-924969caf506] 2026-04-03 04:25:59.732806 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creation complete after 4s [id=39f44498-82eb-430b-ac9b-87a602481065] 2026-04-03 04:25:59.734991 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creating... 2026-04-03 04:25:59.736870 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creating... 2026-04-03 04:25:59.738859 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creating... 2026-04-03 04:25:59.745538 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creation complete after 4s [id=8670c2f2-ada3-4588-ba77-b0fabeb92243] 2026-04-03 04:25:59.758612 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creating... 2026-04-03 04:25:59.758694 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creation complete after 4s [id=26f49153-9bc1-41ad-be70-b72515b841e7] 2026-04-03 04:25:59.765179 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creating... 2026-04-03 04:25:59.818647 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creation complete after 3s [id=294f1b92-5dea-47ac-b0f9-6e803f64e9c9] 2026-04-03 04:25:59.828013 | orchestrator | local_file.id_rsa_pub: Creating... 2026-04-03 04:25:59.831605 | orchestrator | local_file.id_rsa_pub: Creation complete after 0s [id=3091ab185260789dd64c358562cf1a6de134a4a9] 2026-04-03 04:25:59.838513 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creation complete after 3s [id=1ef1650e-19aa-44b7-85c9-c2ec4bb32733] 2026-04-03 04:25:59.839155 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creating... 2026-04-03 04:25:59.845518 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creation complete after 3s [id=ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7] 2026-04-03 04:26:00.404324 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creation complete after 3s [id=b6a4aa0f-934c-4786-af69-31d7f429b32a] 2026-04-03 04:26:00.707399 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creation complete after 1s [id=c5e41906-3b09-4b32-a4a6-8fe5cb4adc08] 2026-04-03 04:26:00.718140 | orchestrator | openstack_networking_router_v2.router: Creating... 2026-04-03 04:26:03.061562 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creation complete after 3s [id=d8baca43-60dc-4fb6-9e83-dc38ea6087e4] 2026-04-03 04:26:03.151856 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creation complete after 3s [id=02c42445-0e82-4fea-8ba6-22ba4a17af8a] 2026-04-03 04:26:03.152597 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creation complete after 3s [id=37834d3d-70d4-489d-8bcd-3715e81551df] 2026-04-03 04:26:03.195705 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creation complete after 3s [id=76b66bca-b893-4285-9198-09d406beb848] 2026-04-03 04:26:03.209073 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creation complete after 3s [id=14ae244f-9908-4e60-9537-d5ef8d66f5e6] 2026-04-03 04:26:03.213416 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creation complete after 3s [id=bb34e97f-be4f-4e74-a2f5-2996b020f327] 2026-04-03 04:26:03.903413 | orchestrator | openstack_networking_router_v2.router: Creation complete after 3s [id=696129a9-7d33-4c82-a2c7-66e3a40e67b1] 2026-04-03 04:26:03.911685 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creating... 2026-04-03 04:26:03.912616 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creating... 2026-04-03 04:26:03.912746 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creating... 2026-04-03 04:26:04.086201 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creation complete after 0s [id=36192efb-a77f-4c2f-b49e-e4fba5d88dd0] 2026-04-03 04:26:04.102156 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creating... 2026-04-03 04:26:04.103383 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creating... 2026-04-03 04:26:04.104883 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creating... 2026-04-03 04:26:04.105246 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creating... 2026-04-03 04:26:04.107279 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creating... 2026-04-03 04:26:04.111394 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creating... 2026-04-03 04:26:04.112157 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creating... 2026-04-03 04:26:04.115270 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creating... 2026-04-03 04:26:04.279003 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creation complete after 0s [id=b8c5c6cd-bd34-4113-8cf8-6a1ef1071b26] 2026-04-03 04:26:04.290702 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creating... 2026-04-03 04:26:04.482723 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creation complete after 0s [id=e375402a-3419-48ec-99e1-1713ca6101c9] 2026-04-03 04:26:04.497778 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creating... 2026-04-03 04:26:04.654161 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creation complete after 1s [id=6d9b60f8-dcee-4c3d-951c-50156c98a74a] 2026-04-03 04:26:04.694942 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creation complete after 1s [id=1413a5cc-835d-4998-9043-63531046846f] 2026-04-03 04:26:04.704136 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creating... 2026-04-03 04:26:04.704285 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creating... 2026-04-03 04:26:04.737089 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creation complete after 1s [id=120949aa-1121-46a6-80cf-aa65efd283a7] 2026-04-03 04:26:04.741056 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creating... 2026-04-03 04:26:04.808622 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creation complete after 1s [id=ed21d41d-3ec1-44ab-96a9-3b57197cd748] 2026-04-03 04:26:04.823288 | orchestrator | openstack_networking_port_v2.manager_port_management: Creating... 2026-04-03 04:26:04.890928 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creation complete after 0s [id=b9d5f8e7-e83b-4bef-896e-60f09500b3f8] 2026-04-03 04:26:04.896544 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creating... 2026-04-03 04:26:04.965788 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creation complete after 1s [id=a378ae38-340d-4192-99a4-d3c47e74986e] 2026-04-03 04:26:04.977670 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creating... 2026-04-03 04:26:05.045157 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creation complete after 0s [id=075f6d0d-d6b0-44e2-8089-ddf35fe99d39] 2026-04-03 04:26:05.067271 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creation complete after 1s [id=a6018f48-b0b1-4268-bc80-fe1434c5733a] 2026-04-03 04:26:05.186112 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creation complete after 1s [id=ef9c1f55-369f-4a35-b356-36587ad6b1f0] 2026-04-03 04:26:05.290386 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creation complete after 1s [id=5463496e-e588-49ef-8fd3-56314e022b9d] 2026-04-03 04:26:05.322478 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creation complete after 0s [id=9b9346a4-2825-4d1d-9b26-6a0804135e03] 2026-04-03 04:26:05.395404 | orchestrator | openstack_networking_port_v2.manager_port_management: Creation complete after 0s [id=e6734f3f-e5c9-4025-9466-68d6a74aadd6] 2026-04-03 04:26:05.487071 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creation complete after 0s [id=a57645b6-3ebb-4d6a-98e7-2a23df4020ff] 2026-04-03 04:26:05.657422 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creation complete after 1s [id=ee054cd7-7d33-455b-a9d8-335a7f395773] 2026-04-03 04:26:05.914727 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creation complete after 2s [id=63676b28-9fae-4225-a715-e131ea9ef345] 2026-04-03 04:26:06.549038 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creation complete after 3s [id=b32cbfe6-8e3b-4c86-ae59-d697ac3e989b] 2026-04-03 04:26:06.567678 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creating... 2026-04-03 04:26:06.583755 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creating... 2026-04-03 04:26:06.586357 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creating... 2026-04-03 04:26:06.591827 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creating... 2026-04-03 04:26:06.592531 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creating... 2026-04-03 04:26:06.595197 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creating... 2026-04-03 04:26:06.611312 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creating... 2026-04-03 04:26:08.636746 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creation complete after 2s [id=6083c73d-d11c-4bdb-ace2-916d092ae8eb] 2026-04-03 04:26:08.642100 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creating... 2026-04-03 04:26:08.651339 | orchestrator | local_file.MANAGER_ADDRESS: Creating... 2026-04-03 04:26:08.652200 | orchestrator | local_file.inventory: Creating... 2026-04-03 04:26:08.656450 | orchestrator | local_file.inventory: Creation complete after 0s [id=69034384ade91639c31e525d375398967964cea2] 2026-04-03 04:26:08.657745 | orchestrator | local_file.MANAGER_ADDRESS: Creation complete after 0s [id=85fd0c63a1a7e54d82cdd6725bcb13984567434f] 2026-04-03 04:26:09.357177 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creation complete after 0s [id=6083c73d-d11c-4bdb-ace2-916d092ae8eb] 2026-04-03 04:26:16.584810 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [10s elapsed] 2026-04-03 04:26:16.993420 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [10s elapsed] 2026-04-03 04:26:16.993567 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [10s elapsed] 2026-04-03 04:26:16.993594 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [10s elapsed] 2026-04-03 04:26:16.993617 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [10s elapsed] 2026-04-03 04:26:16.993629 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [10s elapsed] 2026-04-03 04:26:26.585682 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [20s elapsed] 2026-04-03 04:26:26.591994 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [20s elapsed] 2026-04-03 04:26:26.594227 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [20s elapsed] 2026-04-03 04:26:26.595254 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [20s elapsed] 2026-04-03 04:26:26.605732 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [20s elapsed] 2026-04-03 04:26:26.613166 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [20s elapsed] 2026-04-03 04:26:27.042851 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creation complete after 20s [id=55b343e3-71a5-43ee-a1c6-a4770aaaebd5] 2026-04-03 04:26:27.169561 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creation complete after 20s [id=57c63c2c-4c93-419e-820f-51f0df175af8] 2026-04-03 04:26:27.281000 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creation complete after 20s [id=2e58bdc5-a2ca-4ce7-966a-8573f1191e23] 2026-04-03 04:26:36.595822 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [30s elapsed] 2026-04-03 04:26:36.606543 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [30s elapsed] 2026-04-03 04:26:36.613827 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [30s elapsed] 2026-04-03 04:26:37.380291 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creation complete after 30s [id=beeed926-b616-44a9-9f99-3b44169b128e] 2026-04-03 04:26:37.465563 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creation complete after 30s [id=f2e30427-3200-495d-9da8-badca9f3a6ff] 2026-04-03 04:26:37.620364 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creation complete after 31s [id=4252de81-668f-44c6-a238-aa6e82a608d9] 2026-04-03 04:26:37.648411 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creating... 2026-04-03 04:26:37.649940 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creating... 2026-04-03 04:26:37.652960 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creating... 2026-04-03 04:26:37.656249 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creating... 2026-04-03 04:26:37.656416 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creating... 2026-04-03 04:26:37.667219 | orchestrator | null_resource.node_semaphore: Creating... 2026-04-03 04:26:37.667283 | orchestrator | null_resource.node_semaphore: Creation complete after 0s [id=7215269417365943383] 2026-04-03 04:26:37.671138 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creating... 2026-04-03 04:26:37.672396 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creating... 2026-04-03 04:26:37.679590 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creating... 2026-04-03 04:26:37.679777 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creating... 2026-04-03 04:26:37.684888 | orchestrator | openstack_compute_instance_v2.manager_server: Creating... 2026-04-03 04:26:41.044047 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creation complete after 3s [id=f2e30427-3200-495d-9da8-badca9f3a6ff/7cc69c6f-db35-4918-9d0a-70ecc89938b4] 2026-04-03 04:26:41.056268 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creation complete after 3s [id=beeed926-b616-44a9-9f99-3b44169b128e/39f44498-82eb-430b-ac9b-87a602481065] 2026-04-03 04:26:41.067937 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creation complete after 3s [id=2e58bdc5-a2ca-4ce7-966a-8573f1191e23/ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7] 2026-04-03 04:26:41.079326 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creation complete after 3s [id=f2e30427-3200-495d-9da8-badca9f3a6ff/ed3cd219-4944-484e-a6c4-5c14d036f42d] 2026-04-03 04:26:41.093395 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creation complete after 3s [id=2e58bdc5-a2ca-4ce7-966a-8573f1191e23/8670c2f2-ada3-4588-ba77-b0fabeb92243] 2026-04-03 04:26:41.108109 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creation complete after 3s [id=beeed926-b616-44a9-9f99-3b44169b128e/1ef1650e-19aa-44b7-85c9-c2ec4bb32733] 2026-04-03 04:26:47.181036 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creation complete after 9s [id=2e58bdc5-a2ca-4ce7-966a-8573f1191e23/9ac243a5-e044-41c7-a018-924969caf506] 2026-04-03 04:26:47.184427 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creation complete after 9s [id=f2e30427-3200-495d-9da8-badca9f3a6ff/26f49153-9bc1-41ad-be70-b72515b841e7] 2026-04-03 04:26:47.214778 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creation complete after 9s [id=beeed926-b616-44a9-9f99-3b44169b128e/294f1b92-5dea-47ac-b0f9-6e803f64e9c9] 2026-04-03 04:26:47.688373 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [10s elapsed] 2026-04-03 04:26:57.688660 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [20s elapsed] 2026-04-03 04:26:58.459518 | orchestrator | openstack_compute_instance_v2.manager_server: Creation complete after 20s [id=4c8ff31a-898b-4333-834f-764e9e1f85d0] 2026-04-03 04:26:58.477348 | orchestrator | 2026-04-03 04:26:58.477508 | orchestrator | Apply complete! Resources: 64 added, 0 changed, 0 destroyed. 2026-04-03 04:26:58.477541 | orchestrator | 2026-04-03 04:26:58.477555 | orchestrator | Outputs: 2026-04-03 04:26:58.477567 | orchestrator | 2026-04-03 04:26:58.477579 | orchestrator | manager_address = 2026-04-03 04:26:58.477591 | orchestrator | private_key = 2026-04-03 04:26:58.545178 | orchestrator | ok: Runtime: 0:01:09.771710 2026-04-03 04:26:58.567865 | 2026-04-03 04:26:58.567995 | TASK [Fetch manager address] 2026-04-03 04:26:59.040584 | orchestrator | ok 2026-04-03 04:26:59.050549 | 2026-04-03 04:26:59.050684 | TASK [Set manager_host address] 2026-04-03 04:26:59.129487 | orchestrator | ok 2026-04-03 04:26:59.139774 | 2026-04-03 04:26:59.139937 | LOOP [Update ansible collections] 2026-04-03 04:27:00.771146 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-03 04:27:00.771557 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-03 04:27:00.771625 | orchestrator | Starting galaxy collection install process 2026-04-03 04:27:00.771668 | orchestrator | Process install dependency map 2026-04-03 04:27:00.771706 | orchestrator | Starting collection install process 2026-04-03 04:27:00.771742 | orchestrator | Installing 'osism.commons:999.0.0' to '/home/zuul-testbed02/.ansible/collections/ansible_collections/osism/commons' 2026-04-03 04:27:00.771782 | orchestrator | Created collection for osism.commons:999.0.0 at /home/zuul-testbed02/.ansible/collections/ansible_collections/osism/commons 2026-04-03 04:27:00.771823 | orchestrator | osism.commons:999.0.0 was installed successfully 2026-04-03 04:27:00.771899 | orchestrator | ok: Item: commons Runtime: 0:00:01.278965 2026-04-03 04:27:01.758985 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-03 04:27:01.759235 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-03 04:27:01.759323 | orchestrator | Starting galaxy collection install process 2026-04-03 04:27:01.759368 | orchestrator | Process install dependency map 2026-04-03 04:27:01.759406 | orchestrator | Starting collection install process 2026-04-03 04:27:01.759441 | orchestrator | Installing 'osism.services:999.0.0' to '/home/zuul-testbed02/.ansible/collections/ansible_collections/osism/services' 2026-04-03 04:27:01.759476 | orchestrator | Created collection for osism.services:999.0.0 at /home/zuul-testbed02/.ansible/collections/ansible_collections/osism/services 2026-04-03 04:27:01.759510 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-03 04:27:01.759571 | orchestrator | ok: Item: services Runtime: 0:00:00.706363 2026-04-03 04:27:01.783598 | 2026-04-03 04:27:01.783808 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-03 04:27:12.378306 | orchestrator | ok 2026-04-03 04:27:12.390217 | 2026-04-03 04:27:12.390353 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-03 04:28:12.437799 | orchestrator | ok 2026-04-03 04:28:12.448230 | 2026-04-03 04:28:12.448351 | TASK [Fetch manager ssh hostkey] 2026-04-03 04:28:14.024148 | orchestrator | Output suppressed because no_log was given 2026-04-03 04:28:14.040305 | 2026-04-03 04:28:14.040508 | TASK [Get ssh keypair from terraform environment] 2026-04-03 04:28:14.577938 | orchestrator | ok: Runtime: 0:00:00.012022 2026-04-03 04:28:14.588176 | 2026-04-03 04:28:14.588300 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-03 04:28:14.619992 | orchestrator | ok: The task 'Run manager part 0' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minutes for this task to complete. 2026-04-03 04:28:14.626867 | 2026-04-03 04:28:14.626974 | TASK [Run manager part 0] 2026-04-03 04:28:15.838656 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-03 04:28:15.928696 | orchestrator | 2026-04-03 04:28:15.928755 | orchestrator | PLAY [Wait for cloud-init to finish] ******************************************* 2026-04-03 04:28:15.928764 | orchestrator | 2026-04-03 04:28:15.928780 | orchestrator | TASK [Check /var/lib/cloud/instance/boot-finished] ***************************** 2026-04-03 04:28:18.077187 | orchestrator | ok: [testbed-manager] 2026-04-03 04:28:18.077248 | orchestrator | 2026-04-03 04:28:18.077273 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-03 04:28:18.077284 | orchestrator | 2026-04-03 04:28:18.077294 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:28:20.123166 | orchestrator | ok: [testbed-manager] 2026-04-03 04:28:20.123213 | orchestrator | 2026-04-03 04:28:20.123220 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-03 04:28:20.829991 | orchestrator | ok: [testbed-manager] 2026-04-03 04:28:20.830063 | orchestrator | 2026-04-03 04:28:20.830075 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-03 04:28:20.896984 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:28:20.897044 | orchestrator | 2026-04-03 04:28:20.897058 | orchestrator | TASK [Fail if Ubuntu version is lower than 24.04] ****************************** 2026-04-03 04:28:20.935105 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:28:20.935154 | orchestrator | 2026-04-03 04:28:20.935161 | orchestrator | TASK [Fail if Debian version is lower than 12] ********************************* 2026-04-03 04:28:20.968010 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:28:20.968069 | orchestrator | 2026-04-03 04:28:20.968079 | orchestrator | TASK [Set APT options on manager] ********************************************** 2026-04-03 04:28:21.773637 | orchestrator | changed: [testbed-manager] 2026-04-03 04:28:21.773739 | orchestrator | 2026-04-03 04:28:21.773746 | orchestrator | TASK [Update APT cache and run dist-upgrade] *********************************** 2026-04-03 04:31:28.755108 | orchestrator | changed: [testbed-manager] 2026-04-03 04:31:28.755193 | orchestrator | 2026-04-03 04:31:28.755212 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-03 04:33:13.304764 | orchestrator | changed: [testbed-manager] 2026-04-03 04:33:13.304814 | orchestrator | 2026-04-03 04:33:13.304825 | orchestrator | TASK [Install required packages] *********************************************** 2026-04-03 04:33:39.059532 | orchestrator | changed: [testbed-manager] 2026-04-03 04:33:39.059576 | orchestrator | 2026-04-03 04:33:39.059585 | orchestrator | TASK [Remove some python packages] ********************************************* 2026-04-03 04:33:49.190084 | orchestrator | changed: [testbed-manager] 2026-04-03 04:33:49.190188 | orchestrator | 2026-04-03 04:33:49.190206 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-03 04:33:49.249759 | orchestrator | ok: [testbed-manager] 2026-04-03 04:33:49.249847 | orchestrator | 2026-04-03 04:33:49.249863 | orchestrator | TASK [Get current user] ******************************************************** 2026-04-03 04:33:50.061996 | orchestrator | ok: [testbed-manager] 2026-04-03 04:33:50.062130 | orchestrator | 2026-04-03 04:33:50.062156 | orchestrator | TASK [Create venv directory] *************************************************** 2026-04-03 04:33:50.835646 | orchestrator | changed: [testbed-manager] 2026-04-03 04:33:50.835739 | orchestrator | 2026-04-03 04:33:50.835758 | orchestrator | TASK [Install netaddr in venv] ************************************************* 2026-04-03 04:33:57.608463 | orchestrator | changed: [testbed-manager] 2026-04-03 04:33:57.608572 | orchestrator | 2026-04-03 04:33:57.608590 | orchestrator | TASK [Install ansible-core in venv] ******************************************** 2026-04-03 04:34:03.947532 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:03.947591 | orchestrator | 2026-04-03 04:34:03.947604 | orchestrator | TASK [Install requests >= 2.32.2] ********************************************** 2026-04-03 04:34:06.730644 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:06.730726 | orchestrator | 2026-04-03 04:34:06.730740 | orchestrator | TASK [Install docker >= 7.1.0] ************************************************* 2026-04-03 04:34:08.688228 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:08.688312 | orchestrator | 2026-04-03 04:34:08.688327 | orchestrator | TASK [Create directories in /opt/src] ****************************************** 2026-04-03 04:34:09.943743 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-03 04:34:09.943873 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-03 04:34:09.943881 | orchestrator | 2026-04-03 04:34:09.943889 | orchestrator | TASK [Sync sources in /opt/src] ************************************************ 2026-04-03 04:34:09.980012 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-03 04:34:09.980064 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-03 04:34:09.980070 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-03 04:34:09.980076 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-03 04:34:14.511336 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-03 04:34:14.511473 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-03 04:34:14.511491 | orchestrator | 2026-04-03 04:34:14.511504 | orchestrator | TASK [Create /usr/share/ansible directory] ************************************* 2026-04-03 04:34:15.150292 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:15.150339 | orchestrator | 2026-04-03 04:34:15.150348 | orchestrator | TASK [Install collections from Ansible galaxy] ********************************* 2026-04-03 04:34:37.032997 | orchestrator | changed: [testbed-manager] => (item=ansible.netcommon) 2026-04-03 04:34:37.033113 | orchestrator | changed: [testbed-manager] => (item=ansible.posix) 2026-04-03 04:34:37.033129 | orchestrator | changed: [testbed-manager] => (item=community.docker>=3.10.2) 2026-04-03 04:34:37.033141 | orchestrator | 2026-04-03 04:34:37.033154 | orchestrator | TASK [Install local collections] *********************************************** 2026-04-03 04:34:39.532098 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-commons) 2026-04-03 04:34:39.532196 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-services) 2026-04-03 04:34:39.532205 | orchestrator | 2026-04-03 04:34:39.532215 | orchestrator | PLAY [Create operator user] **************************************************** 2026-04-03 04:34:39.532222 | orchestrator | 2026-04-03 04:34:39.532230 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:34:40.973164 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:40.973254 | orchestrator | 2026-04-03 04:34:40.973270 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-03 04:34:41.022495 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:41.022583 | orchestrator | 2026-04-03 04:34:41.022598 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-03 04:34:41.094067 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:41.094165 | orchestrator | 2026-04-03 04:34:41.094182 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-03 04:34:41.854732 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:41.854824 | orchestrator | 2026-04-03 04:34:41.854844 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-03 04:34:42.642008 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:42.642169 | orchestrator | 2026-04-03 04:34:42.642197 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-03 04:34:44.133936 | orchestrator | changed: [testbed-manager] => (item=adm) 2026-04-03 04:34:44.133987 | orchestrator | changed: [testbed-manager] => (item=sudo) 2026-04-03 04:34:44.133993 | orchestrator | 2026-04-03 04:34:44.133999 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-03 04:34:45.604012 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:45.604111 | orchestrator | 2026-04-03 04:34:45.604129 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-03 04:34:47.531809 | orchestrator | changed: [testbed-manager] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:34:47.531870 | orchestrator | changed: [testbed-manager] => (item=export LANG=C.UTF-8) 2026-04-03 04:34:47.531895 | orchestrator | changed: [testbed-manager] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:34:47.531905 | orchestrator | 2026-04-03 04:34:47.531917 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-03 04:34:47.585737 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:47.585828 | orchestrator | 2026-04-03 04:34:47.585844 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-03 04:34:47.664946 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:47.665040 | orchestrator | 2026-04-03 04:34:47.665056 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-03 04:34:48.266758 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:48.266849 | orchestrator | 2026-04-03 04:34:48.266863 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-03 04:34:48.338225 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:48.338286 | orchestrator | 2026-04-03 04:34:48.338295 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-03 04:34:49.223562 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:34:49.223737 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:49.223757 | orchestrator | 2026-04-03 04:34:49.223769 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-03 04:34:49.264677 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:49.264764 | orchestrator | 2026-04-03 04:34:49.264778 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-03 04:34:49.304952 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:49.305042 | orchestrator | 2026-04-03 04:34:49.305059 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-03 04:34:49.339511 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:49.339591 | orchestrator | 2026-04-03 04:34:49.339604 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-03 04:34:49.410660 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:49.410729 | orchestrator | 2026-04-03 04:34:49.410740 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-03 04:34:50.172070 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:50.172684 | orchestrator | 2026-04-03 04:34:50.172721 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-03 04:34:50.172742 | orchestrator | 2026-04-03 04:34:50.172764 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:34:51.640922 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:51.641022 | orchestrator | 2026-04-03 04:34:51.641039 | orchestrator | TASK [Recursively change ownership of /opt/venv] ******************************* 2026-04-03 04:34:52.610742 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:52.610831 | orchestrator | 2026-04-03 04:34:52.610846 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:34:52.610860 | orchestrator | testbed-manager : ok=33 changed=23 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 2026-04-03 04:34:52.610871 | orchestrator | 2026-04-03 04:34:52.922015 | orchestrator | ok: Runtime: 0:06:37.782075 2026-04-03 04:34:52.940188 | 2026-04-03 04:34:52.940331 | TASK [Point out that the log in on the manager is now possible] 2026-04-03 04:34:52.988637 | orchestrator | ok: It is now already possible to log in to the manager with 'make login'. 2026-04-03 04:34:52.999155 | 2026-04-03 04:34:52.999283 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-03 04:34:53.038201 | orchestrator | ok: The task 'Run manager part 1 + 2' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minuts for this task to complete. 2026-04-03 04:34:53.048028 | 2026-04-03 04:34:53.048169 | TASK [Run manager part 1 + 2] 2026-04-03 04:34:53.867211 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-03 04:34:53.920294 | orchestrator | 2026-04-03 04:34:53.920338 | orchestrator | PLAY [Run manager part 1] ****************************************************** 2026-04-03 04:34:53.920345 | orchestrator | 2026-04-03 04:34:53.920358 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:34:56.559658 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:56.559711 | orchestrator | 2026-04-03 04:34:56.559733 | orchestrator | TASK [Set venv_command fact (RedHat)] ****************************************** 2026-04-03 04:34:56.595982 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:56.596046 | orchestrator | 2026-04-03 04:34:56.596059 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-03 04:34:56.638599 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:56.638671 | orchestrator | 2026-04-03 04:34:56.638686 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-03 04:34:56.680742 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:56.680803 | orchestrator | 2026-04-03 04:34:56.680814 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-03 04:34:56.758314 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:56.758376 | orchestrator | 2026-04-03 04:34:56.758386 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-03 04:34:56.832796 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:56.832855 | orchestrator | 2026-04-03 04:34:56.832865 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-03 04:34:56.877815 | orchestrator | included: /home/zuul-testbed02/.ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager 2026-04-03 04:34:56.877863 | orchestrator | 2026-04-03 04:34:56.877869 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-03 04:34:57.638505 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:57.638576 | orchestrator | 2026-04-03 04:34:57.638587 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-03 04:34:57.689186 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:34:57.689242 | orchestrator | 2026-04-03 04:34:57.689251 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-03 04:34:59.223544 | orchestrator | changed: [testbed-manager] 2026-04-03 04:34:59.223614 | orchestrator | 2026-04-03 04:34:59.223626 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-03 04:34:59.846539 | orchestrator | ok: [testbed-manager] 2026-04-03 04:34:59.846600 | orchestrator | 2026-04-03 04:34:59.846610 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-03 04:35:01.126813 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:01.126894 | orchestrator | 2026-04-03 04:35:01.126914 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-03 04:35:17.914336 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:17.914468 | orchestrator | 2026-04-03 04:35:17.914486 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-03 04:35:18.612947 | orchestrator | ok: [testbed-manager] 2026-04-03 04:35:18.613040 | orchestrator | 2026-04-03 04:35:18.613060 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-03 04:35:18.701235 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:35:18.701313 | orchestrator | 2026-04-03 04:35:18.701324 | orchestrator | TASK [Copy SSH public key] ***************************************************** 2026-04-03 04:35:19.699467 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:19.699567 | orchestrator | 2026-04-03 04:35:19.699584 | orchestrator | TASK [Copy SSH private key] **************************************************** 2026-04-03 04:35:20.716507 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:20.716619 | orchestrator | 2026-04-03 04:35:20.716645 | orchestrator | TASK [Create configuration directory] ****************************************** 2026-04-03 04:35:21.315298 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:21.315343 | orchestrator | 2026-04-03 04:35:21.315352 | orchestrator | TASK [Copy testbed repo] ******************************************************* 2026-04-03 04:35:21.359500 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-03 04:35:21.359627 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-03 04:35:21.359644 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-03 04:35:21.359656 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-03 04:35:24.231216 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:24.231269 | orchestrator | 2026-04-03 04:35:24.231278 | orchestrator | TASK [Install python requirements in venv] ************************************* 2026-04-03 04:35:33.657678 | orchestrator | ok: [testbed-manager] => (item=Jinja2) 2026-04-03 04:35:33.657722 | orchestrator | ok: [testbed-manager] => (item=PyYAML) 2026-04-03 04:35:33.657731 | orchestrator | ok: [testbed-manager] => (item=packaging) 2026-04-03 04:35:33.657738 | orchestrator | changed: [testbed-manager] => (item=python-gilt==1.2.3) 2026-04-03 04:35:33.657748 | orchestrator | ok: [testbed-manager] => (item=requests>=2.32.2) 2026-04-03 04:35:33.657754 | orchestrator | ok: [testbed-manager] => (item=docker>=7.1.0) 2026-04-03 04:35:33.657760 | orchestrator | 2026-04-03 04:35:33.657766 | orchestrator | TASK [Copy testbed custom CA certificate on Debian/Ubuntu] ********************* 2026-04-03 04:35:34.757030 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:34.757127 | orchestrator | 2026-04-03 04:35:34.757142 | orchestrator | TASK [Run update-ca-certificates on Debian/Ubuntu] ***************************** 2026-04-03 04:35:38.008316 | orchestrator | changed: [testbed-manager] 2026-04-03 04:35:38.008421 | orchestrator | 2026-04-03 04:35:38.008441 | orchestrator | TASK [Run update-ca-trust on RedHat] ******************************************* 2026-04-03 04:35:38.048127 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:35:38.048228 | orchestrator | 2026-04-03 04:35:38.048248 | orchestrator | TASK [Run manager part 2] ****************************************************** 2026-04-03 04:37:23.099614 | orchestrator | changed: [testbed-manager] 2026-04-03 04:37:23.099734 | orchestrator | 2026-04-03 04:37:23.099762 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-03 04:37:24.315482 | orchestrator | ok: [testbed-manager] 2026-04-03 04:37:24.315596 | orchestrator | 2026-04-03 04:37:24.315614 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:37:24.315627 | orchestrator | testbed-manager : ok=21 changed=11 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026-04-03 04:37:24.315640 | orchestrator | 2026-04-03 04:37:24.696554 | orchestrator | ok: Runtime: 0:02:31.071485 2026-04-03 04:37:24.717420 | 2026-04-03 04:37:24.717621 | TASK [Reboot manager] 2026-04-03 04:37:26.256649 | orchestrator | ok: Runtime: 0:00:01.107045 2026-04-03 04:37:26.273271 | 2026-04-03 04:37:26.273435 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-03 04:37:42.702931 | orchestrator | ok 2026-04-03 04:37:42.714075 | 2026-04-03 04:37:42.714255 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-03 04:38:42.762234 | orchestrator | ok 2026-04-03 04:38:42.772071 | 2026-04-03 04:38:42.772289 | TASK [Deploy manager + bootstrap nodes] 2026-04-03 04:38:45.432563 | orchestrator | 2026-04-03 04:38:45.432802 | orchestrator | # DEPLOY MANAGER 2026-04-03 04:38:45.432835 | orchestrator | 2026-04-03 04:38:45.432851 | orchestrator | + set -e 2026-04-03 04:38:45.432862 | orchestrator | + echo 2026-04-03 04:38:45.432873 | orchestrator | + echo '# DEPLOY MANAGER' 2026-04-03 04:38:45.432887 | orchestrator | + echo 2026-04-03 04:38:45.432925 | orchestrator | + cat /opt/manager-vars.sh 2026-04-03 04:38:45.435882 | orchestrator | export NUMBER_OF_NODES=6 2026-04-03 04:38:45.435918 | orchestrator | 2026-04-03 04:38:45.435930 | orchestrator | export CEPH_VERSION=reef 2026-04-03 04:38:45.435946 | orchestrator | export CONFIGURATION_VERSION=main 2026-04-03 04:38:45.435961 | orchestrator | export MANAGER_VERSION=9.5.0 2026-04-03 04:38:45.435987 | orchestrator | export OPENSTACK_VERSION=2024.2 2026-04-03 04:38:45.436001 | orchestrator | 2026-04-03 04:38:45.436019 | orchestrator | export ARA=false 2026-04-03 04:38:45.436029 | orchestrator | export DEPLOY_MODE=manager 2026-04-03 04:38:45.436053 | orchestrator | export TEMPEST=false 2026-04-03 04:38:45.436071 | orchestrator | export IS_ZUUL=true 2026-04-03 04:38:45.436084 | orchestrator | 2026-04-03 04:38:45.436104 | orchestrator | export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 04:38:45.436119 | orchestrator | export EXTERNAL_API=false 2026-04-03 04:38:45.436132 | orchestrator | 2026-04-03 04:38:45.436146 | orchestrator | export IMAGE_USER=ubuntu 2026-04-03 04:38:45.436164 | orchestrator | export IMAGE_NODE_USER=ubuntu 2026-04-03 04:38:45.436177 | orchestrator | 2026-04-03 04:38:45.436190 | orchestrator | export CEPH_STACK=ceph-ansible 2026-04-03 04:38:45.436213 | orchestrator | 2026-04-03 04:38:45.436226 | orchestrator | + echo 2026-04-03 04:38:45.436241 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 04:38:45.437056 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 04:38:45.437077 | orchestrator | ++ INTERACTIVE=false 2026-04-03 04:38:45.437087 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 04:38:45.437097 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 04:38:45.437256 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 04:38:45.437275 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 04:38:45.437288 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 04:38:45.437302 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 04:38:45.437315 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 04:38:45.437329 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 04:38:45.437345 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 04:38:45.437358 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 04:38:45.437372 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 04:38:45.437385 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 04:38:45.437408 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 04:38:45.437423 | orchestrator | ++ export ARA=false 2026-04-03 04:38:45.437436 | orchestrator | ++ ARA=false 2026-04-03 04:38:45.437450 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 04:38:45.437464 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 04:38:45.437478 | orchestrator | ++ export TEMPEST=false 2026-04-03 04:38:45.437487 | orchestrator | ++ TEMPEST=false 2026-04-03 04:38:45.437499 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 04:38:45.437508 | orchestrator | ++ IS_ZUUL=true 2026-04-03 04:38:45.437516 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 04:38:45.437524 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 04:38:45.437533 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 04:38:45.437540 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 04:38:45.437548 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 04:38:45.437556 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 04:38:45.437564 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 04:38:45.437572 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 04:38:45.437581 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 04:38:45.437589 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 04:38:45.437597 | orchestrator | + sudo ln -sf /opt/configuration/contrib/semver2.sh /usr/local/bin/semver 2026-04-03 04:38:45.495484 | orchestrator | + docker version 2026-04-03 04:38:45.604556 | orchestrator | Client: Docker Engine - Community 2026-04-03 04:38:45.604685 | orchestrator | Version: 27.5.1 2026-04-03 04:38:45.604704 | orchestrator | API version: 1.47 2026-04-03 04:38:45.604716 | orchestrator | Go version: go1.22.11 2026-04-03 04:38:45.604728 | orchestrator | Git commit: 9f9e405 2026-04-03 04:38:45.604739 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-03 04:38:45.604751 | orchestrator | OS/Arch: linux/amd64 2026-04-03 04:38:45.604762 | orchestrator | Context: default 2026-04-03 04:38:45.604773 | orchestrator | 2026-04-03 04:38:45.604784 | orchestrator | Server: Docker Engine - Community 2026-04-03 04:38:45.604812 | orchestrator | Engine: 2026-04-03 04:38:45.604824 | orchestrator | Version: 27.5.1 2026-04-03 04:38:45.604836 | orchestrator | API version: 1.47 (minimum version 1.24) 2026-04-03 04:38:45.604878 | orchestrator | Go version: go1.22.11 2026-04-03 04:38:45.604890 | orchestrator | Git commit: 4c9b3b0 2026-04-03 04:38:45.604902 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-03 04:38:45.604913 | orchestrator | OS/Arch: linux/amd64 2026-04-03 04:38:45.604923 | orchestrator | Experimental: false 2026-04-03 04:38:45.604935 | orchestrator | containerd: 2026-04-03 04:38:45.604946 | orchestrator | Version: v2.2.2 2026-04-03 04:38:45.604957 | orchestrator | GitCommit: 301b2dac98f15c27117da5c8af12118a041a31d9 2026-04-03 04:38:45.604968 | orchestrator | runc: 2026-04-03 04:38:45.604980 | orchestrator | Version: 1.3.4 2026-04-03 04:38:45.604991 | orchestrator | GitCommit: v1.3.4-0-gd6d73eb8 2026-04-03 04:38:45.605002 | orchestrator | docker-init: 2026-04-03 04:38:45.605013 | orchestrator | Version: 0.19.0 2026-04-03 04:38:45.605024 | orchestrator | GitCommit: de40ad0 2026-04-03 04:38:45.607607 | orchestrator | + sh -c /opt/configuration/scripts/deploy/000-manager.sh 2026-04-03 04:38:45.614081 | orchestrator | + set -e 2026-04-03 04:38:45.614113 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 04:38:45.614125 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 04:38:45.614136 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 04:38:45.614147 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 04:38:45.614157 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 04:38:45.614168 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 04:38:45.614180 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 04:38:45.614191 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 04:38:45.614201 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 04:38:45.614212 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 04:38:45.614223 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 04:38:45.614234 | orchestrator | ++ export ARA=false 2026-04-03 04:38:45.614245 | orchestrator | ++ ARA=false 2026-04-03 04:38:45.614256 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 04:38:45.614267 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 04:38:45.614277 | orchestrator | ++ export TEMPEST=false 2026-04-03 04:38:45.614288 | orchestrator | ++ TEMPEST=false 2026-04-03 04:38:45.614299 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 04:38:45.614310 | orchestrator | ++ IS_ZUUL=true 2026-04-03 04:38:45.614320 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 04:38:45.614331 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 04:38:45.614342 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 04:38:45.614352 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 04:38:45.614363 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 04:38:45.614374 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 04:38:45.614385 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 04:38:45.614395 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 04:38:45.614406 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 04:38:45.614417 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 04:38:45.614428 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 04:38:45.614438 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 04:38:45.614449 | orchestrator | ++ INTERACTIVE=false 2026-04-03 04:38:45.614459 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 04:38:45.614476 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 04:38:45.614487 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-03 04:38:45.614498 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 9.5.0 2026-04-03 04:38:45.622386 | orchestrator | + set -e 2026-04-03 04:38:45.622449 | orchestrator | + VERSION=9.5.0 2026-04-03 04:38:45.622464 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 9.5.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-03 04:38:45.627950 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-03 04:38:45.627978 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-03 04:38:45.633457 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-03 04:38:45.638277 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-03 04:38:45.642938 | orchestrator | + set -e 2026-04-03 04:38:45.643039 | orchestrator | /opt/configuration ~ 2026-04-03 04:38:45.643059 | orchestrator | + pushd /opt/configuration 2026-04-03 04:38:45.643072 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 04:38:45.645072 | orchestrator | + source /opt/venv/bin/activate 2026-04-03 04:38:45.647540 | orchestrator | ++ deactivate nondestructive 2026-04-03 04:38:45.647584 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:45.647595 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:45.647654 | orchestrator | ++ hash -r 2026-04-03 04:38:45.647667 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:45.647678 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-03 04:38:45.647689 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-03 04:38:45.647700 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-03 04:38:45.647712 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-03 04:38:45.647724 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-03 04:38:45.647732 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-03 04:38:45.647738 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-03 04:38:45.647746 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:38:45.647753 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:38:45.647760 | orchestrator | ++ export PATH 2026-04-03 04:38:45.647767 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:45.647774 | orchestrator | ++ '[' -z '' ']' 2026-04-03 04:38:45.647780 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-03 04:38:45.647787 | orchestrator | ++ PS1='(venv) ' 2026-04-03 04:38:45.647793 | orchestrator | ++ export PS1 2026-04-03 04:38:45.647800 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-03 04:38:45.647806 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-03 04:38:45.647813 | orchestrator | ++ hash -r 2026-04-03 04:38:45.647826 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-03 04:38:46.887851 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-03 04:38:46.888522 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-03 04:38:46.889912 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-03 04:38:46.891370 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-03 04:38:46.892479 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.0) 2026-04-03 04:38:46.902909 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.1) 2026-04-03 04:38:46.904294 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-03 04:38:46.905606 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-03 04:38:46.906779 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-03 04:38:46.942588 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-03 04:38:46.944014 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.11) 2026-04-03 04:38:46.945912 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-03 04:38:46.947374 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.2.25) 2026-04-03 04:38:46.951223 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-03 04:38:47.197137 | orchestrator | ++ which gilt 2026-04-03 04:38:47.199596 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-03 04:38:47.199695 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-03 04:38:47.463773 | orchestrator | osism.cfg-generics: 2026-04-03 04:38:47.607706 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-03 04:38:47.607809 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-03 04:38:47.607824 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-03 04:38:47.607848 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-03 04:38:48.726998 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-03 04:38:48.735441 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-03 04:38:49.074844 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-03 04:38:49.123935 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 04:38:49.124007 | orchestrator | + deactivate 2026-04-03 04:38:49.124014 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-03 04:38:49.124020 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:38:49.124026 | orchestrator | + export PATH 2026-04-03 04:38:49.124031 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-03 04:38:49.124036 | orchestrator | + '[' -n '' ']' 2026-04-03 04:38:49.124043 | orchestrator | + hash -r 2026-04-03 04:38:49.124048 | orchestrator | + '[' -n '' ']' 2026-04-03 04:38:49.124053 | orchestrator | + unset VIRTUAL_ENV 2026-04-03 04:38:49.124058 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-03 04:38:49.124063 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-03 04:38:49.124067 | orchestrator | + unset -f deactivate 2026-04-03 04:38:49.124072 | orchestrator | ~ 2026-04-03 04:38:49.124077 | orchestrator | + popd 2026-04-03 04:38:49.125876 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 04:38:49.125888 | orchestrator | + [[ ceph-ansible == \r\o\o\k ]] 2026-04-03 04:38:49.126737 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-03 04:38:49.189784 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 04:38:49.189897 | orchestrator | + echo 'enable_osism_kubernetes: true' 2026-04-03 04:38:49.190880 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 04:38:49.252360 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 04:38:49.252723 | orchestrator | ++ semver 2024.2 2025.1 2026-04-03 04:38:49.311192 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 04:38:49.311316 | orchestrator | + /opt/configuration/scripts/enable-resource-nodes.sh 2026-04-03 04:38:49.406330 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 04:38:49.406446 | orchestrator | + source /opt/venv/bin/activate 2026-04-03 04:38:49.406471 | orchestrator | ++ deactivate nondestructive 2026-04-03 04:38:49.406492 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:49.406512 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:49.406533 | orchestrator | ++ hash -r 2026-04-03 04:38:49.406548 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:49.406562 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-03 04:38:49.406582 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-03 04:38:49.406617 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-03 04:38:49.406675 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-03 04:38:49.406695 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-03 04:38:49.406712 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-03 04:38:49.406728 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-03 04:38:49.406751 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:38:49.406800 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:38:49.406823 | orchestrator | ++ export PATH 2026-04-03 04:38:49.406848 | orchestrator | ++ '[' -n '' ']' 2026-04-03 04:38:49.406867 | orchestrator | ++ '[' -z '' ']' 2026-04-03 04:38:49.406892 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-03 04:38:49.406910 | orchestrator | ++ PS1='(venv) ' 2026-04-03 04:38:49.406928 | orchestrator | ++ export PS1 2026-04-03 04:38:49.406946 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-03 04:38:49.406967 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-03 04:38:49.406986 | orchestrator | ++ hash -r 2026-04-03 04:38:49.407287 | orchestrator | + ansible-playbook -i testbed-manager, --vault-password-file /opt/configuration/environments/.vault_pass /opt/configuration/ansible/manager-part-3.yml 2026-04-03 04:38:50.590200 | orchestrator | 2026-04-03 04:38:50.590317 | orchestrator | PLAY [Copy custom facts] ******************************************************* 2026-04-03 04:38:50.590338 | orchestrator | 2026-04-03 04:38:50.590354 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-03 04:38:51.189963 | orchestrator | ok: [testbed-manager] 2026-04-03 04:38:51.190146 | orchestrator | 2026-04-03 04:38:51.190166 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-03 04:38:52.204859 | orchestrator | changed: [testbed-manager] 2026-04-03 04:38:52.204947 | orchestrator | 2026-04-03 04:38:52.204957 | orchestrator | PLAY [Before the deployment of the manager] ************************************ 2026-04-03 04:38:52.204984 | orchestrator | 2026-04-03 04:38:52.204991 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:38:54.607909 | orchestrator | ok: [testbed-manager] 2026-04-03 04:38:54.608043 | orchestrator | 2026-04-03 04:38:54.608070 | orchestrator | TASK [Get /opt/manager-vars.sh] ************************************************ 2026-04-03 04:38:54.659483 | orchestrator | ok: [testbed-manager] 2026-04-03 04:38:54.659575 | orchestrator | 2026-04-03 04:38:54.659592 | orchestrator | TASK [Add ara_server_mariadb_volume_type parameter] **************************** 2026-04-03 04:38:55.166131 | orchestrator | changed: [testbed-manager] 2026-04-03 04:38:55.166229 | orchestrator | 2026-04-03 04:38:55.166249 | orchestrator | TASK [Add netbox_enable parameter] ********************************************* 2026-04-03 04:38:55.209579 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:38:55.209692 | orchestrator | 2026-04-03 04:38:55.209708 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-03 04:38:55.556235 | orchestrator | changed: [testbed-manager] 2026-04-03 04:38:55.556357 | orchestrator | 2026-04-03 04:38:55.556384 | orchestrator | TASK [Check if /etc/OTC_region exist] ****************************************** 2026-04-03 04:38:55.903338 | orchestrator | ok: [testbed-manager] 2026-04-03 04:38:55.903430 | orchestrator | 2026-04-03 04:38:55.903445 | orchestrator | TASK [Add nova_compute_virt_type parameter] ************************************ 2026-04-03 04:38:56.034148 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:38:56.034244 | orchestrator | 2026-04-03 04:38:56.034260 | orchestrator | PLAY [Apply role traefik] ****************************************************** 2026-04-03 04:38:56.034274 | orchestrator | 2026-04-03 04:38:56.034285 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:38:57.837768 | orchestrator | ok: [testbed-manager] 2026-04-03 04:38:57.837871 | orchestrator | 2026-04-03 04:38:57.837888 | orchestrator | TASK [Apply traefik role] ****************************************************** 2026-04-03 04:38:57.960966 | orchestrator | included: osism.services.traefik for testbed-manager 2026-04-03 04:38:57.961058 | orchestrator | 2026-04-03 04:38:57.961088 | orchestrator | TASK [osism.services.traefik : Include config tasks] *************************** 2026-04-03 04:38:58.026295 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/config.yml for testbed-manager 2026-04-03 04:38:58.026397 | orchestrator | 2026-04-03 04:38:58.026415 | orchestrator | TASK [osism.services.traefik : Create required directories] ******************** 2026-04-03 04:38:59.167012 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik) 2026-04-03 04:38:59.167128 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/certificates) 2026-04-03 04:38:59.167145 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/configuration) 2026-04-03 04:38:59.167158 | orchestrator | 2026-04-03 04:38:59.167173 | orchestrator | TASK [osism.services.traefik : Copy configuration files] *********************** 2026-04-03 04:39:01.003494 | orchestrator | changed: [testbed-manager] => (item=traefik.yml) 2026-04-03 04:39:01.003619 | orchestrator | changed: [testbed-manager] => (item=traefik.env) 2026-04-03 04:39:01.003637 | orchestrator | changed: [testbed-manager] => (item=certificates.yml) 2026-04-03 04:39:01.003697 | orchestrator | 2026-04-03 04:39:01.003710 | orchestrator | TASK [osism.services.traefik : Copy certificate cert files] ******************** 2026-04-03 04:39:01.636151 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:39:01.636223 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:01.636230 | orchestrator | 2026-04-03 04:39:01.636236 | orchestrator | TASK [osism.services.traefik : Copy certificate key files] ********************* 2026-04-03 04:39:02.300591 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:39:02.300747 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:02.300766 | orchestrator | 2026-04-03 04:39:02.300779 | orchestrator | TASK [osism.services.traefik : Copy dynamic configuration] ********************* 2026-04-03 04:39:02.350352 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:02.350452 | orchestrator | 2026-04-03 04:39:02.350469 | orchestrator | TASK [osism.services.traefik : Remove dynamic configuration] ******************* 2026-04-03 04:39:02.713139 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:02.713239 | orchestrator | 2026-04-03 04:39:02.713255 | orchestrator | TASK [osism.services.traefik : Include service tasks] ************************** 2026-04-03 04:39:02.803148 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/service.yml for testbed-manager 2026-04-03 04:39:02.803234 | orchestrator | 2026-04-03 04:39:02.803244 | orchestrator | TASK [osism.services.traefik : Create traefik external network] **************** 2026-04-03 04:39:03.993777 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:03.993871 | orchestrator | 2026-04-03 04:39:03.993882 | orchestrator | TASK [osism.services.traefik : Copy docker-compose.yml file] ******************* 2026-04-03 04:39:04.871708 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:04.871815 | orchestrator | 2026-04-03 04:39:04.871831 | orchestrator | TASK [osism.services.traefik : Manage traefik service] ************************* 2026-04-03 04:39:16.208715 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:16.208834 | orchestrator | 2026-04-03 04:39:16.208851 | orchestrator | RUNNING HANDLER [osism.services.traefik : Restart traefik service] ************* 2026-04-03 04:39:16.272228 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:16.272348 | orchestrator | 2026-04-03 04:39:16.272399 | orchestrator | PLAY [Deploy manager service] ************************************************** 2026-04-03 04:39:16.272423 | orchestrator | 2026-04-03 04:39:16.272444 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:39:19.151732 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:19.151812 | orchestrator | 2026-04-03 04:39:19.151822 | orchestrator | TASK [Apply manager role] ****************************************************** 2026-04-03 04:39:19.288138 | orchestrator | included: osism.services.manager for testbed-manager 2026-04-03 04:39:19.288210 | orchestrator | 2026-04-03 04:39:19.288218 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-03 04:39:19.342515 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 04:39:19.342594 | orchestrator | 2026-04-03 04:39:19.342604 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-03 04:39:21.883559 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:21.883726 | orchestrator | 2026-04-03 04:39:21.883746 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-03 04:39:21.937122 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:21.937211 | orchestrator | 2026-04-03 04:39:21.937223 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-03 04:39:22.066131 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-03 04:39:22.066210 | orchestrator | 2026-04-03 04:39:22.066219 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-03 04:39:24.997997 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible) 2026-04-03 04:39:24.998154 | orchestrator | changed: [testbed-manager] => (item=/opt/archive) 2026-04-03 04:39:24.998171 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-03 04:39:24.998183 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/data) 2026-04-03 04:39:24.998195 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-03 04:39:24.998206 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-03 04:39:24.998217 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-03 04:39:24.998228 | orchestrator | changed: [testbed-manager] => (item=/opt/state) 2026-04-03 04:39:24.998240 | orchestrator | 2026-04-03 04:39:24.998252 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-03 04:39:25.666729 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:25.666859 | orchestrator | 2026-04-03 04:39:25.666889 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-03 04:39:26.328252 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:26.328353 | orchestrator | 2026-04-03 04:39:26.328370 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-03 04:39:26.403005 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-03 04:39:26.403111 | orchestrator | 2026-04-03 04:39:26.403128 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-03 04:39:27.635150 | orchestrator | changed: [testbed-manager] => (item=ara) 2026-04-03 04:39:27.635260 | orchestrator | changed: [testbed-manager] => (item=ara-server) 2026-04-03 04:39:27.635277 | orchestrator | 2026-04-03 04:39:27.635291 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-03 04:39:28.249302 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:28.249425 | orchestrator | 2026-04-03 04:39:28.249452 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-03 04:39:28.297797 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:28.297875 | orchestrator | 2026-04-03 04:39:28.297886 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-03 04:39:28.381136 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-03 04:39:28.381226 | orchestrator | 2026-04-03 04:39:28.381239 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-03 04:39:29.012398 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:29.012497 | orchestrator | 2026-04-03 04:39:29.012515 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-03 04:39:29.077369 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-03 04:39:29.077450 | orchestrator | 2026-04-03 04:39:29.077461 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-03 04:39:30.479393 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:39:30.479496 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:39:30.479511 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:30.479525 | orchestrator | 2026-04-03 04:39:30.479537 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-03 04:39:31.125140 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:31.125241 | orchestrator | 2026-04-03 04:39:31.125257 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-03 04:39:31.179426 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:31.179513 | orchestrator | 2026-04-03 04:39:31.179527 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-03 04:39:31.289118 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-03 04:39:31.289216 | orchestrator | 2026-04-03 04:39:31.289232 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-03 04:39:31.818004 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:31.818199 | orchestrator | 2026-04-03 04:39:31.818218 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-03 04:39:32.263552 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:32.263718 | orchestrator | 2026-04-03 04:39:32.263739 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-03 04:39:33.486330 | orchestrator | changed: [testbed-manager] => (item=conductor) 2026-04-03 04:39:33.486435 | orchestrator | changed: [testbed-manager] => (item=openstack) 2026-04-03 04:39:33.486453 | orchestrator | 2026-04-03 04:39:33.486466 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-03 04:39:34.178262 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:34.178345 | orchestrator | 2026-04-03 04:39:34.178357 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-03 04:39:34.567402 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:34.567478 | orchestrator | 2026-04-03 04:39:34.567488 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-03 04:39:34.924514 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:34.924626 | orchestrator | 2026-04-03 04:39:34.924654 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-03 04:39:34.969414 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:34.969499 | orchestrator | 2026-04-03 04:39:34.969514 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-03 04:39:35.041573 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-03 04:39:35.041740 | orchestrator | 2026-04-03 04:39:35.041757 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-03 04:39:35.093190 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:35.093279 | orchestrator | 2026-04-03 04:39:35.093294 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-03 04:39:37.201789 | orchestrator | changed: [testbed-manager] => (item=osism) 2026-04-03 04:39:37.201893 | orchestrator | changed: [testbed-manager] => (item=osism-update-docker) 2026-04-03 04:39:37.201910 | orchestrator | changed: [testbed-manager] => (item=osism-update-manager) 2026-04-03 04:39:37.201922 | orchestrator | 2026-04-03 04:39:37.201935 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-03 04:39:38.007586 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:38.007708 | orchestrator | 2026-04-03 04:39:38.007725 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-03 04:39:38.744338 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:38.744441 | orchestrator | 2026-04-03 04:39:38.744458 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-03 04:39:39.490414 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:39.490510 | orchestrator | 2026-04-03 04:39:39.490521 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-03 04:39:39.574240 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-03 04:39:39.574324 | orchestrator | 2026-04-03 04:39:39.574336 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-03 04:39:39.628558 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:39.628637 | orchestrator | 2026-04-03 04:39:39.628648 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-03 04:39:40.357351 | orchestrator | changed: [testbed-manager] => (item=osism-include) 2026-04-03 04:39:40.357450 | orchestrator | 2026-04-03 04:39:40.357465 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-03 04:39:40.444915 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-03 04:39:40.445025 | orchestrator | 2026-04-03 04:39:40.445045 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-03 04:39:41.176422 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:41.176523 | orchestrator | 2026-04-03 04:39:41.176540 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-03 04:39:41.815402 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:41.815504 | orchestrator | 2026-04-03 04:39:41.815522 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-03 04:39:41.865382 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:39:41.865485 | orchestrator | 2026-04-03 04:39:41.865512 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-03 04:39:41.931157 | orchestrator | ok: [testbed-manager] 2026-04-03 04:39:41.931250 | orchestrator | 2026-04-03 04:39:41.931265 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-03 04:39:42.749067 | orchestrator | changed: [testbed-manager] 2026-04-03 04:39:42.749169 | orchestrator | 2026-04-03 04:39:42.749186 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-03 04:40:52.930583 | orchestrator | changed: [testbed-manager] 2026-04-03 04:40:52.930703 | orchestrator | 2026-04-03 04:40:52.930722 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-03 04:40:53.941724 | orchestrator | ok: [testbed-manager] 2026-04-03 04:40:53.941908 | orchestrator | 2026-04-03 04:40:53.941930 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-03 04:40:54.004636 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:40:54.004728 | orchestrator | 2026-04-03 04:40:54.004766 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-03 04:40:59.839905 | orchestrator | changed: [testbed-manager] 2026-04-03 04:40:59.840020 | orchestrator | 2026-04-03 04:40:59.840038 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-03 04:40:59.888684 | orchestrator | ok: [testbed-manager] 2026-04-03 04:40:59.888851 | orchestrator | 2026-04-03 04:40:59.888873 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-03 04:40:59.888887 | orchestrator | 2026-04-03 04:40:59.888898 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-03 04:41:00.065499 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:41:00.065606 | orchestrator | 2026-04-03 04:41:00.065630 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-03 04:42:00.124703 | orchestrator | Pausing for 60 seconds 2026-04-03 04:42:00.124797 | orchestrator | changed: [testbed-manager] 2026-04-03 04:42:00.124807 | orchestrator | 2026-04-03 04:42:00.124815 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-03 04:42:03.203205 | orchestrator | changed: [testbed-manager] 2026-04-03 04:42:03.203341 | orchestrator | 2026-04-03 04:42:03.203353 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-03 04:43:05.471026 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-03 04:43:05.471143 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-03 04:43:05.471182 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-03 04:43:05.471194 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:05.471208 | orchestrator | 2026-04-03 04:43:05.471220 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-03 04:43:16.229410 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:16.229522 | orchestrator | 2026-04-03 04:43:16.229543 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-03 04:43:16.322991 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-03 04:43:16.323073 | orchestrator | 2026-04-03 04:43:16.323084 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-03 04:43:16.323092 | orchestrator | 2026-04-03 04:43:16.323099 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-03 04:43:16.383467 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:43:16.383540 | orchestrator | 2026-04-03 04:43:16.383552 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-03 04:43:16.465124 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-03 04:43:16.465203 | orchestrator | 2026-04-03 04:43:16.465213 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-03 04:43:17.270928 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:17.271028 | orchestrator | 2026-04-03 04:43:17.271046 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-03 04:43:20.513511 | orchestrator | ok: [testbed-manager] 2026-04-03 04:43:20.513578 | orchestrator | 2026-04-03 04:43:20.513585 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-03 04:43:20.594271 | orchestrator | ok: [testbed-manager] => { 2026-04-03 04:43:20.594396 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-03 04:43:20.594413 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-03 04:43:20.594425 | orchestrator | "Checking running containers against expected versions...", 2026-04-03 04:43:20.594437 | orchestrator | "", 2026-04-03 04:43:20.594449 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-03 04:43:20.594460 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-03 04:43:20.594472 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594483 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-03 04:43:20.594494 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594505 | orchestrator | "", 2026-04-03 04:43:20.594517 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-03 04:43:20.594555 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-03 04:43:20.594567 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594578 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-03 04:43:20.594589 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594600 | orchestrator | "", 2026-04-03 04:43:20.594611 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-03 04:43:20.594622 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-03 04:43:20.594632 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594643 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-03 04:43:20.594654 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594664 | orchestrator | "", 2026-04-03 04:43:20.594675 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-03 04:43:20.594697 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-03 04:43:20.594708 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594719 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-03 04:43:20.594729 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594740 | orchestrator | "", 2026-04-03 04:43:20.594753 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-03 04:43:20.594764 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-03 04:43:20.594774 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594785 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-03 04:43:20.594796 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594806 | orchestrator | "", 2026-04-03 04:43:20.594817 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-03 04:43:20.594828 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.594839 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594850 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.594860 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594871 | orchestrator | "", 2026-04-03 04:43:20.594882 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-03 04:43:20.594893 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-03 04:43:20.594904 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594915 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-03 04:43:20.594926 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.594937 | orchestrator | "", 2026-04-03 04:43:20.594947 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-03 04:43:20.594958 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-03 04:43:20.594969 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.594979 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-03 04:43:20.594990 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595001 | orchestrator | "", 2026-04-03 04:43:20.595012 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-03 04:43:20.595023 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-03 04:43:20.595033 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595044 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-03 04:43:20.595055 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595066 | orchestrator | "", 2026-04-03 04:43:20.595076 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-03 04:43:20.595087 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-03 04:43:20.595098 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595109 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-03 04:43:20.595119 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595130 | orchestrator | "", 2026-04-03 04:43:20.595141 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-03 04:43:20.595159 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595170 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595181 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595192 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595202 | orchestrator | "", 2026-04-03 04:43:20.595213 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-03 04:43:20.595224 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595235 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595245 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595256 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595267 | orchestrator | "", 2026-04-03 04:43:20.595278 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-03 04:43:20.595289 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595300 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595311 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595321 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595368 | orchestrator | "", 2026-04-03 04:43:20.595380 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-03 04:43:20.595391 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595402 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595413 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595440 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595451 | orchestrator | "", 2026-04-03 04:43:20.595462 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-03 04:43:20.595473 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595491 | orchestrator | " Enabled: true", 2026-04-03 04:43:20.595502 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-03 04:43:20.595513 | orchestrator | " Status: ✅ MATCH", 2026-04-03 04:43:20.595524 | orchestrator | "", 2026-04-03 04:43:20.595535 | orchestrator | "=== Summary ===", 2026-04-03 04:43:20.595545 | orchestrator | "Errors (version mismatches): 0", 2026-04-03 04:43:20.595556 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-03 04:43:20.595567 | orchestrator | "", 2026-04-03 04:43:20.595578 | orchestrator | "✅ All running containers match expected versions!" 2026-04-03 04:43:20.595589 | orchestrator | ] 2026-04-03 04:43:20.595600 | orchestrator | } 2026-04-03 04:43:20.595611 | orchestrator | 2026-04-03 04:43:20.595622 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-03 04:43:20.650539 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:43:20.650639 | orchestrator | 2026-04-03 04:43:20.650656 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:43:20.650669 | orchestrator | testbed-manager : ok=70 changed=37 unreachable=0 failed=0 skipped=12 rescued=0 ignored=0 2026-04-03 04:43:20.650681 | orchestrator | 2026-04-03 04:43:20.767927 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 04:43:20.768016 | orchestrator | + deactivate 2026-04-03 04:43:20.768030 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-03 04:43:20.768043 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 04:43:20.768054 | orchestrator | + export PATH 2026-04-03 04:43:20.768065 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-03 04:43:20.768077 | orchestrator | + '[' -n '' ']' 2026-04-03 04:43:20.768088 | orchestrator | + hash -r 2026-04-03 04:43:20.768099 | orchestrator | + '[' -n '' ']' 2026-04-03 04:43:20.768110 | orchestrator | + unset VIRTUAL_ENV 2026-04-03 04:43:20.768121 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-03 04:43:20.768132 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-03 04:43:20.768143 | orchestrator | + unset -f deactivate 2026-04-03 04:43:20.768155 | orchestrator | + cp /home/dragon/.ssh/id_rsa.pub /opt/ansible/secrets/id_rsa.operator.pub 2026-04-03 04:43:20.773272 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 04:43:20.773313 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-03 04:43:20.773396 | orchestrator | + local max_attempts=60 2026-04-03 04:43:20.773409 | orchestrator | + local name=ceph-ansible 2026-04-03 04:43:20.773421 | orchestrator | + local attempt_num=1 2026-04-03 04:43:20.773843 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 04:43:20.806257 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 04:43:20.806318 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-03 04:43:20.806330 | orchestrator | + local max_attempts=60 2026-04-03 04:43:20.806374 | orchestrator | + local name=kolla-ansible 2026-04-03 04:43:20.806386 | orchestrator | + local attempt_num=1 2026-04-03 04:43:20.807433 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-03 04:43:20.843487 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 04:43:20.843543 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-03 04:43:20.843555 | orchestrator | + local max_attempts=60 2026-04-03 04:43:20.843566 | orchestrator | + local name=osism-ansible 2026-04-03 04:43:20.843577 | orchestrator | + local attempt_num=1 2026-04-03 04:43:20.844462 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-03 04:43:20.871729 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 04:43:20.871780 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 04:43:20.871795 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-03 04:43:21.595628 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-03 04:43:21.773057 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-03 04:43:21.773151 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" ceph-ansible 2 minutes ago Up About a minute (healthy) 2026-04-03 04:43:21.773166 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" kolla-ansible 2 minutes ago Up About a minute (healthy) 2026-04-03 04:43:21.773177 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" api 2 minutes ago Up 2 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-03 04:43:21.773189 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 2 minutes ago Up 2 minutes (healthy) 8000/tcp 2026-04-03 04:43:21.773220 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" beat 2 minutes ago Up 2 minutes (healthy) 2026-04-03 04:43:21.773231 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" flower 2 minutes ago Up 2 minutes (healthy) 2026-04-03 04:43:21.773240 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" inventory_reconciler 2 minutes ago Up About a minute (healthy) 2026-04-03 04:43:21.773250 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" listener 2 minutes ago Up 2 minutes (healthy) 2026-04-03 04:43:21.773260 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 2 minutes ago Up 2 minutes (healthy) 3306/tcp 2026-04-03 04:43:21.773269 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" openstack 2 minutes ago Up 2 minutes (healthy) 2026-04-03 04:43:21.773279 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 2 minutes ago Up 2 minutes (healthy) 6379/tcp 2026-04-03 04:43:21.773289 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" osism-ansible 2 minutes ago Up About a minute (healthy) 2026-04-03 04:43:21.773318 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" frontend 2 minutes ago Up 2 minutes 192.168.16.5:3000->3000/tcp 2026-04-03 04:43:21.773329 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" osism-kubernetes 2 minutes ago Up About a minute (healthy) 2026-04-03 04:43:21.773407 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" osismclient 2 minutes ago Up 2 minutes (healthy) 2026-04-03 04:43:21.779209 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-03 04:43:21.830232 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 04:43:21.830320 | orchestrator | + sed -i s/community.general.yaml/osism.commons.still_alive/ /opt/configuration/environments/ansible.cfg 2026-04-03 04:43:21.835162 | orchestrator | + osism apply resolvconf -l testbed-manager 2026-04-03 04:43:34.176916 | orchestrator | 2026-04-03 04:43:34 | INFO  | Task 71d4b379-c690-4ba6-87c5-2a9dda7a4a75 (resolvconf) was prepared for execution. 2026-04-03 04:43:34.177032 | orchestrator | 2026-04-03 04:43:34 | INFO  | It takes a moment until task 71d4b379-c690-4ba6-87c5-2a9dda7a4a75 (resolvconf) has been started and output is visible here. 2026-04-03 04:43:49.629902 | orchestrator | 2026-04-03 04:43:49.630124 | orchestrator | PLAY [Apply role resolvconf] *************************************************** 2026-04-03 04:43:49.630159 | orchestrator | 2026-04-03 04:43:49.630173 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:43:49.630185 | orchestrator | Friday 03 April 2026 04:43:38 +0000 (0:00:00.142) 0:00:00.142 ********** 2026-04-03 04:43:49.630196 | orchestrator | ok: [testbed-manager] 2026-04-03 04:43:49.630208 | orchestrator | 2026-04-03 04:43:49.630220 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-03 04:43:49.630231 | orchestrator | Friday 03 April 2026 04:43:43 +0000 (0:00:04.936) 0:00:05.078 ********** 2026-04-03 04:43:49.630243 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:43:49.630255 | orchestrator | 2026-04-03 04:43:49.630266 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-03 04:43:49.630277 | orchestrator | Friday 03 April 2026 04:43:43 +0000 (0:00:00.067) 0:00:05.145 ********** 2026-04-03 04:43:49.630288 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager 2026-04-03 04:43:49.630300 | orchestrator | 2026-04-03 04:43:49.630314 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-03 04:43:49.630332 | orchestrator | Friday 03 April 2026 04:43:43 +0000 (0:00:00.084) 0:00:05.230 ********** 2026-04-03 04:43:49.630373 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 04:43:49.630393 | orchestrator | 2026-04-03 04:43:49.630405 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-03 04:43:49.630419 | orchestrator | Friday 03 April 2026 04:43:43 +0000 (0:00:00.081) 0:00:05.312 ********** 2026-04-03 04:43:49.630432 | orchestrator | ok: [testbed-manager] 2026-04-03 04:43:49.630478 | orchestrator | 2026-04-03 04:43:49.630499 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-03 04:43:49.630513 | orchestrator | Friday 03 April 2026 04:43:44 +0000 (0:00:01.190) 0:00:06.502 ********** 2026-04-03 04:43:49.630530 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:43:49.630548 | orchestrator | 2026-04-03 04:43:49.630566 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-03 04:43:49.630586 | orchestrator | Friday 03 April 2026 04:43:44 +0000 (0:00:00.054) 0:00:06.557 ********** 2026-04-03 04:43:49.630634 | orchestrator | ok: [testbed-manager] 2026-04-03 04:43:49.630648 | orchestrator | 2026-04-03 04:43:49.630662 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-03 04:43:49.630675 | orchestrator | Friday 03 April 2026 04:43:45 +0000 (0:00:00.515) 0:00:07.072 ********** 2026-04-03 04:43:49.630687 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:43:49.630700 | orchestrator | 2026-04-03 04:43:49.630712 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-03 04:43:49.630726 | orchestrator | Friday 03 April 2026 04:43:45 +0000 (0:00:00.074) 0:00:07.147 ********** 2026-04-03 04:43:49.630739 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:49.630751 | orchestrator | 2026-04-03 04:43:49.630764 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-03 04:43:49.630777 | orchestrator | Friday 03 April 2026 04:43:45 +0000 (0:00:00.567) 0:00:07.714 ********** 2026-04-03 04:43:49.630787 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:49.630798 | orchestrator | 2026-04-03 04:43:49.630809 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-03 04:43:49.630820 | orchestrator | Friday 03 April 2026 04:43:47 +0000 (0:00:01.220) 0:00:08.935 ********** 2026-04-03 04:43:49.630830 | orchestrator | ok: [testbed-manager] 2026-04-03 04:43:49.630841 | orchestrator | 2026-04-03 04:43:49.630852 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-03 04:43:49.630863 | orchestrator | Friday 03 April 2026 04:43:48 +0000 (0:00:01.064) 0:00:09.999 ********** 2026-04-03 04:43:49.630874 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager 2026-04-03 04:43:49.630885 | orchestrator | 2026-04-03 04:43:49.630895 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-03 04:43:49.630906 | orchestrator | Friday 03 April 2026 04:43:48 +0000 (0:00:00.079) 0:00:10.079 ********** 2026-04-03 04:43:49.630917 | orchestrator | changed: [testbed-manager] 2026-04-03 04:43:49.630927 | orchestrator | 2026-04-03 04:43:49.630938 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:43:49.630950 | orchestrator | testbed-manager : ok=10  changed=3  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 04:43:49.630961 | orchestrator | 2026-04-03 04:43:49.630971 | orchestrator | 2026-04-03 04:43:49.630982 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:43:49.630992 | orchestrator | Friday 03 April 2026 04:43:49 +0000 (0:00:01.139) 0:00:11.219 ********** 2026-04-03 04:43:49.631003 | orchestrator | =============================================================================== 2026-04-03 04:43:49.631014 | orchestrator | Gathering Facts --------------------------------------------------------- 4.94s 2026-04-03 04:43:49.631024 | orchestrator | osism.commons.resolvconf : Copy configuration files --------------------- 1.22s 2026-04-03 04:43:49.631035 | orchestrator | osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf --- 1.19s 2026-04-03 04:43:49.631045 | orchestrator | osism.commons.resolvconf : Restart systemd-resolved service ------------- 1.14s 2026-04-03 04:43:49.631056 | orchestrator | osism.commons.resolvconf : Start/enable systemd-resolved service -------- 1.06s 2026-04-03 04:43:49.631067 | orchestrator | osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf --- 0.57s 2026-04-03 04:43:49.631098 | orchestrator | osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf ----- 0.52s 2026-04-03 04:43:49.631125 | orchestrator | osism.commons.resolvconf : Include resolvconf tasks --------------------- 0.08s 2026-04-03 04:43:49.631136 | orchestrator | osism.commons.resolvconf : Include distribution specific installation tasks --- 0.08s 2026-04-03 04:43:49.631146 | orchestrator | osism.commons.resolvconf : Include distribution specific configuration tasks --- 0.08s 2026-04-03 04:43:49.631157 | orchestrator | osism.commons.resolvconf : Archive existing file /etc/resolv.conf ------- 0.07s 2026-04-03 04:43:49.631168 | orchestrator | osism.commons.resolvconf : Check minimum and maximum number of name servers --- 0.07s 2026-04-03 04:43:49.631186 | orchestrator | osism.commons.resolvconf : Install package systemd-resolved ------------- 0.05s 2026-04-03 04:43:49.929072 | orchestrator | + osism apply sshconfig 2026-04-03 04:44:01.997190 | orchestrator | 2026-04-03 04:44:01 | INFO  | Task ad54f6b2-94c7-4c03-b85c-9cd1d18a7425 (sshconfig) was prepared for execution. 2026-04-03 04:44:01.997334 | orchestrator | 2026-04-03 04:44:01 | INFO  | It takes a moment until task ad54f6b2-94c7-4c03-b85c-9cd1d18a7425 (sshconfig) has been started and output is visible here. 2026-04-03 04:44:14.104399 | orchestrator | 2026-04-03 04:44:14.104594 | orchestrator | PLAY [Apply role sshconfig] **************************************************** 2026-04-03 04:44:14.104613 | orchestrator | 2026-04-03 04:44:14.104655 | orchestrator | TASK [osism.commons.sshconfig : Get home directory of operator user] *********** 2026-04-03 04:44:14.104668 | orchestrator | Friday 03 April 2026 04:44:06 +0000 (0:00:00.159) 0:00:00.159 ********** 2026-04-03 04:44:14.104680 | orchestrator | ok: [testbed-manager] 2026-04-03 04:44:14.104693 | orchestrator | 2026-04-03 04:44:14.104704 | orchestrator | TASK [osism.commons.sshconfig : Ensure .ssh/config.d exist] ******************** 2026-04-03 04:44:14.104715 | orchestrator | Friday 03 April 2026 04:44:06 +0000 (0:00:00.563) 0:00:00.723 ********** 2026-04-03 04:44:14.104726 | orchestrator | changed: [testbed-manager] 2026-04-03 04:44:14.104739 | orchestrator | 2026-04-03 04:44:14.104750 | orchestrator | TASK [osism.commons.sshconfig : Ensure config for each host exist] ************* 2026-04-03 04:44:14.104761 | orchestrator | Friday 03 April 2026 04:44:07 +0000 (0:00:00.536) 0:00:01.260 ********** 2026-04-03 04:44:14.104772 | orchestrator | changed: [testbed-manager] => (item=testbed-manager) 2026-04-03 04:44:14.104783 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0) 2026-04-03 04:44:14.104795 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1) 2026-04-03 04:44:14.104805 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2) 2026-04-03 04:44:14.104816 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3) 2026-04-03 04:44:14.104827 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4) 2026-04-03 04:44:14.104838 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5) 2026-04-03 04:44:14.104848 | orchestrator | 2026-04-03 04:44:14.104859 | orchestrator | TASK [osism.commons.sshconfig : Add extra config] ****************************** 2026-04-03 04:44:14.104870 | orchestrator | Friday 03 April 2026 04:44:13 +0000 (0:00:05.833) 0:00:07.093 ********** 2026-04-03 04:44:14.104881 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:44:14.104891 | orchestrator | 2026-04-03 04:44:14.104902 | orchestrator | TASK [osism.commons.sshconfig : Assemble ssh config] *************************** 2026-04-03 04:44:14.104915 | orchestrator | Friday 03 April 2026 04:44:13 +0000 (0:00:00.070) 0:00:07.164 ********** 2026-04-03 04:44:14.104927 | orchestrator | changed: [testbed-manager] 2026-04-03 04:44:14.104940 | orchestrator | 2026-04-03 04:44:14.104952 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:44:14.104967 | orchestrator | testbed-manager : ok=4  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 04:44:14.104979 | orchestrator | 2026-04-03 04:44:14.104992 | orchestrator | 2026-04-03 04:44:14.105005 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:44:14.105019 | orchestrator | Friday 03 April 2026 04:44:13 +0000 (0:00:00.577) 0:00:07.741 ********** 2026-04-03 04:44:14.105032 | orchestrator | =============================================================================== 2026-04-03 04:44:14.105059 | orchestrator | osism.commons.sshconfig : Ensure config for each host exist ------------- 5.83s 2026-04-03 04:44:14.105082 | orchestrator | osism.commons.sshconfig : Assemble ssh config --------------------------- 0.58s 2026-04-03 04:44:14.105095 | orchestrator | osism.commons.sshconfig : Get home directory of operator user ----------- 0.56s 2026-04-03 04:44:14.105108 | orchestrator | osism.commons.sshconfig : Ensure .ssh/config.d exist -------------------- 0.54s 2026-04-03 04:44:14.105145 | orchestrator | osism.commons.sshconfig : Add extra config ------------------------------ 0.07s 2026-04-03 04:44:14.409392 | orchestrator | + osism apply known-hosts 2026-04-03 04:44:26.555939 | orchestrator | 2026-04-03 04:44:26 | INFO  | Task c8bc072c-1c4f-4af2-a786-1222d20da42b (known-hosts) was prepared for execution. 2026-04-03 04:44:26.556088 | orchestrator | 2026-04-03 04:44:26 | INFO  | It takes a moment until task c8bc072c-1c4f-4af2-a786-1222d20da42b (known-hosts) has been started and output is visible here. 2026-04-03 04:44:43.767456 | orchestrator | 2026-04-03 04:44:43.767575 | orchestrator | PLAY [Apply role known_hosts] ************************************************** 2026-04-03 04:44:43.767592 | orchestrator | 2026-04-03 04:44:43.767605 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname] *** 2026-04-03 04:44:43.767617 | orchestrator | Friday 03 April 2026 04:44:30 +0000 (0:00:00.165) 0:00:00.165 ********** 2026-04-03 04:44:43.767678 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-03 04:44:43.767691 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-03 04:44:43.767702 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-03 04:44:43.767714 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-03 04:44:43.767725 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-03 04:44:43.767736 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-03 04:44:43.767747 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-03 04:44:43.767757 | orchestrator | 2026-04-03 04:44:43.767769 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname] *** 2026-04-03 04:44:43.767781 | orchestrator | Friday 03 April 2026 04:44:36 +0000 (0:00:06.210) 0:00:06.376 ********** 2026-04-03 04:44:43.767794 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-03 04:44:43.767807 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-03 04:44:43.767818 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-03 04:44:43.767829 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-03 04:44:43.767840 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-03 04:44:43.767863 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-03 04:44:43.767875 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-03 04:44:43.767886 | orchestrator | 2026-04-03 04:44:43.767897 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.767908 | orchestrator | Friday 03 April 2026 04:44:37 +0000 (0:00:00.172) 0:00:06.548 ********** 2026-04-03 04:44:43.767919 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHszxZV5Sx/CPXxNvJMVjq9uD18x0lvLalt9Hi8++2A0) 2026-04-03 04:44:43.767940 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDn3n0kDZk/xH3jb/hs9su/A5+rjhLGBEFxT+3HaWitBnuHGfr6aUpd0Y3fKQ03R7MgGVfzwAJaNcHnaoObgDn8ruzmQGdpryHSL3o1E8gk8AaTWA7X5zVoh3+HnDTCv9LNpz3SZH/AAVBGiNR6MAlYwBFpDsmpoPyA4Y8RkeQ3M6r5squ+9Txbw4mf4Z9kVAZuVJKE7DqZIQeIKjLzS6FLcLfz176dH1iD70j6gfytH1kfyRWVeZQTfc85ii5XhG6FIpEYKCzlSnZzwQU4VevHIH/hiZznEPFneprj7lZzFA/Qw+LLDcV8B8dK73jPOknXhWG5JvqRmMn9g5CgkmWfeLjyUTqR3xc06aFybdvtV6lcNj3M7QbGw94jPLcxN+gfOuCp7RVZIhcv4cLR+iX7rFisR3YC8BFnGtZSGKH1K2PutaD0ArPZ00MShNXNw+dTDxXMjSj9wfnXaZ4P6XdFvKo2xC3ZHcvjWlfdZ+O9YmpYVXQKvLrWqjypl6aKn0=) 2026-04-03 04:44:43.767981 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1G7F3kueWV+C1ZhE9KsSw9V0aTeYOZ0Tox3fhz7idheX1HFihYA2WulFl3PD4sLAZ14dyNeJxz45GtAf5suxI=) 2026-04-03 04:44:43.767997 | orchestrator | 2026-04-03 04:44:43.768009 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.768022 | orchestrator | Friday 03 April 2026 04:44:38 +0000 (0:00:01.229) 0:00:07.777 ********** 2026-04-03 04:44:43.768035 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHkPDz/yyA4Rb8+joyRstsP96X6C6KOv+nuy6lPpkVtMnwIqqeeCWzz5k/LpwdshVSA8kczQDK0X1/y8Dt8+byA=) 2026-04-03 04:44:43.768077 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCde7ICUTGWk+5mcDILyke14tp9k5OgTHrSWWlFtB/xUXOSELifVaZSnOgc1czn1l3zgdpwKjAmtXgmsDxCBMijrWqa17Zubp5fftOB5Sy6E4XxqfzytkHVK7SGc0Iyx7z66LtuLNKXgcCRubQ4rJ8lgjjHuOw7KXx8LkFWuvWAR+xft1awU0DMY/SUOYLa5dSOwUShxOT49jU1vG3DBxQ/kQX7Fv5dHmk4UJdwkqHJivBzoQI8nb2eshIZ/AT34iRrgAzfxxlV3pCk2iL95+lAO2qzgSGMzb0PTjsBVH5j74CdrDpbDf8IALQuSHBV4K0SSGMvk/fFRcN1z05+yy/XwrRSRK1qYtvFCqgphYSULX78av+9qF0UBXBk+hrEncdgjAovm3nr72fxu4ehmnuZrySa0kN3p+apPQ6qFewXPUUeLSuX1XEZ3E+Ry+AgF3R02Ys0KU2uIWd+07OD//79UTCqiY2dqO9RAP4L1u5PY/DWHoWf/FLyS+YpA3uvjJs=) 2026-04-03 04:44:43.768092 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIApYljJPANp2wQkUWdZFaQVEATwkb1dbgqFQe+JQFHEm) 2026-04-03 04:44:43.768106 | orchestrator | 2026-04-03 04:44:43.768119 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.768132 | orchestrator | Friday 03 April 2026 04:44:39 +0000 (0:00:01.104) 0:00:08.882 ********** 2026-04-03 04:44:43.768145 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCzya/LPEZXvQmunqAhjVbL87BiYCSovn6dHNZIq6KUMJZts3TAQogUCp9GK1n1rr7isRFheMWGCdoKSso1nTKM=) 2026-04-03 04:44:43.768159 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPqwavn8YSZME0F+bXqrf9oEU1cKEdEAz3ixz0yBq1U5) 2026-04-03 04:44:43.768173 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeLBD5d7TuJ0SwF17d6OKD3yA88M1OEgjWuUYrw9r/AceQPB1MaTfmUzUUvma08GYsVgl2DR8yIC3cr1rZJO50oGmlK8Qj4NtOBzkJ9Us+43yhUokb67fgjBIMu8JnKUlnBMHAlseK27gMq/HRhjBivhP8F2/NDDqKIaRC55qW0wS7eJGAKQsA/ajIvvlSl4sw4Ox2GW0K4vSCeEDb54Qfm00wuCeVBXitfMgR3dr51UdwpUnIRywo/9sX6W3ZxrsJBD8YItUSj+kngc+piV9JeHpZ5aXexmD7rYZv/h1J9JbK6YQCLCWZxTLUQ8EhR3v9umyvQC7PzAJQ1xGuwYITTyKGsfDYOzur+alBKzlCWW1Ep3+Sri43y6P3HIHOgWSeAueb12kYWcfe24p3LDsKFZsHY7+t65ANpUz/4VrYfwVWE6kVBIlIc88PhoVt5rm1E4spcV91QoY0MUsPLivxINSnGsQK3D1OesjVIX9mUBBKO29rshsCSvuKuWNhiNE=) 2026-04-03 04:44:43.768187 | orchestrator | 2026-04-03 04:44:43.768200 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.768214 | orchestrator | Friday 03 April 2026 04:44:40 +0000 (0:00:01.072) 0:00:09.954 ********** 2026-04-03 04:44:43.768226 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfAOWt293SXKmGOE7uw1nheLMZVsvGuOJ4IdlG4W4+06jKu0hCdVE4mC9/nnAfAr7n4Vj2iEjeb7xsRl4WDYNGPdBg4r3J1cgB8Zk6zaFdBzcmUU7gPucVS0HEBJv8qfPIx5p6kAX0nF+mEkK+ou67Y1n6aCpl+fbl+gSB49r7HiG+IE3ZTc/Gw2bETxh2FkyK4sI6TqMq/s/0dQ4Y3ABhUMCVQlH9ca6p210B0kUQlpbsvUGzlzt4s3YvwL1H4zEnQ9pS7HYhNhTCKi9xoyULJS+5vX1sCTw7mzOsckHBDv8+F2d6ZjchKfHphnqYnuKlNnyah4s7bO8trL9fPhRsaIujOMUMz22hLoG8JNTxmqpYbh73VIhFDmwjVTKVi7WgQqBgP6+16e0sXBygC9FTYRCWlwiJhm+seFcYgZOgxO8udjfxkmtO0SirmTUmdXe3wEkhvAL8UQkN5yP/oKKBwM5TycRoAnS9ujYyXP73MzZI25bib93lLzaFlxIrQ/U=) 2026-04-03 04:44:43.768246 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5hZRIUoIjiwNh/pJgOMY90oSDteeUyXo/OjWQF721T7wHbdYEfF3l/BooHXJmH/YTjC9lwK8REIAILP/iFigA=) 2026-04-03 04:44:43.768257 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICIRW3SlmzX0O6dfqm8p1OXniNeCk/1tpM3iIyH8ftAT) 2026-04-03 04:44:43.768268 | orchestrator | 2026-04-03 04:44:43.768279 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.768290 | orchestrator | Friday 03 April 2026 04:44:41 +0000 (0:00:01.109) 0:00:11.064 ********** 2026-04-03 04:44:43.768376 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFMfP33rqrrWlA3OfVTRQ+2vi63Yc2+yD4x6FrsYwkZWoSdaNhc25GOx0DsFBzql+6wq0vyciPvO1DezP4UjyolifwIjRzv2DOhyJ7fSebqg2211qUpHyrSv8Y9lBlZiwAb/+kdvzv95Kb/CGRX3jYsb8KwlhneYn7Ladv+jWb2HZpSlDNVwW+uQVT2BBFS6cH9kwhGdQ4uem/tP3oL5QzF3Ap0YwAXmRYUJ46mkSW8G1Y6khidLPD7+F+DdWA6zgzlP9HJpNVC1EVev0QCIl+apig3MY6wSoSEvEcHc8WhLJoVFM2jWLltYX45eELXLtuNQCAY9nSi8zpSKprF2WJZv4szsc7oAbsM2PBBALCF2lFVXviHn3G3j7lQw0EYtnfuziUFl0mjZDFblaHgU6Hze+5UmuBDPEXwNT3+6zBE8vaUOEq34yYRVVG6FNnixmhjFCm68EcKtdwPX+ls1NJ5inV2S09lEKsCdpKL1TJka37eUgHb1Xy7sWLhvJdLqc=) 2026-04-03 04:44:43.768388 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjZVPjGVQkhtz3g9MqQ+QKXVhaIrTTxWuNiKlX4EJY3B51Bq6a2DvGxhWSFZtC7ngauK3wjHaO2C0q4b3rSF6A=) 2026-04-03 04:44:43.768399 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILqEu4iuRHHkXqEr4AKN2wHux2wvzB46cZa+57sDik84) 2026-04-03 04:44:43.768410 | orchestrator | 2026-04-03 04:44:43.768421 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:43.768432 | orchestrator | Friday 03 April 2026 04:44:42 +0000 (0:00:01.089) 0:00:12.153 ********** 2026-04-03 04:44:43.768453 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCOVA56flc0P+CqpQpgSagip24LyE4bt9ihMkH4SW3t64brAO2p5V9sftHyxFIPkyILX6vnYDcXviTFLVoKK35sxOM0NDzpCsFBpiLSkcLmzxmpvJqbz0pkdB+aazfZKsTFkQ2/BLZq5+E4k5Q2UnwdHZ4FVSwgBPK5NwHGvoDPf0RyUktyVSPi4gTH403Ay6mnbjf7YFqMRmtdrUmGloXqKGqn6Fp6oD+fyRUE8PzI5kRh8IQRcyHbhk7ykWB751S5ciu6ZH8qnZ6GSpuca0v3/i+MSQXSrwZd5RGJNe/eAOSHHKvCvNJvj8Ksn7Y7pvv59WdooY/O4FP8xLIZ6Yv8U8qmP5WugWWYSDJdVCnz3S0e9zar/2+s3Dw5F4h6Nf0sgqGdt/cz+AHp5qtx37RfR6bHd131VizSLOx9zeeGkcBAHb8iOhMpIl7OEizJe3xpYXP1Nj0ddQVJjlyCG+FHcO+lcyqAld5qpT2fEJ6XmkuiyqAnNvHv6mkWelSenms=) 2026-04-03 04:44:55.062192 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBftU6gBDE0OfAtSKcJCnzRc+TphkDgexUWjnbqLx2DwMkCory+a38C5QVkRzlxRVOPPBFE2OVg9OtOdCT6WJjA=) 2026-04-03 04:44:55.062317 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFn5DIspk6d/hanbyj8Hqa4nSl6C3jfVNOHdKi7wz62) 2026-04-03 04:44:55.062335 | orchestrator | 2026-04-03 04:44:55.062348 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:55.062361 | orchestrator | Friday 03 April 2026 04:44:43 +0000 (0:00:01.067) 0:00:13.221 ********** 2026-04-03 04:44:55.062375 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCJP1WIROjwX3qTDVmb/mIh3x7hhdFnWP5VPg+5vPnH0j6mXvmrmLfI6PGa11/xs20RXoHbad1hXglDRbvoZjsWS3su71VWW0NDOSyIgquyHyrVbeMHaZbdRXkgyymh4VspO8FjzRafl43TB0ZeUhFdLtuAZajiQMQ23kHaNB4LwX13vNOUAEPQjZ778uWH32VYz+A5AdVZX7XnRJtrv7XUIBM3BUBJ81ZEfQdh5fl5mClKs+Q18zroaMJOQezRMq05KaynAjVbK8QDck9OjHkt0XgFXxbY3TD+fYtmiip5cXkmfWDd89uooSZP3gl3MhPt64hLFEnApyO/i6DSVBlkHldb8/pRoK+pF6+WxK0WNEJpLRowNzrAc5ArRJu30FYIcn6IFce/PSYIu1JNHbqlu1Gv2w7T+38aPqcamP+dAnCMKzjC4KjxRcj+OHXvheSykuiZn1X4F6K4vdKQ4JHZzeUFuW+gtIpYC8/Gx4YfejCLJEk79gJB1c6vJ9JfOwE=) 2026-04-03 04:44:55.062389 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcpb3Nl/zS0/f6XO8M+wLIckz3g2m4vo7gMCwB0awSXCmLEjRcoRFFlaDL8qGkLXZ5QDJahjeydSzYmvF+PdsM=) 2026-04-03 04:44:55.062427 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPsqu3UvU9vzQmOq6xEOaQa0clP8S6XrdcRrYYFLexYs) 2026-04-03 04:44:55.062439 | orchestrator | 2026-04-03 04:44:55.062450 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host] *** 2026-04-03 04:44:55.062462 | orchestrator | Friday 03 April 2026 04:44:44 +0000 (0:00:01.194) 0:00:14.416 ********** 2026-04-03 04:44:55.062474 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-03 04:44:55.062485 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-03 04:44:55.062496 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-03 04:44:55.062506 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-03 04:44:55.062517 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-03 04:44:55.062528 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-03 04:44:55.062538 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-03 04:44:55.062549 | orchestrator | 2026-04-03 04:44:55.062560 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host] *** 2026-04-03 04:44:55.062572 | orchestrator | Friday 03 April 2026 04:44:50 +0000 (0:00:05.382) 0:00:19.798 ********** 2026-04-03 04:44:55.062584 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-03 04:44:55.062597 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-03 04:44:55.062608 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-03 04:44:55.062618 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-03 04:44:55.062629 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-03 04:44:55.062640 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-03 04:44:55.062651 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-03 04:44:55.062693 | orchestrator | 2026-04-03 04:44:55.062704 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:55.062716 | orchestrator | Friday 03 April 2026 04:44:50 +0000 (0:00:00.186) 0:00:19.984 ********** 2026-04-03 04:44:55.062762 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDn3n0kDZk/xH3jb/hs9su/A5+rjhLGBEFxT+3HaWitBnuHGfr6aUpd0Y3fKQ03R7MgGVfzwAJaNcHnaoObgDn8ruzmQGdpryHSL3o1E8gk8AaTWA7X5zVoh3+HnDTCv9LNpz3SZH/AAVBGiNR6MAlYwBFpDsmpoPyA4Y8RkeQ3M6r5squ+9Txbw4mf4Z9kVAZuVJKE7DqZIQeIKjLzS6FLcLfz176dH1iD70j6gfytH1kfyRWVeZQTfc85ii5XhG6FIpEYKCzlSnZzwQU4VevHIH/hiZznEPFneprj7lZzFA/Qw+LLDcV8B8dK73jPOknXhWG5JvqRmMn9g5CgkmWfeLjyUTqR3xc06aFybdvtV6lcNj3M7QbGw94jPLcxN+gfOuCp7RVZIhcv4cLR+iX7rFisR3YC8BFnGtZSGKH1K2PutaD0ArPZ00MShNXNw+dTDxXMjSj9wfnXaZ4P6XdFvKo2xC3ZHcvjWlfdZ+O9YmpYVXQKvLrWqjypl6aKn0=) 2026-04-03 04:44:55.062776 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1G7F3kueWV+C1ZhE9KsSw9V0aTeYOZ0Tox3fhz7idheX1HFihYA2WulFl3PD4sLAZ14dyNeJxz45GtAf5suxI=) 2026-04-03 04:44:55.062806 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHszxZV5Sx/CPXxNvJMVjq9uD18x0lvLalt9Hi8++2A0) 2026-04-03 04:44:55.062818 | orchestrator | 2026-04-03 04:44:55.062830 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:55.062841 | orchestrator | Friday 03 April 2026 04:44:51 +0000 (0:00:01.131) 0:00:21.116 ********** 2026-04-03 04:44:55.062857 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHkPDz/yyA4Rb8+joyRstsP96X6C6KOv+nuy6lPpkVtMnwIqqeeCWzz5k/LpwdshVSA8kczQDK0X1/y8Dt8+byA=) 2026-04-03 04:44:55.062869 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCde7ICUTGWk+5mcDILyke14tp9k5OgTHrSWWlFtB/xUXOSELifVaZSnOgc1czn1l3zgdpwKjAmtXgmsDxCBMijrWqa17Zubp5fftOB5Sy6E4XxqfzytkHVK7SGc0Iyx7z66LtuLNKXgcCRubQ4rJ8lgjjHuOw7KXx8LkFWuvWAR+xft1awU0DMY/SUOYLa5dSOwUShxOT49jU1vG3DBxQ/kQX7Fv5dHmk4UJdwkqHJivBzoQI8nb2eshIZ/AT34iRrgAzfxxlV3pCk2iL95+lAO2qzgSGMzb0PTjsBVH5j74CdrDpbDf8IALQuSHBV4K0SSGMvk/fFRcN1z05+yy/XwrRSRK1qYtvFCqgphYSULX78av+9qF0UBXBk+hrEncdgjAovm3nr72fxu4ehmnuZrySa0kN3p+apPQ6qFewXPUUeLSuX1XEZ3E+Ry+AgF3R02Ys0KU2uIWd+07OD//79UTCqiY2dqO9RAP4L1u5PY/DWHoWf/FLyS+YpA3uvjJs=) 2026-04-03 04:44:55.062881 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIApYljJPANp2wQkUWdZFaQVEATwkb1dbgqFQe+JQFHEm) 2026-04-03 04:44:55.062892 | orchestrator | 2026-04-03 04:44:55.062903 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:55.062914 | orchestrator | Friday 03 April 2026 04:44:52 +0000 (0:00:01.146) 0:00:22.262 ********** 2026-04-03 04:44:55.062925 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeLBD5d7TuJ0SwF17d6OKD3yA88M1OEgjWuUYrw9r/AceQPB1MaTfmUzUUvma08GYsVgl2DR8yIC3cr1rZJO50oGmlK8Qj4NtOBzkJ9Us+43yhUokb67fgjBIMu8JnKUlnBMHAlseK27gMq/HRhjBivhP8F2/NDDqKIaRC55qW0wS7eJGAKQsA/ajIvvlSl4sw4Ox2GW0K4vSCeEDb54Qfm00wuCeVBXitfMgR3dr51UdwpUnIRywo/9sX6W3ZxrsJBD8YItUSj+kngc+piV9JeHpZ5aXexmD7rYZv/h1J9JbK6YQCLCWZxTLUQ8EhR3v9umyvQC7PzAJQ1xGuwYITTyKGsfDYOzur+alBKzlCWW1Ep3+Sri43y6P3HIHOgWSeAueb12kYWcfe24p3LDsKFZsHY7+t65ANpUz/4VrYfwVWE6kVBIlIc88PhoVt5rm1E4spcV91QoY0MUsPLivxINSnGsQK3D1OesjVIX9mUBBKO29rshsCSvuKuWNhiNE=) 2026-04-03 04:44:55.062937 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCzya/LPEZXvQmunqAhjVbL87BiYCSovn6dHNZIq6KUMJZts3TAQogUCp9GK1n1rr7isRFheMWGCdoKSso1nTKM=) 2026-04-03 04:44:55.062948 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPqwavn8YSZME0F+bXqrf9oEU1cKEdEAz3ixz0yBq1U5) 2026-04-03 04:44:55.062959 | orchestrator | 2026-04-03 04:44:55.062970 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:55.062980 | orchestrator | Friday 03 April 2026 04:44:53 +0000 (0:00:01.124) 0:00:23.387 ********** 2026-04-03 04:44:55.062991 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5hZRIUoIjiwNh/pJgOMY90oSDteeUyXo/OjWQF721T7wHbdYEfF3l/BooHXJmH/YTjC9lwK8REIAILP/iFigA=) 2026-04-03 04:44:55.063003 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfAOWt293SXKmGOE7uw1nheLMZVsvGuOJ4IdlG4W4+06jKu0hCdVE4mC9/nnAfAr7n4Vj2iEjeb7xsRl4WDYNGPdBg4r3J1cgB8Zk6zaFdBzcmUU7gPucVS0HEBJv8qfPIx5p6kAX0nF+mEkK+ou67Y1n6aCpl+fbl+gSB49r7HiG+IE3ZTc/Gw2bETxh2FkyK4sI6TqMq/s/0dQ4Y3ABhUMCVQlH9ca6p210B0kUQlpbsvUGzlzt4s3YvwL1H4zEnQ9pS7HYhNhTCKi9xoyULJS+5vX1sCTw7mzOsckHBDv8+F2d6ZjchKfHphnqYnuKlNnyah4s7bO8trL9fPhRsaIujOMUMz22hLoG8JNTxmqpYbh73VIhFDmwjVTKVi7WgQqBgP6+16e0sXBygC9FTYRCWlwiJhm+seFcYgZOgxO8udjfxkmtO0SirmTUmdXe3wEkhvAL8UQkN5yP/oKKBwM5TycRoAnS9ujYyXP73MzZI25bib93lLzaFlxIrQ/U=) 2026-04-03 04:44:55.063027 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICIRW3SlmzX0O6dfqm8p1OXniNeCk/1tpM3iIyH8ftAT) 2026-04-03 04:44:59.711639 | orchestrator | 2026-04-03 04:44:59.711823 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:59.711842 | orchestrator | Friday 03 April 2026 04:44:55 +0000 (0:00:01.127) 0:00:24.514 ********** 2026-04-03 04:44:59.711855 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILqEu4iuRHHkXqEr4AKN2wHux2wvzB46cZa+57sDik84) 2026-04-03 04:44:59.711872 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFMfP33rqrrWlA3OfVTRQ+2vi63Yc2+yD4x6FrsYwkZWoSdaNhc25GOx0DsFBzql+6wq0vyciPvO1DezP4UjyolifwIjRzv2DOhyJ7fSebqg2211qUpHyrSv8Y9lBlZiwAb/+kdvzv95Kb/CGRX3jYsb8KwlhneYn7Ladv+jWb2HZpSlDNVwW+uQVT2BBFS6cH9kwhGdQ4uem/tP3oL5QzF3Ap0YwAXmRYUJ46mkSW8G1Y6khidLPD7+F+DdWA6zgzlP9HJpNVC1EVev0QCIl+apig3MY6wSoSEvEcHc8WhLJoVFM2jWLltYX45eELXLtuNQCAY9nSi8zpSKprF2WJZv4szsc7oAbsM2PBBALCF2lFVXviHn3G3j7lQw0EYtnfuziUFl0mjZDFblaHgU6Hze+5UmuBDPEXwNT3+6zBE8vaUOEq34yYRVVG6FNnixmhjFCm68EcKtdwPX+ls1NJ5inV2S09lEKsCdpKL1TJka37eUgHb1Xy7sWLhvJdLqc=) 2026-04-03 04:44:59.711887 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjZVPjGVQkhtz3g9MqQ+QKXVhaIrTTxWuNiKlX4EJY3B51Bq6a2DvGxhWSFZtC7ngauK3wjHaO2C0q4b3rSF6A=) 2026-04-03 04:44:59.711900 | orchestrator | 2026-04-03 04:44:59.711912 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:59.711923 | orchestrator | Friday 03 April 2026 04:44:56 +0000 (0:00:01.092) 0:00:25.607 ********** 2026-04-03 04:44:59.711934 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBftU6gBDE0OfAtSKcJCnzRc+TphkDgexUWjnbqLx2DwMkCory+a38C5QVkRzlxRVOPPBFE2OVg9OtOdCT6WJjA=) 2026-04-03 04:44:59.711946 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCOVA56flc0P+CqpQpgSagip24LyE4bt9ihMkH4SW3t64brAO2p5V9sftHyxFIPkyILX6vnYDcXviTFLVoKK35sxOM0NDzpCsFBpiLSkcLmzxmpvJqbz0pkdB+aazfZKsTFkQ2/BLZq5+E4k5Q2UnwdHZ4FVSwgBPK5NwHGvoDPf0RyUktyVSPi4gTH403Ay6mnbjf7YFqMRmtdrUmGloXqKGqn6Fp6oD+fyRUE8PzI5kRh8IQRcyHbhk7ykWB751S5ciu6ZH8qnZ6GSpuca0v3/i+MSQXSrwZd5RGJNe/eAOSHHKvCvNJvj8Ksn7Y7pvv59WdooY/O4FP8xLIZ6Yv8U8qmP5WugWWYSDJdVCnz3S0e9zar/2+s3Dw5F4h6Nf0sgqGdt/cz+AHp5qtx37RfR6bHd131VizSLOx9zeeGkcBAHb8iOhMpIl7OEizJe3xpYXP1Nj0ddQVJjlyCG+FHcO+lcyqAld5qpT2fEJ6XmkuiyqAnNvHv6mkWelSenms=) 2026-04-03 04:44:59.711957 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFn5DIspk6d/hanbyj8Hqa4nSl6C3jfVNOHdKi7wz62) 2026-04-03 04:44:59.711969 | orchestrator | 2026-04-03 04:44:59.711980 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-03 04:44:59.711991 | orchestrator | Friday 03 April 2026 04:44:57 +0000 (0:00:01.108) 0:00:26.715 ********** 2026-04-03 04:44:59.712002 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPsqu3UvU9vzQmOq6xEOaQa0clP8S6XrdcRrYYFLexYs) 2026-04-03 04:44:59.712034 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCJP1WIROjwX3qTDVmb/mIh3x7hhdFnWP5VPg+5vPnH0j6mXvmrmLfI6PGa11/xs20RXoHbad1hXglDRbvoZjsWS3su71VWW0NDOSyIgquyHyrVbeMHaZbdRXkgyymh4VspO8FjzRafl43TB0ZeUhFdLtuAZajiQMQ23kHaNB4LwX13vNOUAEPQjZ778uWH32VYz+A5AdVZX7XnRJtrv7XUIBM3BUBJ81ZEfQdh5fl5mClKs+Q18zroaMJOQezRMq05KaynAjVbK8QDck9OjHkt0XgFXxbY3TD+fYtmiip5cXkmfWDd89uooSZP3gl3MhPt64hLFEnApyO/i6DSVBlkHldb8/pRoK+pF6+WxK0WNEJpLRowNzrAc5ArRJu30FYIcn6IFce/PSYIu1JNHbqlu1Gv2w7T+38aPqcamP+dAnCMKzjC4KjxRcj+OHXvheSykuiZn1X4F6K4vdKQ4JHZzeUFuW+gtIpYC8/Gx4YfejCLJEk79gJB1c6vJ9JfOwE=) 2026-04-03 04:44:59.712047 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcpb3Nl/zS0/f6XO8M+wLIckz3g2m4vo7gMCwB0awSXCmLEjRcoRFFlaDL8qGkLXZ5QDJahjeydSzYmvF+PdsM=) 2026-04-03 04:44:59.712058 | orchestrator | 2026-04-03 04:44:59.712070 | orchestrator | TASK [osism.commons.known_hosts : Write static known_hosts entries] ************ 2026-04-03 04:44:59.712107 | orchestrator | Friday 03 April 2026 04:44:58 +0000 (0:00:01.127) 0:00:27.843 ********** 2026-04-03 04:44:59.712120 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-03 04:44:59.712131 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-03 04:44:59.712142 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-03 04:44:59.712153 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-03 04:44:59.712164 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-03 04:44:59.712175 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-03 04:44:59.712186 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-03 04:44:59.712198 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:44:59.712209 | orchestrator | 2026-04-03 04:44:59.712238 | orchestrator | TASK [osism.commons.known_hosts : Write extra known_hosts entries] ************* 2026-04-03 04:44:59.712250 | orchestrator | Friday 03 April 2026 04:44:58 +0000 (0:00:00.175) 0:00:28.018 ********** 2026-04-03 04:44:59.712261 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:44:59.712272 | orchestrator | 2026-04-03 04:44:59.712283 | orchestrator | TASK [osism.commons.known_hosts : Delete known_hosts entries] ****************** 2026-04-03 04:44:59.712294 | orchestrator | Friday 03 April 2026 04:44:58 +0000 (0:00:00.062) 0:00:28.081 ********** 2026-04-03 04:44:59.712304 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:44:59.712315 | orchestrator | 2026-04-03 04:44:59.712326 | orchestrator | TASK [osism.commons.known_hosts : Set file permissions] ************************ 2026-04-03 04:44:59.712337 | orchestrator | Friday 03 April 2026 04:44:58 +0000 (0:00:00.060) 0:00:28.141 ********** 2026-04-03 04:44:59.712348 | orchestrator | changed: [testbed-manager] 2026-04-03 04:44:59.712359 | orchestrator | 2026-04-03 04:44:59.712370 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:44:59.712381 | orchestrator | testbed-manager : ok=31  changed=15  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 04:44:59.712393 | orchestrator | 2026-04-03 04:44:59.712404 | orchestrator | 2026-04-03 04:44:59.712414 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:44:59.712425 | orchestrator | Friday 03 April 2026 04:44:59 +0000 (0:00:00.809) 0:00:28.951 ********** 2026-04-03 04:44:59.712442 | orchestrator | =============================================================================== 2026-04-03 04:44:59.712453 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname --- 6.21s 2026-04-03 04:44:59.712464 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host --- 5.38s 2026-04-03 04:44:59.712476 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.23s 2026-04-03 04:44:59.712486 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.19s 2026-04-03 04:44:59.712497 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.15s 2026-04-03 04:44:59.712508 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.13s 2026-04-03 04:44:59.712519 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.13s 2026-04-03 04:44:59.712530 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.13s 2026-04-03 04:44:59.712540 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.12s 2026-04-03 04:44:59.712551 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.11s 2026-04-03 04:44:59.712562 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.11s 2026-04-03 04:44:59.712573 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.10s 2026-04-03 04:44:59.712584 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.09s 2026-04-03 04:44:59.712594 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.09s 2026-04-03 04:44:59.712612 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.07s 2026-04-03 04:44:59.712623 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.07s 2026-04-03 04:44:59.712634 | orchestrator | osism.commons.known_hosts : Set file permissions ------------------------ 0.81s 2026-04-03 04:44:59.712645 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host --- 0.19s 2026-04-03 04:44:59.712656 | orchestrator | osism.commons.known_hosts : Write static known_hosts entries ------------ 0.18s 2026-04-03 04:44:59.712667 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname --- 0.17s 2026-04-03 04:45:00.005997 | orchestrator | + osism apply squid 2026-04-03 04:45:12.119668 | orchestrator | 2026-04-03 04:45:12 | INFO  | Task be0f3019-b6e4-4d34-9f1a-c64280367080 (squid) was prepared for execution. 2026-04-03 04:45:12.119826 | orchestrator | 2026-04-03 04:45:12 | INFO  | It takes a moment until task be0f3019-b6e4-4d34-9f1a-c64280367080 (squid) has been started and output is visible here. 2026-04-03 04:47:18.307461 | orchestrator | 2026-04-03 04:47:18.307579 | orchestrator | PLAY [Apply role squid] ******************************************************** 2026-04-03 04:47:18.307597 | orchestrator | 2026-04-03 04:47:18.307609 | orchestrator | TASK [osism.services.squid : Include install tasks] **************************** 2026-04-03 04:47:18.307621 | orchestrator | Friday 03 April 2026 04:45:16 +0000 (0:00:00.162) 0:00:00.162 ********** 2026-04-03 04:47:18.307633 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/squid/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 04:47:18.307645 | orchestrator | 2026-04-03 04:47:18.307656 | orchestrator | TASK [osism.services.squid : Install required packages] ************************ 2026-04-03 04:47:18.307667 | orchestrator | Friday 03 April 2026 04:45:16 +0000 (0:00:00.092) 0:00:00.255 ********** 2026-04-03 04:47:18.307678 | orchestrator | ok: [testbed-manager] 2026-04-03 04:47:18.307691 | orchestrator | 2026-04-03 04:47:18.307702 | orchestrator | TASK [osism.services.squid : Create required directories] ********************** 2026-04-03 04:47:18.307713 | orchestrator | Friday 03 April 2026 04:45:17 +0000 (0:00:01.542) 0:00:01.797 ********** 2026-04-03 04:47:18.307725 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration) 2026-04-03 04:47:18.307736 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration/conf.d) 2026-04-03 04:47:18.307747 | orchestrator | ok: [testbed-manager] => (item=/opt/squid) 2026-04-03 04:47:18.307758 | orchestrator | 2026-04-03 04:47:18.307769 | orchestrator | TASK [osism.services.squid : Copy squid configuration files] ******************* 2026-04-03 04:47:18.307780 | orchestrator | Friday 03 April 2026 04:45:19 +0000 (0:00:01.168) 0:00:02.966 ********** 2026-04-03 04:47:18.307790 | orchestrator | changed: [testbed-manager] => (item=osism.conf) 2026-04-03 04:47:18.307802 | orchestrator | 2026-04-03 04:47:18.307813 | orchestrator | TASK [osism.services.squid : Remove osism_allow_list.conf configuration file] *** 2026-04-03 04:47:18.307824 | orchestrator | Friday 03 April 2026 04:45:20 +0000 (0:00:01.127) 0:00:04.094 ********** 2026-04-03 04:47:18.307834 | orchestrator | ok: [testbed-manager] 2026-04-03 04:47:18.307845 | orchestrator | 2026-04-03 04:47:18.307856 | orchestrator | TASK [osism.services.squid : Copy docker-compose.yml file] ********************* 2026-04-03 04:47:18.307867 | orchestrator | Friday 03 April 2026 04:45:20 +0000 (0:00:00.369) 0:00:04.464 ********** 2026-04-03 04:47:18.307879 | orchestrator | changed: [testbed-manager] 2026-04-03 04:47:18.307890 | orchestrator | 2026-04-03 04:47:18.307901 | orchestrator | TASK [osism.services.squid : Manage squid service] ***************************** 2026-04-03 04:47:18.307912 | orchestrator | Friday 03 April 2026 04:45:21 +0000 (0:00:00.964) 0:00:05.428 ********** 2026-04-03 04:47:18.307924 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage squid service (10 retries left). 2026-04-03 04:47:18.307939 | orchestrator | ok: [testbed-manager] 2026-04-03 04:47:18.307950 | orchestrator | 2026-04-03 04:47:18.307961 | orchestrator | RUNNING HANDLER [osism.services.squid : Restart squid service] ***************** 2026-04-03 04:47:18.308001 | orchestrator | Friday 03 April 2026 04:46:05 +0000 (0:00:43.607) 0:00:49.036 ********** 2026-04-03 04:47:18.308016 | orchestrator | changed: [testbed-manager] 2026-04-03 04:47:18.308029 | orchestrator | 2026-04-03 04:47:18.308041 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for squid service to start] ******* 2026-04-03 04:47:18.308053 | orchestrator | Friday 03 April 2026 04:46:17 +0000 (0:00:12.040) 0:01:01.076 ********** 2026-04-03 04:47:18.308067 | orchestrator | Pausing for 60 seconds 2026-04-03 04:47:18.308081 | orchestrator | changed: [testbed-manager] 2026-04-03 04:47:18.308121 | orchestrator | 2026-04-03 04:47:18.308133 | orchestrator | RUNNING HANDLER [osism.services.squid : Register that squid service was restarted] *** 2026-04-03 04:47:18.308146 | orchestrator | Friday 03 April 2026 04:47:17 +0000 (0:01:00.101) 0:02:01.177 ********** 2026-04-03 04:47:18.308159 | orchestrator | ok: [testbed-manager] 2026-04-03 04:47:18.308171 | orchestrator | 2026-04-03 04:47:18.308185 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for an healthy squid service] ***** 2026-04-03 04:47:18.308198 | orchestrator | Friday 03 April 2026 04:47:17 +0000 (0:00:00.063) 0:02:01.241 ********** 2026-04-03 04:47:18.308210 | orchestrator | changed: [testbed-manager] 2026-04-03 04:47:18.308224 | orchestrator | 2026-04-03 04:47:18.308237 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:47:18.308250 | orchestrator | testbed-manager : ok=11  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:47:18.308262 | orchestrator | 2026-04-03 04:47:18.308275 | orchestrator | 2026-04-03 04:47:18.308288 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:47:18.308301 | orchestrator | Friday 03 April 2026 04:47:18 +0000 (0:00:00.627) 0:02:01.869 ********** 2026-04-03 04:47:18.308314 | orchestrator | =============================================================================== 2026-04-03 04:47:18.308326 | orchestrator | osism.services.squid : Wait for squid service to start ----------------- 60.10s 2026-04-03 04:47:18.308338 | orchestrator | osism.services.squid : Manage squid service ---------------------------- 43.61s 2026-04-03 04:47:18.308370 | orchestrator | osism.services.squid : Restart squid service --------------------------- 12.04s 2026-04-03 04:47:18.308381 | orchestrator | osism.services.squid : Install required packages ------------------------ 1.54s 2026-04-03 04:47:18.308392 | orchestrator | osism.services.squid : Create required directories ---------------------- 1.17s 2026-04-03 04:47:18.308402 | orchestrator | osism.services.squid : Copy squid configuration files ------------------- 1.13s 2026-04-03 04:47:18.308413 | orchestrator | osism.services.squid : Copy docker-compose.yml file --------------------- 0.96s 2026-04-03 04:47:18.308424 | orchestrator | osism.services.squid : Wait for an healthy squid service ---------------- 0.63s 2026-04-03 04:47:18.308434 | orchestrator | osism.services.squid : Remove osism_allow_list.conf configuration file --- 0.37s 2026-04-03 04:47:18.308445 | orchestrator | osism.services.squid : Include install tasks ---------------------------- 0.09s 2026-04-03 04:47:18.308455 | orchestrator | osism.services.squid : Register that squid service was restarted -------- 0.06s 2026-04-03 04:47:18.608526 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-03 04:47:18.609080 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 04:47:18.656641 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 04:47:18.656742 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-03 04:47:18.663481 | orchestrator | + set -e 2026-04-03 04:47:18.663536 | orchestrator | + NAMESPACE=kolla/release 2026-04-03 04:47:18.663544 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-03 04:47:18.671117 | orchestrator | ++ semver 9.5.0 9.0.0 2026-04-03 04:47:18.747383 | orchestrator | + [[ 1 -lt 0 ]] 2026-04-03 04:47:18.747813 | orchestrator | + osism apply operator -u ubuntu -l testbed-nodes 2026-04-03 04:47:30.874937 | orchestrator | 2026-04-03 04:47:30 | INFO  | Task 330c26ad-259a-411e-a2d2-1b7a7b03c824 (operator) was prepared for execution. 2026-04-03 04:47:30.875051 | orchestrator | 2026-04-03 04:47:30 | INFO  | It takes a moment until task 330c26ad-259a-411e-a2d2-1b7a7b03c824 (operator) has been started and output is visible here. 2026-04-03 04:47:47.422284 | orchestrator | 2026-04-03 04:47:47.422399 | orchestrator | PLAY [Make ssh pipelining working] ********************************************* 2026-04-03 04:47:47.422415 | orchestrator | 2026-04-03 04:47:47.422427 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 04:47:47.422439 | orchestrator | Friday 03 April 2026 04:47:35 +0000 (0:00:00.140) 0:00:00.140 ********** 2026-04-03 04:47:47.422450 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:47:47.422462 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:47:47.422473 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:47:47.422484 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:47:47.422495 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:47:47.422505 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:47:47.422516 | orchestrator | 2026-04-03 04:47:47.422527 | orchestrator | TASK [Do not require tty for all users] **************************************** 2026-04-03 04:47:47.422538 | orchestrator | Friday 03 April 2026 04:47:39 +0000 (0:00:04.081) 0:00:04.222 ********** 2026-04-03 04:47:47.422549 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:47:47.422560 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:47:47.422571 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:47:47.422581 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:47:47.422592 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:47:47.422603 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:47:47.422613 | orchestrator | 2026-04-03 04:47:47.422625 | orchestrator | PLAY [Apply role operator] ***************************************************** 2026-04-03 04:47:47.422636 | orchestrator | 2026-04-03 04:47:47.422647 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-03 04:47:47.422657 | orchestrator | Friday 03 April 2026 04:47:39 +0000 (0:00:00.727) 0:00:04.950 ********** 2026-04-03 04:47:47.422668 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:47:47.422679 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:47:47.422690 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:47:47.422700 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:47:47.422711 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:47:47.422722 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:47:47.422734 | orchestrator | 2026-04-03 04:47:47.422745 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-03 04:47:47.422772 | orchestrator | Friday 03 April 2026 04:47:40 +0000 (0:00:00.180) 0:00:05.130 ********** 2026-04-03 04:47:47.422786 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:47:47.422799 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:47:47.422811 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:47:47.422824 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:47:47.422836 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:47:47.422849 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:47:47.422862 | orchestrator | 2026-04-03 04:47:47.422874 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-03 04:47:47.422885 | orchestrator | Friday 03 April 2026 04:47:40 +0000 (0:00:00.180) 0:00:05.310 ********** 2026-04-03 04:47:47.422896 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:47.422909 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:47.422920 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:47.422931 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:47.422942 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:47.422952 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:47.422963 | orchestrator | 2026-04-03 04:47:47.422974 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-03 04:47:47.422986 | orchestrator | Friday 03 April 2026 04:47:40 +0000 (0:00:00.631) 0:00:05.941 ********** 2026-04-03 04:47:47.422997 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:47.423007 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:47.423018 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:47.423029 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:47.423040 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:47.423051 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:47.423085 | orchestrator | 2026-04-03 04:47:47.423097 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-03 04:47:47.423108 | orchestrator | Friday 03 April 2026 04:47:41 +0000 (0:00:00.832) 0:00:06.774 ********** 2026-04-03 04:47:47.423119 | orchestrator | changed: [testbed-node-0] => (item=adm) 2026-04-03 04:47:47.423130 | orchestrator | changed: [testbed-node-1] => (item=adm) 2026-04-03 04:47:47.423141 | orchestrator | changed: [testbed-node-2] => (item=adm) 2026-04-03 04:47:47.423152 | orchestrator | changed: [testbed-node-3] => (item=adm) 2026-04-03 04:47:47.423162 | orchestrator | changed: [testbed-node-4] => (item=adm) 2026-04-03 04:47:47.423173 | orchestrator | changed: [testbed-node-5] => (item=adm) 2026-04-03 04:47:47.423204 | orchestrator | changed: [testbed-node-1] => (item=sudo) 2026-04-03 04:47:47.423215 | orchestrator | changed: [testbed-node-0] => (item=sudo) 2026-04-03 04:47:47.423226 | orchestrator | changed: [testbed-node-2] => (item=sudo) 2026-04-03 04:47:47.423236 | orchestrator | changed: [testbed-node-3] => (item=sudo) 2026-04-03 04:47:47.423247 | orchestrator | changed: [testbed-node-4] => (item=sudo) 2026-04-03 04:47:47.423258 | orchestrator | changed: [testbed-node-5] => (item=sudo) 2026-04-03 04:47:47.423269 | orchestrator | 2026-04-03 04:47:47.423279 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-03 04:47:47.423290 | orchestrator | Friday 03 April 2026 04:47:42 +0000 (0:00:01.223) 0:00:07.997 ********** 2026-04-03 04:47:47.423301 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:47.423312 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:47.423323 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:47.423334 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:47.423345 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:47.423356 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:47.423367 | orchestrator | 2026-04-03 04:47:47.423378 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-03 04:47:47.423389 | orchestrator | Friday 03 April 2026 04:47:44 +0000 (0:00:01.178) 0:00:09.176 ********** 2026-04-03 04:47:47.423400 | orchestrator | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-03 04:47:47.423411 | orchestrator | with a mode of 0700, this may cause issues when running as another user. To 2026-04-03 04:47:47.423422 | orchestrator | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-03 04:47:47.423433 | orchestrator | changed: [testbed-node-3] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423462 | orchestrator | changed: [testbed-node-0] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423473 | orchestrator | changed: [testbed-node-2] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423484 | orchestrator | changed: [testbed-node-1] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423495 | orchestrator | changed: [testbed-node-5] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423506 | orchestrator | changed: [testbed-node-4] => (item=export LANGUAGE=C.UTF-8) 2026-04-03 04:47:47.423517 | orchestrator | changed: [testbed-node-3] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423527 | orchestrator | changed: [testbed-node-0] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423538 | orchestrator | changed: [testbed-node-2] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423549 | orchestrator | changed: [testbed-node-1] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423560 | orchestrator | changed: [testbed-node-5] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423570 | orchestrator | changed: [testbed-node-4] => (item=export LANG=C.UTF-8) 2026-04-03 04:47:47.423581 | orchestrator | changed: [testbed-node-3] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423592 | orchestrator | changed: [testbed-node-0] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423602 | orchestrator | changed: [testbed-node-2] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423613 | orchestrator | changed: [testbed-node-1] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423624 | orchestrator | changed: [testbed-node-5] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423643 | orchestrator | changed: [testbed-node-4] => (item=export LC_ALL=C.UTF-8) 2026-04-03 04:47:47.423654 | orchestrator | 2026-04-03 04:47:47.423665 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-03 04:47:47.423677 | orchestrator | Friday 03 April 2026 04:47:45 +0000 (0:00:01.184) 0:00:10.361 ********** 2026-04-03 04:47:47.423688 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:47.423698 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:47.423709 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:47.423720 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:47.423731 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:47.423742 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:47.423753 | orchestrator | 2026-04-03 04:47:47.423763 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-03 04:47:47.423774 | orchestrator | Friday 03 April 2026 04:47:45 +0000 (0:00:00.167) 0:00:10.528 ********** 2026-04-03 04:47:47.423785 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:47.423796 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:47.423807 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:47.423818 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:47.423829 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:47.423840 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:47.423850 | orchestrator | 2026-04-03 04:47:47.423861 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-03 04:47:47.423872 | orchestrator | Friday 03 April 2026 04:47:45 +0000 (0:00:00.197) 0:00:10.726 ********** 2026-04-03 04:47:47.423883 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:47.423894 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:47.423905 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:47.423915 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:47.423926 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:47.423937 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:47.423947 | orchestrator | 2026-04-03 04:47:47.423958 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-03 04:47:47.423969 | orchestrator | Friday 03 April 2026 04:47:46 +0000 (0:00:00.579) 0:00:11.305 ********** 2026-04-03 04:47:47.423980 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:47.423991 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:47.424002 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:47.424012 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:47.424023 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:47.424034 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:47.424044 | orchestrator | 2026-04-03 04:47:47.424055 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-03 04:47:47.424075 | orchestrator | Friday 03 April 2026 04:47:46 +0000 (0:00:00.158) 0:00:11.464 ********** 2026-04-03 04:47:47.424086 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-03 04:47:47.424097 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:47.424108 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-03 04:47:47.424119 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:47.424130 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 04:47:47.424141 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:47.424163 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 04:47:47.424175 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:47.424207 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 04:47:47.424218 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:47.424228 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 04:47:47.424239 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:47.424250 | orchestrator | 2026-04-03 04:47:47.424261 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-03 04:47:47.424271 | orchestrator | Friday 03 April 2026 04:47:47 +0000 (0:00:00.657) 0:00:12.122 ********** 2026-04-03 04:47:47.424290 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:47.424301 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:47.424312 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:47.424323 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:47.424333 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:47.424344 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:47.424355 | orchestrator | 2026-04-03 04:47:47.424366 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-03 04:47:47.424377 | orchestrator | Friday 03 April 2026 04:47:47 +0000 (0:00:00.174) 0:00:12.296 ********** 2026-04-03 04:47:47.424388 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:47.424398 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:47.424409 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:47.424420 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:47.424438 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:48.703792 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:48.703913 | orchestrator | 2026-04-03 04:47:48.703938 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-03 04:47:48.703959 | orchestrator | Friday 03 April 2026 04:47:47 +0000 (0:00:00.188) 0:00:12.485 ********** 2026-04-03 04:47:48.703979 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:48.703999 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:48.704019 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:48.704038 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:48.704057 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:48.704076 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:48.704095 | orchestrator | 2026-04-03 04:47:48.704114 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-03 04:47:48.704132 | orchestrator | Friday 03 April 2026 04:47:47 +0000 (0:00:00.159) 0:00:12.644 ********** 2026-04-03 04:47:48.704152 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:47:48.704169 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:47:48.704237 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:47:48.704259 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:47:48.704278 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:47:48.704295 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:47:48.704315 | orchestrator | 2026-04-03 04:47:48.704336 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-03 04:47:48.704357 | orchestrator | Friday 03 April 2026 04:47:48 +0000 (0:00:00.644) 0:00:13.288 ********** 2026-04-03 04:47:48.704379 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:47:48.704400 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:47:48.704421 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:47:48.704441 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:47:48.704462 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:47:48.704482 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:47:48.704503 | orchestrator | 2026-04-03 04:47:48.704524 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:47:48.704569 | orchestrator | testbed-node-0 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704588 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704604 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704622 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704643 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704689 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 04:47:48.704709 | orchestrator | 2026-04-03 04:47:48.704728 | orchestrator | 2026-04-03 04:47:48.704748 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:47:48.704768 | orchestrator | Friday 03 April 2026 04:47:48 +0000 (0:00:00.224) 0:00:13.513 ********** 2026-04-03 04:47:48.704789 | orchestrator | =============================================================================== 2026-04-03 04:47:48.704808 | orchestrator | Gathering Facts --------------------------------------------------------- 4.08s 2026-04-03 04:47:48.704828 | orchestrator | osism.commons.operator : Add user to additional groups ------------------ 1.22s 2026-04-03 04:47:48.704849 | orchestrator | osism.commons.operator : Set language variables in .bashrc configuration file --- 1.19s 2026-04-03 04:47:48.704871 | orchestrator | osism.commons.operator : Copy user sudoers file ------------------------- 1.18s 2026-04-03 04:47:48.704889 | orchestrator | osism.commons.operator : Create user ------------------------------------ 0.83s 2026-04-03 04:47:48.704908 | orchestrator | Do not require tty for all users ---------------------------------------- 0.73s 2026-04-03 04:47:48.704928 | orchestrator | osism.commons.operator : Set ssh authorized keys ------------------------ 0.66s 2026-04-03 04:47:48.704947 | orchestrator | osism.commons.operator : Set password ----------------------------------- 0.64s 2026-04-03 04:47:48.704966 | orchestrator | osism.commons.operator : Create operator group -------------------------- 0.63s 2026-04-03 04:47:48.704985 | orchestrator | osism.commons.operator : Create .ssh directory -------------------------- 0.58s 2026-04-03 04:47:48.705004 | orchestrator | osism.commons.operator : Unset & lock password -------------------------- 0.22s 2026-04-03 04:47:48.705023 | orchestrator | osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file --- 0.20s 2026-04-03 04:47:48.705042 | orchestrator | osism.commons.operator : Set authorized GitHub accounts ----------------- 0.19s 2026-04-03 04:47:48.705061 | orchestrator | osism.commons.operator : Set operator_groups variable to default value --- 0.18s 2026-04-03 04:47:48.705080 | orchestrator | osism.commons.operator : Gather variables for each operating system ----- 0.18s 2026-04-03 04:47:48.705099 | orchestrator | osism.commons.operator : Delete ssh authorized keys --------------------- 0.17s 2026-04-03 04:47:48.705117 | orchestrator | osism.commons.operator : Set custom environment variables in .bashrc configuration file --- 0.17s 2026-04-03 04:47:48.705137 | orchestrator | osism.commons.operator : Delete authorized GitHub accounts -------------- 0.16s 2026-04-03 04:47:48.705156 | orchestrator | osism.commons.operator : Check number of SSH authorized keys ------------ 0.16s 2026-04-03 04:47:49.020892 | orchestrator | + osism apply --environment custom facts 2026-04-03 04:47:50.967974 | orchestrator | 2026-04-03 04:47:50 | INFO  | Trying to run play facts in environment custom 2026-04-03 04:48:01.089305 | orchestrator | 2026-04-03 04:48:01 | INFO  | Task 75cb1895-53eb-4fe9-928c-f5d3e12ffdfc (facts) was prepared for execution. 2026-04-03 04:48:01.089414 | orchestrator | 2026-04-03 04:48:01 | INFO  | It takes a moment until task 75cb1895-53eb-4fe9-928c-f5d3e12ffdfc (facts) has been started and output is visible here. 2026-04-03 04:48:41.270080 | orchestrator | 2026-04-03 04:48:41.270197 | orchestrator | PLAY [Copy custom network devices fact] **************************************** 2026-04-03 04:48:41.270215 | orchestrator | 2026-04-03 04:48:41.270227 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-03 04:48:41.270239 | orchestrator | Friday 03 April 2026 04:48:05 +0000 (0:00:00.086) 0:00:00.086 ********** 2026-04-03 04:48:41.270250 | orchestrator | ok: [testbed-manager] 2026-04-03 04:48:41.270262 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.270274 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.270285 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:48:41.270296 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:48:41.270307 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.270371 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:48:41.270385 | orchestrator | 2026-04-03 04:48:41.270396 | orchestrator | TASK [Copy fact file] ********************************************************** 2026-04-03 04:48:41.270407 | orchestrator | Friday 03 April 2026 04:48:06 +0000 (0:00:01.350) 0:00:01.437 ********** 2026-04-03 04:48:41.270418 | orchestrator | ok: [testbed-manager] 2026-04-03 04:48:41.270429 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:48:41.270440 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:48:41.270450 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.270461 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.270472 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.270483 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:48:41.270493 | orchestrator | 2026-04-03 04:48:41.270505 | orchestrator | PLAY [Copy custom ceph devices facts] ****************************************** 2026-04-03 04:48:41.270515 | orchestrator | 2026-04-03 04:48:41.270526 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-03 04:48:41.270537 | orchestrator | Friday 03 April 2026 04:48:07 +0000 (0:00:01.175) 0:00:02.613 ********** 2026-04-03 04:48:41.270548 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.270559 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.270570 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.270581 | orchestrator | 2026-04-03 04:48:41.270591 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-03 04:48:41.270603 | orchestrator | Friday 03 April 2026 04:48:07 +0000 (0:00:00.107) 0:00:02.721 ********** 2026-04-03 04:48:41.270614 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.270625 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.270635 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.270646 | orchestrator | 2026-04-03 04:48:41.270657 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-03 04:48:41.270668 | orchestrator | Friday 03 April 2026 04:48:08 +0000 (0:00:00.206) 0:00:02.927 ********** 2026-04-03 04:48:41.270678 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.270689 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.270700 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.270710 | orchestrator | 2026-04-03 04:48:41.270721 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-03 04:48:41.270733 | orchestrator | Friday 03 April 2026 04:48:08 +0000 (0:00:00.242) 0:00:03.169 ********** 2026-04-03 04:48:41.270748 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 04:48:41.270766 | orchestrator | 2026-04-03 04:48:41.270786 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-03 04:48:41.270799 | orchestrator | Friday 03 April 2026 04:48:08 +0000 (0:00:00.158) 0:00:03.328 ********** 2026-04-03 04:48:41.270810 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.270821 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.270832 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.270842 | orchestrator | 2026-04-03 04:48:41.270853 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-03 04:48:41.270864 | orchestrator | Friday 03 April 2026 04:48:08 +0000 (0:00:00.416) 0:00:03.744 ********** 2026-04-03 04:48:41.270875 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:48:41.270885 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:48:41.270896 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:48:41.270907 | orchestrator | 2026-04-03 04:48:41.270918 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-03 04:48:41.270929 | orchestrator | Friday 03 April 2026 04:48:09 +0000 (0:00:00.153) 0:00:03.898 ********** 2026-04-03 04:48:41.270939 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.270950 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.270961 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.270972 | orchestrator | 2026-04-03 04:48:41.270982 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-03 04:48:41.271001 | orchestrator | Friday 03 April 2026 04:48:10 +0000 (0:00:01.066) 0:00:04.965 ********** 2026-04-03 04:48:41.271012 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.271023 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.271034 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.271044 | orchestrator | 2026-04-03 04:48:41.271056 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-03 04:48:41.271067 | orchestrator | Friday 03 April 2026 04:48:10 +0000 (0:00:00.445) 0:00:05.410 ********** 2026-04-03 04:48:41.271077 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.271088 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.271099 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.271110 | orchestrator | 2026-04-03 04:48:41.271168 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-03 04:48:41.271181 | orchestrator | Friday 03 April 2026 04:48:11 +0000 (0:00:01.004) 0:00:06.415 ********** 2026-04-03 04:48:41.271192 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.271203 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.271214 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.271224 | orchestrator | 2026-04-03 04:48:41.271235 | orchestrator | TASK [Install required packages (RedHat)] ************************************** 2026-04-03 04:48:41.271246 | orchestrator | Friday 03 April 2026 04:48:26 +0000 (0:00:14.699) 0:00:21.114 ********** 2026-04-03 04:48:41.271257 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:48:41.271268 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:48:41.271279 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:48:41.271289 | orchestrator | 2026-04-03 04:48:41.271300 | orchestrator | TASK [Install required packages (Debian)] ************************************** 2026-04-03 04:48:41.271396 | orchestrator | Friday 03 April 2026 04:48:26 +0000 (0:00:00.095) 0:00:21.209 ********** 2026-04-03 04:48:41.271411 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:48:41.271422 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:48:41.271433 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:48:41.271444 | orchestrator | 2026-04-03 04:48:41.271455 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-03 04:48:41.271466 | orchestrator | Friday 03 April 2026 04:48:32 +0000 (0:00:06.387) 0:00:27.597 ********** 2026-04-03 04:48:41.271477 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.271488 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.271499 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.271510 | orchestrator | 2026-04-03 04:48:41.271521 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-03 04:48:41.271532 | orchestrator | Friday 03 April 2026 04:48:33 +0000 (0:00:00.518) 0:00:28.116 ********** 2026-04-03 04:48:41.271543 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices) 2026-04-03 04:48:41.271554 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices) 2026-04-03 04:48:41.271565 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices) 2026-04-03 04:48:41.271576 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices_all) 2026-04-03 04:48:41.271593 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices_all) 2026-04-03 04:48:41.271604 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices_all) 2026-04-03 04:48:41.271615 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices) 2026-04-03 04:48:41.271626 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices) 2026-04-03 04:48:41.271636 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices) 2026-04-03 04:48:41.271647 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices_all) 2026-04-03 04:48:41.271658 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices_all) 2026-04-03 04:48:41.271669 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices_all) 2026-04-03 04:48:41.271680 | orchestrator | 2026-04-03 04:48:41.271691 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-03 04:48:41.271710 | orchestrator | Friday 03 April 2026 04:48:36 +0000 (0:00:03.331) 0:00:31.447 ********** 2026-04-03 04:48:41.271721 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.271732 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.271743 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.271754 | orchestrator | 2026-04-03 04:48:41.271764 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 04:48:41.271775 | orchestrator | 2026-04-03 04:48:41.271786 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 04:48:41.271797 | orchestrator | Friday 03 April 2026 04:48:37 +0000 (0:00:01.256) 0:00:32.703 ********** 2026-04-03 04:48:41.271808 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:48:41.271818 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:48:41.271830 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:48:41.271840 | orchestrator | ok: [testbed-manager] 2026-04-03 04:48:41.271851 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:48:41.271862 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:48:41.271873 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:48:41.271883 | orchestrator | 2026-04-03 04:48:41.271894 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:48:41.271906 | orchestrator | testbed-manager : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:48:41.271918 | orchestrator | testbed-node-0 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:48:41.271930 | orchestrator | testbed-node-1 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:48:41.271941 | orchestrator | testbed-node-2 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:48:41.271952 | orchestrator | testbed-node-3 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:48:41.271963 | orchestrator | testbed-node-4 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:48:41.271973 | orchestrator | testbed-node-5 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:48:41.271984 | orchestrator | 2026-04-03 04:48:41.271995 | orchestrator | 2026-04-03 04:48:41.272006 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:48:41.272017 | orchestrator | Friday 03 April 2026 04:48:41 +0000 (0:00:03.393) 0:00:36.097 ********** 2026-04-03 04:48:41.272028 | orchestrator | =============================================================================== 2026-04-03 04:48:41.272039 | orchestrator | osism.commons.repository : Update package cache ------------------------ 14.70s 2026-04-03 04:48:41.272050 | orchestrator | Install required packages (Debian) -------------------------------------- 6.39s 2026-04-03 04:48:41.272060 | orchestrator | Gathers facts about hosts ----------------------------------------------- 3.39s 2026-04-03 04:48:41.272071 | orchestrator | Copy fact files --------------------------------------------------------- 3.33s 2026-04-03 04:48:41.272082 | orchestrator | Create custom facts directory ------------------------------------------- 1.35s 2026-04-03 04:48:41.272093 | orchestrator | osism.commons.repository : Force update of package cache ---------------- 1.26s 2026-04-03 04:48:41.272111 | orchestrator | Copy fact file ---------------------------------------------------------- 1.18s 2026-04-03 04:48:41.489906 | orchestrator | osism.commons.repository : Copy 99osism apt configuration --------------- 1.07s 2026-04-03 04:48:41.490119 | orchestrator | osism.commons.repository : Copy ubuntu.sources file --------------------- 1.00s 2026-04-03 04:48:41.490135 | orchestrator | Create custom facts directory ------------------------------------------- 0.52s 2026-04-03 04:48:41.490179 | orchestrator | osism.commons.repository : Remove sources.list file --------------------- 0.45s 2026-04-03 04:48:41.490189 | orchestrator | osism.commons.repository : Create /etc/apt/sources.list.d directory ----- 0.42s 2026-04-03 04:48:41.490199 | orchestrator | osism.commons.repository : Set repositories to default ------------------ 0.24s 2026-04-03 04:48:41.490209 | orchestrator | osism.commons.repository : Set repository_default fact to default value --- 0.21s 2026-04-03 04:48:41.490219 | orchestrator | osism.commons.repository : Include distribution specific repository tasks --- 0.16s 2026-04-03 04:48:41.490229 | orchestrator | osism.commons.repository : Include tasks for Ubuntu < 24.04 ------------- 0.15s 2026-04-03 04:48:41.490239 | orchestrator | osism.commons.repository : Gather variables for each operating system --- 0.11s 2026-04-03 04:48:41.490269 | orchestrator | Install required packages (RedHat) -------------------------------------- 0.10s 2026-04-03 04:48:41.808416 | orchestrator | + osism apply bootstrap 2026-04-03 04:48:53.916703 | orchestrator | 2026-04-03 04:48:53 | INFO  | Task b2c57c47-25c3-4d95-8b0a-ee069970cdc2 (bootstrap) was prepared for execution. 2026-04-03 04:48:53.916827 | orchestrator | 2026-04-03 04:48:53 | INFO  | It takes a moment until task b2c57c47-25c3-4d95-8b0a-ee069970cdc2 (bootstrap) has been started and output is visible here. 2026-04-03 04:49:10.655590 | orchestrator | 2026-04-03 04:49:10.655734 | orchestrator | PLAY [Group hosts based on state bootstrap] ************************************ 2026-04-03 04:49:10.655761 | orchestrator | 2026-04-03 04:49:10.655780 | orchestrator | TASK [Group hosts based on state bootstrap] ************************************ 2026-04-03 04:49:10.655799 | orchestrator | Friday 03 April 2026 04:48:58 +0000 (0:00:00.155) 0:00:00.155 ********** 2026-04-03 04:49:10.655818 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:10.655837 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:10.655857 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:10.655877 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:10.655897 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:10.655918 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:10.655936 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:10.655956 | orchestrator | 2026-04-03 04:49:10.655975 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 04:49:10.655993 | orchestrator | 2026-04-03 04:49:10.656012 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 04:49:10.656032 | orchestrator | Friday 03 April 2026 04:48:58 +0000 (0:00:00.257) 0:00:00.412 ********** 2026-04-03 04:49:10.656053 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:10.656072 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:10.656090 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:10.656109 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:10.656128 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:10.656146 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:10.656165 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:10.656183 | orchestrator | 2026-04-03 04:49:10.656201 | orchestrator | PLAY [Gather facts for all hosts (if using --limit)] *************************** 2026-04-03 04:49:10.656220 | orchestrator | 2026-04-03 04:49:10.656233 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 04:49:10.656246 | orchestrator | Friday 03 April 2026 04:49:02 +0000 (0:00:03.449) 0:00:03.862 ********** 2026-04-03 04:49:10.656260 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-03 04:49:10.656273 | orchestrator | skipping: [testbed-node-3] => (item=testbed-manager)  2026-04-03 04:49:10.656286 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-03 04:49:10.656298 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 04:49:10.656311 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-03 04:49:10.656325 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 04:49:10.656337 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-03 04:49:10.656351 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 04:49:10.656363 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-03 04:49:10.656431 | orchestrator | skipping: [testbed-node-4] => (item=testbed-manager)  2026-04-03 04:49:10.656444 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-03 04:49:10.656455 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 04:49:10.656465 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-03 04:49:10.656476 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 04:49:10.656487 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 04:49:10.656499 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:10.656509 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 04:49:10.656520 | orchestrator | skipping: [testbed-node-5] => (item=testbed-manager)  2026-04-03 04:49:10.656531 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 04:49:10.656542 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 04:49:10.656552 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 04:49:10.656562 | orchestrator | skipping: [testbed-node-0] => (item=testbed-manager)  2026-04-03 04:49:10.656572 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 04:49:10.656581 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:10.656591 | orchestrator | skipping: [testbed-node-1] => (item=testbed-manager)  2026-04-03 04:49:10.656600 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 04:49:10.656609 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 04:49:10.656619 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 04:49:10.656628 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 04:49:10.656637 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 04:49:10.656646 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 04:49:10.656656 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 04:49:10.656665 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 04:49:10.656674 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 04:49:10.656684 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 04:49:10.656693 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:10.656703 | orchestrator | skipping: [testbed-node-2] => (item=testbed-manager)  2026-04-03 04:49:10.656712 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 04:49:10.656721 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 04:49:10.656731 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:10.656740 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 04:49:10.656750 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 04:49:10.656759 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 04:49:10.656769 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 04:49:10.656784 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 04:49:10.656802 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 04:49:10.656817 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:10.656856 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 04:49:10.656868 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 04:49:10.656878 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 04:49:10.656887 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 04:49:10.656896 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 04:49:10.656906 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 04:49:10.656915 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:10.656949 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 04:49:10.656959 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:10.656969 | orchestrator | 2026-04-03 04:49:10.656978 | orchestrator | PLAY [Apply bootstrap roles part 1] ******************************************** 2026-04-03 04:49:10.656988 | orchestrator | 2026-04-03 04:49:10.656997 | orchestrator | TASK [osism.commons.hostname : Set hostname] *********************************** 2026-04-03 04:49:10.657007 | orchestrator | Friday 03 April 2026 04:49:02 +0000 (0:00:00.466) 0:00:04.328 ********** 2026-04-03 04:49:10.657016 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:10.657026 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:10.657035 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:10.657045 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:10.657054 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:10.657063 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:10.657073 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:10.657082 | orchestrator | 2026-04-03 04:49:10.657092 | orchestrator | TASK [osism.commons.hostname : Copy /etc/hostname] ***************************** 2026-04-03 04:49:10.657102 | orchestrator | Friday 03 April 2026 04:49:03 +0000 (0:00:01.221) 0:00:05.549 ********** 2026-04-03 04:49:10.657111 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:10.657121 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:10.657131 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:10.657140 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:10.657149 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:10.657158 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:10.657168 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:10.657177 | orchestrator | 2026-04-03 04:49:10.657187 | orchestrator | TASK [osism.commons.hosts : Include type specific tasks] *********************** 2026-04-03 04:49:10.657196 | orchestrator | Friday 03 April 2026 04:49:05 +0000 (0:00:01.271) 0:00:06.821 ********** 2026-04-03 04:49:10.657207 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/hosts/tasks/type-template.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:10.657219 | orchestrator | 2026-04-03 04:49:10.657229 | orchestrator | TASK [osism.commons.hosts : Copy /etc/hosts file] ****************************** 2026-04-03 04:49:10.657239 | orchestrator | Friday 03 April 2026 04:49:05 +0000 (0:00:00.266) 0:00:07.088 ********** 2026-04-03 04:49:10.657248 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:10.657258 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:10.657268 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:10.657277 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:10.657287 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:10.657296 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:10.657306 | orchestrator | changed: [testbed-manager] 2026-04-03 04:49:10.657315 | orchestrator | 2026-04-03 04:49:10.657325 | orchestrator | TASK [osism.commons.proxy : Include distribution specific tasks] *************** 2026-04-03 04:49:10.657335 | orchestrator | Friday 03 April 2026 04:49:08 +0000 (0:00:02.865) 0:00:09.954 ********** 2026-04-03 04:49:10.657344 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:10.657355 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/proxy/tasks/Debian-family.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:10.657366 | orchestrator | 2026-04-03 04:49:10.657376 | orchestrator | TASK [osism.commons.proxy : Configure proxy parameters for apt] **************** 2026-04-03 04:49:10.657386 | orchestrator | Friday 03 April 2026 04:49:08 +0000 (0:00:00.252) 0:00:10.206 ********** 2026-04-03 04:49:10.657424 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:10.657434 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:10.657444 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:10.657453 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:10.657463 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:10.657472 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:10.657488 | orchestrator | 2026-04-03 04:49:10.657498 | orchestrator | TASK [osism.commons.proxy : Set system wide settings in environment file] ****** 2026-04-03 04:49:10.657508 | orchestrator | Friday 03 April 2026 04:49:09 +0000 (0:00:00.997) 0:00:11.203 ********** 2026-04-03 04:49:10.657517 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:10.657527 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:10.657536 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:10.657546 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:10.657555 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:10.657564 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:10.657574 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:10.657583 | orchestrator | 2026-04-03 04:49:10.657593 | orchestrator | TASK [osism.commons.proxy : Remove system wide settings in environment file] *** 2026-04-03 04:49:10.657603 | orchestrator | Friday 03 April 2026 04:49:10 +0000 (0:00:00.576) 0:00:11.779 ********** 2026-04-03 04:49:10.657612 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:10.657622 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:10.657631 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:10.657645 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:10.657655 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:10.657664 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:10.657674 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:10.657683 | orchestrator | 2026-04-03 04:49:10.657693 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-03 04:49:10.657704 | orchestrator | Friday 03 April 2026 04:49:10 +0000 (0:00:00.444) 0:00:12.224 ********** 2026-04-03 04:49:10.657713 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:10.657723 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:10.657753 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:22.396855 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:22.396971 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:22.396995 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:22.397014 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:22.397032 | orchestrator | 2026-04-03 04:49:22.397052 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-03 04:49:22.397072 | orchestrator | Friday 03 April 2026 04:49:10 +0000 (0:00:00.210) 0:00:12.435 ********** 2026-04-03 04:49:22.397092 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:22.397132 | orchestrator | 2026-04-03 04:49:22.397151 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-03 04:49:22.397171 | orchestrator | Friday 03 April 2026 04:49:11 +0000 (0:00:00.312) 0:00:12.747 ********** 2026-04-03 04:49:22.397183 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:22.397195 | orchestrator | 2026-04-03 04:49:22.397207 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-03 04:49:22.397217 | orchestrator | Friday 03 April 2026 04:49:11 +0000 (0:00:00.335) 0:00:13.082 ********** 2026-04-03 04:49:22.397228 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.397240 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.397251 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.397261 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.397272 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.397283 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.397294 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.397305 | orchestrator | 2026-04-03 04:49:22.397316 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-03 04:49:22.397327 | orchestrator | Friday 03 April 2026 04:49:12 +0000 (0:00:01.338) 0:00:14.421 ********** 2026-04-03 04:49:22.397364 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:22.397376 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:22.397386 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:22.397397 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:22.397407 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:22.397418 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:22.397452 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:22.397463 | orchestrator | 2026-04-03 04:49:22.397474 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-03 04:49:22.397486 | orchestrator | Friday 03 April 2026 04:49:12 +0000 (0:00:00.215) 0:00:14.636 ********** 2026-04-03 04:49:22.397496 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.397507 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.397518 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.397528 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.397539 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.397549 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.397560 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.397570 | orchestrator | 2026-04-03 04:49:22.397581 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-03 04:49:22.397592 | orchestrator | Friday 03 April 2026 04:49:13 +0000 (0:00:00.536) 0:00:15.172 ********** 2026-04-03 04:49:22.397602 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:22.397613 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:22.397624 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:22.397635 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:22.397645 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:22.397656 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:22.397667 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:22.397678 | orchestrator | 2026-04-03 04:49:22.397689 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-03 04:49:22.397702 | orchestrator | Friday 03 April 2026 04:49:13 +0000 (0:00:00.325) 0:00:15.498 ********** 2026-04-03 04:49:22.397712 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.397723 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:22.397733 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:22.397744 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:22.397755 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:22.397765 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:22.397776 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:22.397786 | orchestrator | 2026-04-03 04:49:22.397797 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-03 04:49:22.397808 | orchestrator | Friday 03 April 2026 04:49:14 +0000 (0:00:00.544) 0:00:16.043 ********** 2026-04-03 04:49:22.397819 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.397829 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:22.397840 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:22.397850 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:22.397861 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:22.397871 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:22.397882 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:22.397892 | orchestrator | 2026-04-03 04:49:22.397903 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-03 04:49:22.397914 | orchestrator | Friday 03 April 2026 04:49:15 +0000 (0:00:01.104) 0:00:17.147 ********** 2026-04-03 04:49:22.397924 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.397944 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.397955 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.397966 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.397976 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.397987 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.397998 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398008 | orchestrator | 2026-04-03 04:49:22.398079 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-03 04:49:22.398100 | orchestrator | Friday 03 April 2026 04:49:16 +0000 (0:00:01.001) 0:00:18.149 ********** 2026-04-03 04:49:22.398131 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:22.398143 | orchestrator | 2026-04-03 04:49:22.398154 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-03 04:49:22.398165 | orchestrator | Friday 03 April 2026 04:49:16 +0000 (0:00:00.306) 0:00:18.456 ********** 2026-04-03 04:49:22.398176 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:22.398186 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:22.398197 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:49:22.398208 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:49:22.398218 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:22.398229 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:49:22.398240 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:22.398250 | orchestrator | 2026-04-03 04:49:22.398261 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-03 04:49:22.398272 | orchestrator | Friday 03 April 2026 04:49:18 +0000 (0:00:01.255) 0:00:19.711 ********** 2026-04-03 04:49:22.398283 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.398294 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.398305 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.398315 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398326 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.398337 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.398347 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.398358 | orchestrator | 2026-04-03 04:49:22.398369 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-03 04:49:22.398380 | orchestrator | Friday 03 April 2026 04:49:18 +0000 (0:00:00.250) 0:00:19.962 ********** 2026-04-03 04:49:22.398391 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.398401 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.398412 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.398468 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398480 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.398491 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.398502 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.398512 | orchestrator | 2026-04-03 04:49:22.398523 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-03 04:49:22.398534 | orchestrator | Friday 03 April 2026 04:49:18 +0000 (0:00:00.246) 0:00:20.208 ********** 2026-04-03 04:49:22.398545 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.398555 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.398566 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.398577 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398587 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.398598 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.398609 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.398619 | orchestrator | 2026-04-03 04:49:22.398630 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-03 04:49:22.398641 | orchestrator | Friday 03 April 2026 04:49:18 +0000 (0:00:00.223) 0:00:20.432 ********** 2026-04-03 04:49:22.398653 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:49:22.398666 | orchestrator | 2026-04-03 04:49:22.398677 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-03 04:49:22.398687 | orchestrator | Friday 03 April 2026 04:49:18 +0000 (0:00:00.273) 0:00:20.706 ********** 2026-04-03 04:49:22.398698 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.398709 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.398727 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.398738 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398749 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.398760 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.398770 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.398781 | orchestrator | 2026-04-03 04:49:22.398792 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-03 04:49:22.398803 | orchestrator | Friday 03 April 2026 04:49:19 +0000 (0:00:00.496) 0:00:21.202 ********** 2026-04-03 04:49:22.398813 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:49:22.398824 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:49:22.398835 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:49:22.398846 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:49:22.398857 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:49:22.398868 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:49:22.398878 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:49:22.398889 | orchestrator | 2026-04-03 04:49:22.398900 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-03 04:49:22.398911 | orchestrator | Friday 03 April 2026 04:49:19 +0000 (0:00:00.243) 0:00:21.446 ********** 2026-04-03 04:49:22.398922 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.398933 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.398944 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.398955 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.398965 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:49:22.398976 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:49:22.398987 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:49:22.398998 | orchestrator | 2026-04-03 04:49:22.399008 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-03 04:49:22.399019 | orchestrator | Friday 03 April 2026 04:49:20 +0000 (0:00:01.013) 0:00:22.460 ********** 2026-04-03 04:49:22.399030 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.399041 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.399052 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.399062 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.399073 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:49:22.399084 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:49:22.399095 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:49:22.399105 | orchestrator | 2026-04-03 04:49:22.399117 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-03 04:49:22.399128 | orchestrator | Friday 03 April 2026 04:49:21 +0000 (0:00:00.565) 0:00:23.026 ********** 2026-04-03 04:49:22.399139 | orchestrator | ok: [testbed-manager] 2026-04-03 04:49:22.399149 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:49:22.399169 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:49:22.399180 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:49:22.399198 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.375680 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.375797 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.375814 | orchestrator | 2026-04-03 04:50:01.375827 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-03 04:50:01.375841 | orchestrator | Friday 03 April 2026 04:49:22 +0000 (0:00:01.065) 0:00:24.091 ********** 2026-04-03 04:50:01.375853 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.375865 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.375876 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.375896 | orchestrator | changed: [testbed-manager] 2026-04-03 04:50:01.375920 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.375949 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.375967 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.375987 | orchestrator | 2026-04-03 04:50:01.376008 | orchestrator | TASK [osism.services.rsyslog : Gather variables for each operating system] ***** 2026-04-03 04:50:01.376029 | orchestrator | Friday 03 April 2026 04:49:36 +0000 (0:00:14.596) 0:00:38.687 ********** 2026-04-03 04:50:01.376046 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.376085 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.376096 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.376107 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.376118 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.376128 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.376139 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.376149 | orchestrator | 2026-04-03 04:50:01.376160 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_user variable to default value] ***** 2026-04-03 04:50:01.376171 | orchestrator | Friday 03 April 2026 04:49:37 +0000 (0:00:00.227) 0:00:38.914 ********** 2026-04-03 04:50:01.376184 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.376196 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.376208 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.376221 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.376233 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.376246 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.376259 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.376272 | orchestrator | 2026-04-03 04:50:01.376286 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_workdir variable to default value] *** 2026-04-03 04:50:01.376298 | orchestrator | Friday 03 April 2026 04:49:37 +0000 (0:00:00.236) 0:00:39.151 ********** 2026-04-03 04:50:01.376311 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.376324 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.376336 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.376350 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.376362 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.376375 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.376388 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.376400 | orchestrator | 2026-04-03 04:50:01.376413 | orchestrator | TASK [osism.services.rsyslog : Include distribution specific install tasks] **** 2026-04-03 04:50:01.376426 | orchestrator | Friday 03 April 2026 04:49:37 +0000 (0:00:00.215) 0:00:39.366 ********** 2026-04-03 04:50:01.376442 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:50:01.376457 | orchestrator | 2026-04-03 04:50:01.376471 | orchestrator | TASK [osism.services.rsyslog : Install rsyslog package] ************************ 2026-04-03 04:50:01.376485 | orchestrator | Friday 03 April 2026 04:49:37 +0000 (0:00:00.300) 0:00:39.667 ********** 2026-04-03 04:50:01.376498 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.376512 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.376523 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.376565 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.376576 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.376587 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.376597 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.376608 | orchestrator | 2026-04-03 04:50:01.376619 | orchestrator | TASK [osism.services.rsyslog : Copy rsyslog.conf configuration file] *********** 2026-04-03 04:50:01.376630 | orchestrator | Friday 03 April 2026 04:49:39 +0000 (0:00:01.545) 0:00:41.212 ********** 2026-04-03 04:50:01.376641 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:50:01.376652 | orchestrator | changed: [testbed-manager] 2026-04-03 04:50:01.376663 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:50:01.376673 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:50:01.376684 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.376695 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.376706 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.376717 | orchestrator | 2026-04-03 04:50:01.376728 | orchestrator | TASK [osism.services.rsyslog : Manage rsyslog service] ************************* 2026-04-03 04:50:01.376739 | orchestrator | Friday 03 April 2026 04:49:40 +0000 (0:00:01.029) 0:00:42.242 ********** 2026-04-03 04:50:01.376750 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.376760 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.376771 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.376790 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.376801 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.376812 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.376822 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.376833 | orchestrator | 2026-04-03 04:50:01.376844 | orchestrator | TASK [osism.services.rsyslog : Include fluentd tasks] ************************** 2026-04-03 04:50:01.376855 | orchestrator | Friday 03 April 2026 04:49:41 +0000 (0:00:00.824) 0:00:43.066 ********** 2026-04-03 04:50:01.376867 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/fluentd.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:50:01.376879 | orchestrator | 2026-04-03 04:50:01.376905 | orchestrator | TASK [osism.services.rsyslog : Forward syslog message to local fluentd daemon] *** 2026-04-03 04:50:01.376917 | orchestrator | Friday 03 April 2026 04:49:41 +0000 (0:00:00.309) 0:00:43.376 ********** 2026-04-03 04:50:01.376927 | orchestrator | changed: [testbed-manager] 2026-04-03 04:50:01.376939 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:50:01.376950 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:50:01.376969 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:50:01.377000 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.377018 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.377036 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.377052 | orchestrator | 2026-04-03 04:50:01.377093 | orchestrator | TASK [osism.services.rsyslog : Include additional log server tasks] ************ 2026-04-03 04:50:01.377116 | orchestrator | Friday 03 April 2026 04:49:42 +0000 (0:00:01.017) 0:00:44.393 ********** 2026-04-03 04:50:01.377134 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:50:01.377152 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:50:01.377163 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:50:01.377174 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:50:01.377184 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:50:01.377195 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:50:01.377206 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:50:01.377216 | orchestrator | 2026-04-03 04:50:01.377227 | orchestrator | TASK [osism.services.rsyslog : Include logrotate tasks] ************************ 2026-04-03 04:50:01.377238 | orchestrator | Friday 03 April 2026 04:49:42 +0000 (0:00:00.244) 0:00:44.638 ********** 2026-04-03 04:50:01.377250 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/logrotate.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:50:01.377262 | orchestrator | 2026-04-03 04:50:01.377281 | orchestrator | TASK [osism.services.rsyslog : Ensure logrotate package is installed] ********** 2026-04-03 04:50:01.377300 | orchestrator | Friday 03 April 2026 04:49:43 +0000 (0:00:00.310) 0:00:44.948 ********** 2026-04-03 04:50:01.377317 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.377335 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.377352 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.377369 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.377386 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.377404 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.377421 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.377440 | orchestrator | 2026-04-03 04:50:01.377460 | orchestrator | TASK [osism.services.rsyslog : Configure logrotate for rsyslog] **************** 2026-04-03 04:50:01.377477 | orchestrator | Friday 03 April 2026 04:49:44 +0000 (0:00:01.460) 0:00:46.409 ********** 2026-04-03 04:50:01.377494 | orchestrator | changed: [testbed-manager] 2026-04-03 04:50:01.377506 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:50:01.377517 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:50:01.377555 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:50:01.377567 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.377578 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.377589 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.377611 | orchestrator | 2026-04-03 04:50:01.377623 | orchestrator | TASK [osism.commons.systohc : Install util-linux-extra package] **************** 2026-04-03 04:50:01.377634 | orchestrator | Friday 03 April 2026 04:49:45 +0000 (0:00:01.091) 0:00:47.501 ********** 2026-04-03 04:50:01.377644 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:50:01.377655 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:50:01.377666 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:50:01.377677 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:50:01.377690 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:50:01.377709 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:50:01.377726 | orchestrator | changed: [testbed-manager] 2026-04-03 04:50:01.377744 | orchestrator | 2026-04-03 04:50:01.377763 | orchestrator | TASK [osism.commons.systohc : Sync hardware clock] ***************************** 2026-04-03 04:50:01.377781 | orchestrator | Friday 03 April 2026 04:49:58 +0000 (0:00:12.259) 0:00:59.760 ********** 2026-04-03 04:50:01.377800 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.377819 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.377839 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.377858 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.377876 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.377895 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.377915 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.377936 | orchestrator | 2026-04-03 04:50:01.377957 | orchestrator | TASK [osism.commons.configfs : Start sys-kernel-config mount] ****************** 2026-04-03 04:50:01.377978 | orchestrator | Friday 03 April 2026 04:49:59 +0000 (0:00:01.622) 0:01:01.383 ********** 2026-04-03 04:50:01.377997 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.378098 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.378123 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.378143 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.378161 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.378181 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.378199 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.378218 | orchestrator | 2026-04-03 04:50:01.378238 | orchestrator | TASK [osism.commons.packages : Gather variables for each operating system] ***** 2026-04-03 04:50:01.378258 | orchestrator | Friday 03 April 2026 04:50:00 +0000 (0:00:00.924) 0:01:02.308 ********** 2026-04-03 04:50:01.378277 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.378295 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.378314 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.378330 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.378341 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.378352 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.378363 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.378373 | orchestrator | 2026-04-03 04:50:01.378384 | orchestrator | TASK [osism.commons.packages : Set required_packages_distribution variable to default value] *** 2026-04-03 04:50:01.378396 | orchestrator | Friday 03 April 2026 04:50:00 +0000 (0:00:00.236) 0:01:02.544 ********** 2026-04-03 04:50:01.378407 | orchestrator | ok: [testbed-manager] 2026-04-03 04:50:01.378418 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:50:01.378428 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:50:01.378439 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:50:01.378450 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:50:01.378460 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:50:01.378471 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:50:01.378481 | orchestrator | 2026-04-03 04:50:01.378508 | orchestrator | TASK [osism.commons.packages : Include distribution specific package tasks] **** 2026-04-03 04:50:01.378552 | orchestrator | Friday 03 April 2026 04:50:01 +0000 (0:00:00.238) 0:01:02.782 ********** 2026-04-03 04:50:01.378573 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/packages/tasks/package-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:50:01.378592 | orchestrator | 2026-04-03 04:50:01.378630 | orchestrator | TASK [osism.commons.packages : Install needrestart package] ******************** 2026-04-03 04:52:16.317899 | orchestrator | Friday 03 April 2026 04:50:01 +0000 (0:00:00.288) 0:01:03.070 ********** 2026-04-03 04:52:16.317996 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318008 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318051 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318060 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318067 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318074 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318081 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318089 | orchestrator | 2026-04-03 04:52:16.318097 | orchestrator | TASK [osism.commons.packages : Set needrestart mode] *************************** 2026-04-03 04:52:16.318104 | orchestrator | Friday 03 April 2026 04:50:02 +0000 (0:00:01.546) 0:01:04.617 ********** 2026-04-03 04:52:16.318111 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:16.318119 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:16.318126 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:16.318133 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:16.318140 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:16.318146 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:16.318153 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:16.318160 | orchestrator | 2026-04-03 04:52:16.318167 | orchestrator | TASK [osism.commons.packages : Set apt_cache_valid_time variable to default value] *** 2026-04-03 04:52:16.318175 | orchestrator | Friday 03 April 2026 04:50:03 +0000 (0:00:00.642) 0:01:05.259 ********** 2026-04-03 04:52:16.318181 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318188 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318195 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318202 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318209 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318215 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318222 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318229 | orchestrator | 2026-04-03 04:52:16.318237 | orchestrator | TASK [osism.commons.packages : Update package cache] *************************** 2026-04-03 04:52:16.318244 | orchestrator | Friday 03 April 2026 04:50:03 +0000 (0:00:00.262) 0:01:05.522 ********** 2026-04-03 04:52:16.318251 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318258 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318264 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318271 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318278 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318285 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318292 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318299 | orchestrator | 2026-04-03 04:52:16.318305 | orchestrator | TASK [osism.commons.packages : Download upgrade packages] ********************** 2026-04-03 04:52:16.318313 | orchestrator | Friday 03 April 2026 04:50:04 +0000 (0:00:01.130) 0:01:06.653 ********** 2026-04-03 04:52:16.318320 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:16.318327 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:16.318334 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:16.318340 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:16.318347 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:16.318354 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:16.318361 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:16.318368 | orchestrator | 2026-04-03 04:52:16.318378 | orchestrator | TASK [osism.commons.packages : Upgrade packages] ******************************* 2026-04-03 04:52:16.318385 | orchestrator | Friday 03 April 2026 04:50:06 +0000 (0:00:01.513) 0:01:08.167 ********** 2026-04-03 04:52:16.318392 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318399 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318406 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318414 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318421 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318429 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318436 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318443 | orchestrator | 2026-04-03 04:52:16.318451 | orchestrator | TASK [osism.commons.packages : Download required packages] ********************* 2026-04-03 04:52:16.318481 | orchestrator | Friday 03 April 2026 04:50:08 +0000 (0:00:02.133) 0:01:10.300 ********** 2026-04-03 04:52:16.318489 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318496 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318503 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318511 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318518 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318525 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318532 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318540 | orchestrator | 2026-04-03 04:52:16.318547 | orchestrator | TASK [osism.commons.packages : Install required packages] ********************** 2026-04-03 04:52:16.318554 | orchestrator | Friday 03 April 2026 04:50:47 +0000 (0:00:39.405) 0:01:49.706 ********** 2026-04-03 04:52:16.318562 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:16.318569 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:16.318577 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:16.318584 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:16.318591 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:16.318598 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:16.318606 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:16.318613 | orchestrator | 2026-04-03 04:52:16.318620 | orchestrator | TASK [osism.commons.packages : Remove useless packages from the cache] ********* 2026-04-03 04:52:16.318628 | orchestrator | Friday 03 April 2026 04:52:00 +0000 (0:01:12.882) 0:03:02.588 ********** 2026-04-03 04:52:16.318636 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:16.318643 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318651 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318658 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318665 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318673 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318680 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318687 | orchestrator | 2026-04-03 04:52:16.318694 | orchestrator | TASK [osism.commons.packages : Remove dependencies that are no longer required] *** 2026-04-03 04:52:16.318702 | orchestrator | Friday 03 April 2026 04:52:02 +0000 (0:00:01.719) 0:03:04.308 ********** 2026-04-03 04:52:16.318710 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:16.318717 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:16.318725 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:16.318732 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:16.318739 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:16.318747 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:16.318754 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:16.318762 | orchestrator | 2026-04-03 04:52:16.318769 | orchestrator | TASK [osism.commons.sysctl : Include sysctl tasks] ***************************** 2026-04-03 04:52:16.318777 | orchestrator | Friday 03 April 2026 04:52:15 +0000 (0:00:12.485) 0:03:16.793 ********** 2026-04-03 04:52:16.318810 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'elasticsearch', 'value': [{'name': 'vm.max_map_count', 'value': 262144}]}) 2026-04-03 04:52:16.318845 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'rabbitmq', 'value': [{'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}, {'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}, {'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}, {'name': 'net.core.wmem_max', 'value': 16777216}, {'name': 'net.core.rmem_max', 'value': 16777216}, {'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}, {'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}, {'name': 'net.core.somaxconn', 'value': 4096}, {'name': 'net.ipv4.tcp_syncookies', 'value': 0}, {'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}]}) 2026-04-03 04:52:16.318860 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'generic', 'value': [{'name': 'vm.swappiness', 'value': 1}]}) 2026-04-03 04:52:16.318868 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'compute', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-03 04:52:16.318875 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'network', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-03 04:52:16.318881 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'k3s_node', 'value': [{'name': 'fs.inotify.max_user_instances', 'value': 1024}]}) 2026-04-03 04:52:16.318888 | orchestrator | 2026-04-03 04:52:16.318894 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on elasticsearch] *********** 2026-04-03 04:52:16.318900 | orchestrator | Friday 03 April 2026 04:52:15 +0000 (0:00:00.427) 0:03:17.220 ********** 2026-04-03 04:52:16.318907 | orchestrator | skipping: [testbed-manager] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-03 04:52:16.318913 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:16.318920 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-03 04:52:16.318926 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-03 04:52:16.318932 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:16.318939 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:16.318945 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-03 04:52:16.318951 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:16.318958 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 04:52:16.318964 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 04:52:16.318970 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 04:52:16.318976 | orchestrator | 2026-04-03 04:52:16.318983 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on rabbitmq] **************** 2026-04-03 04:52:16.318989 | orchestrator | Friday 03 April 2026 04:52:16 +0000 (0:00:00.701) 0:03:17.922 ********** 2026-04-03 04:52:16.318998 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-03 04:52:16.319006 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-03 04:52:16.319012 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-03 04:52:16.319019 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-03 04:52:16.319025 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-03 04:52:16.319035 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-03 04:52:20.874273 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-03 04:52:20.874375 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-03 04:52:20.874412 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-03 04:52:20.874423 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-03 04:52:20.874435 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-03 04:52:20.874445 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-03 04:52:20.874456 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-03 04:52:20.874467 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-03 04:52:20.874478 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-03 04:52:20.874488 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-03 04:52:20.874499 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-03 04:52:20.874510 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-03 04:52:20.874522 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:20.874534 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-03 04:52:20.874545 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-03 04:52:20.874556 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-03 04:52:20.874566 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-03 04:52:20.874577 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:20.874588 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-03 04:52:20.874599 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-03 04:52:20.874610 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-03 04:52:20.874621 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-03 04:52:20.874631 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-03 04:52:20.874642 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-03 04:52:20.874652 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-03 04:52:20.874663 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-03 04:52:20.874674 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-03 04:52:20.874685 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-03 04:52:20.874695 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:20.874706 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-03 04:52:20.874717 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-03 04:52:20.874727 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-03 04:52:20.874738 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-03 04:52:20.874749 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-03 04:52:20.874759 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-03 04:52:20.874771 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-03 04:52:20.874790 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-03 04:52:20.874801 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:20.874828 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-03 04:52:20.874840 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-03 04:52:20.874880 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-03 04:52:20.874892 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-03 04:52:20.874905 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-03 04:52:20.874934 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-03 04:52:20.874947 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-03 04:52:20.874959 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-03 04:52:20.874972 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-03 04:52:20.874985 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-03 04:52:20.874997 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-03 04:52:20.875010 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-03 04:52:20.875023 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-03 04:52:20.875036 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-03 04:52:20.875048 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-03 04:52:20.875061 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-03 04:52:20.875074 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-03 04:52:20.875087 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-03 04:52:20.875101 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-03 04:52:20.875114 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-03 04:52:20.875127 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-03 04:52:20.875139 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-03 04:52:20.875152 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-03 04:52:20.875165 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-03 04:52:20.875176 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-03 04:52:20.875187 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-03 04:52:20.875197 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-03 04:52:20.875208 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-03 04:52:20.875218 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-03 04:52:20.875230 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-03 04:52:20.875248 | orchestrator | 2026-04-03 04:52:20.875260 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on generic] ***************** 2026-04-03 04:52:20.875271 | orchestrator | Friday 03 April 2026 04:52:19 +0000 (0:00:03.599) 0:03:21.521 ********** 2026-04-03 04:52:20.875282 | orchestrator | changed: [testbed-manager] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875293 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875303 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875314 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875325 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875336 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875346 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-03 04:52:20.875357 | orchestrator | 2026-04-03 04:52:20.875368 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on compute] ***************** 2026-04-03 04:52:20.875379 | orchestrator | Friday 03 April 2026 04:52:20 +0000 (0:00:00.555) 0:03:22.077 ********** 2026-04-03 04:52:20.875390 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:20.875400 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:20.875411 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:20.875428 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:20.875439 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:52:20.875450 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:52:20.875460 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:20.875471 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:52:20.875482 | orchestrator | changed: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:20.875493 | orchestrator | changed: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:20.875510 | orchestrator | changed: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:33.731577 | orchestrator | 2026-04-03 04:52:33.731659 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on network] ***************** 2026-04-03 04:52:33.731667 | orchestrator | Friday 03 April 2026 04:52:20 +0000 (0:00:00.497) 0:03:22.574 ********** 2026-04-03 04:52:33.731672 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:33.731678 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:33.731684 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:33.731690 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:33.731695 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:33.731699 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:33.731704 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-03 04:52:33.731708 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:33.731713 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:33.731718 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:33.731722 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-03 04:52:33.731727 | orchestrator | 2026-04-03 04:52:33.731732 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on k3s_node] **************** 2026-04-03 04:52:33.731751 | orchestrator | Friday 03 April 2026 04:52:21 +0000 (0:00:00.603) 0:03:23.178 ********** 2026-04-03 04:52:33.731756 | orchestrator | skipping: [testbed-manager] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-03 04:52:33.731761 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:33.731765 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-03 04:52:33.731770 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-03 04:52:33.731775 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:52:33.731779 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:52:33.731784 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-03 04:52:33.731788 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:52:33.731793 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-03 04:52:33.731797 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-03 04:52:33.731802 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-03 04:52:33.731807 | orchestrator | 2026-04-03 04:52:33.731811 | orchestrator | TASK [osism.commons.limits : Include limits tasks] ***************************** 2026-04-03 04:52:33.731816 | orchestrator | Friday 03 April 2026 04:52:22 +0000 (0:00:00.566) 0:03:23.745 ********** 2026-04-03 04:52:33.731821 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:33.731825 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:33.731830 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:33.731834 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:33.731839 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:52:33.731844 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:52:33.731848 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:52:33.731853 | orchestrator | 2026-04-03 04:52:33.731857 | orchestrator | TASK [osism.commons.services : Populate service facts] ************************* 2026-04-03 04:52:33.731862 | orchestrator | Friday 03 April 2026 04:52:22 +0000 (0:00:00.330) 0:03:24.075 ********** 2026-04-03 04:52:33.731866 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:33.731913 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:33.731918 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:33.731922 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:33.731927 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:33.731931 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:33.731936 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:33.731940 | orchestrator | 2026-04-03 04:52:33.731945 | orchestrator | TASK [osism.commons.services : Check services] ********************************* 2026-04-03 04:52:33.731950 | orchestrator | Friday 03 April 2026 04:52:27 +0000 (0:00:05.571) 0:03:29.647 ********** 2026-04-03 04:52:33.731954 | orchestrator | skipping: [testbed-manager] => (item=nscd)  2026-04-03 04:52:33.731959 | orchestrator | skipping: [testbed-node-3] => (item=nscd)  2026-04-03 04:52:33.731964 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:33.731968 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:33.731973 | orchestrator | skipping: [testbed-node-4] => (item=nscd)  2026-04-03 04:52:33.731977 | orchestrator | skipping: [testbed-node-5] => (item=nscd)  2026-04-03 04:52:33.731982 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:33.731987 | orchestrator | skipping: [testbed-node-0] => (item=nscd)  2026-04-03 04:52:33.731991 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:33.731996 | orchestrator | skipping: [testbed-node-1] => (item=nscd)  2026-04-03 04:52:33.732013 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:52:33.732018 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:52:33.732023 | orchestrator | skipping: [testbed-node-2] => (item=nscd)  2026-04-03 04:52:33.732028 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:52:33.732032 | orchestrator | 2026-04-03 04:52:33.732044 | orchestrator | TASK [osism.commons.services : Start/enable required services] ***************** 2026-04-03 04:52:33.732048 | orchestrator | Friday 03 April 2026 04:52:28 +0000 (0:00:00.334) 0:03:29.981 ********** 2026-04-03 04:52:33.732053 | orchestrator | ok: [testbed-manager] => (item=cron) 2026-04-03 04:52:33.732058 | orchestrator | ok: [testbed-node-3] => (item=cron) 2026-04-03 04:52:33.732062 | orchestrator | ok: [testbed-node-4] => (item=cron) 2026-04-03 04:52:33.732078 | orchestrator | ok: [testbed-node-5] => (item=cron) 2026-04-03 04:52:33.732083 | orchestrator | ok: [testbed-node-0] => (item=cron) 2026-04-03 04:52:33.732087 | orchestrator | ok: [testbed-node-1] => (item=cron) 2026-04-03 04:52:33.732092 | orchestrator | ok: [testbed-node-2] => (item=cron) 2026-04-03 04:52:33.732096 | orchestrator | 2026-04-03 04:52:33.732101 | orchestrator | TASK [osism.commons.motd : Include distribution specific configure tasks] ****** 2026-04-03 04:52:33.732106 | orchestrator | Friday 03 April 2026 04:52:29 +0000 (0:00:01.021) 0:03:31.003 ********** 2026-04-03 04:52:33.732111 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/motd/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:52:33.732118 | orchestrator | 2026-04-03 04:52:33.732122 | orchestrator | TASK [osism.commons.motd : Remove update-motd package] ************************* 2026-04-03 04:52:33.732127 | orchestrator | Friday 03 April 2026 04:52:29 +0000 (0:00:00.513) 0:03:31.516 ********** 2026-04-03 04:52:33.732131 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:33.732136 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:33.732142 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:33.732147 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:33.732152 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:33.732157 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:33.732162 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:33.732167 | orchestrator | 2026-04-03 04:52:33.732173 | orchestrator | TASK [osism.commons.motd : Check if /etc/default/motd-news exists] ************* 2026-04-03 04:52:33.732179 | orchestrator | Friday 03 April 2026 04:52:30 +0000 (0:00:01.144) 0:03:32.661 ********** 2026-04-03 04:52:33.732184 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:33.732189 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:33.732194 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:33.732200 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:33.732205 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:33.732210 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:33.732215 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:33.732221 | orchestrator | 2026-04-03 04:52:33.732226 | orchestrator | TASK [osism.commons.motd : Disable the dynamic motd-news service] ************** 2026-04-03 04:52:33.732231 | orchestrator | Friday 03 April 2026 04:52:31 +0000 (0:00:00.590) 0:03:33.252 ********** 2026-04-03 04:52:33.732237 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:33.732242 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:33.732248 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:33.732253 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:33.732258 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:33.732263 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:33.732268 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:33.732273 | orchestrator | 2026-04-03 04:52:33.732279 | orchestrator | TASK [osism.commons.motd : Get all configuration files in /etc/pam.d] ********** 2026-04-03 04:52:33.732284 | orchestrator | Friday 03 April 2026 04:52:32 +0000 (0:00:00.578) 0:03:33.830 ********** 2026-04-03 04:52:33.732289 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:33.732295 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:33.732300 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:33.732305 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:33.732310 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:33.732316 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:33.732322 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:33.732327 | orchestrator | 2026-04-03 04:52:33.732332 | orchestrator | TASK [osism.commons.motd : Remove pam_motd.so rule] **************************** 2026-04-03 04:52:33.732341 | orchestrator | Friday 03 April 2026 04:52:32 +0000 (0:00:00.609) 0:03:34.440 ********** 2026-04-03 04:52:33.732350 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190496.2143803, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:33.732357 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190519.4457731, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:33.732366 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190528.0179741, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:33.732383 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190531.1532583, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.480812 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190527.04476, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481006 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190531.668457, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481037 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1775190523.330882, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481096 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481119 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481158 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481181 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481229 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481253 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481274 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 04:52:38.481309 | orchestrator | 2026-04-03 04:52:38.481332 | orchestrator | TASK [osism.commons.motd : Copy motd file] ************************************* 2026-04-03 04:52:38.481354 | orchestrator | Friday 03 April 2026 04:52:33 +0000 (0:00:00.988) 0:03:35.429 ********** 2026-04-03 04:52:38.481373 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:38.481392 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:38.481409 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:38.481425 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:38.481444 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:38.481462 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:38.481481 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:38.481499 | orchestrator | 2026-04-03 04:52:38.481516 | orchestrator | TASK [osism.commons.motd : Copy issue file] ************************************ 2026-04-03 04:52:38.481534 | orchestrator | Friday 03 April 2026 04:52:34 +0000 (0:00:01.095) 0:03:36.524 ********** 2026-04-03 04:52:38.481553 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:38.481572 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:38.481590 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:38.481608 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:38.481627 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:38.481646 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:38.481665 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:38.481682 | orchestrator | 2026-04-03 04:52:38.481699 | orchestrator | TASK [osism.commons.motd : Copy issue.net file] ******************************** 2026-04-03 04:52:38.481717 | orchestrator | Friday 03 April 2026 04:52:35 +0000 (0:00:01.126) 0:03:37.650 ********** 2026-04-03 04:52:38.481734 | orchestrator | changed: [testbed-manager] 2026-04-03 04:52:38.481753 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:52:38.481771 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:52:38.481790 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:52:38.481810 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:52:38.481830 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:52:38.481848 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:52:38.481867 | orchestrator | 2026-04-03 04:52:38.481915 | orchestrator | TASK [osism.commons.motd : Configure SSH to print the motd] ******************** 2026-04-03 04:52:38.481935 | orchestrator | Friday 03 April 2026 04:52:37 +0000 (0:00:01.073) 0:03:38.724 ********** 2026-04-03 04:52:38.481954 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:52:38.481972 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:52:38.482001 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:52:38.482103 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:52:38.482128 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:52:38.482144 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:52:38.482162 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:52:38.482179 | orchestrator | 2026-04-03 04:52:38.482196 | orchestrator | TASK [osism.commons.motd : Configure SSH to not print the motd] **************** 2026-04-03 04:52:38.482213 | orchestrator | Friday 03 April 2026 04:52:37 +0000 (0:00:00.303) 0:03:39.028 ********** 2026-04-03 04:52:38.482231 | orchestrator | ok: [testbed-manager] 2026-04-03 04:52:38.482250 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:52:38.482268 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:52:38.482286 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:52:38.482301 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:52:38.482318 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:52:38.482335 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:52:38.482354 | orchestrator | 2026-04-03 04:52:38.482371 | orchestrator | TASK [osism.services.rng : Include distribution specific install tasks] ******** 2026-04-03 04:52:38.482390 | orchestrator | Friday 03 April 2026 04:52:38 +0000 (0:00:00.699) 0:03:39.728 ********** 2026-04-03 04:52:38.482409 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rng/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:52:38.482449 | orchestrator | 2026-04-03 04:52:38.482469 | orchestrator | TASK [osism.services.rng : Install rng package] ******************************** 2026-04-03 04:52:38.482510 | orchestrator | Friday 03 April 2026 04:52:38 +0000 (0:00:00.450) 0:03:40.179 ********** 2026-04-03 04:53:50.494722 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.494809 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:53:50.494817 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:53:50.494822 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:53:50.494833 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:53:50.494837 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:53:50.494841 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:53:50.494845 | orchestrator | 2026-04-03 04:53:50.494850 | orchestrator | TASK [osism.services.rng : Remove haveged package] ***************************** 2026-04-03 04:53:50.494855 | orchestrator | Friday 03 April 2026 04:52:45 +0000 (0:00:07.467) 0:03:47.646 ********** 2026-04-03 04:53:50.494859 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.494864 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.494868 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.494871 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.494875 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.494879 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.494883 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.494887 | orchestrator | 2026-04-03 04:53:50.494891 | orchestrator | TASK [osism.services.rng : Manage rng service] ********************************* 2026-04-03 04:53:50.494895 | orchestrator | Friday 03 April 2026 04:52:47 +0000 (0:00:01.142) 0:03:48.789 ********** 2026-04-03 04:53:50.494935 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.494941 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.494946 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.494951 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.494954 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.494958 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.494962 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.494965 | orchestrator | 2026-04-03 04:53:50.494970 | orchestrator | TASK [osism.commons.cleanup : Gather variables for each operating system] ****** 2026-04-03 04:53:50.494974 | orchestrator | Friday 03 April 2026 04:52:48 +0000 (0:00:01.173) 0:03:49.963 ********** 2026-04-03 04:53:50.494977 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.494981 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.494985 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.494989 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.494993 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.494997 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.495000 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.495004 | orchestrator | 2026-04-03 04:53:50.495008 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_packages_distribution variable to default value] *** 2026-04-03 04:53:50.495013 | orchestrator | Friday 03 April 2026 04:52:48 +0000 (0:00:00.295) 0:03:50.258 ********** 2026-04-03 04:53:50.495055 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.495059 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.495063 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.495067 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.495071 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.495075 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.495078 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.495082 | orchestrator | 2026-04-03 04:53:50.495086 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_services_distribution variable to default value] *** 2026-04-03 04:53:50.495090 | orchestrator | Friday 03 April 2026 04:52:48 +0000 (0:00:00.326) 0:03:50.585 ********** 2026-04-03 04:53:50.495094 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.495098 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.495102 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.495123 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.495127 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.495131 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.495135 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.495139 | orchestrator | 2026-04-03 04:53:50.495142 | orchestrator | TASK [osism.commons.cleanup : Populate service facts] ************************** 2026-04-03 04:53:50.495146 | orchestrator | Friday 03 April 2026 04:52:49 +0000 (0:00:00.291) 0:03:50.876 ********** 2026-04-03 04:53:50.495150 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.495154 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.495158 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.495161 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.495165 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.495169 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.495173 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.495176 | orchestrator | 2026-04-03 04:53:50.495180 | orchestrator | TASK [osism.commons.cleanup : Include distribution specific timer tasks] ******* 2026-04-03 04:53:50.495184 | orchestrator | Friday 03 April 2026 04:52:54 +0000 (0:00:05.343) 0:03:56.219 ********** 2026-04-03 04:53:50.495190 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/timers-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:53:50.495195 | orchestrator | 2026-04-03 04:53:50.495199 | orchestrator | TASK [osism.commons.cleanup : Disable apt-daily timers] ************************ 2026-04-03 04:53:50.495203 | orchestrator | Friday 03 April 2026 04:52:54 +0000 (0:00:00.427) 0:03:56.647 ********** 2026-04-03 04:53:50.495207 | orchestrator | skipping: [testbed-manager] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495211 | orchestrator | skipping: [testbed-manager] => (item=apt-daily)  2026-04-03 04:53:50.495215 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495220 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily)  2026-04-03 04:53:50.495223 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:53:50.495239 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495243 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily)  2026-04-03 04:53:50.495247 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:53:50.495251 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:53:50.495254 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495258 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily)  2026-04-03 04:53:50.495262 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495266 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily)  2026-04-03 04:53:50.495269 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:53:50.495273 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495277 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily)  2026-04-03 04:53:50.495292 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:53:50.495297 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:53:50.495301 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily-upgrade)  2026-04-03 04:53:50.495306 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily)  2026-04-03 04:53:50.495310 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:53:50.495315 | orchestrator | 2026-04-03 04:53:50.495319 | orchestrator | TASK [osism.commons.cleanup : Include service tasks] *************************** 2026-04-03 04:53:50.495323 | orchestrator | Friday 03 April 2026 04:52:55 +0000 (0:00:00.385) 0:03:57.033 ********** 2026-04-03 04:53:50.495328 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/services-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:53:50.495333 | orchestrator | 2026-04-03 04:53:50.495337 | orchestrator | TASK [osism.commons.cleanup : Cleanup services] ******************************** 2026-04-03 04:53:50.495346 | orchestrator | Friday 03 April 2026 04:52:55 +0000 (0:00:00.387) 0:03:57.420 ********** 2026-04-03 04:53:50.495350 | orchestrator | skipping: [testbed-manager] => (item=ModemManager.service)  2026-04-03 04:53:50.495354 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:53:50.495359 | orchestrator | skipping: [testbed-node-3] => (item=ModemManager.service)  2026-04-03 04:53:50.495363 | orchestrator | skipping: [testbed-node-4] => (item=ModemManager.service)  2026-04-03 04:53:50.495368 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:53:50.495373 | orchestrator | skipping: [testbed-node-5] => (item=ModemManager.service)  2026-04-03 04:53:50.495377 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:53:50.495381 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:53:50.495386 | orchestrator | skipping: [testbed-node-0] => (item=ModemManager.service)  2026-04-03 04:53:50.495390 | orchestrator | skipping: [testbed-node-1] => (item=ModemManager.service)  2026-04-03 04:53:50.495395 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:53:50.495399 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:53:50.495404 | orchestrator | skipping: [testbed-node-2] => (item=ModemManager.service)  2026-04-03 04:53:50.495408 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:53:50.495412 | orchestrator | 2026-04-03 04:53:50.495416 | orchestrator | TASK [osism.commons.cleanup : Include packages tasks] ************************** 2026-04-03 04:53:50.495421 | orchestrator | Friday 03 April 2026 04:52:56 +0000 (0:00:00.303) 0:03:57.724 ********** 2026-04-03 04:53:50.495426 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/packages-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:53:50.495431 | orchestrator | 2026-04-03 04:53:50.495435 | orchestrator | TASK [osism.commons.cleanup : Cleanup installed packages] ********************** 2026-04-03 04:53:50.495440 | orchestrator | Friday 03 April 2026 04:52:56 +0000 (0:00:00.442) 0:03:58.166 ********** 2026-04-03 04:53:50.495444 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:53:50.495449 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:53:50.495453 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:53:50.495457 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:53:50.495462 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:53:50.495466 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:53:50.495471 | orchestrator | changed: [testbed-manager] 2026-04-03 04:53:50.495475 | orchestrator | 2026-04-03 04:53:50.495479 | orchestrator | TASK [osism.commons.cleanup : Remove cloudinit package] ************************ 2026-04-03 04:53:50.495484 | orchestrator | Friday 03 April 2026 04:53:29 +0000 (0:00:32.685) 0:04:30.852 ********** 2026-04-03 04:53:50.495488 | orchestrator | changed: [testbed-manager] 2026-04-03 04:53:50.495492 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:53:50.495497 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:53:50.495501 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:53:50.495505 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:53:50.495510 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:53:50.495514 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:53:50.495519 | orchestrator | 2026-04-03 04:53:50.495523 | orchestrator | TASK [osism.commons.cleanup : Uninstall unattended-upgrades package] *********** 2026-04-03 04:53:50.495530 | orchestrator | Friday 03 April 2026 04:53:36 +0000 (0:00:07.406) 0:04:38.258 ********** 2026-04-03 04:53:50.495535 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:53:50.495539 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:53:50.495544 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:53:50.495548 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:53:50.495553 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:53:50.495558 | orchestrator | changed: [testbed-manager] 2026-04-03 04:53:50.495562 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:53:50.495566 | orchestrator | 2026-04-03 04:53:50.495571 | orchestrator | TASK [osism.commons.cleanup : Remove useless packages from the cache] ********** 2026-04-03 04:53:50.495579 | orchestrator | Friday 03 April 2026 04:53:43 +0000 (0:00:06.934) 0:04:45.193 ********** 2026-04-03 04:53:50.495583 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:53:50.495586 | orchestrator | ok: [testbed-manager] 2026-04-03 04:53:50.495590 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:53:50.495594 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:53:50.495598 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:53:50.495601 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:53:50.495605 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:53:50.495609 | orchestrator | 2026-04-03 04:53:50.495613 | orchestrator | TASK [osism.commons.cleanup : Remove dependencies that are no longer required] *** 2026-04-03 04:53:50.495617 | orchestrator | Friday 03 April 2026 04:53:45 +0000 (0:00:01.623) 0:04:46.817 ********** 2026-04-03 04:53:50.495620 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:53:50.495624 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:53:50.495628 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:53:50.495632 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:53:50.495635 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:53:50.495639 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:53:50.495643 | orchestrator | changed: [testbed-manager] 2026-04-03 04:53:50.495647 | orchestrator | 2026-04-03 04:53:50.495653 | orchestrator | TASK [osism.commons.cleanup : Include cloudinit tasks] ************************* 2026-04-03 04:54:01.707282 | orchestrator | Friday 03 April 2026 04:53:50 +0000 (0:00:05.363) 0:04:52.180 ********** 2026-04-03 04:54:01.707393 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/cloudinit.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:54:01.707405 | orchestrator | 2026-04-03 04:54:01.707411 | orchestrator | TASK [osism.commons.cleanup : Remove cloud-init configuration directory] ******* 2026-04-03 04:54:01.707416 | orchestrator | Friday 03 April 2026 04:53:51 +0000 (0:00:00.544) 0:04:52.724 ********** 2026-04-03 04:54:01.707421 | orchestrator | changed: [testbed-manager] 2026-04-03 04:54:01.707426 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:01.707431 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:01.707435 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:01.707440 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:01.707444 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:01.707449 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:01.707453 | orchestrator | 2026-04-03 04:54:01.707498 | orchestrator | TASK [osism.commons.timezone : Install tzdata package] ************************* 2026-04-03 04:54:01.707506 | orchestrator | Friday 03 April 2026 04:53:51 +0000 (0:00:00.704) 0:04:53.428 ********** 2026-04-03 04:54:01.707511 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:01.707516 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:54:01.707521 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:54:01.707526 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:54:01.707530 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:54:01.707535 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:54:01.707539 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:54:01.707543 | orchestrator | 2026-04-03 04:54:01.707548 | orchestrator | TASK [osism.commons.timezone : Set timezone to UTC] **************************** 2026-04-03 04:54:01.707553 | orchestrator | Friday 03 April 2026 04:53:53 +0000 (0:00:01.670) 0:04:55.099 ********** 2026-04-03 04:54:01.707557 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:01.707561 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:01.707566 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:01.707570 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:01.707576 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:01.707584 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:01.707591 | orchestrator | changed: [testbed-manager] 2026-04-03 04:54:01.707597 | orchestrator | 2026-04-03 04:54:01.707604 | orchestrator | TASK [osism.commons.timezone : Create /etc/adjtime file] *********************** 2026-04-03 04:54:01.707611 | orchestrator | Friday 03 April 2026 04:53:54 +0000 (0:00:00.792) 0:04:55.891 ********** 2026-04-03 04:54:01.707636 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.707644 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.707651 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.707658 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:01.707665 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:01.707672 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:01.707679 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:01.707687 | orchestrator | 2026-04-03 04:54:01.707694 | orchestrator | TASK [osism.commons.timezone : Ensure UTC in /etc/adjtime] ********************* 2026-04-03 04:54:01.707701 | orchestrator | Friday 03 April 2026 04:53:54 +0000 (0:00:00.314) 0:04:56.205 ********** 2026-04-03 04:54:01.707707 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.707715 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.707722 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.707729 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:01.707735 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:01.707742 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:01.707749 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:01.707756 | orchestrator | 2026-04-03 04:54:01.707762 | orchestrator | TASK [osism.services.docker : Gather variables for each operating system] ****** 2026-04-03 04:54:01.707769 | orchestrator | Friday 03 April 2026 04:53:54 +0000 (0:00:00.434) 0:04:56.639 ********** 2026-04-03 04:54:01.707776 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:01.707783 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:54:01.707791 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:54:01.707798 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:54:01.707806 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:54:01.707813 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:54:01.707821 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:54:01.707827 | orchestrator | 2026-04-03 04:54:01.707834 | orchestrator | TASK [osism.services.docker : Set docker_version variable to default value] **** 2026-04-03 04:54:01.707857 | orchestrator | Friday 03 April 2026 04:53:55 +0000 (0:00:00.287) 0:04:56.927 ********** 2026-04-03 04:54:01.707866 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.707874 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.707883 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.707891 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:01.707900 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:01.707908 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:01.707917 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:01.707925 | orchestrator | 2026-04-03 04:54:01.707933 | orchestrator | TASK [osism.services.docker : Set docker_cli_version variable to default value] *** 2026-04-03 04:54:01.707942 | orchestrator | Friday 03 April 2026 04:53:55 +0000 (0:00:00.312) 0:04:57.239 ********** 2026-04-03 04:54:01.707950 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:01.707958 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:54:01.707965 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:54:01.707973 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:54:01.707981 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:54:01.707988 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:54:01.707995 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:54:01.708003 | orchestrator | 2026-04-03 04:54:01.708011 | orchestrator | TASK [osism.services.docker : Print used docker version] *********************** 2026-04-03 04:54:01.708020 | orchestrator | Friday 03 April 2026 04:53:55 +0000 (0:00:00.340) 0:04:57.579 ********** 2026-04-03 04:54:01.708028 | orchestrator | ok: [testbed-manager] =>  2026-04-03 04:54:01.708067 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708077 | orchestrator | ok: [testbed-node-3] =>  2026-04-03 04:54:01.708085 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708094 | orchestrator | ok: [testbed-node-4] =>  2026-04-03 04:54:01.708103 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708112 | orchestrator | ok: [testbed-node-5] =>  2026-04-03 04:54:01.708121 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708147 | orchestrator | ok: [testbed-node-0] =>  2026-04-03 04:54:01.708166 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708175 | orchestrator | ok: [testbed-node-1] =>  2026-04-03 04:54:01.708185 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708193 | orchestrator | ok: [testbed-node-2] =>  2026-04-03 04:54:01.708202 | orchestrator |  docker_version: 5:27.5.1 2026-04-03 04:54:01.708210 | orchestrator | 2026-04-03 04:54:01.708218 | orchestrator | TASK [osism.services.docker : Print used docker cli version] ******************* 2026-04-03 04:54:01.708226 | orchestrator | Friday 03 April 2026 04:53:56 +0000 (0:00:00.281) 0:04:57.861 ********** 2026-04-03 04:54:01.708234 | orchestrator | ok: [testbed-manager] =>  2026-04-03 04:54:01.708242 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708249 | orchestrator | ok: [testbed-node-3] =>  2026-04-03 04:54:01.708257 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708265 | orchestrator | ok: [testbed-node-4] =>  2026-04-03 04:54:01.708273 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708280 | orchestrator | ok: [testbed-node-5] =>  2026-04-03 04:54:01.708288 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708296 | orchestrator | ok: [testbed-node-0] =>  2026-04-03 04:54:01.708303 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708311 | orchestrator | ok: [testbed-node-1] =>  2026-04-03 04:54:01.708319 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708327 | orchestrator | ok: [testbed-node-2] =>  2026-04-03 04:54:01.708334 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-03 04:54:01.708343 | orchestrator | 2026-04-03 04:54:01.708351 | orchestrator | TASK [osism.services.docker : Include block storage tasks] ********************* 2026-04-03 04:54:01.708359 | orchestrator | Friday 03 April 2026 04:53:56 +0000 (0:00:00.315) 0:04:58.176 ********** 2026-04-03 04:54:01.708367 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.708375 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.708382 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.708390 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:01.708398 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:01.708406 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:01.708413 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:01.708420 | orchestrator | 2026-04-03 04:54:01.708427 | orchestrator | TASK [osism.services.docker : Include zram storage tasks] ********************** 2026-04-03 04:54:01.708434 | orchestrator | Friday 03 April 2026 04:53:56 +0000 (0:00:00.273) 0:04:58.450 ********** 2026-04-03 04:54:01.708440 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.708447 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.708454 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.708461 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:01.708467 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:01.708474 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:01.708481 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:01.708488 | orchestrator | 2026-04-03 04:54:01.708494 | orchestrator | TASK [osism.services.docker : Include docker install tasks] ******************** 2026-04-03 04:54:01.708501 | orchestrator | Friday 03 April 2026 04:53:57 +0000 (0:00:00.306) 0:04:58.757 ********** 2026-04-03 04:54:01.708510 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/install-docker-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:54:01.708518 | orchestrator | 2026-04-03 04:54:01.708525 | orchestrator | TASK [osism.services.docker : Remove old architecture-dependent repository] **** 2026-04-03 04:54:01.708532 | orchestrator | Friday 03 April 2026 04:53:57 +0000 (0:00:00.500) 0:04:59.257 ********** 2026-04-03 04:54:01.708539 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:01.708545 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:54:01.708552 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:54:01.708558 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:54:01.708565 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:54:01.708580 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:54:01.708588 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:54:01.708596 | orchestrator | 2026-04-03 04:54:01.708603 | orchestrator | TASK [osism.services.docker : Gather package facts] **************************** 2026-04-03 04:54:01.708609 | orchestrator | Friday 03 April 2026 04:53:58 +0000 (0:00:00.958) 0:05:00.216 ********** 2026-04-03 04:54:01.708617 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:54:01.708624 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:54:01.708631 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:54:01.708638 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:54:01.708645 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:01.708658 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:54:01.708665 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:54:01.708672 | orchestrator | 2026-04-03 04:54:01.708679 | orchestrator | TASK [osism.services.docker : Check whether packages are installed that should not be installed] *** 2026-04-03 04:54:01.708687 | orchestrator | Friday 03 April 2026 04:54:01 +0000 (0:00:02.816) 0:05:03.032 ********** 2026-04-03 04:54:01.708695 | orchestrator | skipping: [testbed-manager] => (item=containerd)  2026-04-03 04:54:01.708702 | orchestrator | skipping: [testbed-manager] => (item=docker.io)  2026-04-03 04:54:01.708710 | orchestrator | skipping: [testbed-manager] => (item=docker-engine)  2026-04-03 04:54:01.708717 | orchestrator | skipping: [testbed-node-3] => (item=containerd)  2026-04-03 04:54:01.708724 | orchestrator | skipping: [testbed-node-3] => (item=docker.io)  2026-04-03 04:54:01.708730 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:01.708737 | orchestrator | skipping: [testbed-node-3] => (item=docker-engine)  2026-04-03 04:54:01.708745 | orchestrator | skipping: [testbed-node-4] => (item=containerd)  2026-04-03 04:54:01.708752 | orchestrator | skipping: [testbed-node-4] => (item=docker.io)  2026-04-03 04:54:01.708758 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:01.708766 | orchestrator | skipping: [testbed-node-4] => (item=docker-engine)  2026-04-03 04:54:01.708771 | orchestrator | skipping: [testbed-node-5] => (item=containerd)  2026-04-03 04:54:01.708776 | orchestrator | skipping: [testbed-node-5] => (item=docker.io)  2026-04-03 04:54:01.708780 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:01.708784 | orchestrator | skipping: [testbed-node-5] => (item=docker-engine)  2026-04-03 04:54:01.708789 | orchestrator | skipping: [testbed-node-0] => (item=containerd)  2026-04-03 04:54:01.708802 | orchestrator | skipping: [testbed-node-0] => (item=docker.io)  2026-04-03 04:54:58.016325 | orchestrator | skipping: [testbed-node-0] => (item=docker-engine)  2026-04-03 04:54:58.016445 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:58.016461 | orchestrator | skipping: [testbed-node-1] => (item=containerd)  2026-04-03 04:54:58.016474 | orchestrator | skipping: [testbed-node-1] => (item=docker.io)  2026-04-03 04:54:58.016486 | orchestrator | skipping: [testbed-node-1] => (item=docker-engine)  2026-04-03 04:54:58.016496 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:58.016507 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:58.016518 | orchestrator | skipping: [testbed-node-2] => (item=containerd)  2026-04-03 04:54:58.016529 | orchestrator | skipping: [testbed-node-2] => (item=docker.io)  2026-04-03 04:54:58.016540 | orchestrator | skipping: [testbed-node-2] => (item=docker-engine)  2026-04-03 04:54:58.016551 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:58.016562 | orchestrator | 2026-04-03 04:54:58.016574 | orchestrator | TASK [osism.services.docker : Install apt-transport-https package] ************* 2026-04-03 04:54:58.016586 | orchestrator | Friday 03 April 2026 04:54:01 +0000 (0:00:00.574) 0:05:03.606 ********** 2026-04-03 04:54:58.016597 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.016608 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.016619 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.016630 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.016641 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.016652 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.016690 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.016701 | orchestrator | 2026-04-03 04:54:58.016713 | orchestrator | TASK [osism.services.docker : Add repository gpg key] ************************** 2026-04-03 04:54:58.016723 | orchestrator | Friday 03 April 2026 04:54:07 +0000 (0:00:05.162) 0:05:08.769 ********** 2026-04-03 04:54:58.016734 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.016745 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.016756 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.016766 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.016777 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.016787 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.016798 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.016809 | orchestrator | 2026-04-03 04:54:58.016819 | orchestrator | TASK [osism.services.docker : Add repository] ********************************** 2026-04-03 04:54:58.016830 | orchestrator | Friday 03 April 2026 04:54:08 +0000 (0:00:00.979) 0:05:09.749 ********** 2026-04-03 04:54:58.016841 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.016854 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.016867 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.016880 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.016893 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.016905 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.016918 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.016930 | orchestrator | 2026-04-03 04:54:58.016943 | orchestrator | TASK [osism.services.docker : Update package cache] **************************** 2026-04-03 04:54:58.016956 | orchestrator | Friday 03 April 2026 04:54:15 +0000 (0:00:07.894) 0:05:17.644 ********** 2026-04-03 04:54:58.016968 | orchestrator | changed: [testbed-manager] 2026-04-03 04:54:58.016981 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.016994 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017007 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017020 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017032 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017045 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017058 | orchestrator | 2026-04-03 04:54:58.017070 | orchestrator | TASK [osism.services.docker : Pin docker package version] ********************** 2026-04-03 04:54:58.017083 | orchestrator | Friday 03 April 2026 04:54:19 +0000 (0:00:03.163) 0:05:20.807 ********** 2026-04-03 04:54:58.017095 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.017108 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017120 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017161 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017174 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017187 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017201 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017213 | orchestrator | 2026-04-03 04:54:58.017224 | orchestrator | TASK [osism.services.docker : Pin docker-cli package version] ****************** 2026-04-03 04:54:58.017235 | orchestrator | Friday 03 April 2026 04:54:20 +0000 (0:00:01.247) 0:05:22.055 ********** 2026-04-03 04:54:58.017246 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.017257 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017268 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017278 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017289 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017299 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017310 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017321 | orchestrator | 2026-04-03 04:54:58.017332 | orchestrator | TASK [osism.services.docker : Unlock containerd package] *********************** 2026-04-03 04:54:58.017342 | orchestrator | Friday 03 April 2026 04:54:21 +0000 (0:00:01.498) 0:05:23.553 ********** 2026-04-03 04:54:58.017353 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:58.017364 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:58.017374 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:58.017385 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:58.017405 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:58.017415 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:58.017426 | orchestrator | changed: [testbed-manager] 2026-04-03 04:54:58.017437 | orchestrator | 2026-04-03 04:54:58.017448 | orchestrator | TASK [osism.services.docker : Install containerd package] ********************** 2026-04-03 04:54:58.017459 | orchestrator | Friday 03 April 2026 04:54:22 +0000 (0:00:00.645) 0:05:24.198 ********** 2026-04-03 04:54:58.017469 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.017480 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017491 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017501 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017512 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017522 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017533 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017543 | orchestrator | 2026-04-03 04:54:58.017554 | orchestrator | TASK [osism.services.docker : Lock containerd package] ************************* 2026-04-03 04:54:58.017582 | orchestrator | Friday 03 April 2026 04:54:31 +0000 (0:00:08.866) 0:05:33.064 ********** 2026-04-03 04:54:58.017594 | orchestrator | changed: [testbed-manager] 2026-04-03 04:54:58.017604 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017615 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017626 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017636 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017646 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017657 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017667 | orchestrator | 2026-04-03 04:54:58.017678 | orchestrator | TASK [osism.services.docker : Install docker-cli package] ********************** 2026-04-03 04:54:58.017689 | orchestrator | Friday 03 April 2026 04:54:32 +0000 (0:00:00.915) 0:05:33.979 ********** 2026-04-03 04:54:58.017700 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.017710 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017721 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017731 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017742 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017752 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017763 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017773 | orchestrator | 2026-04-03 04:54:58.017784 | orchestrator | TASK [osism.services.docker : Install docker package] ************************** 2026-04-03 04:54:58.017795 | orchestrator | Friday 03 April 2026 04:54:40 +0000 (0:00:08.728) 0:05:42.708 ********** 2026-04-03 04:54:58.017805 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.017816 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.017826 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.017837 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.017847 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.017858 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.017868 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.017878 | orchestrator | 2026-04-03 04:54:58.017889 | orchestrator | TASK [osism.services.docker : Unblock installation of python docker packages] *** 2026-04-03 04:54:58.017900 | orchestrator | Friday 03 April 2026 04:54:51 +0000 (0:00:10.275) 0:05:52.983 ********** 2026-04-03 04:54:58.017911 | orchestrator | ok: [testbed-manager] => (item=python3-docker) 2026-04-03 04:54:58.017921 | orchestrator | ok: [testbed-node-3] => (item=python3-docker) 2026-04-03 04:54:58.017932 | orchestrator | ok: [testbed-node-4] => (item=python3-docker) 2026-04-03 04:54:58.017942 | orchestrator | ok: [testbed-node-5] => (item=python3-docker) 2026-04-03 04:54:58.017953 | orchestrator | ok: [testbed-node-0] => (item=python3-docker) 2026-04-03 04:54:58.017963 | orchestrator | ok: [testbed-manager] => (item=python-docker) 2026-04-03 04:54:58.017974 | orchestrator | ok: [testbed-node-3] => (item=python-docker) 2026-04-03 04:54:58.017984 | orchestrator | ok: [testbed-node-1] => (item=python3-docker) 2026-04-03 04:54:58.017995 | orchestrator | ok: [testbed-node-2] => (item=python3-docker) 2026-04-03 04:54:58.018015 | orchestrator | ok: [testbed-node-4] => (item=python-docker) 2026-04-03 04:54:58.018091 | orchestrator | ok: [testbed-node-5] => (item=python-docker) 2026-04-03 04:54:58.018180 | orchestrator | ok: [testbed-node-0] => (item=python-docker) 2026-04-03 04:54:58.018204 | orchestrator | ok: [testbed-node-1] => (item=python-docker) 2026-04-03 04:54:58.018223 | orchestrator | ok: [testbed-node-2] => (item=python-docker) 2026-04-03 04:54:58.018235 | orchestrator | 2026-04-03 04:54:58.018246 | orchestrator | TASK [osism.services.docker : Install python3 docker package] ****************** 2026-04-03 04:54:58.018257 | orchestrator | Friday 03 April 2026 04:54:52 +0000 (0:00:01.205) 0:05:54.189 ********** 2026-04-03 04:54:58.018267 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:58.018278 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:58.018288 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:58.018299 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:58.018309 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:58.018320 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:58.018330 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:58.018341 | orchestrator | 2026-04-03 04:54:58.018352 | orchestrator | TASK [osism.services.docker : Install python3 docker package from Debian Sid] *** 2026-04-03 04:54:58.018363 | orchestrator | Friday 03 April 2026 04:54:53 +0000 (0:00:00.577) 0:05:54.767 ********** 2026-04-03 04:54:58.018373 | orchestrator | ok: [testbed-manager] 2026-04-03 04:54:58.018384 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:54:58.018395 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:54:58.018405 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:54:58.018416 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:54:58.018426 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:54:58.018441 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:54:58.018452 | orchestrator | 2026-04-03 04:54:58.018463 | orchestrator | TASK [osism.services.docker : Remove python docker packages (install python bindings from pip)] *** 2026-04-03 04:54:58.018475 | orchestrator | Friday 03 April 2026 04:54:57 +0000 (0:00:03.960) 0:05:58.727 ********** 2026-04-03 04:54:58.018485 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:58.018496 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:58.018506 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:58.018517 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:54:58.018527 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:54:58.018538 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:54:58.018548 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:54:58.018801 | orchestrator | 2026-04-03 04:54:58.018818 | orchestrator | TASK [osism.services.docker : Block installation of python docker packages (install python bindings from pip)] *** 2026-04-03 04:54:58.018829 | orchestrator | Friday 03 April 2026 04:54:57 +0000 (0:00:00.513) 0:05:59.241 ********** 2026-04-03 04:54:58.018840 | orchestrator | skipping: [testbed-manager] => (item=python3-docker)  2026-04-03 04:54:58.018851 | orchestrator | skipping: [testbed-manager] => (item=python-docker)  2026-04-03 04:54:58.018862 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:54:58.018873 | orchestrator | skipping: [testbed-node-3] => (item=python3-docker)  2026-04-03 04:54:58.018883 | orchestrator | skipping: [testbed-node-3] => (item=python-docker)  2026-04-03 04:54:58.018894 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:54:58.018904 | orchestrator | skipping: [testbed-node-4] => (item=python3-docker)  2026-04-03 04:54:58.018915 | orchestrator | skipping: [testbed-node-4] => (item=python-docker)  2026-04-03 04:54:58.018926 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:54:58.018949 | orchestrator | skipping: [testbed-node-5] => (item=python3-docker)  2026-04-03 04:55:16.883551 | orchestrator | skipping: [testbed-node-5] => (item=python-docker)  2026-04-03 04:55:16.883663 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:16.883677 | orchestrator | skipping: [testbed-node-0] => (item=python3-docker)  2026-04-03 04:55:16.883688 | orchestrator | skipping: [testbed-node-0] => (item=python-docker)  2026-04-03 04:55:16.883698 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:16.883728 | orchestrator | skipping: [testbed-node-1] => (item=python3-docker)  2026-04-03 04:55:16.883739 | orchestrator | skipping: [testbed-node-1] => (item=python-docker)  2026-04-03 04:55:16.883749 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:16.883759 | orchestrator | skipping: [testbed-node-2] => (item=python3-docker)  2026-04-03 04:55:16.883768 | orchestrator | skipping: [testbed-node-2] => (item=python-docker)  2026-04-03 04:55:16.883778 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:16.883788 | orchestrator | 2026-04-03 04:55:16.883799 | orchestrator | TASK [osism.services.docker : Install python3-pip package (install python bindings from pip)] *** 2026-04-03 04:55:16.883810 | orchestrator | Friday 03 April 2026 04:54:58 +0000 (0:00:00.724) 0:05:59.966 ********** 2026-04-03 04:55:16.883820 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:16.883829 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:16.883839 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:16.883848 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:16.883858 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:16.883867 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:16.883877 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:16.883886 | orchestrator | 2026-04-03 04:55:16.883896 | orchestrator | TASK [osism.services.docker : Install docker packages (install python bindings from pip)] *** 2026-04-03 04:55:16.883906 | orchestrator | Friday 03 April 2026 04:54:58 +0000 (0:00:00.505) 0:06:00.471 ********** 2026-04-03 04:55:16.883915 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:16.883924 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:16.883934 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:16.883943 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:16.883953 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:16.883962 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:16.883971 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:16.883981 | orchestrator | 2026-04-03 04:55:16.883990 | orchestrator | TASK [osism.services.docker : Install packages required by docker login] ******* 2026-04-03 04:55:16.884000 | orchestrator | Friday 03 April 2026 04:54:59 +0000 (0:00:00.513) 0:06:00.984 ********** 2026-04-03 04:55:16.884009 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:16.884019 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:16.884028 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:16.884037 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:16.884047 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:16.884056 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:16.884065 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:16.884075 | orchestrator | 2026-04-03 04:55:16.884084 | orchestrator | TASK [osism.services.docker : Ensure that some packages are not installed] ***** 2026-04-03 04:55:16.884094 | orchestrator | Friday 03 April 2026 04:54:59 +0000 (0:00:00.562) 0:06:01.547 ********** 2026-04-03 04:55:16.884106 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.884119 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.884130 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.884141 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.884152 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.884214 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.884232 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.884248 | orchestrator | 2026-04-03 04:55:16.884263 | orchestrator | TASK [osism.services.docker : Include config tasks] **************************** 2026-04-03 04:55:16.884275 | orchestrator | Friday 03 April 2026 04:55:01 +0000 (0:00:01.854) 0:06:03.401 ********** 2026-04-03 04:55:16.884288 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/config.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:55:16.884302 | orchestrator | 2026-04-03 04:55:16.884314 | orchestrator | TASK [osism.services.docker : Create plugins directory] ************************ 2026-04-03 04:55:16.884325 | orchestrator | Friday 03 April 2026 04:55:02 +0000 (0:00:00.883) 0:06:04.285 ********** 2026-04-03 04:55:16.884353 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.884366 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:16.884377 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:16.884388 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:16.884400 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:16.884410 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:16.884422 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:16.884433 | orchestrator | 2026-04-03 04:55:16.884444 | orchestrator | TASK [osism.services.docker : Create systemd overlay directory] **************** 2026-04-03 04:55:16.884456 | orchestrator | Friday 03 April 2026 04:55:03 +0000 (0:00:00.841) 0:06:05.126 ********** 2026-04-03 04:55:16.884467 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.884477 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:16.884486 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:16.884496 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:16.884505 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:16.884515 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:16.884524 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:16.884534 | orchestrator | 2026-04-03 04:55:16.884543 | orchestrator | TASK [osism.services.docker : Copy systemd overlay file] *********************** 2026-04-03 04:55:16.884553 | orchestrator | Friday 03 April 2026 04:55:04 +0000 (0:00:00.853) 0:06:05.979 ********** 2026-04-03 04:55:16.884562 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.884572 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:16.884581 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:16.884591 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:16.884600 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:16.884610 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:16.884619 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:16.884628 | orchestrator | 2026-04-03 04:55:16.884638 | orchestrator | TASK [osism.services.docker : Reload systemd daemon if systemd overlay file is changed] *** 2026-04-03 04:55:16.884667 | orchestrator | Friday 03 April 2026 04:55:05 +0000 (0:00:01.583) 0:06:07.563 ********** 2026-04-03 04:55:16.884684 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:16.884698 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.884712 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.884727 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.884744 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.884763 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.884782 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.884802 | orchestrator | 2026-04-03 04:55:16.884820 | orchestrator | TASK [osism.services.docker : Copy limits configuration file] ****************** 2026-04-03 04:55:16.884833 | orchestrator | Friday 03 April 2026 04:55:07 +0000 (0:00:01.270) 0:06:08.834 ********** 2026-04-03 04:55:16.884844 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.884855 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:16.884865 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:16.884876 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:16.884887 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:16.884897 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:16.884908 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:16.884919 | orchestrator | 2026-04-03 04:55:16.884930 | orchestrator | TASK [osism.services.docker : Copy daemon.json configuration file] ************* 2026-04-03 04:55:16.884940 | orchestrator | Friday 03 April 2026 04:55:08 +0000 (0:00:01.261) 0:06:10.095 ********** 2026-04-03 04:55:16.884951 | orchestrator | changed: [testbed-manager] 2026-04-03 04:55:16.884962 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:16.884972 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:16.884983 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:16.884994 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:16.885005 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:16.885015 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:16.885026 | orchestrator | 2026-04-03 04:55:16.885045 | orchestrator | TASK [osism.services.docker : Include service tasks] *************************** 2026-04-03 04:55:16.885057 | orchestrator | Friday 03 April 2026 04:55:09 +0000 (0:00:01.339) 0:06:11.435 ********** 2026-04-03 04:55:16.885068 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/service.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:55:16.885079 | orchestrator | 2026-04-03 04:55:16.885090 | orchestrator | TASK [osism.services.docker : Reload systemd daemon] *************************** 2026-04-03 04:55:16.885101 | orchestrator | Friday 03 April 2026 04:55:10 +0000 (0:00:01.070) 0:06:12.506 ********** 2026-04-03 04:55:16.885112 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.885122 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.885133 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.885144 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.885154 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.885195 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.885207 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.885217 | orchestrator | 2026-04-03 04:55:16.885228 | orchestrator | TASK [osism.services.docker : Manage service] ********************************** 2026-04-03 04:55:16.885239 | orchestrator | Friday 03 April 2026 04:55:12 +0000 (0:00:01.282) 0:06:13.788 ********** 2026-04-03 04:55:16.885250 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.885261 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.885271 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.885281 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.885292 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.885303 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.885313 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.885324 | orchestrator | 2026-04-03 04:55:16.885335 | orchestrator | TASK [osism.services.docker : Manage docker socket service] ******************** 2026-04-03 04:55:16.885346 | orchestrator | Friday 03 April 2026 04:55:13 +0000 (0:00:01.097) 0:06:14.886 ********** 2026-04-03 04:55:16.885357 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.885367 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.885378 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.885388 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.885399 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.885409 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.885420 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.885430 | orchestrator | 2026-04-03 04:55:16.885441 | orchestrator | TASK [osism.services.docker : Manage containerd service] *********************** 2026-04-03 04:55:16.885452 | orchestrator | Friday 03 April 2026 04:55:14 +0000 (0:00:01.087) 0:06:15.973 ********** 2026-04-03 04:55:16.885463 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:16.885490 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:16.885501 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:16.885512 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:16.885523 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:16.885533 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:16.885544 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:16.885554 | orchestrator | 2026-04-03 04:55:16.885565 | orchestrator | TASK [osism.services.docker : Include bootstrap tasks] ************************* 2026-04-03 04:55:16.885576 | orchestrator | Friday 03 April 2026 04:55:15 +0000 (0:00:01.341) 0:06:17.315 ********** 2026-04-03 04:55:16.885586 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/bootstrap.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:55:16.885597 | orchestrator | 2026-04-03 04:55:16.885608 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:16.885619 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.927) 0:06:18.243 ********** 2026-04-03 04:55:16.885630 | orchestrator | 2026-04-03 04:55:16.885641 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:16.885658 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.046) 0:06:18.289 ********** 2026-04-03 04:55:16.885669 | orchestrator | 2026-04-03 04:55:16.885680 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:16.885691 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.039) 0:06:18.329 ********** 2026-04-03 04:55:16.885702 | orchestrator | 2026-04-03 04:55:16.885713 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:16.885736 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.067) 0:06:18.397 ********** 2026-04-03 04:55:41.593109 | orchestrator | 2026-04-03 04:55:41.593276 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:41.593294 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.040) 0:06:18.438 ********** 2026-04-03 04:55:41.593304 | orchestrator | 2026-04-03 04:55:41.593313 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:41.593323 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.039) 0:06:18.477 ********** 2026-04-03 04:55:41.593332 | orchestrator | 2026-04-03 04:55:41.593342 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-03 04:55:41.593351 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.048) 0:06:18.525 ********** 2026-04-03 04:55:41.593361 | orchestrator | 2026-04-03 04:55:41.593369 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-03 04:55:41.593379 | orchestrator | Friday 03 April 2026 04:55:16 +0000 (0:00:00.040) 0:06:18.565 ********** 2026-04-03 04:55:41.593388 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:41.593398 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:41.593407 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:41.593415 | orchestrator | 2026-04-03 04:55:41.593425 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart rsyslog service] ************* 2026-04-03 04:55:41.593434 | orchestrator | Friday 03 April 2026 04:55:17 +0000 (0:00:01.116) 0:06:19.682 ********** 2026-04-03 04:55:41.593444 | orchestrator | changed: [testbed-manager] 2026-04-03 04:55:41.593454 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:41.593462 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:41.593471 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:41.593480 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:41.593490 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:41.593499 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:41.593508 | orchestrator | 2026-04-03 04:55:41.593515 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart logrotate service] *********** 2026-04-03 04:55:41.593523 | orchestrator | Friday 03 April 2026 04:55:19 +0000 (0:00:01.440) 0:06:21.122 ********** 2026-04-03 04:55:41.593531 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:41.593539 | orchestrator | changed: [testbed-manager] 2026-04-03 04:55:41.593547 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:41.593555 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:41.593563 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:41.593571 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:41.593579 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:41.593588 | orchestrator | 2026-04-03 04:55:41.593596 | orchestrator | RUNNING HANDLER [osism.services.docker : Restart docker service] *************** 2026-04-03 04:55:41.593605 | orchestrator | Friday 03 April 2026 04:55:20 +0000 (0:00:01.157) 0:06:22.280 ********** 2026-04-03 04:55:41.593613 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:41.593622 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:41.593631 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:41.593639 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:41.593648 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:41.593657 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:41.593666 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:41.593674 | orchestrator | 2026-04-03 04:55:41.593683 | orchestrator | RUNNING HANDLER [osism.services.docker : Wait after docker service restart] **** 2026-04-03 04:55:41.593692 | orchestrator | Friday 03 April 2026 04:55:22 +0000 (0:00:02.209) 0:06:24.489 ********** 2026-04-03 04:55:41.593722 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:41.593731 | orchestrator | 2026-04-03 04:55:41.593740 | orchestrator | TASK [osism.services.docker : Add user to docker group] ************************ 2026-04-03 04:55:41.593750 | orchestrator | Friday 03 April 2026 04:55:22 +0000 (0:00:00.099) 0:06:24.589 ********** 2026-04-03 04:55:41.593760 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.593768 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:41.593777 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:41.593786 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:41.593795 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:55:41.593805 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:41.593814 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:41.593823 | orchestrator | 2026-04-03 04:55:41.593833 | orchestrator | TASK [osism.services.docker : Log into private registry and force re-authorization] *** 2026-04-03 04:55:41.593844 | orchestrator | Friday 03 April 2026 04:55:23 +0000 (0:00:01.006) 0:06:25.596 ********** 2026-04-03 04:55:41.593854 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:41.593880 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:41.593890 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:41.593898 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:41.593907 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:41.593915 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:41.593925 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:41.593935 | orchestrator | 2026-04-03 04:55:41.593944 | orchestrator | TASK [osism.services.docker : Include facts tasks] ***************************** 2026-04-03 04:55:41.593953 | orchestrator | Friday 03 April 2026 04:55:24 +0000 (0:00:00.530) 0:06:26.126 ********** 2026-04-03 04:55:41.593963 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/facts.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:55:41.593975 | orchestrator | 2026-04-03 04:55:41.593984 | orchestrator | TASK [osism.services.docker : Create facts directory] ************************** 2026-04-03 04:55:41.593992 | orchestrator | Friday 03 April 2026 04:55:25 +0000 (0:00:01.087) 0:06:27.214 ********** 2026-04-03 04:55:41.594001 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.594011 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:41.594078 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:41.594088 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:41.594096 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:41.594106 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:41.594116 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:41.594126 | orchestrator | 2026-04-03 04:55:41.594134 | orchestrator | TASK [osism.services.docker : Copy docker fact files] ************************** 2026-04-03 04:55:41.594144 | orchestrator | Friday 03 April 2026 04:55:26 +0000 (0:00:00.828) 0:06:28.043 ********** 2026-04-03 04:55:41.594153 | orchestrator | ok: [testbed-manager] => (item=docker_containers) 2026-04-03 04:55:41.594181 | orchestrator | changed: [testbed-node-3] => (item=docker_containers) 2026-04-03 04:55:41.594192 | orchestrator | changed: [testbed-node-4] => (item=docker_containers) 2026-04-03 04:55:41.594218 | orchestrator | changed: [testbed-node-5] => (item=docker_containers) 2026-04-03 04:55:41.594227 | orchestrator | changed: [testbed-node-0] => (item=docker_containers) 2026-04-03 04:55:41.594237 | orchestrator | changed: [testbed-node-1] => (item=docker_containers) 2026-04-03 04:55:41.594245 | orchestrator | changed: [testbed-node-2] => (item=docker_containers) 2026-04-03 04:55:41.594254 | orchestrator | ok: [testbed-manager] => (item=docker_images) 2026-04-03 04:55:41.594263 | orchestrator | changed: [testbed-node-3] => (item=docker_images) 2026-04-03 04:55:41.594271 | orchestrator | changed: [testbed-node-4] => (item=docker_images) 2026-04-03 04:55:41.594279 | orchestrator | changed: [testbed-node-5] => (item=docker_images) 2026-04-03 04:55:41.594287 | orchestrator | changed: [testbed-node-0] => (item=docker_images) 2026-04-03 04:55:41.594304 | orchestrator | changed: [testbed-node-1] => (item=docker_images) 2026-04-03 04:55:41.594312 | orchestrator | changed: [testbed-node-2] => (item=docker_images) 2026-04-03 04:55:41.594321 | orchestrator | 2026-04-03 04:55:41.594329 | orchestrator | TASK [osism.commons.docker_compose : This install type is not supported] ******* 2026-04-03 04:55:41.594337 | orchestrator | Friday 03 April 2026 04:55:28 +0000 (0:00:02.414) 0:06:30.457 ********** 2026-04-03 04:55:41.594346 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:41.594354 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:41.594362 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:41.594369 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:41.594377 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:41.594385 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:41.594393 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:41.594402 | orchestrator | 2026-04-03 04:55:41.594410 | orchestrator | TASK [osism.commons.docker_compose : Include distribution specific install tasks] *** 2026-04-03 04:55:41.594419 | orchestrator | Friday 03 April 2026 04:55:29 +0000 (0:00:00.678) 0:06:31.136 ********** 2026-04-03 04:55:41.594429 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/docker_compose/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:55:41.594440 | orchestrator | 2026-04-03 04:55:41.594449 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose apt preferences file] *** 2026-04-03 04:55:41.594458 | orchestrator | Friday 03 April 2026 04:55:30 +0000 (0:00:00.826) 0:06:31.963 ********** 2026-04-03 04:55:41.594466 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.594474 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:41.594482 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:41.594491 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:41.594500 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:41.594509 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:41.594518 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:41.594527 | orchestrator | 2026-04-03 04:55:41.594535 | orchestrator | TASK [osism.commons.docker_compose : Get checksum of docker-compose file] ****** 2026-04-03 04:55:41.594545 | orchestrator | Friday 03 April 2026 04:55:31 +0000 (0:00:00.850) 0:06:32.813 ********** 2026-04-03 04:55:41.594554 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.594563 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:41.594572 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:41.594580 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:41.594590 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:41.594599 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:41.594608 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:41.594617 | orchestrator | 2026-04-03 04:55:41.594625 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose binary] ************* 2026-04-03 04:55:41.594634 | orchestrator | Friday 03 April 2026 04:55:32 +0000 (0:00:01.026) 0:06:33.840 ********** 2026-04-03 04:55:41.594644 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:41.594653 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:41.594663 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:41.594672 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:41.594681 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:41.594691 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:41.594700 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:41.594709 | orchestrator | 2026-04-03 04:55:41.594719 | orchestrator | TASK [osism.commons.docker_compose : Uninstall docker-compose package] ********* 2026-04-03 04:55:41.594729 | orchestrator | Friday 03 April 2026 04:55:32 +0000 (0:00:00.494) 0:06:34.334 ********** 2026-04-03 04:55:41.594739 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.594749 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:55:41.594758 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:55:41.594768 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:55:41.594778 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:55:41.594798 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:55:41.594806 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:55:41.594816 | orchestrator | 2026-04-03 04:55:41.594825 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose script] *************** 2026-04-03 04:55:41.594836 | orchestrator | Friday 03 April 2026 04:55:34 +0000 (0:00:01.382) 0:06:35.717 ********** 2026-04-03 04:55:41.594846 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:55:41.594856 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:55:41.594866 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:55:41.594876 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:55:41.594885 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:55:41.594895 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:55:41.594904 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:55:41.594914 | orchestrator | 2026-04-03 04:55:41.594923 | orchestrator | TASK [osism.commons.docker_compose : Install docker-compose-plugin package] **** 2026-04-03 04:55:41.594933 | orchestrator | Friday 03 April 2026 04:55:34 +0000 (0:00:00.547) 0:06:36.264 ********** 2026-04-03 04:55:41.594943 | orchestrator | ok: [testbed-manager] 2026-04-03 04:55:41.594951 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:55:41.594960 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:55:41.594969 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:55:41.594978 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:55:41.594987 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:55:41.595005 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:12.670125 | orchestrator | 2026-04-03 04:56:12.670245 | orchestrator | TASK [osism.commons.docker_compose : Copy osism.target systemd file] *********** 2026-04-03 04:56:12.670337 | orchestrator | Friday 03 April 2026 04:55:41 +0000 (0:00:07.017) 0:06:43.282 ********** 2026-04-03 04:56:12.670358 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.670379 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:12.670392 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:12.670403 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:12.670415 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:12.670426 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:12.670437 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:12.670447 | orchestrator | 2026-04-03 04:56:12.670459 | orchestrator | TASK [osism.commons.docker_compose : Enable osism.target] ********************** 2026-04-03 04:56:12.670470 | orchestrator | Friday 03 April 2026 04:55:43 +0000 (0:00:01.525) 0:06:44.807 ********** 2026-04-03 04:56:12.670481 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.670492 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:12.670502 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:12.670513 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:12.670524 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:12.670535 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:12.670545 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:12.670556 | orchestrator | 2026-04-03 04:56:12.670567 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose systemd unit file] **** 2026-04-03 04:56:12.670578 | orchestrator | Friday 03 April 2026 04:55:44 +0000 (0:00:01.662) 0:06:46.470 ********** 2026-04-03 04:56:12.670589 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.670601 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:12.670614 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:12.670626 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:12.670639 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:12.670652 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:12.670665 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:12.670677 | orchestrator | 2026-04-03 04:56:12.670690 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 04:56:12.670718 | orchestrator | Friday 03 April 2026 04:55:46 +0000 (0:00:01.600) 0:06:48.070 ********** 2026-04-03 04:56:12.670729 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.670751 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.670762 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.670803 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.670824 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.670844 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.670862 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.670882 | orchestrator | 2026-04-03 04:56:12.670901 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 04:56:12.670920 | orchestrator | Friday 03 April 2026 04:55:47 +0000 (0:00:00.851) 0:06:48.922 ********** 2026-04-03 04:56:12.670932 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:56:12.670943 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:56:12.670954 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:56:12.670965 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:56:12.670976 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:56:12.670987 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:56:12.670998 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:56:12.671008 | orchestrator | 2026-04-03 04:56:12.671019 | orchestrator | TASK [osism.services.chrony : Check minimum and maximum number of servers] ***** 2026-04-03 04:56:12.671030 | orchestrator | Friday 03 April 2026 04:55:48 +0000 (0:00:01.030) 0:06:49.952 ********** 2026-04-03 04:56:12.671041 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:56:12.671052 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:56:12.671063 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:56:12.671073 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:56:12.671084 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:56:12.671094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:56:12.671105 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:56:12.671116 | orchestrator | 2026-04-03 04:56:12.671127 | orchestrator | TASK [osism.services.chrony : Gather variables for each operating system] ****** 2026-04-03 04:56:12.671138 | orchestrator | Friday 03 April 2026 04:55:48 +0000 (0:00:00.556) 0:06:50.509 ********** 2026-04-03 04:56:12.671148 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671177 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671188 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671199 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.671210 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.671220 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.671236 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.671287 | orchestrator | 2026-04-03 04:56:12.671300 | orchestrator | TASK [osism.services.chrony : Set chrony_conf_file variable to default value] *** 2026-04-03 04:56:12.671311 | orchestrator | Friday 03 April 2026 04:55:49 +0000 (0:00:00.527) 0:06:51.036 ********** 2026-04-03 04:56:12.671322 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671332 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671343 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671354 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.671365 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.671375 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.671386 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.671396 | orchestrator | 2026-04-03 04:56:12.671407 | orchestrator | TASK [osism.services.chrony : Set chrony_key_file variable to default value] *** 2026-04-03 04:56:12.671418 | orchestrator | Friday 03 April 2026 04:55:49 +0000 (0:00:00.523) 0:06:51.560 ********** 2026-04-03 04:56:12.671429 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671439 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671450 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671460 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.671471 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.671481 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.671492 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.671502 | orchestrator | 2026-04-03 04:56:12.671525 | orchestrator | TASK [osism.services.chrony : Populate service facts] ************************** 2026-04-03 04:56:12.671536 | orchestrator | Friday 03 April 2026 04:55:50 +0000 (0:00:00.726) 0:06:52.287 ********** 2026-04-03 04:56:12.671558 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671569 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671590 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671600 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.671611 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.671622 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.671632 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.671643 | orchestrator | 2026-04-03 04:56:12.671674 | orchestrator | TASK [osism.services.chrony : Manage timesyncd service] ************************ 2026-04-03 04:56:12.671686 | orchestrator | Friday 03 April 2026 04:55:55 +0000 (0:00:05.411) 0:06:57.699 ********** 2026-04-03 04:56:12.671697 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:56:12.671708 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:56:12.671719 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:56:12.671729 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:56:12.671740 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:56:12.671751 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:56:12.671762 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:56:12.671772 | orchestrator | 2026-04-03 04:56:12.671783 | orchestrator | TASK [osism.services.chrony : Include distribution specific install tasks] ***** 2026-04-03 04:56:12.671794 | orchestrator | Friday 03 April 2026 04:55:56 +0000 (0:00:00.562) 0:06:58.261 ********** 2026-04-03 04:56:12.671807 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:12.671820 | orchestrator | 2026-04-03 04:56:12.671832 | orchestrator | TASK [osism.services.chrony : Install package] ********************************* 2026-04-03 04:56:12.671842 | orchestrator | Friday 03 April 2026 04:55:57 +0000 (0:00:01.059) 0:06:59.321 ********** 2026-04-03 04:56:12.671853 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671864 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671875 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671885 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.671896 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.671907 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.671917 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.671928 | orchestrator | 2026-04-03 04:56:12.671939 | orchestrator | TASK [osism.services.chrony : Manage chrony service] *************************** 2026-04-03 04:56:12.671950 | orchestrator | Friday 03 April 2026 04:55:59 +0000 (0:00:01.807) 0:07:01.128 ********** 2026-04-03 04:56:12.671961 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.671971 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.671982 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.671993 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.672003 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.672014 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.672024 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.672035 | orchestrator | 2026-04-03 04:56:12.672046 | orchestrator | TASK [osism.services.chrony : Check if configuration file exists] ************** 2026-04-03 04:56:12.672057 | orchestrator | Friday 03 April 2026 04:56:00 +0000 (0:00:01.103) 0:07:02.232 ********** 2026-04-03 04:56:12.672067 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:12.672078 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:12.672089 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:12.672099 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:12.672110 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:12.672121 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:12.672131 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:12.672142 | orchestrator | 2026-04-03 04:56:12.672153 | orchestrator | TASK [osism.services.chrony : Copy configuration file] ************************* 2026-04-03 04:56:12.672164 | orchestrator | Friday 03 April 2026 04:56:01 +0000 (0:00:00.825) 0:07:03.057 ********** 2026-04-03 04:56:12.672175 | orchestrator | changed: [testbed-manager] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672188 | orchestrator | changed: [testbed-node-3] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672205 | orchestrator | changed: [testbed-node-4] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672217 | orchestrator | changed: [testbed-node-5] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672233 | orchestrator | changed: [testbed-node-0] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672244 | orchestrator | changed: [testbed-node-1] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672274 | orchestrator | changed: [testbed-node-2] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-03 04:56:12.672285 | orchestrator | 2026-04-03 04:56:12.672296 | orchestrator | TASK [osism.services.lldpd : Include distribution specific install tasks] ****** 2026-04-03 04:56:12.672307 | orchestrator | Friday 03 April 2026 04:56:03 +0000 (0:00:01.851) 0:07:04.909 ********** 2026-04-03 04:56:12.672318 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/lldpd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:12.672329 | orchestrator | 2026-04-03 04:56:12.672340 | orchestrator | TASK [osism.services.lldpd : Install lldpd package] **************************** 2026-04-03 04:56:12.672351 | orchestrator | Friday 03 April 2026 04:56:04 +0000 (0:00:00.833) 0:07:05.743 ********** 2026-04-03 04:56:12.672362 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:12.672373 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:12.672384 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:12.672395 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:12.672406 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:12.672417 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:12.672427 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:12.672438 | orchestrator | 2026-04-03 04:56:12.672456 | orchestrator | TASK [osism.services.lldpd : Manage lldpd service] ***************************** 2026-04-03 04:56:42.732693 | orchestrator | Friday 03 April 2026 04:56:12 +0000 (0:00:08.616) 0:07:14.359 ********** 2026-04-03 04:56:42.732806 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:42.732824 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:42.732836 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:42.732847 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:42.732857 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:42.732868 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:42.732878 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:42.732890 | orchestrator | 2026-04-03 04:56:42.732902 | orchestrator | RUNNING HANDLER [osism.commons.docker_compose : Reload systemd daemon] ********* 2026-04-03 04:56:42.732913 | orchestrator | Friday 03 April 2026 04:56:14 +0000 (0:00:01.966) 0:07:16.326 ********** 2026-04-03 04:56:42.732924 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:42.732935 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:42.732945 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:42.732956 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:42.732967 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:42.732977 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:42.732988 | orchestrator | 2026-04-03 04:56:42.732999 | orchestrator | RUNNING HANDLER [osism.services.chrony : Restart chrony service] *************** 2026-04-03 04:56:42.733010 | orchestrator | Friday 03 April 2026 04:56:15 +0000 (0:00:01.265) 0:07:17.591 ********** 2026-04-03 04:56:42.733021 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.733033 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.733044 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.733054 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.733065 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.733103 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.733114 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.733125 | orchestrator | 2026-04-03 04:56:42.733136 | orchestrator | PLAY [Apply bootstrap role part 2] ********************************************* 2026-04-03 04:56:42.733147 | orchestrator | 2026-04-03 04:56:42.733157 | orchestrator | TASK [Include hardening role] ************************************************** 2026-04-03 04:56:42.733169 | orchestrator | Friday 03 April 2026 04:56:17 +0000 (0:00:01.215) 0:07:18.807 ********** 2026-04-03 04:56:42.733179 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:56:42.733190 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:56:42.733203 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:56:42.733215 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:56:42.733228 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:56:42.733241 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:56:42.733253 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:56:42.733265 | orchestrator | 2026-04-03 04:56:42.733278 | orchestrator | PLAY [Apply bootstrap roles part 3] ******************************************** 2026-04-03 04:56:42.733292 | orchestrator | 2026-04-03 04:56:42.733325 | orchestrator | TASK [osism.services.journald : Copy configuration file] *********************** 2026-04-03 04:56:42.733338 | orchestrator | Friday 03 April 2026 04:56:17 +0000 (0:00:00.731) 0:07:19.538 ********** 2026-04-03 04:56:42.733350 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.733362 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.733375 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.733388 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.733400 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.733413 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.733426 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.733436 | orchestrator | 2026-04-03 04:56:42.733447 | orchestrator | TASK [osism.services.journald : Manage journald service] *********************** 2026-04-03 04:56:42.733458 | orchestrator | Friday 03 April 2026 04:56:19 +0000 (0:00:01.298) 0:07:20.837 ********** 2026-04-03 04:56:42.733469 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:42.733479 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:42.733490 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:42.733501 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:42.733512 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:42.733522 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:42.733533 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:42.733543 | orchestrator | 2026-04-03 04:56:42.733554 | orchestrator | TASK [Include auditd role] ***************************************************** 2026-04-03 04:56:42.733565 | orchestrator | Friday 03 April 2026 04:56:20 +0000 (0:00:01.427) 0:07:22.265 ********** 2026-04-03 04:56:42.733576 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:56:42.733587 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:56:42.733598 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:56:42.733608 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:56:42.733619 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:56:42.733645 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:56:42.733656 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:56:42.733667 | orchestrator | 2026-04-03 04:56:42.733678 | orchestrator | TASK [Include smartd role] ***************************************************** 2026-04-03 04:56:42.733689 | orchestrator | Friday 03 April 2026 04:56:21 +0000 (0:00:00.500) 0:07:22.765 ********** 2026-04-03 04:56:42.733701 | orchestrator | included: osism.services.smartd for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:42.733713 | orchestrator | 2026-04-03 04:56:42.733724 | orchestrator | TASK [osism.services.smartd : Include distribution specific install tasks] ***** 2026-04-03 04:56:42.733735 | orchestrator | Friday 03 April 2026 04:56:22 +0000 (0:00:01.040) 0:07:23.806 ********** 2026-04-03 04:56:42.733747 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/smartd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:42.733768 | orchestrator | 2026-04-03 04:56:42.733779 | orchestrator | TASK [osism.services.smartd : Install smartmontools package] ******************* 2026-04-03 04:56:42.733790 | orchestrator | Friday 03 April 2026 04:56:22 +0000 (0:00:00.791) 0:07:24.597 ********** 2026-04-03 04:56:42.733801 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.733811 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.733822 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.733838 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.733856 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.733875 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.733894 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.733909 | orchestrator | 2026-04-03 04:56:42.733949 | orchestrator | TASK [osism.services.smartd : Create /var/log/smartd directory] **************** 2026-04-03 04:56:42.733967 | orchestrator | Friday 03 April 2026 04:56:31 +0000 (0:00:08.180) 0:07:32.778 ********** 2026-04-03 04:56:42.733986 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734004 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734085 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734098 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734109 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734119 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734130 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734141 | orchestrator | 2026-04-03 04:56:42.734152 | orchestrator | TASK [osism.services.smartd : Copy smartmontools configuration file] *********** 2026-04-03 04:56:42.734163 | orchestrator | Friday 03 April 2026 04:56:32 +0000 (0:00:01.023) 0:07:33.801 ********** 2026-04-03 04:56:42.734174 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734185 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734206 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734217 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734228 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734239 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734250 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734261 | orchestrator | 2026-04-03 04:56:42.734272 | orchestrator | TASK [osism.services.smartd : Manage smartd service] *************************** 2026-04-03 04:56:42.734283 | orchestrator | Friday 03 April 2026 04:56:33 +0000 (0:00:01.336) 0:07:35.137 ********** 2026-04-03 04:56:42.734293 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734329 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734340 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734351 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734362 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734373 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734384 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734394 | orchestrator | 2026-04-03 04:56:42.734405 | orchestrator | RUNNING HANDLER [osism.services.journald : Restart journald service] *********** 2026-04-03 04:56:42.734416 | orchestrator | Friday 03 April 2026 04:56:35 +0000 (0:00:01.976) 0:07:37.114 ********** 2026-04-03 04:56:42.734427 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734438 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734449 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734460 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734470 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734481 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734492 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734503 | orchestrator | 2026-04-03 04:56:42.734514 | orchestrator | RUNNING HANDLER [osism.services.smartd : Restart smartd service] *************** 2026-04-03 04:56:42.734525 | orchestrator | Friday 03 April 2026 04:56:36 +0000 (0:00:01.204) 0:07:38.318 ********** 2026-04-03 04:56:42.734536 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734547 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734569 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734580 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734591 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734606 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734625 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734642 | orchestrator | 2026-04-03 04:56:42.734659 | orchestrator | PLAY [Set state bootstrap] ***************************************************** 2026-04-03 04:56:42.734678 | orchestrator | 2026-04-03 04:56:42.734695 | orchestrator | TASK [Set osism.bootstrap.status fact] ***************************************** 2026-04-03 04:56:42.734715 | orchestrator | Friday 03 April 2026 04:56:37 +0000 (0:00:01.090) 0:07:39.409 ********** 2026-04-03 04:56:42.734735 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:42.734754 | orchestrator | 2026-04-03 04:56:42.734767 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-03 04:56:42.734778 | orchestrator | Friday 03 April 2026 04:56:38 +0000 (0:00:00.889) 0:07:40.298 ********** 2026-04-03 04:56:42.734789 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:42.734799 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:42.734810 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:42.734821 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:42.734832 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:42.734842 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:42.734860 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:42.734872 | orchestrator | 2026-04-03 04:56:42.734883 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-03 04:56:42.734893 | orchestrator | Friday 03 April 2026 04:56:39 +0000 (0:00:01.095) 0:07:41.394 ********** 2026-04-03 04:56:42.734904 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:42.734915 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:42.734926 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:42.734937 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:42.734948 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:42.734959 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:42.734969 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:42.734980 | orchestrator | 2026-04-03 04:56:42.734991 | orchestrator | TASK [Set osism.bootstrap.timestamp fact] ************************************** 2026-04-03 04:56:42.735002 | orchestrator | Friday 03 April 2026 04:56:40 +0000 (0:00:01.162) 0:07:42.556 ********** 2026-04-03 04:56:42.735013 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 04:56:42.735029 | orchestrator | 2026-04-03 04:56:42.735048 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-03 04:56:42.735066 | orchestrator | Friday 03 April 2026 04:56:41 +0000 (0:00:01.017) 0:07:43.573 ********** 2026-04-03 04:56:42.735083 | orchestrator | ok: [testbed-manager] 2026-04-03 04:56:42.735101 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:56:42.735120 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:56:42.735138 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:56:42.735157 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:56:42.735175 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:56:42.735193 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:56:42.735210 | orchestrator | 2026-04-03 04:56:42.735243 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-03 04:56:44.355946 | orchestrator | Friday 03 April 2026 04:56:42 +0000 (0:00:00.853) 0:07:44.426 ********** 2026-04-03 04:56:44.356049 | orchestrator | changed: [testbed-manager] 2026-04-03 04:56:44.356066 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:56:44.356078 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:56:44.356090 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:56:44.356101 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:56:44.356112 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:56:44.356123 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:56:44.356160 | orchestrator | 2026-04-03 04:56:44.356173 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:56:44.356185 | orchestrator | testbed-manager : ok=168  changed=40  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-03 04:56:44.356198 | orchestrator | testbed-node-0 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-03 04:56:44.356209 | orchestrator | testbed-node-1 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-03 04:56:44.356220 | orchestrator | testbed-node-2 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-03 04:56:44.356231 | orchestrator | testbed-node-3 : ok=175  changed=65  unreachable=0 failed=0 skipped=38  rescued=0 ignored=0 2026-04-03 04:56:44.356242 | orchestrator | testbed-node-4 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-03 04:56:44.356253 | orchestrator | testbed-node-5 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-03 04:56:44.356263 | orchestrator | 2026-04-03 04:56:44.356274 | orchestrator | 2026-04-03 04:56:44.356285 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:56:44.356297 | orchestrator | Friday 03 April 2026 04:56:43 +0000 (0:00:01.131) 0:07:45.558 ********** 2026-04-03 04:56:44.356356 | orchestrator | =============================================================================== 2026-04-03 04:56:44.356367 | orchestrator | osism.commons.packages : Install required packages --------------------- 72.88s 2026-04-03 04:56:44.356379 | orchestrator | osism.commons.packages : Download required packages -------------------- 39.41s 2026-04-03 04:56:44.356389 | orchestrator | osism.commons.cleanup : Cleanup installed packages --------------------- 32.69s 2026-04-03 04:56:44.356400 | orchestrator | osism.commons.repository : Update package cache ------------------------ 14.60s 2026-04-03 04:56:44.356411 | orchestrator | osism.commons.packages : Remove dependencies that are no longer required -- 12.49s 2026-04-03 04:56:44.356422 | orchestrator | osism.commons.systohc : Install util-linux-extra package --------------- 12.26s 2026-04-03 04:56:44.356433 | orchestrator | osism.services.docker : Install docker package ------------------------- 10.28s 2026-04-03 04:56:44.356444 | orchestrator | osism.services.docker : Install containerd package ---------------------- 8.87s 2026-04-03 04:56:44.356455 | orchestrator | osism.services.docker : Install docker-cli package ---------------------- 8.73s 2026-04-03 04:56:44.356466 | orchestrator | osism.services.lldpd : Install lldpd package ---------------------------- 8.62s 2026-04-03 04:56:44.356477 | orchestrator | osism.services.smartd : Install smartmontools package ------------------- 8.18s 2026-04-03 04:56:44.356489 | orchestrator | osism.services.docker : Add repository ---------------------------------- 7.89s 2026-04-03 04:56:44.356502 | orchestrator | osism.services.rng : Install rng package -------------------------------- 7.47s 2026-04-03 04:56:44.356529 | orchestrator | osism.commons.cleanup : Remove cloudinit package ------------------------ 7.41s 2026-04-03 04:56:44.356543 | orchestrator | osism.commons.docker_compose : Install docker-compose-plugin package ---- 7.02s 2026-04-03 04:56:44.356555 | orchestrator | osism.commons.cleanup : Uninstall unattended-upgrades package ----------- 6.93s 2026-04-03 04:56:44.356567 | orchestrator | osism.commons.services : Populate service facts ------------------------- 5.57s 2026-04-03 04:56:44.356580 | orchestrator | osism.services.chrony : Populate service facts -------------------------- 5.41s 2026-04-03 04:56:44.356593 | orchestrator | osism.commons.cleanup : Remove dependencies that are no longer required --- 5.36s 2026-04-03 04:56:44.356605 | orchestrator | osism.commons.cleanup : Populate service facts -------------------------- 5.34s 2026-04-03 04:56:44.657134 | orchestrator | + osism apply fail2ban 2026-04-03 04:56:57.409098 | orchestrator | 2026-04-03 04:56:57 | INFO  | Task 2a5e6b08-95d5-40ef-a0d6-ce610b60ad61 (fail2ban) was prepared for execution. 2026-04-03 04:56:57.409197 | orchestrator | 2026-04-03 04:56:57 | INFO  | It takes a moment until task 2a5e6b08-95d5-40ef-a0d6-ce610b60ad61 (fail2ban) has been started and output is visible here. 2026-04-03 04:57:19.544947 | orchestrator | 2026-04-03 04:57:19.545028 | orchestrator | PLAY [Apply role fail2ban] ***************************************************** 2026-04-03 04:57:19.545036 | orchestrator | 2026-04-03 04:57:19.545041 | orchestrator | TASK [osism.services.fail2ban : Include distribution specific install tasks] *** 2026-04-03 04:57:19.545045 | orchestrator | Friday 03 April 2026 04:57:01 +0000 (0:00:00.268) 0:00:00.268 ********** 2026-04-03 04:57:19.545050 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/fail2ban/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 04:57:19.545056 | orchestrator | 2026-04-03 04:57:19.545059 | orchestrator | TASK [osism.services.fail2ban : Install fail2ban package] ********************** 2026-04-03 04:57:19.545063 | orchestrator | Friday 03 April 2026 04:57:03 +0000 (0:00:01.173) 0:00:01.441 ********** 2026-04-03 04:57:19.545067 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:57:19.545072 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:57:19.545076 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:57:19.545080 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:57:19.545084 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:57:19.545088 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:57:19.545091 | orchestrator | changed: [testbed-manager] 2026-04-03 04:57:19.545096 | orchestrator | 2026-04-03 04:57:19.545100 | orchestrator | TASK [osism.services.fail2ban : Copy configuration files] ********************** 2026-04-03 04:57:19.545103 | orchestrator | Friday 03 April 2026 04:57:13 +0000 (0:00:10.809) 0:00:12.251 ********** 2026-04-03 04:57:19.545107 | orchestrator | changed: [testbed-manager] 2026-04-03 04:57:19.545111 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:57:19.545115 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:57:19.545119 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:57:19.545122 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:57:19.545126 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:57:19.545130 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:57:19.545134 | orchestrator | 2026-04-03 04:57:19.545137 | orchestrator | TASK [osism.services.fail2ban : Manage fail2ban service] *********************** 2026-04-03 04:57:19.545141 | orchestrator | Friday 03 April 2026 04:57:15 +0000 (0:00:01.398) 0:00:13.649 ********** 2026-04-03 04:57:19.545145 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:57:19.545150 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:57:19.545153 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:57:19.545157 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:57:19.545161 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:57:19.545165 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:57:19.545168 | orchestrator | ok: [testbed-manager] 2026-04-03 04:57:19.545172 | orchestrator | 2026-04-03 04:57:19.545176 | orchestrator | TASK [osism.services.fail2ban : Reload fail2ban configuration] ***************** 2026-04-03 04:57:19.545180 | orchestrator | Friday 03 April 2026 04:57:17 +0000 (0:00:02.228) 0:00:15.878 ********** 2026-04-03 04:57:19.545184 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:57:19.545191 | orchestrator | changed: [testbed-manager] 2026-04-03 04:57:19.545197 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:57:19.545203 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:57:19.545209 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:57:19.545215 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:57:19.545221 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:57:19.545227 | orchestrator | 2026-04-03 04:57:19.545234 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:57:19.545240 | orchestrator | testbed-manager : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545269 | orchestrator | testbed-node-0 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545274 | orchestrator | testbed-node-1 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545278 | orchestrator | testbed-node-2 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545281 | orchestrator | testbed-node-3 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545285 | orchestrator | testbed-node-4 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545289 | orchestrator | testbed-node-5 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:57:19.545293 | orchestrator | 2026-04-03 04:57:19.545297 | orchestrator | 2026-04-03 04:57:19.545301 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:57:19.545305 | orchestrator | Friday 03 April 2026 04:57:19 +0000 (0:00:01.620) 0:00:17.499 ********** 2026-04-03 04:57:19.545309 | orchestrator | =============================================================================== 2026-04-03 04:57:19.545313 | orchestrator | osism.services.fail2ban : Install fail2ban package --------------------- 10.81s 2026-04-03 04:57:19.545316 | orchestrator | osism.services.fail2ban : Manage fail2ban service ----------------------- 2.23s 2026-04-03 04:57:19.545320 | orchestrator | osism.services.fail2ban : Reload fail2ban configuration ----------------- 1.62s 2026-04-03 04:57:19.545324 | orchestrator | osism.services.fail2ban : Copy configuration files ---------------------- 1.40s 2026-04-03 04:57:19.545327 | orchestrator | osism.services.fail2ban : Include distribution specific install tasks --- 1.17s 2026-04-03 04:57:19.869188 | orchestrator | + osism apply network 2026-04-03 04:57:32.007489 | orchestrator | 2026-04-03 04:57:31 | INFO  | Task 4d2d6f5e-b138-4298-b83a-c9b5b1a9b236 (network) was prepared for execution. 2026-04-03 04:57:32.007606 | orchestrator | 2026-04-03 04:57:32 | INFO  | It takes a moment until task 4d2d6f5e-b138-4298-b83a-c9b5b1a9b236 (network) has been started and output is visible here. 2026-04-03 04:58:00.463301 | orchestrator | 2026-04-03 04:58:00.463491 | orchestrator | PLAY [Apply role network] ****************************************************** 2026-04-03 04:58:00.463525 | orchestrator | 2026-04-03 04:58:00.463547 | orchestrator | TASK [osism.commons.network : Gather variables for each operating system] ****** 2026-04-03 04:58:00.463567 | orchestrator | Friday 03 April 2026 04:57:36 +0000 (0:00:00.282) 0:00:00.282 ********** 2026-04-03 04:58:00.463586 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.463603 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.463614 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.463625 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.463635 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.463646 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.463657 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.463668 | orchestrator | 2026-04-03 04:58:00.463679 | orchestrator | TASK [osism.commons.network : Include type specific tasks] ********************* 2026-04-03 04:58:00.463690 | orchestrator | Friday 03 April 2026 04:57:37 +0000 (0:00:00.731) 0:00:01.013 ********** 2026-04-03 04:58:00.463703 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/netplan-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 04:58:00.463717 | orchestrator | 2026-04-03 04:58:00.463728 | orchestrator | TASK [osism.commons.network : Install required packages] *********************** 2026-04-03 04:58:00.463739 | orchestrator | Friday 03 April 2026 04:57:38 +0000 (0:00:01.216) 0:00:02.230 ********** 2026-04-03 04:58:00.463779 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.463791 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.463802 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.463816 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.463831 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.463850 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.463877 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.463899 | orchestrator | 2026-04-03 04:58:00.463917 | orchestrator | TASK [osism.commons.network : Remove ifupdown package] ************************* 2026-04-03 04:58:00.463935 | orchestrator | Friday 03 April 2026 04:57:40 +0000 (0:00:01.932) 0:00:04.163 ********** 2026-04-03 04:58:00.463953 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.463969 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.463986 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.464005 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.464022 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.464041 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.464059 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.464079 | orchestrator | 2026-04-03 04:58:00.464099 | orchestrator | TASK [osism.commons.network : Create required directories] ********************* 2026-04-03 04:58:00.464118 | orchestrator | Friday 03 April 2026 04:57:42 +0000 (0:00:01.722) 0:00:05.886 ********** 2026-04-03 04:58:00.464135 | orchestrator | ok: [testbed-node-0] => (item=/etc/netplan) 2026-04-03 04:58:00.464156 | orchestrator | ok: [testbed-manager] => (item=/etc/netplan) 2026-04-03 04:58:00.464174 | orchestrator | ok: [testbed-node-1] => (item=/etc/netplan) 2026-04-03 04:58:00.464192 | orchestrator | ok: [testbed-node-2] => (item=/etc/netplan) 2026-04-03 04:58:00.464210 | orchestrator | ok: [testbed-node-3] => (item=/etc/netplan) 2026-04-03 04:58:00.464230 | orchestrator | ok: [testbed-node-4] => (item=/etc/netplan) 2026-04-03 04:58:00.464248 | orchestrator | ok: [testbed-node-5] => (item=/etc/netplan) 2026-04-03 04:58:00.464268 | orchestrator | 2026-04-03 04:58:00.464311 | orchestrator | TASK [osism.commons.network : Prepare netplan configuration template] ********** 2026-04-03 04:58:00.464324 | orchestrator | Friday 03 April 2026 04:57:43 +0000 (0:00:01.024) 0:00:06.910 ********** 2026-04-03 04:58:00.464335 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 04:58:00.464347 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 04:58:00.464358 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 04:58:00.464369 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 04:58:00.464380 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 04:58:00.464391 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 04:58:00.464401 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 04:58:00.464412 | orchestrator | 2026-04-03 04:58:00.464487 | orchestrator | TASK [osism.commons.network : Copy netplan configuration] ********************** 2026-04-03 04:58:00.464506 | orchestrator | Friday 03 April 2026 04:57:46 +0000 (0:00:03.347) 0:00:10.258 ********** 2026-04-03 04:58:00.464522 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:00.464533 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:58:00.464544 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:58:00.464555 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:58:00.464566 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:58:00.464583 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:58:00.464594 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:58:00.464605 | orchestrator | 2026-04-03 04:58:00.464616 | orchestrator | TASK [osism.commons.network : Remove netplan configuration template] *********** 2026-04-03 04:58:00.464627 | orchestrator | Friday 03 April 2026 04:57:47 +0000 (0:00:01.580) 0:00:11.839 ********** 2026-04-03 04:58:00.464638 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 04:58:00.464648 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 04:58:00.464659 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 04:58:00.464670 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 04:58:00.464681 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 04:58:00.464704 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 04:58:00.464715 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 04:58:00.464725 | orchestrator | 2026-04-03 04:58:00.464736 | orchestrator | TASK [osism.commons.network : Check if path for interface file exists] ********* 2026-04-03 04:58:00.464747 | orchestrator | Friday 03 April 2026 04:57:49 +0000 (0:00:01.711) 0:00:13.550 ********** 2026-04-03 04:58:00.464758 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.464769 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.464780 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.464791 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.464802 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.464813 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.464823 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.464834 | orchestrator | 2026-04-03 04:58:00.464845 | orchestrator | TASK [osism.commons.network : Copy interfaces file] **************************** 2026-04-03 04:58:00.464877 | orchestrator | Friday 03 April 2026 04:57:50 +0000 (0:00:01.181) 0:00:14.731 ********** 2026-04-03 04:58:00.464889 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:58:00.464900 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:00.464911 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:00.464922 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:00.464932 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:00.464943 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:00.464954 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:00.464964 | orchestrator | 2026-04-03 04:58:00.464976 | orchestrator | TASK [osism.commons.network : Install package networkd-dispatcher] ************* 2026-04-03 04:58:00.464986 | orchestrator | Friday 03 April 2026 04:57:51 +0000 (0:00:00.669) 0:00:15.400 ********** 2026-04-03 04:58:00.464997 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.465008 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.465019 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.465030 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.465040 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.465051 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.465062 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.465072 | orchestrator | 2026-04-03 04:58:00.465083 | orchestrator | TASK [osism.commons.network : Copy dispatcher scripts] ************************* 2026-04-03 04:58:00.465095 | orchestrator | Friday 03 April 2026 04:57:53 +0000 (0:00:02.106) 0:00:17.507 ********** 2026-04-03 04:58:00.465105 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:00.465116 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:00.465127 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:00.465138 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:00.465149 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:00.465159 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:00.465171 | orchestrator | changed: [testbed-manager] => (item={'dest': 'routable.d/iptables.sh', 'src': '/opt/configuration/network/iptables.sh'}) 2026-04-03 04:58:00.465184 | orchestrator | 2026-04-03 04:58:00.465195 | orchestrator | TASK [osism.commons.network : Manage service networkd-dispatcher] ************** 2026-04-03 04:58:00.465206 | orchestrator | Friday 03 April 2026 04:57:54 +0000 (0:00:00.942) 0:00:18.449 ********** 2026-04-03 04:58:00.465217 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.465228 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:58:00.465239 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:58:00.465249 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:58:00.465260 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:58:00.465271 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:58:00.465282 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:58:00.465292 | orchestrator | 2026-04-03 04:58:00.465303 | orchestrator | TASK [osism.commons.network : Include cleanup tasks] *************************** 2026-04-03 04:58:00.465314 | orchestrator | Friday 03 April 2026 04:57:56 +0000 (0:00:01.608) 0:00:20.058 ********** 2026-04-03 04:58:00.465326 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-netplan.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 04:58:00.465345 | orchestrator | 2026-04-03 04:58:00.465356 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-03 04:58:00.465367 | orchestrator | Friday 03 April 2026 04:57:57 +0000 (0:00:01.282) 0:00:21.341 ********** 2026-04-03 04:58:00.465379 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.465389 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.465400 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.465411 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.465449 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.465468 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.465485 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.465503 | orchestrator | 2026-04-03 04:58:00.465522 | orchestrator | TASK [osism.commons.network : Set network_configured_files fact] *************** 2026-04-03 04:58:00.465543 | orchestrator | Friday 03 April 2026 04:57:58 +0000 (0:00:00.940) 0:00:22.281 ********** 2026-04-03 04:58:00.465564 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:00.465584 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:00.465603 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:00.465632 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:00.465653 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:00.465671 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:00.465688 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:00.465705 | orchestrator | 2026-04-03 04:58:00.465723 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-03 04:58:00.465741 | orchestrator | Friday 03 April 2026 04:57:59 +0000 (0:00:00.833) 0:00:23.115 ********** 2026-04-03 04:58:00.465770 | orchestrator | skipping: [testbed-manager] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465790 | orchestrator | skipping: [testbed-node-0] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465804 | orchestrator | skipping: [testbed-node-1] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465815 | orchestrator | skipping: [testbed-node-2] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465826 | orchestrator | changed: [testbed-manager] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465836 | orchestrator | skipping: [testbed-node-3] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465847 | orchestrator | changed: [testbed-node-0] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465858 | orchestrator | skipping: [testbed-node-4] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465869 | orchestrator | changed: [testbed-node-1] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465880 | orchestrator | changed: [testbed-node-2] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465890 | orchestrator | changed: [testbed-node-3] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465901 | orchestrator | changed: [testbed-node-4] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465912 | orchestrator | skipping: [testbed-node-5] => (item=/etc/netplan/01-osism.yaml)  2026-04-03 04:58:00.465923 | orchestrator | changed: [testbed-node-5] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-03 04:58:00.465934 | orchestrator | 2026-04-03 04:58:00.465956 | orchestrator | TASK [osism.commons.network : Include dummy interfaces] ************************ 2026-04-03 04:58:17.709282 | orchestrator | Friday 03 April 2026 04:58:00 +0000 (0:00:01.178) 0:00:24.293 ********** 2026-04-03 04:58:17.709382 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:58:17.709395 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:17.709404 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:17.709412 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:17.709421 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:17.709429 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:17.709437 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:17.709445 | orchestrator | 2026-04-03 04:58:17.709506 | orchestrator | TASK [osism.commons.network : Include vxlan interfaces] ************************ 2026-04-03 04:58:17.709537 | orchestrator | Friday 03 April 2026 04:58:01 +0000 (0:00:00.667) 0:00:24.960 ********** 2026-04-03 04:58:17.709548 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/vxlan-interfaces.yml for testbed-node-1, testbed-node-0, testbed-manager, testbed-node-3, testbed-node-2, testbed-node-4, testbed-node-5 2026-04-03 04:58:17.709558 | orchestrator | 2026-04-03 04:58:17.709566 | orchestrator | TASK [osism.commons.network : Create systemd networkd netdev files] ************ 2026-04-03 04:58:17.709574 | orchestrator | Friday 03 April 2026 04:58:06 +0000 (0:00:04.939) 0:00:29.899 ********** 2026-04-03 04:58:17.709584 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709592 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709601 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709610 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709618 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709626 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709645 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709660 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709669 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709677 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709685 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709707 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709723 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709731 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709739 | orchestrator | 2026-04-03 04:58:17.709747 | orchestrator | TASK [osism.commons.network : Create systemd networkd network files] *********** 2026-04-03 04:58:17.709755 | orchestrator | Friday 03 April 2026 04:58:11 +0000 (0:00:05.909) 0:00:35.808 ********** 2026-04-03 04:58:17.709764 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709772 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709780 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709788 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709796 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709804 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709812 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709821 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-03 04:58:17.709835 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709845 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709854 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709869 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:17.709885 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:24.091652 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-03 04:58:24.091785 | orchestrator | 2026-04-03 04:58:24.091806 | orchestrator | TASK [osism.commons.network : Include networkd cleanup tasks] ****************** 2026-04-03 04:58:24.091820 | orchestrator | Friday 03 April 2026 04:58:17 +0000 (0:00:05.729) 0:00:41.538 ********** 2026-04-03 04:58:24.091834 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-networkd.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 04:58:24.091846 | orchestrator | 2026-04-03 04:58:24.091858 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-03 04:58:24.091870 | orchestrator | Friday 03 April 2026 04:58:19 +0000 (0:00:01.333) 0:00:42.872 ********** 2026-04-03 04:58:24.091881 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:24.091893 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:58:24.091905 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:58:24.091916 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:58:24.091926 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:58:24.091937 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:58:24.091948 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:58:24.091959 | orchestrator | 2026-04-03 04:58:24.091970 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-03 04:58:24.091982 | orchestrator | Friday 03 April 2026 04:58:20 +0000 (0:00:01.161) 0:00:44.034 ********** 2026-04-03 04:58:24.091993 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092005 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092016 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092027 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092038 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:58:24.092050 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092060 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092071 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092082 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092093 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:24.092104 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092115 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092126 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092137 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092148 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:24.092180 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092195 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092208 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092220 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092234 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:24.092262 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092276 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092289 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092302 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092315 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:24.092328 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092340 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092353 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092367 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092381 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:24.092393 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-03 04:58:24.092406 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-03 04:58:24.092419 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-03 04:58:24.092431 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-03 04:58:24.092444 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:24.092479 | orchestrator | 2026-04-03 04:58:24.092493 | orchestrator | RUNNING HANDLER [osism.commons.network : Reload systemd-networkd] ************** 2026-04-03 04:58:24.092525 | orchestrator | Friday 03 April 2026 04:58:22 +0000 (0:00:02.095) 0:00:46.130 ********** 2026-04-03 04:58:24.092538 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:58:24.092552 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:24.092563 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:24.092574 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:24.092585 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:24.092596 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:24.092607 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:24.092618 | orchestrator | 2026-04-03 04:58:24.092629 | orchestrator | RUNNING HANDLER [osism.commons.network : Netplan configuration changed] ******** 2026-04-03 04:58:24.092640 | orchestrator | Friday 03 April 2026 04:58:22 +0000 (0:00:00.663) 0:00:46.793 ********** 2026-04-03 04:58:24.092651 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:58:24.092661 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:58:24.092672 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:58:24.092683 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:58:24.092694 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:58:24.092705 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:58:24.092716 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:58:24.092727 | orchestrator | 2026-04-03 04:58:24.092738 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:58:24.092750 | orchestrator | testbed-manager : ok=21  changed=5  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 04:58:24.092762 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092783 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092795 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092805 | orchestrator | testbed-node-3 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092816 | orchestrator | testbed-node-4 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092827 | orchestrator | testbed-node-5 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 04:58:24.092838 | orchestrator | 2026-04-03 04:58:24.092849 | orchestrator | 2026-04-03 04:58:24.092860 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:58:24.092871 | orchestrator | Friday 03 April 2026 04:58:23 +0000 (0:00:00.735) 0:00:47.529 ********** 2026-04-03 04:58:24.092882 | orchestrator | =============================================================================== 2026-04-03 04:58:24.092893 | orchestrator | osism.commons.network : Create systemd networkd netdev files ------------ 5.91s 2026-04-03 04:58:24.092904 | orchestrator | osism.commons.network : Create systemd networkd network files ----------- 5.73s 2026-04-03 04:58:24.092914 | orchestrator | osism.commons.network : Include vxlan interfaces ------------------------ 4.94s 2026-04-03 04:58:24.092925 | orchestrator | osism.commons.network : Prepare netplan configuration template ---------- 3.35s 2026-04-03 04:58:24.092936 | orchestrator | osism.commons.network : Install package networkd-dispatcher ------------- 2.11s 2026-04-03 04:58:24.092947 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 2.10s 2026-04-03 04:58:24.092958 | orchestrator | osism.commons.network : Install required packages ----------------------- 1.93s 2026-04-03 04:58:24.092968 | orchestrator | osism.commons.network : Remove ifupdown package ------------------------- 1.72s 2026-04-03 04:58:24.092985 | orchestrator | osism.commons.network : Remove netplan configuration template ----------- 1.71s 2026-04-03 04:58:24.092996 | orchestrator | osism.commons.network : Manage service networkd-dispatcher -------------- 1.61s 2026-04-03 04:58:24.093007 | orchestrator | osism.commons.network : Copy netplan configuration ---------------------- 1.58s 2026-04-03 04:58:24.093017 | orchestrator | osism.commons.network : Include networkd cleanup tasks ------------------ 1.33s 2026-04-03 04:58:24.093028 | orchestrator | osism.commons.network : Include cleanup tasks --------------------------- 1.28s 2026-04-03 04:58:24.093039 | orchestrator | osism.commons.network : Include type specific tasks --------------------- 1.22s 2026-04-03 04:58:24.093050 | orchestrator | osism.commons.network : Check if path for interface file exists --------- 1.18s 2026-04-03 04:58:24.093061 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 1.18s 2026-04-03 04:58:24.093071 | orchestrator | osism.commons.network : List existing configuration files --------------- 1.16s 2026-04-03 04:58:24.093082 | orchestrator | osism.commons.network : Create required directories --------------------- 1.02s 2026-04-03 04:58:24.093093 | orchestrator | osism.commons.network : Copy dispatcher scripts ------------------------- 0.94s 2026-04-03 04:58:24.093104 | orchestrator | osism.commons.network : List existing configuration files --------------- 0.94s 2026-04-03 04:58:24.407649 | orchestrator | + osism apply wireguard 2026-04-03 04:58:36.500926 | orchestrator | 2026-04-03 04:58:36 | INFO  | Task 91821101-b905-42f2-9ed7-13790387e5fc (wireguard) was prepared for execution. 2026-04-03 04:58:36.501032 | orchestrator | 2026-04-03 04:58:36 | INFO  | It takes a moment until task 91821101-b905-42f2-9ed7-13790387e5fc (wireguard) has been started and output is visible here. 2026-04-03 04:58:56.887159 | orchestrator | 2026-04-03 04:58:56.887288 | orchestrator | PLAY [Apply role wireguard] **************************************************** 2026-04-03 04:58:56.887329 | orchestrator | 2026-04-03 04:58:56.887340 | orchestrator | TASK [osism.services.wireguard : Install iptables package] ********************* 2026-04-03 04:58:56.887351 | orchestrator | Friday 03 April 2026 04:58:40 +0000 (0:00:00.223) 0:00:00.223 ********** 2026-04-03 04:58:56.887361 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:56.887372 | orchestrator | 2026-04-03 04:58:56.887382 | orchestrator | TASK [osism.services.wireguard : Install wireguard package] ******************** 2026-04-03 04:58:56.887391 | orchestrator | Friday 03 April 2026 04:58:42 +0000 (0:00:01.578) 0:00:01.802 ********** 2026-04-03 04:58:56.887401 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887411 | orchestrator | 2026-04-03 04:58:56.887425 | orchestrator | TASK [osism.services.wireguard : Create public and private key - server] ******* 2026-04-03 04:58:56.887435 | orchestrator | Friday 03 April 2026 04:58:48 +0000 (0:00:06.584) 0:00:08.386 ********** 2026-04-03 04:58:56.887445 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887455 | orchestrator | 2026-04-03 04:58:56.887465 | orchestrator | TASK [osism.services.wireguard : Create preshared key] ************************* 2026-04-03 04:58:56.887474 | orchestrator | Friday 03 April 2026 04:58:49 +0000 (0:00:00.566) 0:00:08.952 ********** 2026-04-03 04:58:56.887484 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887493 | orchestrator | 2026-04-03 04:58:56.887503 | orchestrator | TASK [osism.services.wireguard : Get preshared key] **************************** 2026-04-03 04:58:56.887584 | orchestrator | Friday 03 April 2026 04:58:49 +0000 (0:00:00.431) 0:00:09.384 ********** 2026-04-03 04:58:56.887596 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:56.887606 | orchestrator | 2026-04-03 04:58:56.887616 | orchestrator | TASK [osism.services.wireguard : Get public key - server] ********************** 2026-04-03 04:58:56.887625 | orchestrator | Friday 03 April 2026 04:58:50 +0000 (0:00:00.736) 0:00:10.121 ********** 2026-04-03 04:58:56.887635 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:56.887645 | orchestrator | 2026-04-03 04:58:56.887654 | orchestrator | TASK [osism.services.wireguard : Get private key - server] ********************* 2026-04-03 04:58:56.887664 | orchestrator | Friday 03 April 2026 04:58:51 +0000 (0:00:00.471) 0:00:10.592 ********** 2026-04-03 04:58:56.887673 | orchestrator | ok: [testbed-manager] 2026-04-03 04:58:56.887683 | orchestrator | 2026-04-03 04:58:56.887692 | orchestrator | TASK [osism.services.wireguard : Copy wg0.conf configuration file] ************* 2026-04-03 04:58:56.887704 | orchestrator | Friday 03 April 2026 04:58:51 +0000 (0:00:00.442) 0:00:11.035 ********** 2026-04-03 04:58:56.887715 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887726 | orchestrator | 2026-04-03 04:58:56.887737 | orchestrator | TASK [osism.services.wireguard : Copy client configuration files] ************** 2026-04-03 04:58:56.887749 | orchestrator | Friday 03 April 2026 04:58:52 +0000 (0:00:01.244) 0:00:12.279 ********** 2026-04-03 04:58:56.887761 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-03 04:58:56.887773 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887785 | orchestrator | 2026-04-03 04:58:56.887796 | orchestrator | TASK [osism.services.wireguard : Manage wg-quick@wg0.service service] ********** 2026-04-03 04:58:56.887808 | orchestrator | Friday 03 April 2026 04:58:53 +0000 (0:00:00.995) 0:00:13.275 ********** 2026-04-03 04:58:56.887819 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887830 | orchestrator | 2026-04-03 04:58:56.887842 | orchestrator | RUNNING HANDLER [osism.services.wireguard : Restart wg0 service] *************** 2026-04-03 04:58:56.887854 | orchestrator | Friday 03 April 2026 04:58:55 +0000 (0:00:01.712) 0:00:14.988 ********** 2026-04-03 04:58:56.887866 | orchestrator | changed: [testbed-manager] 2026-04-03 04:58:56.887877 | orchestrator | 2026-04-03 04:58:56.887889 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:58:56.887901 | orchestrator | testbed-manager : ok=11  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 04:58:56.887913 | orchestrator | 2026-04-03 04:58:56.887925 | orchestrator | 2026-04-03 04:58:56.887936 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:58:56.887948 | orchestrator | Friday 03 April 2026 04:58:56 +0000 (0:00:00.961) 0:00:15.949 ********** 2026-04-03 04:58:56.887968 | orchestrator | =============================================================================== 2026-04-03 04:58:56.887979 | orchestrator | osism.services.wireguard : Install wireguard package -------------------- 6.58s 2026-04-03 04:58:56.887990 | orchestrator | osism.services.wireguard : Manage wg-quick@wg0.service service ---------- 1.71s 2026-04-03 04:58:56.888002 | orchestrator | osism.services.wireguard : Install iptables package --------------------- 1.58s 2026-04-03 04:58:56.888013 | orchestrator | osism.services.wireguard : Copy wg0.conf configuration file ------------- 1.24s 2026-04-03 04:58:56.888025 | orchestrator | osism.services.wireguard : Copy client configuration files -------------- 1.00s 2026-04-03 04:58:56.888036 | orchestrator | osism.services.wireguard : Restart wg0 service -------------------------- 0.96s 2026-04-03 04:58:56.888047 | orchestrator | osism.services.wireguard : Get preshared key ---------------------------- 0.74s 2026-04-03 04:58:56.888059 | orchestrator | osism.services.wireguard : Create public and private key - server ------- 0.57s 2026-04-03 04:58:56.888068 | orchestrator | osism.services.wireguard : Get public key - server ---------------------- 0.47s 2026-04-03 04:58:56.888078 | orchestrator | osism.services.wireguard : Get private key - server --------------------- 0.44s 2026-04-03 04:58:56.888088 | orchestrator | osism.services.wireguard : Create preshared key ------------------------- 0.43s 2026-04-03 04:58:57.210742 | orchestrator | + sh -c /opt/configuration/scripts/prepare-wireguard-configuration.sh 2026-04-03 04:58:57.246410 | orchestrator | % Total % Received % Xferd Average Speed Time Time Time Current 2026-04-03 04:58:57.246503 | orchestrator | Dload Upload Total Spent Left Speed 2026-04-03 04:58:57.332812 | orchestrator | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 15 100 15 0 0 174 0 --:--:-- --:--:-- --:--:-- 176 2026-04-03 04:58:57.350359 | orchestrator | + osism apply --environment custom workarounds 2026-04-03 04:58:59.328609 | orchestrator | 2026-04-03 04:58:59 | INFO  | Trying to run play workarounds in environment custom 2026-04-03 04:59:09.418668 | orchestrator | 2026-04-03 04:59:09 | INFO  | Task 284fa973-84d2-4382-905d-5205ca82584e (workarounds) was prepared for execution. 2026-04-03 04:59:09.418800 | orchestrator | 2026-04-03 04:59:09 | INFO  | It takes a moment until task 284fa973-84d2-4382-905d-5205ca82584e (workarounds) has been started and output is visible here. 2026-04-03 04:59:34.406346 | orchestrator | 2026-04-03 04:59:34.406455 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 04:59:34.406471 | orchestrator | 2026-04-03 04:59:34.406483 | orchestrator | TASK [Group hosts based on virtualization_role] ******************************** 2026-04-03 04:59:34.406494 | orchestrator | Friday 03 April 2026 04:59:13 +0000 (0:00:00.140) 0:00:00.140 ********** 2026-04-03 04:59:34.406505 | orchestrator | changed: [testbed-node-0] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406517 | orchestrator | changed: [testbed-node-1] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406528 | orchestrator | changed: [testbed-node-2] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406538 | orchestrator | changed: [testbed-node-3] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406549 | orchestrator | changed: [testbed-node-4] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406560 | orchestrator | changed: [testbed-node-5] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406597 | orchestrator | changed: [testbed-manager] => (item=virtualization_role_guest) 2026-04-03 04:59:34.406608 | orchestrator | 2026-04-03 04:59:34.406619 | orchestrator | PLAY [Apply netplan configuration on the manager node] ************************* 2026-04-03 04:59:34.406630 | orchestrator | 2026-04-03 04:59:34.406641 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-03 04:59:34.406652 | orchestrator | Friday 03 April 2026 04:59:14 +0000 (0:00:00.806) 0:00:00.946 ********** 2026-04-03 04:59:34.406663 | orchestrator | ok: [testbed-manager] 2026-04-03 04:59:34.406675 | orchestrator | 2026-04-03 04:59:34.406705 | orchestrator | PLAY [Apply netplan configuration on all other nodes] ************************** 2026-04-03 04:59:34.406717 | orchestrator | 2026-04-03 04:59:34.406727 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-03 04:59:34.406738 | orchestrator | Friday 03 April 2026 04:59:16 +0000 (0:00:02.376) 0:00:03.322 ********** 2026-04-03 04:59:34.406749 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:59:34.406760 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:59:34.406771 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:59:34.406781 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:59:34.406791 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:59:34.406802 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:59:34.406812 | orchestrator | 2026-04-03 04:59:34.406823 | orchestrator | PLAY [Add custom CA certificates to non-manager nodes] ************************* 2026-04-03 04:59:34.406834 | orchestrator | 2026-04-03 04:59:34.406844 | orchestrator | TASK [Copy custom CA certificates] ********************************************* 2026-04-03 04:59:34.406855 | orchestrator | Friday 03 April 2026 04:59:18 +0000 (0:00:01.762) 0:00:05.084 ********** 2026-04-03 04:59:34.406867 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406879 | orchestrator | changed: [testbed-node-3] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406891 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406904 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406916 | orchestrator | changed: [testbed-node-4] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406936 | orchestrator | changed: [testbed-node-5] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-03 04:59:34.406948 | orchestrator | 2026-04-03 04:59:34.406961 | orchestrator | TASK [Run update-ca-certificates] ********************************************** 2026-04-03 04:59:34.406974 | orchestrator | Friday 03 April 2026 04:59:19 +0000 (0:00:01.487) 0:00:06.572 ********** 2026-04-03 04:59:34.406987 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:59:34.407000 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:59:34.407013 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:59:34.407026 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:59:34.407038 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:59:34.407051 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:59:34.407063 | orchestrator | 2026-04-03 04:59:34.407076 | orchestrator | TASK [Run update-ca-trust] ***************************************************** 2026-04-03 04:59:34.407088 | orchestrator | Friday 03 April 2026 04:59:23 +0000 (0:00:03.625) 0:00:10.197 ********** 2026-04-03 04:59:34.407100 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:59:34.407113 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:59:34.407126 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:59:34.407138 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:59:34.407151 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:59:34.407163 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:59:34.407176 | orchestrator | 2026-04-03 04:59:34.407188 | orchestrator | PLAY [Add a workaround service] ************************************************ 2026-04-03 04:59:34.407201 | orchestrator | 2026-04-03 04:59:34.407214 | orchestrator | TASK [Copy workarounds.sh scripts] ********************************************* 2026-04-03 04:59:34.407227 | orchestrator | Friday 03 April 2026 04:59:24 +0000 (0:00:00.742) 0:00:10.940 ********** 2026-04-03 04:59:34.407240 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:59:34.407251 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:59:34.407261 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:59:34.407272 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:59:34.407282 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:59:34.407293 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:59:34.407303 | orchestrator | changed: [testbed-manager] 2026-04-03 04:59:34.407322 | orchestrator | 2026-04-03 04:59:34.407333 | orchestrator | TASK [Copy workarounds systemd unit file] ************************************** 2026-04-03 04:59:34.407344 | orchestrator | Friday 03 April 2026 04:59:25 +0000 (0:00:01.565) 0:00:12.505 ********** 2026-04-03 04:59:34.407355 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:59:34.407365 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:59:34.407376 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:59:34.407386 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:59:34.407397 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:59:34.407407 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:59:34.407434 | orchestrator | changed: [testbed-manager] 2026-04-03 04:59:34.407445 | orchestrator | 2026-04-03 04:59:34.407456 | orchestrator | TASK [Reload systemd daemon] *************************************************** 2026-04-03 04:59:34.407467 | orchestrator | Friday 03 April 2026 04:59:27 +0000 (0:00:01.635) 0:00:14.141 ********** 2026-04-03 04:59:34.407477 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:59:34.407488 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:59:34.407499 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:59:34.407509 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:59:34.407520 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:59:34.407530 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:59:34.407541 | orchestrator | ok: [testbed-manager] 2026-04-03 04:59:34.407552 | orchestrator | 2026-04-03 04:59:34.407562 | orchestrator | TASK [Enable workarounds.service (Debian)] ************************************* 2026-04-03 04:59:34.407622 | orchestrator | Friday 03 April 2026 04:59:29 +0000 (0:00:01.547) 0:00:15.688 ********** 2026-04-03 04:59:34.407633 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:59:34.407644 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:59:34.407655 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:59:34.407665 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:59:34.407676 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:59:34.407686 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:59:34.407696 | orchestrator | changed: [testbed-manager] 2026-04-03 04:59:34.407707 | orchestrator | 2026-04-03 04:59:34.407718 | orchestrator | TASK [Enable and start workarounds.service (RedHat)] *************************** 2026-04-03 04:59:34.407729 | orchestrator | Friday 03 April 2026 04:59:30 +0000 (0:00:01.857) 0:00:17.546 ********** 2026-04-03 04:59:34.407739 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:59:34.407750 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:59:34.407760 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:59:34.407771 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:59:34.407781 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:59:34.407792 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:59:34.407802 | orchestrator | skipping: [testbed-manager] 2026-04-03 04:59:34.407813 | orchestrator | 2026-04-03 04:59:34.407824 | orchestrator | PLAY [On Ubuntu 24.04 install python3-docker from Debian Sid] ****************** 2026-04-03 04:59:34.407835 | orchestrator | 2026-04-03 04:59:34.407845 | orchestrator | TASK [Install python3-docker] ************************************************** 2026-04-03 04:59:34.407856 | orchestrator | Friday 03 April 2026 04:59:31 +0000 (0:00:00.661) 0:00:18.208 ********** 2026-04-03 04:59:34.407866 | orchestrator | ok: [testbed-node-3] 2026-04-03 04:59:34.407877 | orchestrator | ok: [testbed-node-2] 2026-04-03 04:59:34.407888 | orchestrator | ok: [testbed-node-4] 2026-04-03 04:59:34.407899 | orchestrator | ok: [testbed-node-0] 2026-04-03 04:59:34.407909 | orchestrator | ok: [testbed-node-5] 2026-04-03 04:59:34.407920 | orchestrator | ok: [testbed-manager] 2026-04-03 04:59:34.407930 | orchestrator | ok: [testbed-node-1] 2026-04-03 04:59:34.407941 | orchestrator | 2026-04-03 04:59:34.407952 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:59:34.407964 | orchestrator | testbed-manager : ok=7  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 04:59:34.407976 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.407994 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.408010 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.408021 | orchestrator | testbed-node-3 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.408032 | orchestrator | testbed-node-4 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.408043 | orchestrator | testbed-node-5 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:34.408053 | orchestrator | 2026-04-03 04:59:34.408064 | orchestrator | 2026-04-03 04:59:34.408075 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:59:34.408086 | orchestrator | Friday 03 April 2026 04:59:34 +0000 (0:00:02.743) 0:00:20.951 ********** 2026-04-03 04:59:34.408096 | orchestrator | =============================================================================== 2026-04-03 04:59:34.408107 | orchestrator | Run update-ca-certificates ---------------------------------------------- 3.63s 2026-04-03 04:59:34.408117 | orchestrator | Install python3-docker -------------------------------------------------- 2.74s 2026-04-03 04:59:34.408128 | orchestrator | Apply netplan configuration --------------------------------------------- 2.38s 2026-04-03 04:59:34.408139 | orchestrator | Enable workarounds.service (Debian) ------------------------------------- 1.86s 2026-04-03 04:59:34.408150 | orchestrator | Apply netplan configuration --------------------------------------------- 1.76s 2026-04-03 04:59:34.408160 | orchestrator | Copy workarounds systemd unit file -------------------------------------- 1.64s 2026-04-03 04:59:34.408171 | orchestrator | Copy workarounds.sh scripts --------------------------------------------- 1.57s 2026-04-03 04:59:34.408182 | orchestrator | Reload systemd daemon --------------------------------------------------- 1.55s 2026-04-03 04:59:34.408192 | orchestrator | Copy custom CA certificates --------------------------------------------- 1.49s 2026-04-03 04:59:34.408203 | orchestrator | Group hosts based on virtualization_role -------------------------------- 0.81s 2026-04-03 04:59:34.408225 | orchestrator | Run update-ca-trust ----------------------------------------------------- 0.74s 2026-04-03 04:59:34.408243 | orchestrator | Enable and start workarounds.service (RedHat) --------------------------- 0.66s 2026-04-03 04:59:35.176918 | orchestrator | + osism apply reboot -l testbed-nodes -e ireallymeanit=yes 2026-04-03 04:59:47.258936 | orchestrator | 2026-04-03 04:59:47 | INFO  | Task 2fee206f-ef4e-4728-9eda-b5fce09bfebe (reboot) was prepared for execution. 2026-04-03 04:59:47.259026 | orchestrator | 2026-04-03 04:59:47 | INFO  | It takes a moment until task 2fee206f-ef4e-4728-9eda-b5fce09bfebe (reboot) has been started and output is visible here. 2026-04-03 04:59:57.528918 | orchestrator | 2026-04-03 04:59:57.529052 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.529071 | orchestrator | 2026-04-03 04:59:57.529132 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.529161 | orchestrator | Friday 03 April 2026 04:59:51 +0000 (0:00:00.238) 0:00:00.238 ********** 2026-04-03 04:59:57.529173 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:59:57.529185 | orchestrator | 2026-04-03 04:59:57.529197 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.529208 | orchestrator | Friday 03 April 2026 04:59:51 +0000 (0:00:00.104) 0:00:00.343 ********** 2026-04-03 04:59:57.529219 | orchestrator | changed: [testbed-node-0] 2026-04-03 04:59:57.529231 | orchestrator | 2026-04-03 04:59:57.529242 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.529283 | orchestrator | Friday 03 April 2026 04:59:52 +0000 (0:00:00.909) 0:00:01.252 ********** 2026-04-03 04:59:57.529295 | orchestrator | skipping: [testbed-node-0] 2026-04-03 04:59:57.529306 | orchestrator | 2026-04-03 04:59:57.529317 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.529327 | orchestrator | 2026-04-03 04:59:57.529338 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.529349 | orchestrator | Friday 03 April 2026 04:59:52 +0000 (0:00:00.123) 0:00:01.376 ********** 2026-04-03 04:59:57.529360 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:59:57.529371 | orchestrator | 2026-04-03 04:59:57.529382 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.529392 | orchestrator | Friday 03 April 2026 04:59:52 +0000 (0:00:00.099) 0:00:01.476 ********** 2026-04-03 04:59:57.529403 | orchestrator | changed: [testbed-node-1] 2026-04-03 04:59:57.529414 | orchestrator | 2026-04-03 04:59:57.529425 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.529435 | orchestrator | Friday 03 April 2026 04:59:53 +0000 (0:00:00.654) 0:00:02.131 ********** 2026-04-03 04:59:57.529446 | orchestrator | skipping: [testbed-node-1] 2026-04-03 04:59:57.529459 | orchestrator | 2026-04-03 04:59:57.529474 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.529486 | orchestrator | 2026-04-03 04:59:57.529498 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.529511 | orchestrator | Friday 03 April 2026 04:59:53 +0000 (0:00:00.121) 0:00:02.252 ********** 2026-04-03 04:59:57.529523 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:59:57.529536 | orchestrator | 2026-04-03 04:59:57.529549 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.529562 | orchestrator | Friday 03 April 2026 04:59:53 +0000 (0:00:00.214) 0:00:02.467 ********** 2026-04-03 04:59:57.529575 | orchestrator | changed: [testbed-node-2] 2026-04-03 04:59:57.529587 | orchestrator | 2026-04-03 04:59:57.529622 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.529653 | orchestrator | Friday 03 April 2026 04:59:54 +0000 (0:00:00.697) 0:00:03.165 ********** 2026-04-03 04:59:57.529667 | orchestrator | skipping: [testbed-node-2] 2026-04-03 04:59:57.529680 | orchestrator | 2026-04-03 04:59:57.529692 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.529706 | orchestrator | 2026-04-03 04:59:57.529719 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.529731 | orchestrator | Friday 03 April 2026 04:59:54 +0000 (0:00:00.108) 0:00:03.273 ********** 2026-04-03 04:59:57.529744 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:59:57.529756 | orchestrator | 2026-04-03 04:59:57.529769 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.529782 | orchestrator | Friday 03 April 2026 04:59:54 +0000 (0:00:00.103) 0:00:03.376 ********** 2026-04-03 04:59:57.529795 | orchestrator | changed: [testbed-node-3] 2026-04-03 04:59:57.529808 | orchestrator | 2026-04-03 04:59:57.529820 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.529831 | orchestrator | Friday 03 April 2026 04:59:55 +0000 (0:00:00.650) 0:00:04.027 ********** 2026-04-03 04:59:57.529842 | orchestrator | skipping: [testbed-node-3] 2026-04-03 04:59:57.529853 | orchestrator | 2026-04-03 04:59:57.529864 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.529874 | orchestrator | 2026-04-03 04:59:57.529885 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.529896 | orchestrator | Friday 03 April 2026 04:59:55 +0000 (0:00:00.115) 0:00:04.142 ********** 2026-04-03 04:59:57.529906 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:59:57.529917 | orchestrator | 2026-04-03 04:59:57.529928 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.529939 | orchestrator | Friday 03 April 2026 04:59:55 +0000 (0:00:00.119) 0:00:04.262 ********** 2026-04-03 04:59:57.529958 | orchestrator | changed: [testbed-node-4] 2026-04-03 04:59:57.529969 | orchestrator | 2026-04-03 04:59:57.529979 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.529991 | orchestrator | Friday 03 April 2026 04:59:56 +0000 (0:00:00.655) 0:00:04.918 ********** 2026-04-03 04:59:57.530001 | orchestrator | skipping: [testbed-node-4] 2026-04-03 04:59:57.530012 | orchestrator | 2026-04-03 04:59:57.530087 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-03 04:59:57.530099 | orchestrator | 2026-04-03 04:59:57.530110 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-03 04:59:57.530121 | orchestrator | Friday 03 April 2026 04:59:56 +0000 (0:00:00.117) 0:00:05.036 ********** 2026-04-03 04:59:57.530131 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:59:57.530142 | orchestrator | 2026-04-03 04:59:57.530153 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-03 04:59:57.530164 | orchestrator | Friday 03 April 2026 04:59:56 +0000 (0:00:00.105) 0:00:05.142 ********** 2026-04-03 04:59:57.530175 | orchestrator | changed: [testbed-node-5] 2026-04-03 04:59:57.530185 | orchestrator | 2026-04-03 04:59:57.530196 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-03 04:59:57.530207 | orchestrator | Friday 03 April 2026 04:59:57 +0000 (0:00:00.658) 0:00:05.800 ********** 2026-04-03 04:59:57.530237 | orchestrator | skipping: [testbed-node-5] 2026-04-03 04:59:57.530249 | orchestrator | 2026-04-03 04:59:57.530259 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 04:59:57.530271 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530284 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530295 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530305 | orchestrator | testbed-node-3 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530316 | orchestrator | testbed-node-4 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530327 | orchestrator | testbed-node-5 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 04:59:57.530337 | orchestrator | 2026-04-03 04:59:57.530348 | orchestrator | 2026-04-03 04:59:57.530359 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 04:59:57.530370 | orchestrator | Friday 03 April 2026 04:59:57 +0000 (0:00:00.041) 0:00:05.842 ********** 2026-04-03 04:59:57.530381 | orchestrator | =============================================================================== 2026-04-03 04:59:57.530392 | orchestrator | Reboot system - do not wait for the reboot to complete ------------------ 4.23s 2026-04-03 04:59:57.530403 | orchestrator | Exit playbook, if user did not mean to reboot systems ------------------- 0.75s 2026-04-03 04:59:57.530413 | orchestrator | Reboot system - wait for the reboot to complete ------------------------- 0.63s 2026-04-03 04:59:57.855037 | orchestrator | + osism apply wait-for-connection -l testbed-nodes -e ireallymeanit=yes 2026-04-03 05:00:09.985907 | orchestrator | 2026-04-03 05:00:09 | INFO  | Task 79d7a3a7-6bca-4855-b266-6d9cf5560a50 (wait-for-connection) was prepared for execution. 2026-04-03 05:00:09.986122 | orchestrator | 2026-04-03 05:00:09 | INFO  | It takes a moment until task 79d7a3a7-6bca-4855-b266-6d9cf5560a50 (wait-for-connection) has been started and output is visible here. 2026-04-03 05:00:25.848478 | orchestrator | 2026-04-03 05:00:25.848586 | orchestrator | PLAY [Wait until remote systems are reachable] ********************************* 2026-04-03 05:00:25.848631 | orchestrator | 2026-04-03 05:00:25.848722 | orchestrator | TASK [Wait until remote system is reachable] *********************************** 2026-04-03 05:00:25.848738 | orchestrator | Friday 03 April 2026 05:00:13 +0000 (0:00:00.238) 0:00:00.238 ********** 2026-04-03 05:00:25.848749 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:00:25.848761 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:00:25.848772 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:00:25.848783 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:00:25.848793 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:00:25.848804 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:00:25.848815 | orchestrator | 2026-04-03 05:00:25.848825 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:00:25.848838 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848850 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848861 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848872 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848883 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848894 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:00:25.848905 | orchestrator | 2026-04-03 05:00:25.848916 | orchestrator | 2026-04-03 05:00:25.848927 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:00:25.848938 | orchestrator | Friday 03 April 2026 05:00:25 +0000 (0:00:11.534) 0:00:11.773 ********** 2026-04-03 05:00:25.848949 | orchestrator | =============================================================================== 2026-04-03 05:00:25.848960 | orchestrator | Wait until remote system is reachable ---------------------------------- 11.53s 2026-04-03 05:00:26.158770 | orchestrator | + osism apply hddtemp 2026-04-03 05:00:38.250652 | orchestrator | 2026-04-03 05:00:38 | INFO  | Task e90ff8b2-65ec-4f54-a5d3-90eaf06afb15 (hddtemp) was prepared for execution. 2026-04-03 05:00:38.250832 | orchestrator | 2026-04-03 05:00:38 | INFO  | It takes a moment until task e90ff8b2-65ec-4f54-a5d3-90eaf06afb15 (hddtemp) has been started and output is visible here. 2026-04-03 05:01:05.205862 | orchestrator | 2026-04-03 05:01:05.205979 | orchestrator | PLAY [Apply role hddtemp] ****************************************************** 2026-04-03 05:01:05.205997 | orchestrator | 2026-04-03 05:01:05.206010 | orchestrator | TASK [osism.services.hddtemp : Gather variables for each operating system] ***** 2026-04-03 05:01:05.206081 | orchestrator | Friday 03 April 2026 05:00:42 +0000 (0:00:00.254) 0:00:00.254 ********** 2026-04-03 05:01:05.206094 | orchestrator | ok: [testbed-manager] 2026-04-03 05:01:05.206106 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:01:05.206117 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:01:05.206129 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:01:05.206174 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:01:05.206185 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:01:05.206196 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:01:05.206207 | orchestrator | 2026-04-03 05:01:05.206218 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific install tasks] **** 2026-04-03 05:01:05.206229 | orchestrator | Friday 03 April 2026 05:00:43 +0000 (0:00:00.707) 0:00:00.961 ********** 2026-04-03 05:01:05.206241 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:01:05.206280 | orchestrator | 2026-04-03 05:01:05.206292 | orchestrator | TASK [osism.services.hddtemp : Remove hddtemp package] ************************* 2026-04-03 05:01:05.206303 | orchestrator | Friday 03 April 2026 05:00:44 +0000 (0:00:01.233) 0:00:02.195 ********** 2026-04-03 05:01:05.206314 | orchestrator | ok: [testbed-manager] 2026-04-03 05:01:05.206325 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:01:05.206337 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:01:05.206351 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:01:05.206364 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:01:05.206378 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:01:05.206391 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:01:05.206404 | orchestrator | 2026-04-03 05:01:05.206418 | orchestrator | TASK [osism.services.hddtemp : Enable Kernel Module drivetemp] ***************** 2026-04-03 05:01:05.206432 | orchestrator | Friday 03 April 2026 05:00:46 +0000 (0:00:01.760) 0:00:03.955 ********** 2026-04-03 05:01:05.206445 | orchestrator | changed: [testbed-manager] 2026-04-03 05:01:05.206460 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:01:05.206473 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:01:05.206486 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:01:05.206499 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:01:05.206513 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:01:05.206527 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:01:05.206539 | orchestrator | 2026-04-03 05:01:05.206552 | orchestrator | TASK [osism.services.hddtemp : Check if drivetemp module is available] ********* 2026-04-03 05:01:05.206566 | orchestrator | Friday 03 April 2026 05:00:47 +0000 (0:00:01.182) 0:00:05.138 ********** 2026-04-03 05:01:05.206578 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:01:05.206591 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:01:05.206605 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:01:05.206618 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:01:05.206631 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:01:05.206643 | orchestrator | ok: [testbed-manager] 2026-04-03 05:01:05.206674 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:01:05.206688 | orchestrator | 2026-04-03 05:01:05.206723 | orchestrator | TASK [osism.services.hddtemp : Load Kernel Module drivetemp] ******************* 2026-04-03 05:01:05.206735 | orchestrator | Friday 03 April 2026 05:00:48 +0000 (0:00:01.119) 0:00:06.257 ********** 2026-04-03 05:01:05.206746 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:01:05.206757 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:01:05.206767 | orchestrator | changed: [testbed-manager] 2026-04-03 05:01:05.206778 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:01:05.206789 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:01:05.206799 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:01:05.206810 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:01:05.206821 | orchestrator | 2026-04-03 05:01:05.206831 | orchestrator | TASK [osism.services.hddtemp : Install lm-sensors] ***************************** 2026-04-03 05:01:05.206842 | orchestrator | Friday 03 April 2026 05:00:49 +0000 (0:00:00.861) 0:00:07.119 ********** 2026-04-03 05:01:05.206853 | orchestrator | changed: [testbed-manager] 2026-04-03 05:01:05.206864 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:01:05.206875 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:01:05.206885 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:01:05.206896 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:01:05.206906 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:01:05.206917 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:01:05.206928 | orchestrator | 2026-04-03 05:01:05.206939 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific service tasks] **** 2026-04-03 05:01:05.206950 | orchestrator | Friday 03 April 2026 05:01:00 +0000 (0:00:11.449) 0:00:18.568 ********** 2026-04-03 05:01:05.206961 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/service-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:01:05.206972 | orchestrator | 2026-04-03 05:01:05.206992 | orchestrator | TASK [osism.services.hddtemp : Manage lm-sensors service] ********************** 2026-04-03 05:01:05.207003 | orchestrator | Friday 03 April 2026 05:01:02 +0000 (0:00:01.237) 0:00:19.806 ********** 2026-04-03 05:01:05.207014 | orchestrator | changed: [testbed-manager] 2026-04-03 05:01:05.207025 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:01:05.207035 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:01:05.207046 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:01:05.207057 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:01:05.207068 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:01:05.207079 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:01:05.207090 | orchestrator | 2026-04-03 05:01:05.207101 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:01:05.207112 | orchestrator | testbed-manager : ok=9  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:01:05.207142 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207154 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207165 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207176 | orchestrator | testbed-node-3 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207187 | orchestrator | testbed-node-4 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207198 | orchestrator | testbed-node-5 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:01:05.207208 | orchestrator | 2026-04-03 05:01:05.207219 | orchestrator | 2026-04-03 05:01:05.207230 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:01:05.207241 | orchestrator | Friday 03 April 2026 05:01:04 +0000 (0:00:02.682) 0:00:22.488 ********** 2026-04-03 05:01:05.207252 | orchestrator | =============================================================================== 2026-04-03 05:01:05.207262 | orchestrator | osism.services.hddtemp : Install lm-sensors ---------------------------- 11.45s 2026-04-03 05:01:05.207273 | orchestrator | osism.services.hddtemp : Manage lm-sensors service ---------------------- 2.68s 2026-04-03 05:01:05.207284 | orchestrator | osism.services.hddtemp : Remove hddtemp package ------------------------- 1.76s 2026-04-03 05:01:05.207294 | orchestrator | osism.services.hddtemp : Include distribution specific service tasks ---- 1.24s 2026-04-03 05:01:05.207305 | orchestrator | osism.services.hddtemp : Include distribution specific install tasks ---- 1.23s 2026-04-03 05:01:05.207316 | orchestrator | osism.services.hddtemp : Enable Kernel Module drivetemp ----------------- 1.18s 2026-04-03 05:01:05.207326 | orchestrator | osism.services.hddtemp : Check if drivetemp module is available --------- 1.12s 2026-04-03 05:01:05.207337 | orchestrator | osism.services.hddtemp : Load Kernel Module drivetemp ------------------- 0.86s 2026-04-03 05:01:05.207348 | orchestrator | osism.services.hddtemp : Gather variables for each operating system ----- 0.71s 2026-04-03 05:01:05.588869 | orchestrator | ++ semver 9.5.0 7.1.1 2026-04-03 05:01:05.643060 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 05:01:05.643155 | orchestrator | + sudo systemctl restart manager.service 2026-04-03 05:01:19.803533 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 05:01:19.803650 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-03 05:01:19.803669 | orchestrator | + local max_attempts=60 2026-04-03 05:01:19.803704 | orchestrator | + local name=ceph-ansible 2026-04-03 05:01:19.803717 | orchestrator | + local attempt_num=1 2026-04-03 05:01:19.803945 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:19.822128 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:19.822223 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:19.822237 | orchestrator | + sleep 5 2026-04-03 05:01:24.825698 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:24.975099 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:24.975210 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:24.975226 | orchestrator | + sleep 5 2026-04-03 05:01:29.969840 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:30.005388 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:30.005512 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:30.005536 | orchestrator | + sleep 5 2026-04-03 05:01:35.009141 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:35.045769 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:35.045884 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:35.045900 | orchestrator | + sleep 5 2026-04-03 05:01:40.050194 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:40.091875 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:40.091964 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:40.091977 | orchestrator | + sleep 5 2026-04-03 05:01:45.097285 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:45.137831 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:45.137926 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:45.137941 | orchestrator | + sleep 5 2026-04-03 05:01:50.143754 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:50.185991 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:50.186151 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:50.186173 | orchestrator | + sleep 5 2026-04-03 05:01:55.189847 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:01:55.238459 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:01:55.238556 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:01:55.238572 | orchestrator | + sleep 5 2026-04-03 05:02:00.242927 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:00.263716 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:00.263823 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:02:00.263840 | orchestrator | + sleep 5 2026-04-03 05:02:05.267485 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:05.306128 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:05.306219 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:02:05.306232 | orchestrator | + sleep 5 2026-04-03 05:02:10.313316 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:10.352312 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:10.352386 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:02:10.352396 | orchestrator | + sleep 5 2026-04-03 05:02:15.357176 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:15.393210 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:15.393330 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:02:15.393357 | orchestrator | + sleep 5 2026-04-03 05:02:20.398796 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:20.437919 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:20.437987 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-03 05:02:20.437993 | orchestrator | + sleep 5 2026-04-03 05:02:25.442800 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-03 05:02:25.483756 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:25.483887 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-03 05:02:25.483905 | orchestrator | + local max_attempts=60 2026-04-03 05:02:25.483918 | orchestrator | + local name=kolla-ansible 2026-04-03 05:02:25.483930 | orchestrator | + local attempt_num=1 2026-04-03 05:02:25.485261 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-03 05:02:25.519520 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:25.519618 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-03 05:02:25.519634 | orchestrator | + local max_attempts=60 2026-04-03 05:02:25.519676 | orchestrator | + local name=osism-ansible 2026-04-03 05:02:25.519688 | orchestrator | + local attempt_num=1 2026-04-03 05:02:25.520214 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-03 05:02:25.559772 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 05:02:25.559905 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 05:02:25.559920 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-03 05:02:25.741958 | orchestrator | ARA in ceph-ansible already disabled. 2026-04-03 05:02:25.898646 | orchestrator | ARA in kolla-ansible already disabled. 2026-04-03 05:02:26.018350 | orchestrator | ARA in osism-ansible already disabled. 2026-04-03 05:02:26.163959 | orchestrator | ARA in osism-kubernetes already disabled. 2026-04-03 05:02:26.164068 | orchestrator | + osism apply gather-facts 2026-04-03 05:02:38.433514 | orchestrator | 2026-04-03 05:02:38 | INFO  | Task 1a5fea8f-c75e-424b-8306-3cc9cfaef7ac (gather-facts) was prepared for execution. 2026-04-03 05:02:38.433601 | orchestrator | 2026-04-03 05:02:38 | INFO  | It takes a moment until task 1a5fea8f-c75e-424b-8306-3cc9cfaef7ac (gather-facts) has been started and output is visible here. 2026-04-03 05:02:51.669618 | orchestrator | 2026-04-03 05:02:51.669760 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 05:02:51.669789 | orchestrator | 2026-04-03 05:02:51.669809 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 05:02:51.669829 | orchestrator | Friday 03 April 2026 05:02:42 +0000 (0:00:00.217) 0:00:00.217 ********** 2026-04-03 05:02:51.669846 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:02:51.669902 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:02:51.669920 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:02:51.669937 | orchestrator | ok: [testbed-manager] 2026-04-03 05:02:51.669954 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:02:51.669973 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:02:51.670010 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:02:51.670103 | orchestrator | 2026-04-03 05:02:51.670124 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 05:02:51.670143 | orchestrator | 2026-04-03 05:02:51.670156 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 05:02:51.670170 | orchestrator | Friday 03 April 2026 05:02:50 +0000 (0:00:08.009) 0:00:08.227 ********** 2026-04-03 05:02:51.670184 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:02:51.670199 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:02:51.670212 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:02:51.670226 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:02:51.670240 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:02:51.670253 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:02:51.670265 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:02:51.670278 | orchestrator | 2026-04-03 05:02:51.670291 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:02:51.670306 | orchestrator | testbed-manager : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670321 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670334 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670349 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670366 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670384 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670398 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:02:51.670438 | orchestrator | 2026-04-03 05:02:51.670452 | orchestrator | 2026-04-03 05:02:51.670465 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:02:51.670478 | orchestrator | Friday 03 April 2026 05:02:51 +0000 (0:00:00.556) 0:00:08.784 ********** 2026-04-03 05:02:51.670492 | orchestrator | =============================================================================== 2026-04-03 05:02:51.670504 | orchestrator | Gathers facts about hosts ----------------------------------------------- 8.01s 2026-04-03 05:02:51.670515 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.56s 2026-04-03 05:02:52.007564 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/001-helpers.sh /usr/local/bin/deploy-helper 2026-04-03 05:02:52.019393 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh /usr/local/bin/deploy-ceph-with-ansible 2026-04-03 05:02:52.035313 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-rook.sh /usr/local/bin/deploy-ceph-with-rook 2026-04-03 05:02:52.047964 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/200-infrastructure.sh /usr/local/bin/deploy-infrastructure 2026-04-03 05:02:52.062312 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/300-openstack.sh /usr/local/bin/deploy-openstack 2026-04-03 05:02:52.081335 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/320-openstack-minimal.sh /usr/local/bin/deploy-openstack-minimal 2026-04-03 05:02:52.096365 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/400-monitoring.sh /usr/local/bin/deploy-monitoring 2026-04-03 05:02:52.115688 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/500-kubernetes.sh /usr/local/bin/deploy-kubernetes 2026-04-03 05:02:52.134229 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/510-clusterapi.sh /usr/local/bin/deploy-kubernetes-clusterapi 2026-04-03 05:02:52.148538 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade-manager.sh /usr/local/bin/upgrade-manager 2026-04-03 05:02:52.168577 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh /usr/local/bin/upgrade-ceph-with-ansible 2026-04-03 05:02:52.186724 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-rook.sh /usr/local/bin/upgrade-ceph-with-rook 2026-04-03 05:02:52.202738 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/200-infrastructure.sh /usr/local/bin/upgrade-infrastructure 2026-04-03 05:02:52.217711 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/300-openstack.sh /usr/local/bin/upgrade-openstack 2026-04-03 05:02:52.233844 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/320-openstack-minimal.sh /usr/local/bin/upgrade-openstack-minimal 2026-04-03 05:02:52.255826 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/400-monitoring.sh /usr/local/bin/upgrade-monitoring 2026-04-03 05:02:52.274258 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/500-kubernetes.sh /usr/local/bin/upgrade-kubernetes 2026-04-03 05:02:52.293656 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/510-clusterapi.sh /usr/local/bin/upgrade-kubernetes-clusterapi 2026-04-03 05:02:52.312136 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/300-openstack.sh /usr/local/bin/bootstrap-openstack 2026-04-03 05:02:52.331531 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/301-openstack-octavia-amhpora-image.sh /usr/local/bin/bootstrap-octavia 2026-04-03 05:02:52.355943 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/302-openstack-k8s-clusterapi-images.sh /usr/local/bin/bootstrap-clusterapi 2026-04-03 05:02:52.374674 | orchestrator | + sudo ln -sf /opt/configuration/scripts/disable-local-registry.sh /usr/local/bin/disable-local-registry 2026-04-03 05:02:52.393830 | orchestrator | + sudo ln -sf /opt/configuration/scripts/pull-images.sh /usr/local/bin/pull-images 2026-04-03 05:02:52.411970 | orchestrator | + [[ false == \t\r\u\e ]] 2026-04-03 05:02:52.868174 | orchestrator | ok: Runtime: 0:24:08.939414 2026-04-03 05:02:53.001704 | 2026-04-03 05:02:53.001873 | TASK [Deploy services] 2026-04-03 05:02:53.791241 | orchestrator | 2026-04-03 05:02:53.791466 | orchestrator | # DEPLOY SERVICES 2026-04-03 05:02:53.791509 | orchestrator | 2026-04-03 05:02:53.791533 | orchestrator | + set -e 2026-04-03 05:02:53.791554 | orchestrator | + echo 2026-04-03 05:02:53.791576 | orchestrator | + echo '# DEPLOY SERVICES' 2026-04-03 05:02:53.791598 | orchestrator | + echo 2026-04-03 05:02:53.791660 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 05:02:53.791693 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 05:02:53.791717 | orchestrator | ++ INTERACTIVE=false 2026-04-03 05:02:53.791738 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 05:02:53.791771 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 05:02:53.791793 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 05:02:53.791818 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 05:02:53.791837 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 05:02:53.791945 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 05:02:53.791969 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 05:02:53.791992 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 05:02:53.792012 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 05:02:53.792036 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 05:02:53.792055 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 05:02:53.792074 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 05:02:53.792095 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 05:02:53.792114 | orchestrator | ++ export ARA=false 2026-04-03 05:02:53.792133 | orchestrator | ++ ARA=false 2026-04-03 05:02:53.792147 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 05:02:53.792158 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 05:02:53.792170 | orchestrator | ++ export TEMPEST=false 2026-04-03 05:02:53.792180 | orchestrator | ++ TEMPEST=false 2026-04-03 05:02:53.792198 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 05:02:53.792216 | orchestrator | ++ IS_ZUUL=true 2026-04-03 05:02:53.792234 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:02:53.792254 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:02:53.792272 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 05:02:53.792290 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 05:02:53.792309 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 05:02:53.792328 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 05:02:53.792347 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 05:02:53.792366 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 05:02:53.792385 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 05:02:53.792406 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 05:02:53.792418 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-03 05:02:53.799940 | orchestrator | + set -e 2026-04-03 05:02:53.800027 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 05:02:53.800052 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 05:02:53.800071 | orchestrator | ++ INTERACTIVE=false 2026-04-03 05:02:53.800083 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 05:02:53.800094 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 05:02:53.800105 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 05:02:53.800116 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 05:02:53.800127 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 05:02:53.800138 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 05:02:53.800149 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 05:02:53.800160 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 05:02:53.800171 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 05:02:53.800199 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 05:02:53.800210 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 05:02:53.800232 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 05:02:53.800243 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 05:02:53.800255 | orchestrator | ++ export ARA=false 2026-04-03 05:02:53.800266 | orchestrator | ++ ARA=false 2026-04-03 05:02:53.800278 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 05:02:53.800288 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 05:02:53.800299 | orchestrator | ++ export TEMPEST=false 2026-04-03 05:02:53.800314 | orchestrator | ++ TEMPEST=false 2026-04-03 05:02:53.800328 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 05:02:53.800340 | orchestrator | ++ IS_ZUUL=true 2026-04-03 05:02:53.800354 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:02:53.800367 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:02:53.800380 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 05:02:53.800392 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 05:02:53.800405 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 05:02:53.800418 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 05:02:53.800431 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 05:02:53.800444 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 05:02:53.800497 | orchestrator | 2026-04-03 05:02:53.800512 | orchestrator | # PULL IMAGES 2026-04-03 05:02:53.800524 | orchestrator | 2026-04-03 05:02:53.800537 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 05:02:53.800550 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 05:02:53.800563 | orchestrator | + echo 2026-04-03 05:02:53.800575 | orchestrator | + echo '# PULL IMAGES' 2026-04-03 05:02:53.800588 | orchestrator | + echo 2026-04-03 05:02:53.801350 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-03 05:02:53.857967 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 05:02:53.858141 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-03 05:02:55.780302 | orchestrator | 2026-04-03 05:02:55 | INFO  | Trying to run play pull-images in environment custom 2026-04-03 05:03:05.869532 | orchestrator | 2026-04-03 05:03:05 | INFO  | Task 668e4860-79ae-4d85-b0e0-221f2ba70c1d (pull-images) was prepared for execution. 2026-04-03 05:03:05.869693 | orchestrator | 2026-04-03 05:03:05 | INFO  | Task 668e4860-79ae-4d85-b0e0-221f2ba70c1d is running in background. No more output. Check ARA for logs. 2026-04-03 05:03:06.178976 | orchestrator | + sh -c /opt/configuration/scripts/deploy/001-helpers.sh 2026-04-03 05:03:18.284869 | orchestrator | 2026-04-03 05:03:18 | INFO  | Task 90b631ce-e804-4c8b-83d6-d3792b5d0f9e (cgit) was prepared for execution. 2026-04-03 05:03:18.285166 | orchestrator | 2026-04-03 05:03:18 | INFO  | Task 90b631ce-e804-4c8b-83d6-d3792b5d0f9e is running in background. No more output. Check ARA for logs. 2026-04-03 05:03:31.282352 | orchestrator | 2026-04-03 05:03:31 | INFO  | Task e1a907ce-acf3-436c-9f91-26c588cadcb3 (dotfiles) was prepared for execution. 2026-04-03 05:03:31.282472 | orchestrator | 2026-04-03 05:03:31 | INFO  | Task e1a907ce-acf3-436c-9f91-26c588cadcb3 is running in background. No more output. Check ARA for logs. 2026-04-03 05:03:43.892596 | orchestrator | 2026-04-03 05:03:43 | INFO  | Task 327a3862-4f89-49dc-a8e6-f462b6bfa9be (homer) was prepared for execution. 2026-04-03 05:03:43.892694 | orchestrator | 2026-04-03 05:03:43 | INFO  | Task 327a3862-4f89-49dc-a8e6-f462b6bfa9be is running in background. No more output. Check ARA for logs. 2026-04-03 05:03:56.425405 | orchestrator | 2026-04-03 05:03:56 | INFO  | Task af1ad804-e687-4412-9730-fbe874beef71 (phpmyadmin) was prepared for execution. 2026-04-03 05:03:56.425498 | orchestrator | 2026-04-03 05:03:56 | INFO  | Task af1ad804-e687-4412-9730-fbe874beef71 is running in background. No more output. Check ARA for logs. 2026-04-03 05:04:08.755717 | orchestrator | 2026-04-03 05:04:08 | INFO  | Task 0b6fb9eb-3fe4-4a98-928c-e9964b99f8e6 (sosreport) was prepared for execution. 2026-04-03 05:04:08.755810 | orchestrator | 2026-04-03 05:04:08 | INFO  | Task 0b6fb9eb-3fe4-4a98-928c-e9964b99f8e6 is running in background. No more output. Check ARA for logs. 2026-04-03 05:04:09.071511 | orchestrator | + sh -c /opt/configuration/scripts/deploy/500-kubernetes.sh 2026-04-03 05:04:09.076771 | orchestrator | + set -e 2026-04-03 05:04:09.076811 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 05:04:09.076824 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 05:04:09.076837 | orchestrator | ++ INTERACTIVE=false 2026-04-03 05:04:09.076850 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 05:04:09.076861 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 05:04:09.076872 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 05:04:09.076883 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 05:04:09.076894 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 05:04:09.076905 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 05:04:09.076916 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 05:04:09.076927 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 05:04:09.076938 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 05:04:09.076949 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 05:04:09.077002 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 05:04:09.077023 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 05:04:09.077043 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 05:04:09.077057 | orchestrator | ++ export ARA=false 2026-04-03 05:04:09.077068 | orchestrator | ++ ARA=false 2026-04-03 05:04:09.077079 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 05:04:09.077122 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 05:04:09.077134 | orchestrator | ++ export TEMPEST=false 2026-04-03 05:04:09.077145 | orchestrator | ++ TEMPEST=false 2026-04-03 05:04:09.077156 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 05:04:09.077166 | orchestrator | ++ IS_ZUUL=true 2026-04-03 05:04:09.077203 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:04:09.077231 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 05:04:09.077250 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 05:04:09.077270 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 05:04:09.077288 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 05:04:09.077305 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 05:04:09.077316 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 05:04:09.077327 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 05:04:09.077338 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 05:04:09.077349 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 05:04:09.077810 | orchestrator | ++ semver 9.5.0 8.0.3 2026-04-03 05:04:09.138355 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 05:04:09.138450 | orchestrator | + osism apply frr 2026-04-03 05:04:21.481316 | orchestrator | 2026-04-03 05:04:21 | INFO  | Task 238af98f-c42b-43df-a19d-db10ef82328a (frr) was prepared for execution. 2026-04-03 05:04:21.481437 | orchestrator | 2026-04-03 05:04:21 | INFO  | It takes a moment until task 238af98f-c42b-43df-a19d-db10ef82328a (frr) has been started and output is visible here. 2026-04-03 05:04:54.067078 | orchestrator | 2026-04-03 05:04:54.067201 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-03 05:04:54.067220 | orchestrator | 2026-04-03 05:04:54.067232 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-03 05:04:54.067253 | orchestrator | Friday 03 April 2026 05:04:27 +0000 (0:00:00.230) 0:00:00.230 ********** 2026-04-03 05:04:54.067266 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 05:04:54.067278 | orchestrator | 2026-04-03 05:04:54.067290 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-03 05:04:54.067301 | orchestrator | Friday 03 April 2026 05:04:27 +0000 (0:00:00.222) 0:00:00.452 ********** 2026-04-03 05:04:54.067313 | orchestrator | changed: [testbed-manager] 2026-04-03 05:04:54.067325 | orchestrator | 2026-04-03 05:04:54.067336 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-03 05:04:54.067349 | orchestrator | Friday 03 April 2026 05:04:29 +0000 (0:00:01.670) 0:00:02.122 ********** 2026-04-03 05:04:54.067364 | orchestrator | changed: [testbed-manager] 2026-04-03 05:04:54.067384 | orchestrator | 2026-04-03 05:04:54.067404 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-03 05:04:54.067424 | orchestrator | Friday 03 April 2026 05:04:43 +0000 (0:00:13.660) 0:00:15.783 ********** 2026-04-03 05:04:54.067443 | orchestrator | ok: [testbed-manager] 2026-04-03 05:04:54.067462 | orchestrator | 2026-04-03 05:04:54.067480 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-03 05:04:54.067499 | orchestrator | Friday 03 April 2026 05:04:44 +0000 (0:00:01.375) 0:00:17.159 ********** 2026-04-03 05:04:54.067519 | orchestrator | changed: [testbed-manager] 2026-04-03 05:04:54.067538 | orchestrator | 2026-04-03 05:04:54.067557 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-03 05:04:54.067577 | orchestrator | Friday 03 April 2026 05:04:45 +0000 (0:00:00.959) 0:00:18.118 ********** 2026-04-03 05:04:54.067598 | orchestrator | ok: [testbed-manager] 2026-04-03 05:04:54.067614 | orchestrator | 2026-04-03 05:04:54.067627 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-03 05:04:54.067641 | orchestrator | Friday 03 April 2026 05:04:46 +0000 (0:00:01.196) 0:00:19.314 ********** 2026-04-03 05:04:54.067654 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:04:54.067667 | orchestrator | 2026-04-03 05:04:54.067680 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-03 05:04:54.067693 | orchestrator | Friday 03 April 2026 05:04:46 +0000 (0:00:00.159) 0:00:19.474 ********** 2026-04-03 05:04:54.067731 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:04:54.067746 | orchestrator | 2026-04-03 05:04:54.067759 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-03 05:04:54.067772 | orchestrator | Friday 03 April 2026 05:04:47 +0000 (0:00:00.196) 0:00:19.670 ********** 2026-04-03 05:04:54.067785 | orchestrator | changed: [testbed-manager] 2026-04-03 05:04:54.067798 | orchestrator | 2026-04-03 05:04:54.067811 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-03 05:04:54.067824 | orchestrator | Friday 03 April 2026 05:04:48 +0000 (0:00:01.048) 0:00:20.719 ********** 2026-04-03 05:04:54.067837 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-03 05:04:54.067849 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-03 05:04:54.067864 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-03 05:04:54.067877 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-03 05:04:54.067890 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-03 05:04:54.067904 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-03 05:04:54.067916 | orchestrator | 2026-04-03 05:04:54.067927 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-03 05:04:54.067938 | orchestrator | Friday 03 April 2026 05:04:50 +0000 (0:00:02.340) 0:00:23.059 ********** 2026-04-03 05:04:54.067949 | orchestrator | ok: [testbed-manager] 2026-04-03 05:04:54.067959 | orchestrator | 2026-04-03 05:04:54.067970 | orchestrator | RUNNING HANDLER [osism.services.frr : Restart frr service] ********************* 2026-04-03 05:04:54.067981 | orchestrator | Friday 03 April 2026 05:04:52 +0000 (0:00:01.766) 0:00:24.826 ********** 2026-04-03 05:04:54.067992 | orchestrator | changed: [testbed-manager] 2026-04-03 05:04:54.068002 | orchestrator | 2026-04-03 05:04:54.068133 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:04:54.068154 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:04:54.068166 | orchestrator | 2026-04-03 05:04:54.068177 | orchestrator | 2026-04-03 05:04:54.068197 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:04:54.068208 | orchestrator | Friday 03 April 2026 05:04:53 +0000 (0:00:01.445) 0:00:26.272 ********** 2026-04-03 05:04:54.068219 | orchestrator | =============================================================================== 2026-04-03 05:04:54.068230 | orchestrator | osism.services.frr : Install frr package ------------------------------- 13.66s 2026-04-03 05:04:54.068241 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 2.34s 2026-04-03 05:04:54.068252 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 1.77s 2026-04-03 05:04:54.068263 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 1.67s 2026-04-03 05:04:54.068274 | orchestrator | osism.services.frr : Restart frr service -------------------------------- 1.45s 2026-04-03 05:04:54.068306 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 1.38s 2026-04-03 05:04:54.068318 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 1.20s 2026-04-03 05:04:54.068329 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 1.05s 2026-04-03 05:04:54.068340 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 0.96s 2026-04-03 05:04:54.068351 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 0.22s 2026-04-03 05:04:54.068364 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 0.20s 2026-04-03 05:04:54.068383 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 0.16s 2026-04-03 05:04:54.427535 | orchestrator | + osism apply kubernetes 2026-04-03 05:04:56.495388 | orchestrator | 2026-04-03 05:04:56 | INFO  | Task 194b33b2-d2c7-4a44-839a-2d7748c35448 (kubernetes) was prepared for execution. 2026-04-03 05:04:56.495512 | orchestrator | 2026-04-03 05:04:56 | INFO  | It takes a moment until task 194b33b2-d2c7-4a44-839a-2d7748c35448 (kubernetes) has been started and output is visible here. 2026-04-03 05:05:20.886914 | orchestrator | 2026-04-03 05:05:20.887026 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-03 05:05:20.887042 | orchestrator | 2026-04-03 05:05:20.887098 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-03 05:05:20.887111 | orchestrator | Friday 03 April 2026 05:05:01 +0000 (0:00:00.182) 0:00:00.182 ********** 2026-04-03 05:05:20.887123 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:05:20.887135 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:05:20.887146 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:05:20.887158 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:05:20.887169 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:05:20.887180 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:05:20.887191 | orchestrator | 2026-04-03 05:05:20.887203 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-03 05:05:20.887214 | orchestrator | Friday 03 April 2026 05:05:02 +0000 (0:00:00.856) 0:00:01.038 ********** 2026-04-03 05:05:20.887225 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.887237 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.887249 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.887260 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.887271 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.887282 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.887293 | orchestrator | 2026-04-03 05:05:20.887304 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-03 05:05:20.887318 | orchestrator | Friday 03 April 2026 05:05:03 +0000 (0:00:00.710) 0:00:01.748 ********** 2026-04-03 05:05:20.887329 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.887340 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.887351 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.887362 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.887373 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.887384 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.887395 | orchestrator | 2026-04-03 05:05:20.887406 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-03 05:05:20.887418 | orchestrator | Friday 03 April 2026 05:05:04 +0000 (0:00:00.976) 0:00:02.725 ********** 2026-04-03 05:05:20.887429 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:05:20.887442 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:05:20.887456 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:05:20.887473 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:05:20.887487 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:05:20.887500 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:05:20.887513 | orchestrator | 2026-04-03 05:05:20.887525 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-03 05:05:20.887539 | orchestrator | Friday 03 April 2026 05:05:05 +0000 (0:00:01.754) 0:00:04.480 ********** 2026-04-03 05:05:20.887553 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:05:20.887566 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:05:20.887579 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:05:20.887592 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:05:20.887605 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:05:20.887617 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:05:20.887631 | orchestrator | 2026-04-03 05:05:20.887644 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-03 05:05:20.887656 | orchestrator | Friday 03 April 2026 05:05:07 +0000 (0:00:01.310) 0:00:05.790 ********** 2026-04-03 05:05:20.887667 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:05:20.887698 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:05:20.887710 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:05:20.887721 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:05:20.887732 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:05:20.887743 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:05:20.887754 | orchestrator | 2026-04-03 05:05:20.887772 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-03 05:05:20.887784 | orchestrator | Friday 03 April 2026 05:05:08 +0000 (0:00:00.981) 0:00:06.772 ********** 2026-04-03 05:05:20.887795 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.887806 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.887817 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.887828 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.887839 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.887850 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.887861 | orchestrator | 2026-04-03 05:05:20.887872 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-03 05:05:20.887883 | orchestrator | Friday 03 April 2026 05:05:08 +0000 (0:00:00.667) 0:00:07.439 ********** 2026-04-03 05:05:20.887894 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.887904 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.887915 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.887926 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.887937 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.887948 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.887959 | orchestrator | 2026-04-03 05:05:20.887970 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-03 05:05:20.887981 | orchestrator | Friday 03 April 2026 05:05:09 +0000 (0:00:00.537) 0:00:07.976 ********** 2026-04-03 05:05:20.887992 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888003 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888014 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888025 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888036 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888097 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888111 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888122 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888133 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.888144 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888173 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888185 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.888196 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888207 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888218 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.888229 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 05:05:20.888240 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 05:05:20.888252 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.888262 | orchestrator | 2026-04-03 05:05:20.888273 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-03 05:05:20.888284 | orchestrator | Friday 03 April 2026 05:05:09 +0000 (0:00:00.538) 0:00:08.515 ********** 2026-04-03 05:05:20.888295 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888306 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888317 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.888337 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.888348 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.888358 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.888369 | orchestrator | 2026-04-03 05:05:20.888380 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-03 05:05:20.888392 | orchestrator | Friday 03 April 2026 05:05:10 +0000 (0:00:00.971) 0:00:09.487 ********** 2026-04-03 05:05:20.888403 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:05:20.888414 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:05:20.888425 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:05:20.888436 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:05:20.888447 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:05:20.888457 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:05:20.888468 | orchestrator | 2026-04-03 05:05:20.888479 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-03 05:05:20.888490 | orchestrator | Friday 03 April 2026 05:05:11 +0000 (0:00:00.696) 0:00:10.183 ********** 2026-04-03 05:05:20.888501 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:05:20.888512 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:05:20.888523 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:05:20.888534 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:05:20.888545 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:05:20.888555 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:05:20.888566 | orchestrator | 2026-04-03 05:05:20.888577 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-03 05:05:20.888589 | orchestrator | Friday 03 April 2026 05:05:17 +0000 (0:00:05.741) 0:00:15.925 ********** 2026-04-03 05:05:20.888600 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888616 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888627 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.888638 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.888649 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.888660 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.888671 | orchestrator | 2026-04-03 05:05:20.888682 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-03 05:05:20.888693 | orchestrator | Friday 03 April 2026 05:05:18 +0000 (0:00:01.014) 0:00:16.940 ********** 2026-04-03 05:05:20.888703 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888714 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888725 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.888735 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.888746 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.888757 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.888768 | orchestrator | 2026-04-03 05:05:20.888779 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-03 05:05:20.888791 | orchestrator | Friday 03 April 2026 05:05:19 +0000 (0:00:01.261) 0:00:18.201 ********** 2026-04-03 05:05:20.888802 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888813 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888823 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.888834 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.888845 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.888856 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.888867 | orchestrator | 2026-04-03 05:05:20.888877 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-03 05:05:20.888888 | orchestrator | Friday 03 April 2026 05:05:20 +0000 (0:00:00.571) 0:00:18.773 ********** 2026-04-03 05:05:20.888899 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-03 05:05:20.888916 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-03 05:05:20.888927 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:05:20.888938 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-03 05:05:20.888956 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-03 05:05:20.888967 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:05:20.888978 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-03 05:05:20.888989 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-03 05:05:20.888999 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:05:20.889010 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-03 05:05:20.889021 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-03 05:05:20.889032 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:05:20.889043 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-03 05:05:20.889070 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-03 05:05:20.889082 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:05:20.889093 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-03 05:05:20.889103 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-03 05:05:20.889115 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:05:20.889125 | orchestrator | 2026-04-03 05:05:20.889137 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-03 05:05:20.889155 | orchestrator | Friday 03 April 2026 05:05:20 +0000 (0:00:00.705) 0:00:19.478 ********** 2026-04-03 05:06:32.944726 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:06:32.944849 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:06:32.944864 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:06:32.944877 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.944888 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.944899 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.944910 | orchestrator | 2026-04-03 05:06:32.944923 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-03 05:06:32.944936 | orchestrator | Friday 03 April 2026 05:05:21 +0000 (0:00:00.521) 0:00:20.000 ********** 2026-04-03 05:06:32.944947 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:06:32.944958 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:06:32.944969 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:06:32.944980 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.944991 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.945002 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.945013 | orchestrator | 2026-04-03 05:06:32.945024 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-03 05:06:32.945035 | orchestrator | 2026-04-03 05:06:32.945047 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-03 05:06:32.945058 | orchestrator | Friday 03 April 2026 05:05:22 +0000 (0:00:01.150) 0:00:21.151 ********** 2026-04-03 05:06:32.945069 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.945081 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.945092 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.945103 | orchestrator | 2026-04-03 05:06:32.945114 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-03 05:06:32.945125 | orchestrator | Friday 03 April 2026 05:05:23 +0000 (0:00:01.121) 0:00:22.272 ********** 2026-04-03 05:06:32.945184 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.945196 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.945206 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.945217 | orchestrator | 2026-04-03 05:06:32.945229 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-03 05:06:32.945240 | orchestrator | Friday 03 April 2026 05:05:24 +0000 (0:00:01.063) 0:00:23.335 ********** 2026-04-03 05:06:32.945254 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.945267 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.945280 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.945293 | orchestrator | 2026-04-03 05:06:32.945306 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-03 05:06:32.945346 | orchestrator | Friday 03 April 2026 05:05:25 +0000 (0:00:00.777) 0:00:24.113 ********** 2026-04-03 05:06:32.945361 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.945374 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.945387 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.945399 | orchestrator | 2026-04-03 05:06:32.945410 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-03 05:06:32.945421 | orchestrator | Friday 03 April 2026 05:05:26 +0000 (0:00:00.590) 0:00:24.703 ********** 2026-04-03 05:06:32.945432 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.945443 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.945454 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.945465 | orchestrator | 2026-04-03 05:06:32.945476 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-03 05:06:32.945503 | orchestrator | Friday 03 April 2026 05:05:26 +0000 (0:00:00.305) 0:00:25.009 ********** 2026-04-03 05:06:32.945515 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.945526 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:06:32.945537 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:06:32.945548 | orchestrator | 2026-04-03 05:06:32.945559 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-03 05:06:32.945570 | orchestrator | Friday 03 April 2026 05:05:27 +0000 (0:00:00.806) 0:00:25.816 ********** 2026-04-03 05:06:32.945581 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.945591 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:06:32.945602 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:06:32.945613 | orchestrator | 2026-04-03 05:06:32.945624 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-03 05:06:32.945635 | orchestrator | Friday 03 April 2026 05:05:28 +0000 (0:00:01.302) 0:00:27.119 ********** 2026-04-03 05:06:32.945646 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:06:32.945657 | orchestrator | 2026-04-03 05:06:32.945667 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-03 05:06:32.945678 | orchestrator | Friday 03 April 2026 05:05:28 +0000 (0:00:00.452) 0:00:27.571 ********** 2026-04-03 05:06:32.945689 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.945700 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.945711 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.945728 | orchestrator | 2026-04-03 05:06:32.945748 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-03 05:06:32.945766 | orchestrator | Friday 03 April 2026 05:05:30 +0000 (0:00:01.557) 0:00:29.128 ********** 2026-04-03 05:06:32.945785 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.945805 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.945821 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.945832 | orchestrator | 2026-04-03 05:06:32.945843 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-03 05:06:32.945854 | orchestrator | Friday 03 April 2026 05:05:31 +0000 (0:00:00.511) 0:00:29.639 ********** 2026-04-03 05:06:32.945865 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.945876 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.945887 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.945897 | orchestrator | 2026-04-03 05:06:32.945908 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-03 05:06:32.945919 | orchestrator | Friday 03 April 2026 05:05:31 +0000 (0:00:00.955) 0:00:30.595 ********** 2026-04-03 05:06:32.945930 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.945941 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.945951 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.945962 | orchestrator | 2026-04-03 05:06:32.945973 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-03 05:06:32.946003 | orchestrator | Friday 03 April 2026 05:05:33 +0000 (0:00:01.267) 0:00:31.862 ********** 2026-04-03 05:06:32.946091 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.946118 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.946158 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.946175 | orchestrator | 2026-04-03 05:06:32.946187 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-03 05:06:32.946198 | orchestrator | Friday 03 April 2026 05:05:33 +0000 (0:00:00.522) 0:00:32.384 ********** 2026-04-03 05:06:32.946208 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.946219 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.946230 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.946241 | orchestrator | 2026-04-03 05:06:32.946252 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-03 05:06:32.946263 | orchestrator | Friday 03 April 2026 05:05:34 +0000 (0:00:00.296) 0:00:32.681 ********** 2026-04-03 05:06:32.946274 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:06:32.946285 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:06:32.946295 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:06:32.946306 | orchestrator | 2026-04-03 05:06:32.946324 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-03 05:06:32.946336 | orchestrator | Friday 03 April 2026 05:05:35 +0000 (0:00:01.111) 0:00:33.793 ********** 2026-04-03 05:06:32.946346 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.946357 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.946368 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.946379 | orchestrator | 2026-04-03 05:06:32.946390 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-03 05:06:32.946401 | orchestrator | Friday 03 April 2026 05:05:37 +0000 (0:00:02.513) 0:00:36.306 ********** 2026-04-03 05:06:32.946412 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.946423 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.946434 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.946448 | orchestrator | 2026-04-03 05:06:32.946460 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-03 05:06:32.946471 | orchestrator | Friday 03 April 2026 05:05:38 +0000 (0:00:00.355) 0:00:36.662 ********** 2026-04-03 05:06:32.946482 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 05:06:32.946495 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 05:06:32.946506 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 05:06:32.946517 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 05:06:32.946528 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 05:06:32.946539 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 05:06:32.946553 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 05:06:32.946572 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 05:06:32.946588 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 05:06:32.946604 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 05:06:32.946620 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 05:06:32.946647 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 05:06:32.946665 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 05:06:32.946681 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 05:06:32.946698 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 05:06:32.946715 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:06:32.946735 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:06:32.946751 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:06:32.946762 | orchestrator | 2026-04-03 05:06:32.946780 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-03 05:06:32.946791 | orchestrator | Friday 03 April 2026 05:06:31 +0000 (0:00:53.633) 0:01:30.295 ********** 2026-04-03 05:06:32.946802 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:06:32.946813 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:06:32.946824 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:06:32.946835 | orchestrator | 2026-04-03 05:06:32.946845 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-03 05:06:32.946856 | orchestrator | Friday 03 April 2026 05:06:31 +0000 (0:00:00.306) 0:01:30.601 ********** 2026-04-03 05:06:32.946879 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.381352 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.381470 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.381486 | orchestrator | 2026-04-03 05:07:14.381498 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-03 05:07:14.381512 | orchestrator | Friday 03 April 2026 05:06:32 +0000 (0:00:00.933) 0:01:31.535 ********** 2026-04-03 05:07:14.381523 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.381534 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.381545 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.381557 | orchestrator | 2026-04-03 05:07:14.381568 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-03 05:07:14.381579 | orchestrator | Friday 03 April 2026 05:06:34 +0000 (0:00:01.193) 0:01:32.728 ********** 2026-04-03 05:07:14.381591 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.381602 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.381613 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.381628 | orchestrator | 2026-04-03 05:07:14.381647 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-03 05:07:14.381665 | orchestrator | Friday 03 April 2026 05:06:59 +0000 (0:00:25.735) 0:01:58.464 ********** 2026-04-03 05:07:14.381683 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.381703 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.381722 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.381741 | orchestrator | 2026-04-03 05:07:14.381760 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-03 05:07:14.381779 | orchestrator | Friday 03 April 2026 05:07:00 +0000 (0:00:00.605) 0:01:59.069 ********** 2026-04-03 05:07:14.381798 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.381816 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.381835 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.381854 | orchestrator | 2026-04-03 05:07:14.381873 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-03 05:07:14.381892 | orchestrator | Friday 03 April 2026 05:07:01 +0000 (0:00:00.626) 0:01:59.696 ********** 2026-04-03 05:07:14.381911 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.381930 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.381949 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.381969 | orchestrator | 2026-04-03 05:07:14.381987 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-03 05:07:14.382145 | orchestrator | Friday 03 April 2026 05:07:01 +0000 (0:00:00.605) 0:02:00.301 ********** 2026-04-03 05:07:14.382198 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.382219 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.382237 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.382255 | orchestrator | 2026-04-03 05:07:14.382274 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-03 05:07:14.382292 | orchestrator | Friday 03 April 2026 05:07:02 +0000 (0:00:00.750) 0:02:01.052 ********** 2026-04-03 05:07:14.382312 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.382332 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.382352 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.382371 | orchestrator | 2026-04-03 05:07:14.382391 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-03 05:07:14.382410 | orchestrator | Friday 03 April 2026 05:07:02 +0000 (0:00:00.289) 0:02:01.341 ********** 2026-04-03 05:07:14.382430 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.382450 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.382469 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.382490 | orchestrator | 2026-04-03 05:07:14.382510 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-03 05:07:14.382530 | orchestrator | Friday 03 April 2026 05:07:03 +0000 (0:00:00.613) 0:02:01.954 ********** 2026-04-03 05:07:14.382548 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.382568 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.382589 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.382610 | orchestrator | 2026-04-03 05:07:14.382630 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-03 05:07:14.382650 | orchestrator | Friday 03 April 2026 05:07:03 +0000 (0:00:00.643) 0:02:02.598 ********** 2026-04-03 05:07:14.382671 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.382690 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.382711 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.382731 | orchestrator | 2026-04-03 05:07:14.382752 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-03 05:07:14.382770 | orchestrator | Friday 03 April 2026 05:07:04 +0000 (0:00:00.836) 0:02:03.434 ********** 2026-04-03 05:07:14.382793 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:07:14.382812 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:07:14.382830 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:07:14.382849 | orchestrator | 2026-04-03 05:07:14.382867 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-03 05:07:14.382886 | orchestrator | Friday 03 April 2026 05:07:05 +0000 (0:00:01.011) 0:02:04.445 ********** 2026-04-03 05:07:14.382904 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:07:14.382921 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:07:14.382939 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:07:14.382958 | orchestrator | 2026-04-03 05:07:14.382976 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-03 05:07:14.382994 | orchestrator | Friday 03 April 2026 05:07:06 +0000 (0:00:00.284) 0:02:04.730 ********** 2026-04-03 05:07:14.383011 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:07:14.383030 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:07:14.383049 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:07:14.383067 | orchestrator | 2026-04-03 05:07:14.383088 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-03 05:07:14.383107 | orchestrator | Friday 03 April 2026 05:07:06 +0000 (0:00:00.300) 0:02:05.031 ********** 2026-04-03 05:07:14.383126 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.383144 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.383161 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.383210 | orchestrator | 2026-04-03 05:07:14.383231 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-03 05:07:14.383250 | orchestrator | Friday 03 April 2026 05:07:07 +0000 (0:00:00.591) 0:02:05.622 ********** 2026-04-03 05:07:14.383291 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:07:14.383304 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:07:14.383341 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:07:14.383353 | orchestrator | 2026-04-03 05:07:14.383365 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-03 05:07:14.383378 | orchestrator | Friday 03 April 2026 05:07:07 +0000 (0:00:00.807) 0:02:06.429 ********** 2026-04-03 05:07:14.383390 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 05:07:14.383401 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 05:07:14.383412 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 05:07:14.383423 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 05:07:14.383434 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 05:07:14.383444 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 05:07:14.383455 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 05:07:14.383467 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 05:07:14.383478 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 05:07:14.383489 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-03 05:07:14.383500 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 05:07:14.383511 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 05:07:14.383522 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-03 05:07:14.383533 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 05:07:14.383544 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 05:07:14.383555 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 05:07:14.383566 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 05:07:14.383577 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 05:07:14.383588 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 05:07:14.383598 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 05:07:14.383609 | orchestrator | 2026-04-03 05:07:14.383620 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-03 05:07:14.383631 | orchestrator | 2026-04-03 05:07:14.383642 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-03 05:07:14.383653 | orchestrator | Friday 03 April 2026 05:07:10 +0000 (0:00:02.965) 0:02:09.395 ********** 2026-04-03 05:07:14.383664 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:07:14.383675 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:07:14.383686 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:07:14.383697 | orchestrator | 2026-04-03 05:07:14.383724 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-03 05:07:14.383736 | orchestrator | Friday 03 April 2026 05:07:11 +0000 (0:00:00.327) 0:02:09.722 ********** 2026-04-03 05:07:14.383747 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:07:14.383765 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:07:14.383784 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:07:14.383813 | orchestrator | 2026-04-03 05:07:14.383831 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-03 05:07:14.383850 | orchestrator | Friday 03 April 2026 05:07:12 +0000 (0:00:01.422) 0:02:11.144 ********** 2026-04-03 05:07:14.383869 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:07:14.383889 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:07:14.383909 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:07:14.383929 | orchestrator | 2026-04-03 05:07:14.383949 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-03 05:07:14.383969 | orchestrator | Friday 03 April 2026 05:07:12 +0000 (0:00:00.350) 0:02:11.495 ********** 2026-04-03 05:07:14.383989 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:07:14.384010 | orchestrator | 2026-04-03 05:07:14.384030 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-03 05:07:14.384050 | orchestrator | Friday 03 April 2026 05:07:13 +0000 (0:00:00.473) 0:02:11.969 ********** 2026-04-03 05:07:14.384070 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:07:14.384090 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:07:14.384110 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:07:14.384130 | orchestrator | 2026-04-03 05:07:14.384150 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-03 05:07:14.384170 | orchestrator | Friday 03 April 2026 05:07:13 +0000 (0:00:00.515) 0:02:12.484 ********** 2026-04-03 05:07:14.384236 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:07:14.384256 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:07:14.384276 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:07:14.384297 | orchestrator | 2026-04-03 05:07:14.384316 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-03 05:07:14.384337 | orchestrator | Friday 03 April 2026 05:07:14 +0000 (0:00:00.323) 0:02:12.808 ********** 2026-04-03 05:07:14.384368 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:08:51.652996 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:08:51.653107 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:08:51.653123 | orchestrator | 2026-04-03 05:08:51.653136 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-03 05:08:51.653147 | orchestrator | Friday 03 April 2026 05:07:14 +0000 (0:00:00.307) 0:02:13.116 ********** 2026-04-03 05:08:51.653157 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:08:51.653167 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:08:51.653177 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:08:51.653187 | orchestrator | 2026-04-03 05:08:51.653198 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-03 05:08:51.653208 | orchestrator | Friday 03 April 2026 05:07:15 +0000 (0:00:00.616) 0:02:13.732 ********** 2026-04-03 05:08:51.653218 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:08:51.653228 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:08:51.653238 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:08:51.653247 | orchestrator | 2026-04-03 05:08:51.653258 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-03 05:08:51.653268 | orchestrator | Friday 03 April 2026 05:07:16 +0000 (0:00:01.308) 0:02:15.041 ********** 2026-04-03 05:08:51.653327 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:08:51.653340 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:08:51.653350 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:08:51.653360 | orchestrator | 2026-04-03 05:08:51.653370 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-03 05:08:51.653380 | orchestrator | Friday 03 April 2026 05:07:17 +0000 (0:00:01.227) 0:02:16.269 ********** 2026-04-03 05:08:51.653390 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:08:51.653400 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:08:51.653409 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:08:51.653419 | orchestrator | 2026-04-03 05:08:51.653429 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-03 05:08:51.653460 | orchestrator | 2026-04-03 05:08:51.653471 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-03 05:08:51.653481 | orchestrator | Friday 03 April 2026 05:07:27 +0000 (0:00:09.505) 0:02:25.774 ********** 2026-04-03 05:08:51.653490 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.653501 | orchestrator | 2026-04-03 05:08:51.653511 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-03 05:08:51.653521 | orchestrator | Friday 03 April 2026 05:07:28 +0000 (0:00:01.000) 0:02:26.775 ********** 2026-04-03 05:08:51.653532 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.653552 | orchestrator | 2026-04-03 05:08:51.653570 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-03 05:08:51.653587 | orchestrator | Friday 03 April 2026 05:07:28 +0000 (0:00:00.442) 0:02:27.218 ********** 2026-04-03 05:08:51.653604 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-03 05:08:51.653623 | orchestrator | 2026-04-03 05:08:51.653642 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-03 05:08:51.653661 | orchestrator | Friday 03 April 2026 05:07:29 +0000 (0:00:00.544) 0:02:27.763 ********** 2026-04-03 05:08:51.653677 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.653687 | orchestrator | 2026-04-03 05:08:51.653697 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-03 05:08:51.653707 | orchestrator | Friday 03 April 2026 05:07:30 +0000 (0:00:00.912) 0:02:28.675 ********** 2026-04-03 05:08:51.653717 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.653727 | orchestrator | 2026-04-03 05:08:51.653737 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-03 05:08:51.653747 | orchestrator | Friday 03 April 2026 05:07:30 +0000 (0:00:00.570) 0:02:29.246 ********** 2026-04-03 05:08:51.653757 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-03 05:08:51.653767 | orchestrator | 2026-04-03 05:08:51.653777 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-03 05:08:51.653786 | orchestrator | Friday 03 April 2026 05:07:32 +0000 (0:00:01.567) 0:02:30.813 ********** 2026-04-03 05:08:51.653796 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-03 05:08:51.653806 | orchestrator | 2026-04-03 05:08:51.653838 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-03 05:08:51.653849 | orchestrator | Friday 03 April 2026 05:07:33 +0000 (0:00:00.820) 0:02:31.633 ********** 2026-04-03 05:08:51.653859 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.653869 | orchestrator | 2026-04-03 05:08:51.653878 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-03 05:08:51.653888 | orchestrator | Friday 03 April 2026 05:07:33 +0000 (0:00:00.440) 0:02:32.074 ********** 2026-04-03 05:08:51.653898 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.653908 | orchestrator | 2026-04-03 05:08:51.653918 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-03 05:08:51.653928 | orchestrator | 2026-04-03 05:08:51.653937 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-03 05:08:51.653948 | orchestrator | Friday 03 April 2026 05:07:33 +0000 (0:00:00.488) 0:02:32.563 ********** 2026-04-03 05:08:51.653958 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.653968 | orchestrator | 2026-04-03 05:08:51.653978 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-03 05:08:51.653988 | orchestrator | Friday 03 April 2026 05:07:34 +0000 (0:00:00.368) 0:02:32.931 ********** 2026-04-03 05:08:51.653998 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 05:08:51.654008 | orchestrator | 2026-04-03 05:08:51.654079 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-03 05:08:51.654091 | orchestrator | Friday 03 April 2026 05:07:34 +0000 (0:00:00.230) 0:02:33.162 ********** 2026-04-03 05:08:51.654101 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.654111 | orchestrator | 2026-04-03 05:08:51.654130 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-03 05:08:51.654140 | orchestrator | Friday 03 April 2026 05:07:35 +0000 (0:00:00.812) 0:02:33.974 ********** 2026-04-03 05:08:51.654150 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.654160 | orchestrator | 2026-04-03 05:08:51.654188 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-03 05:08:51.654198 | orchestrator | Friday 03 April 2026 05:07:36 +0000 (0:00:01.601) 0:02:35.576 ********** 2026-04-03 05:08:51.654208 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.654218 | orchestrator | 2026-04-03 05:08:51.654228 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-03 05:08:51.654238 | orchestrator | Friday 03 April 2026 05:07:37 +0000 (0:00:00.832) 0:02:36.408 ********** 2026-04-03 05:08:51.654248 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.654257 | orchestrator | 2026-04-03 05:08:51.654267 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-03 05:08:51.654320 | orchestrator | Friday 03 April 2026 05:07:38 +0000 (0:00:00.472) 0:02:36.881 ********** 2026-04-03 05:08:51.654332 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.654342 | orchestrator | 2026-04-03 05:08:51.654352 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-03 05:08:51.654362 | orchestrator | Friday 03 April 2026 05:07:46 +0000 (0:00:07.742) 0:02:44.623 ********** 2026-04-03 05:08:51.654372 | orchestrator | changed: [testbed-manager] 2026-04-03 05:08:51.654381 | orchestrator | 2026-04-03 05:08:51.654391 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-03 05:08:51.654401 | orchestrator | Friday 03 April 2026 05:07:58 +0000 (0:00:12.553) 0:02:57.177 ********** 2026-04-03 05:08:51.654411 | orchestrator | ok: [testbed-manager] 2026-04-03 05:08:51.654420 | orchestrator | 2026-04-03 05:08:51.654430 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-03 05:08:51.654440 | orchestrator | 2026-04-03 05:08:51.654450 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-03 05:08:51.654460 | orchestrator | Friday 03 April 2026 05:07:59 +0000 (0:00:00.728) 0:02:57.906 ********** 2026-04-03 05:08:51.654470 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:08:51.654479 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:08:51.654489 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:08:51.654499 | orchestrator | 2026-04-03 05:08:51.654509 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-03 05:08:51.654518 | orchestrator | Friday 03 April 2026 05:07:59 +0000 (0:00:00.324) 0:02:58.231 ********** 2026-04-03 05:08:51.654528 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654544 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:08:51.654561 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:08:51.654576 | orchestrator | 2026-04-03 05:08:51.654592 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-03 05:08:51.654609 | orchestrator | Friday 03 April 2026 05:07:59 +0000 (0:00:00.309) 0:02:58.540 ********** 2026-04-03 05:08:51.654626 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:08:51.654644 | orchestrator | 2026-04-03 05:08:51.654660 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-03 05:08:51.654673 | orchestrator | Friday 03 April 2026 05:08:00 +0000 (0:00:00.664) 0:02:59.204 ********** 2026-04-03 05:08:51.654683 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 05:08:51.654693 | orchestrator | 2026-04-03 05:08:51.654703 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-03 05:08:51.654712 | orchestrator | Friday 03 April 2026 05:08:01 +0000 (0:00:00.815) 0:03:00.019 ********** 2026-04-03 05:08:51.654722 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:08:51.654732 | orchestrator | 2026-04-03 05:08:51.654742 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-03 05:08:51.654760 | orchestrator | Friday 03 April 2026 05:08:02 +0000 (0:00:00.835) 0:03:00.855 ********** 2026-04-03 05:08:51.654770 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654780 | orchestrator | 2026-04-03 05:08:51.654790 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-03 05:08:51.654799 | orchestrator | Friday 03 April 2026 05:08:02 +0000 (0:00:00.120) 0:03:00.976 ********** 2026-04-03 05:08:51.654809 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:08:51.654819 | orchestrator | 2026-04-03 05:08:51.654828 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-03 05:08:51.654838 | orchestrator | Friday 03 April 2026 05:08:03 +0000 (0:00:00.969) 0:03:01.945 ********** 2026-04-03 05:08:51.654848 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654857 | orchestrator | 2026-04-03 05:08:51.654867 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-03 05:08:51.654877 | orchestrator | Friday 03 April 2026 05:08:03 +0000 (0:00:00.115) 0:03:02.061 ********** 2026-04-03 05:08:51.654887 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654896 | orchestrator | 2026-04-03 05:08:51.654906 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-03 05:08:51.654916 | orchestrator | Friday 03 April 2026 05:08:03 +0000 (0:00:00.124) 0:03:02.185 ********** 2026-04-03 05:08:51.654926 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654935 | orchestrator | 2026-04-03 05:08:51.654945 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-03 05:08:51.654961 | orchestrator | Friday 03 April 2026 05:08:03 +0000 (0:00:00.112) 0:03:02.298 ********** 2026-04-03 05:08:51.654971 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:08:51.654980 | orchestrator | 2026-04-03 05:08:51.654990 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-03 05:08:51.655000 | orchestrator | Friday 03 April 2026 05:08:03 +0000 (0:00:00.125) 0:03:02.424 ********** 2026-04-03 05:08:51.655010 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 05:08:51.655020 | orchestrator | 2026-04-03 05:08:51.655029 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-03 05:08:51.655039 | orchestrator | Friday 03 April 2026 05:08:09 +0000 (0:00:05.703) 0:03:08.127 ********** 2026-04-03 05:08:51.655049 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-03 05:08:51.655058 | orchestrator | FAILED - RETRYING: [testbed-node-0 -> localhost]: Wait for Cilium resources (30 retries left). 2026-04-03 05:08:51.655078 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-03 05:09:14.276988 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-03 05:09:14.277103 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-03 05:09:14.277119 | orchestrator | 2026-04-03 05:09:14.277132 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-03 05:09:14.277144 | orchestrator | Friday 03 April 2026 05:08:51 +0000 (0:00:42.117) 0:03:50.245 ********** 2026-04-03 05:09:14.277155 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:09:14.277166 | orchestrator | 2026-04-03 05:09:14.277178 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-03 05:09:14.277189 | orchestrator | Friday 03 April 2026 05:08:52 +0000 (0:00:01.228) 0:03:51.474 ********** 2026-04-03 05:09:14.277201 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 05:09:14.277212 | orchestrator | 2026-04-03 05:09:14.277223 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-03 05:09:14.277234 | orchestrator | Friday 03 April 2026 05:08:54 +0000 (0:00:01.593) 0:03:53.067 ********** 2026-04-03 05:09:14.277245 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 05:09:14.277256 | orchestrator | 2026-04-03 05:09:14.277267 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-03 05:09:14.277279 | orchestrator | Friday 03 April 2026 05:08:55 +0000 (0:00:01.222) 0:03:54.289 ********** 2026-04-03 05:09:14.277392 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:09:14.277407 | orchestrator | 2026-04-03 05:09:14.277419 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-03 05:09:14.277430 | orchestrator | Friday 03 April 2026 05:08:55 +0000 (0:00:00.140) 0:03:54.430 ********** 2026-04-03 05:09:14.277440 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-03 05:09:14.277452 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-03 05:09:14.277463 | orchestrator | 2026-04-03 05:09:14.277474 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-03 05:09:14.277485 | orchestrator | Friday 03 April 2026 05:08:57 +0000 (0:00:01.847) 0:03:56.278 ********** 2026-04-03 05:09:14.277495 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:09:14.277506 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:09:14.277517 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:09:14.277531 | orchestrator | 2026-04-03 05:09:14.277544 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-03 05:09:14.277556 | orchestrator | Friday 03 April 2026 05:08:58 +0000 (0:00:00.337) 0:03:56.615 ********** 2026-04-03 05:09:14.277569 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:09:14.277582 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:09:14.277595 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:09:14.277608 | orchestrator | 2026-04-03 05:09:14.277620 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-03 05:09:14.277633 | orchestrator | 2026-04-03 05:09:14.277646 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-03 05:09:14.277659 | orchestrator | Friday 03 April 2026 05:08:58 +0000 (0:00:00.848) 0:03:57.463 ********** 2026-04-03 05:09:14.277671 | orchestrator | ok: [testbed-manager] 2026-04-03 05:09:14.277684 | orchestrator | 2026-04-03 05:09:14.277698 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-03 05:09:14.277711 | orchestrator | Friday 03 April 2026 05:08:59 +0000 (0:00:00.330) 0:03:57.794 ********** 2026-04-03 05:09:14.277722 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 05:09:14.277732 | orchestrator | 2026-04-03 05:09:14.277743 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-03 05:09:14.277754 | orchestrator | Friday 03 April 2026 05:08:59 +0000 (0:00:00.230) 0:03:58.024 ********** 2026-04-03 05:09:14.277765 | orchestrator | changed: [testbed-manager] 2026-04-03 05:09:14.277776 | orchestrator | 2026-04-03 05:09:14.277787 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-03 05:09:14.277798 | orchestrator | 2026-04-03 05:09:14.277809 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-03 05:09:14.277820 | orchestrator | Friday 03 April 2026 05:09:04 +0000 (0:00:05.174) 0:04:03.199 ********** 2026-04-03 05:09:14.277831 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:09:14.277842 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:09:14.277853 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:09:14.277864 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:09:14.277874 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:09:14.277885 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:09:14.277896 | orchestrator | 2026-04-03 05:09:14.277907 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-03 05:09:14.277918 | orchestrator | Friday 03 April 2026 05:09:05 +0000 (0:00:00.594) 0:04:03.793 ********** 2026-04-03 05:09:14.277929 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 05:09:14.277940 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 05:09:14.277951 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 05:09:14.277962 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 05:09:14.277980 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 05:09:14.277991 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 05:09:14.278002 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 05:09:14.278013 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 05:09:14.278093 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 05:09:14.278125 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 05:09:14.278136 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 05:09:14.278148 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 05:09:14.278159 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 05:09:14.278170 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 05:09:14.278181 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 05:09:14.278208 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 05:09:14.278220 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 05:09:14.278231 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 05:09:14.278242 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 05:09:14.278253 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 05:09:14.278264 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 05:09:14.278275 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 05:09:14.278286 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 05:09:14.278297 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 05:09:14.278336 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 05:09:14.278347 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 05:09:14.278358 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 05:09:14.278369 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 05:09:14.278380 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 05:09:14.278390 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 05:09:14.278401 | orchestrator | 2026-04-03 05:09:14.278412 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-03 05:09:14.278423 | orchestrator | Friday 03 April 2026 05:09:13 +0000 (0:00:07.880) 0:04:11.673 ********** 2026-04-03 05:09:14.278434 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:09:14.278445 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:09:14.278455 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:09:14.278466 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:09:14.278477 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:09:14.278488 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:09:14.278498 | orchestrator | 2026-04-03 05:09:14.278509 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-03 05:09:14.278520 | orchestrator | Friday 03 April 2026 05:09:13 +0000 (0:00:00.534) 0:04:12.208 ********** 2026-04-03 05:09:14.278531 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:09:14.278550 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:09:14.278561 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:09:14.278571 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:09:14.278582 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:09:14.278593 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:09:14.278604 | orchestrator | 2026-04-03 05:09:14.278615 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:09:14.278626 | orchestrator | testbed-manager : ok=21  changed=11  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:09:14.278639 | orchestrator | testbed-node-0 : ok=50  changed=23  unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-03 05:09:14.278651 | orchestrator | testbed-node-1 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 05:09:14.278662 | orchestrator | testbed-node-2 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 05:09:14.278673 | orchestrator | testbed-node-3 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 05:09:14.278684 | orchestrator | testbed-node-4 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 05:09:14.278695 | orchestrator | testbed-node-5 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 05:09:14.278706 | orchestrator | 2026-04-03 05:09:14.278717 | orchestrator | 2026-04-03 05:09:14.278728 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:09:14.278739 | orchestrator | Friday 03 April 2026 05:09:14 +0000 (0:00:00.650) 0:04:12.858 ********** 2026-04-03 05:09:14.278757 | orchestrator | =============================================================================== 2026-04-03 05:09:14.634975 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 53.63s 2026-04-03 05:09:14.635096 | orchestrator | k3s_server_post : Wait for Cilium resources ---------------------------- 42.12s 2026-04-03 05:09:14.635122 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 25.74s 2026-04-03 05:09:14.635142 | orchestrator | kubectl : Install required packages ------------------------------------ 12.55s 2026-04-03 05:09:14.635162 | orchestrator | k3s_agent : Manage k3s service ------------------------------------------ 9.51s 2026-04-03 05:09:14.635183 | orchestrator | Manage labels ----------------------------------------------------------- 7.88s 2026-04-03 05:09:14.635203 | orchestrator | kubectl : Add repository Debian ----------------------------------------- 7.74s 2026-04-03 05:09:14.635223 | orchestrator | k3s_download : Download k3s binary x64 ---------------------------------- 5.74s 2026-04-03 05:09:14.635243 | orchestrator | k3s_server_post : Install Cilium ---------------------------------------- 5.70s 2026-04-03 05:09:14.635263 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.17s 2026-04-03 05:09:14.635284 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 2.97s 2026-04-03 05:09:14.635367 | orchestrator | k3s_server : Detect Kubernetes version for label compatibility ---------- 2.51s 2026-04-03 05:09:14.635390 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 1.85s 2026-04-03 05:09:14.635410 | orchestrator | k3s_prereq : Enable IPv4 forwarding ------------------------------------- 1.75s 2026-04-03 05:09:14.635430 | orchestrator | kubectl : Install apt-transport-https package --------------------------- 1.60s 2026-04-03 05:09:14.635450 | orchestrator | k3s_server_post : Copy BGP manifests to first master -------------------- 1.59s 2026-04-03 05:09:14.635470 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 1.57s 2026-04-03 05:09:14.635526 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 1.56s 2026-04-03 05:09:14.635548 | orchestrator | k3s_agent : Check if system is PXE-booted ------------------------------- 1.42s 2026-04-03 05:09:14.635569 | orchestrator | k3s_prereq : Enable IPv6 forwarding ------------------------------------- 1.31s 2026-04-03 05:09:14.961172 | orchestrator | + osism apply copy-kubeconfig 2026-04-03 05:09:27.042279 | orchestrator | 2026-04-03 05:09:27 | INFO  | Task dab38c9f-995e-4869-820e-20dd25f73a4f (copy-kubeconfig) was prepared for execution. 2026-04-03 05:09:27.042501 | orchestrator | 2026-04-03 05:09:27 | INFO  | It takes a moment until task dab38c9f-995e-4869-820e-20dd25f73a4f (copy-kubeconfig) has been started and output is visible here. 2026-04-03 05:09:34.033188 | orchestrator | 2026-04-03 05:09:34.033288 | orchestrator | PLAY [Copy kubeconfig to the configuration repository] ************************* 2026-04-03 05:09:34.033301 | orchestrator | 2026-04-03 05:09:34.033310 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-03 05:09:34.033318 | orchestrator | Friday 03 April 2026 05:09:31 +0000 (0:00:00.168) 0:00:00.168 ********** 2026-04-03 05:09:34.033391 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-03 05:09:34.033406 | orchestrator | 2026-04-03 05:09:34.033415 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-03 05:09:34.033423 | orchestrator | Friday 03 April 2026 05:09:31 +0000 (0:00:00.707) 0:00:00.876 ********** 2026-04-03 05:09:34.033448 | orchestrator | changed: [testbed-manager] 2026-04-03 05:09:34.033458 | orchestrator | 2026-04-03 05:09:34.033466 | orchestrator | TASK [Change server address in the kubeconfig file] **************************** 2026-04-03 05:09:34.033474 | orchestrator | Friday 03 April 2026 05:09:33 +0000 (0:00:01.268) 0:00:02.145 ********** 2026-04-03 05:09:34.033484 | orchestrator | changed: [testbed-manager] 2026-04-03 05:09:34.033492 | orchestrator | 2026-04-03 05:09:34.033503 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:09:34.033511 | orchestrator | testbed-manager : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:09:34.033519 | orchestrator | 2026-04-03 05:09:34.033527 | orchestrator | 2026-04-03 05:09:34.033534 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:09:34.033542 | orchestrator | Friday 03 April 2026 05:09:33 +0000 (0:00:00.474) 0:00:02.619 ********** 2026-04-03 05:09:34.033549 | orchestrator | =============================================================================== 2026-04-03 05:09:34.033556 | orchestrator | Write kubeconfig file --------------------------------------------------- 1.27s 2026-04-03 05:09:34.033563 | orchestrator | Get kubeconfig file ----------------------------------------------------- 0.71s 2026-04-03 05:09:34.033571 | orchestrator | Change server address in the kubeconfig file ---------------------------- 0.47s 2026-04-03 05:09:34.345091 | orchestrator | + sh -c /opt/configuration/scripts/deploy/200-infrastructure.sh 2026-04-03 05:09:46.481414 | orchestrator | 2026-04-03 05:09:46 | INFO  | Task 51c1f519-40f6-40f5-995e-63198b532afb (openstackclient) was prepared for execution. 2026-04-03 05:09:46.481521 | orchestrator | 2026-04-03 05:09:46 | INFO  | It takes a moment until task 51c1f519-40f6-40f5-995e-63198b532afb (openstackclient) has been started and output is visible here. 2026-04-03 05:10:34.458527 | orchestrator | 2026-04-03 05:10:34.458631 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-03 05:10:34.458643 | orchestrator | 2026-04-03 05:10:34.458650 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-03 05:10:34.458658 | orchestrator | Friday 03 April 2026 05:09:50 +0000 (0:00:00.227) 0:00:00.227 ********** 2026-04-03 05:10:34.458666 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-03 05:10:34.458674 | orchestrator | 2026-04-03 05:10:34.458710 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-03 05:10:34.458717 | orchestrator | Friday 03 April 2026 05:09:51 +0000 (0:00:00.231) 0:00:00.459 ********** 2026-04-03 05:10:34.458723 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-03 05:10:34.458732 | orchestrator | changed: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-03 05:10:34.458738 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-03 05:10:34.458745 | orchestrator | 2026-04-03 05:10:34.458752 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-03 05:10:34.458757 | orchestrator | Friday 03 April 2026 05:09:52 +0000 (0:00:01.262) 0:00:01.722 ********** 2026-04-03 05:10:34.458764 | orchestrator | changed: [testbed-manager] 2026-04-03 05:10:34.458771 | orchestrator | 2026-04-03 05:10:34.458778 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-03 05:10:34.458785 | orchestrator | Friday 03 April 2026 05:09:53 +0000 (0:00:01.455) 0:00:03.177 ********** 2026-04-03 05:10:34.458791 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage openstackclient service (10 retries left). 2026-04-03 05:10:34.458800 | orchestrator | ok: [testbed-manager] 2026-04-03 05:10:34.458808 | orchestrator | 2026-04-03 05:10:34.458815 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-03 05:10:34.458822 | orchestrator | Friday 03 April 2026 05:10:29 +0000 (0:00:35.459) 0:00:38.637 ********** 2026-04-03 05:10:34.458828 | orchestrator | changed: [testbed-manager] 2026-04-03 05:10:34.458835 | orchestrator | 2026-04-03 05:10:34.458841 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-03 05:10:34.458849 | orchestrator | Friday 03 April 2026 05:10:30 +0000 (0:00:00.958) 0:00:39.596 ********** 2026-04-03 05:10:34.458856 | orchestrator | ok: [testbed-manager] 2026-04-03 05:10:34.458863 | orchestrator | 2026-04-03 05:10:34.458870 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-03 05:10:34.458877 | orchestrator | Friday 03 April 2026 05:10:30 +0000 (0:00:00.643) 0:00:40.240 ********** 2026-04-03 05:10:34.458885 | orchestrator | changed: [testbed-manager] 2026-04-03 05:10:34.458892 | orchestrator | 2026-04-03 05:10:34.458902 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-03 05:10:34.458910 | orchestrator | Friday 03 April 2026 05:10:32 +0000 (0:00:01.468) 0:00:41.708 ********** 2026-04-03 05:10:34.458916 | orchestrator | changed: [testbed-manager] 2026-04-03 05:10:34.458923 | orchestrator | 2026-04-03 05:10:34.458929 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-03 05:10:34.458934 | orchestrator | Friday 03 April 2026 05:10:33 +0000 (0:00:00.724) 0:00:42.432 ********** 2026-04-03 05:10:34.458938 | orchestrator | changed: [testbed-manager] 2026-04-03 05:10:34.458942 | orchestrator | 2026-04-03 05:10:34.458947 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-03 05:10:34.458951 | orchestrator | Friday 03 April 2026 05:10:33 +0000 (0:00:00.622) 0:00:43.054 ********** 2026-04-03 05:10:34.458955 | orchestrator | ok: [testbed-manager] 2026-04-03 05:10:34.458959 | orchestrator | 2026-04-03 05:10:34.458964 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:10:34.458969 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:10:34.458974 | orchestrator | 2026-04-03 05:10:34.458979 | orchestrator | 2026-04-03 05:10:34.458983 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:10:34.458987 | orchestrator | Friday 03 April 2026 05:10:34 +0000 (0:00:00.410) 0:00:43.465 ********** 2026-04-03 05:10:34.458991 | orchestrator | =============================================================================== 2026-04-03 05:10:34.458996 | orchestrator | osism.services.openstackclient : Manage openstackclient service -------- 35.46s 2026-04-03 05:10:34.459000 | orchestrator | osism.services.openstackclient : Restart openstackclient service -------- 1.47s 2026-04-03 05:10:34.459011 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 1.46s 2026-04-03 05:10:34.459016 | orchestrator | osism.services.openstackclient : Create required directories ------------ 1.26s 2026-04-03 05:10:34.459020 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 0.96s 2026-04-03 05:10:34.459024 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 0.72s 2026-04-03 05:10:34.459028 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 0.64s 2026-04-03 05:10:34.459032 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 0.62s 2026-04-03 05:10:34.459037 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 0.41s 2026-04-03 05:10:34.459041 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 0.23s 2026-04-03 05:10:36.828529 | orchestrator | 2026-04-03 05:10:36 | INFO  | Task c477097d-edf8-4c51-8585-fe0669e589f7 (common) was prepared for execution. 2026-04-03 05:10:36.828620 | orchestrator | 2026-04-03 05:10:36 | INFO  | It takes a moment until task c477097d-edf8-4c51-8585-fe0669e589f7 (common) has been started and output is visible here. 2026-04-03 05:10:48.964796 | orchestrator | 2026-04-03 05:10:48.964939 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-03 05:10:48.964960 | orchestrator | 2026-04-03 05:10:48.964972 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-03 05:10:48.964984 | orchestrator | Friday 03 April 2026 05:10:40 +0000 (0:00:00.274) 0:00:00.274 ********** 2026-04-03 05:10:48.964996 | orchestrator | included: /ansible/roles/common/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:10:48.965009 | orchestrator | 2026-04-03 05:10:48.965020 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-03 05:10:48.965031 | orchestrator | Friday 03 April 2026 05:10:42 +0000 (0:00:01.284) 0:00:01.559 ********** 2026-04-03 05:10:48.965042 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965053 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965065 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965076 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965087 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965098 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965109 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965120 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965131 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965174 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965203 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 05:10:48.965221 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965238 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965256 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965272 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965292 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965311 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 05:10:48.965356 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965376 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965395 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965487 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 05:10:48.965503 | orchestrator | 2026-04-03 05:10:48.965515 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-03 05:10:48.965526 | orchestrator | Friday 03 April 2026 05:10:44 +0000 (0:00:02.648) 0:00:04.207 ********** 2026-04-03 05:10:48.965538 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:10:48.965551 | orchestrator | 2026-04-03 05:10:48.965562 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-03 05:10:48.965584 | orchestrator | Friday 03 April 2026 05:10:46 +0000 (0:00:01.323) 0:00:05.531 ********** 2026-04-03 05:10:48.965600 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965616 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965656 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965670 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965682 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965693 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965714 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:48.965726 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:48.965738 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:48.965767 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138900 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138935 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138946 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138957 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138981 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.138993 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.139026 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.139037 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.139047 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.139064 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:50.139075 | orchestrator | 2026-04-03 05:10:50.139086 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-03 05:10:50.139097 | orchestrator | Friday 03 April 2026 05:10:49 +0000 (0:00:03.603) 0:00:09.135 ********** 2026-04-03 05:10:50.139111 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.139121 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.139131 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.139142 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:10:50.139154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.139176 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725076 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725199 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:10:50.725263 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.725280 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725292 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725304 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:10:50.725315 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.725338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725350 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725362 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:10:50.725391 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.725457 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725471 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725483 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:10:50.725494 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.725506 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725517 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:50.725529 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:10:50.725541 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:50.725560 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588021 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588108 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:10:51.588120 | orchestrator | 2026-04-03 05:10:51.588128 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-03 05:10:51.588137 | orchestrator | Friday 03 April 2026 05:10:50 +0000 (0:00:00.885) 0:00:10.020 ********** 2026-04-03 05:10:51.588146 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:51.588155 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588164 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:51.588198 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588224 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588231 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:10:51.588239 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:10:51.588267 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:51.588276 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588283 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588291 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:10:51.588298 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:51.588306 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588316 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:51.588328 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:10:51.588336 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:51.588355 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739162 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739269 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:10:56.739289 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:56.739304 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739316 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739328 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:10:56.739340 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 05:10:56.739373 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739385 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:10:56.739397 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:10:56.739408 | orchestrator | 2026-04-03 05:10:56.739484 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-03 05:10:56.739499 | orchestrator | Friday 03 April 2026 05:10:52 +0000 (0:00:01.782) 0:00:11.803 ********** 2026-04-03 05:10:56.739510 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:10:56.739521 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:10:56.739532 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:10:56.739543 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:10:56.739572 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:10:56.739584 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:10:56.739595 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:10:56.739606 | orchestrator | 2026-04-03 05:10:56.739617 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-03 05:10:56.739628 | orchestrator | Friday 03 April 2026 05:10:53 +0000 (0:00:00.711) 0:00:12.514 ********** 2026-04-03 05:10:56.739639 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:10:56.739652 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:10:56.739665 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:10:56.739678 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:10:56.739690 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:10:56.739703 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:10:56.739715 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:10:56.739728 | orchestrator | 2026-04-03 05:10:56.739741 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-03 05:10:56.739754 | orchestrator | Friday 03 April 2026 05:10:54 +0000 (0:00:00.886) 0:00:13.400 ********** 2026-04-03 05:10:56.739768 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739797 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739820 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739838 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739851 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739864 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:56.739892 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:10:59.333851 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.333954 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.333994 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334082 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334100 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334112 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334153 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334167 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334181 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334201 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334213 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334224 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334236 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334247 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:10:59.334259 | orchestrator | 2026-04-03 05:10:59.334271 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-03 05:10:59.334284 | orchestrator | Friday 03 April 2026 05:10:57 +0000 (0:00:03.334) 0:00:16.735 ********** 2026-04-03 05:10:59.334295 | orchestrator | [WARNING]: Skipped 2026-04-03 05:10:59.334306 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-03 05:10:59.334318 | orchestrator | to this access issue: 2026-04-03 05:10:59.334330 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-03 05:10:59.334341 | orchestrator | directory 2026-04-03 05:10:59.334352 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 05:10:59.334364 | orchestrator | 2026-04-03 05:10:59.334375 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-03 05:10:59.334388 | orchestrator | Friday 03 April 2026 05:10:58 +0000 (0:00:00.964) 0:00:17.700 ********** 2026-04-03 05:10:59.334400 | orchestrator | [WARNING]: Skipped 2026-04-03 05:10:59.334447 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-03 05:11:08.932188 | orchestrator | to this access issue: 2026-04-03 05:11:08.932325 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-03 05:11:08.932355 | orchestrator | directory 2026-04-03 05:11:08.932376 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 05:11:08.932395 | orchestrator | 2026-04-03 05:11:08.932415 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-03 05:11:08.932512 | orchestrator | Friday 03 April 2026 05:10:59 +0000 (0:00:01.195) 0:00:18.896 ********** 2026-04-03 05:11:08.932567 | orchestrator | [WARNING]: Skipped 2026-04-03 05:11:08.932584 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-03 05:11:08.932595 | orchestrator | to this access issue: 2026-04-03 05:11:08.932606 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-03 05:11:08.932617 | orchestrator | directory 2026-04-03 05:11:08.932628 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 05:11:08.932639 | orchestrator | 2026-04-03 05:11:08.932650 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-03 05:11:08.932661 | orchestrator | Friday 03 April 2026 05:11:00 +0000 (0:00:00.825) 0:00:19.721 ********** 2026-04-03 05:11:08.932672 | orchestrator | [WARNING]: Skipped 2026-04-03 05:11:08.932682 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-03 05:11:08.932693 | orchestrator | to this access issue: 2026-04-03 05:11:08.932704 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-03 05:11:08.932715 | orchestrator | directory 2026-04-03 05:11:08.932726 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 05:11:08.932736 | orchestrator | 2026-04-03 05:11:08.932747 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-03 05:11:08.932758 | orchestrator | Friday 03 April 2026 05:11:01 +0000 (0:00:00.859) 0:00:20.581 ********** 2026-04-03 05:11:08.932769 | orchestrator | changed: [testbed-manager] 2026-04-03 05:11:08.932780 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:11:08.932790 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:11:08.932801 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:11:08.932812 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:11:08.932822 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:11:08.932850 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:11:08.932861 | orchestrator | 2026-04-03 05:11:08.932872 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-03 05:11:08.932883 | orchestrator | Friday 03 April 2026 05:11:03 +0000 (0:00:02.457) 0:00:23.038 ********** 2026-04-03 05:11:08.932894 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932907 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932917 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932928 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932939 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932957 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932968 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 05:11:08.932979 | orchestrator | 2026-04-03 05:11:08.932990 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-03 05:11:08.933001 | orchestrator | Friday 03 April 2026 05:11:05 +0000 (0:00:02.013) 0:00:25.052 ********** 2026-04-03 05:11:08.933012 | orchestrator | changed: [testbed-manager] 2026-04-03 05:11:08.933023 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:11:08.933034 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:11:08.933044 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:11:08.933055 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:11:08.933066 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:11:08.933076 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:11:08.933087 | orchestrator | 2026-04-03 05:11:08.933098 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-03 05:11:08.933119 | orchestrator | Friday 03 April 2026 05:11:07 +0000 (0:00:01.814) 0:00:26.867 ********** 2026-04-03 05:11:08.933133 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:08.933170 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:08.933182 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:08.933194 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:08.933205 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:08.933222 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:08.933234 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:08.933262 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:08.933276 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:08.933295 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:14.606774 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:14.606913 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.606942 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.606984 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:14.607006 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:14.607051 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:14.607072 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.607114 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:11:14.607135 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.607155 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.607175 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:14.607195 | orchestrator | 2026-04-03 05:11:14.607215 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-03 05:11:14.607234 | orchestrator | Friday 03 April 2026 05:11:09 +0000 (0:00:01.507) 0:00:28.374 ********** 2026-04-03 05:11:14.607252 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607270 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607300 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607317 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607333 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607349 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607365 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 05:11:14.607381 | orchestrator | 2026-04-03 05:11:14.607398 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-03 05:11:14.607416 | orchestrator | Friday 03 April 2026 05:11:10 +0000 (0:00:01.888) 0:00:30.263 ********** 2026-04-03 05:11:14.607432 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607484 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607502 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607530 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607548 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607564 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607579 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 05:11:14.607594 | orchestrator | 2026-04-03 05:11:14.607610 | orchestrator | TASK [common : Check common containers] **************************************** 2026-04-03 05:11:14.607627 | orchestrator | Friday 03 April 2026 05:11:12 +0000 (0:00:01.650) 0:00:31.914 ********** 2026-04-03 05:11:14.607645 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:14.607678 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223214 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223318 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223356 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223383 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223397 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223410 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223423 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 05:11:15.223515 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223530 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223555 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223567 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223579 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223593 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223605 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:11:15.223627 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:12:34.668805 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:12:34.668955 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:12:34.668973 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:12:34.668999 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:12:34.669012 | orchestrator | 2026-04-03 05:12:34.669025 | orchestrator | TASK [common : Creating log volume] ******************************************** 2026-04-03 05:12:34.669038 | orchestrator | Friday 03 April 2026 05:11:15 +0000 (0:00:02.603) 0:00:34.518 ********** 2026-04-03 05:12:34.669050 | orchestrator | changed: [testbed-manager] 2026-04-03 05:12:34.669062 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:34.669073 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:34.669084 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:34.669095 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:12:34.669106 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:12:34.669117 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:12:34.669128 | orchestrator | 2026-04-03 05:12:34.669140 | orchestrator | TASK [common : Link kolla_logs volume to /var/log/kolla] *********************** 2026-04-03 05:12:34.669151 | orchestrator | Friday 03 April 2026 05:11:16 +0000 (0:00:01.302) 0:00:35.820 ********** 2026-04-03 05:12:34.669162 | orchestrator | changed: [testbed-manager] 2026-04-03 05:12:34.669173 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:34.669184 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:34.669195 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:34.669206 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:12:34.669216 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:12:34.669227 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:12:34.669238 | orchestrator | 2026-04-03 05:12:34.669249 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669260 | orchestrator | Friday 03 April 2026 05:11:17 +0000 (0:00:01.063) 0:00:36.883 ********** 2026-04-03 05:12:34.669271 | orchestrator | 2026-04-03 05:12:34.669283 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669293 | orchestrator | Friday 03 April 2026 05:11:17 +0000 (0:00:00.068) 0:00:36.952 ********** 2026-04-03 05:12:34.669305 | orchestrator | 2026-04-03 05:12:34.669315 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669327 | orchestrator | Friday 03 April 2026 05:11:17 +0000 (0:00:00.064) 0:00:37.016 ********** 2026-04-03 05:12:34.669338 | orchestrator | 2026-04-03 05:12:34.669348 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669359 | orchestrator | Friday 03 April 2026 05:11:17 +0000 (0:00:00.083) 0:00:37.100 ********** 2026-04-03 05:12:34.669371 | orchestrator | 2026-04-03 05:12:34.669382 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669403 | orchestrator | Friday 03 April 2026 05:11:18 +0000 (0:00:00.223) 0:00:37.323 ********** 2026-04-03 05:12:34.669414 | orchestrator | 2026-04-03 05:12:34.669425 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669436 | orchestrator | Friday 03 April 2026 05:11:18 +0000 (0:00:00.061) 0:00:37.384 ********** 2026-04-03 05:12:34.669447 | orchestrator | 2026-04-03 05:12:34.669458 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 05:12:34.669469 | orchestrator | Friday 03 April 2026 05:11:18 +0000 (0:00:00.067) 0:00:37.451 ********** 2026-04-03 05:12:34.669480 | orchestrator | 2026-04-03 05:12:34.669491 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-03 05:12:34.669502 | orchestrator | Friday 03 April 2026 05:11:18 +0000 (0:00:00.094) 0:00:37.546 ********** 2026-04-03 05:12:34.669513 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:34.669550 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:34.669562 | orchestrator | changed: [testbed-manager] 2026-04-03 05:12:34.669573 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:12:34.669584 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:34.669612 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:12:34.669624 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:12:34.669635 | orchestrator | 2026-04-03 05:12:34.669646 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-03 05:12:34.669658 | orchestrator | Friday 03 April 2026 05:11:56 +0000 (0:00:37.937) 0:01:15.483 ********** 2026-04-03 05:12:34.669669 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:34.669680 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:34.669691 | orchestrator | changed: [testbed-manager] 2026-04-03 05:12:34.669702 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:12:34.669713 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:12:34.669724 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:12:34.669735 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:34.669746 | orchestrator | 2026-04-03 05:12:34.669757 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-03 05:12:34.669768 | orchestrator | Friday 03 April 2026 05:12:24 +0000 (0:00:28.104) 0:01:43.587 ********** 2026-04-03 05:12:34.669779 | orchestrator | ok: [testbed-manager] 2026-04-03 05:12:34.669805 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:12:34.669817 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:12:34.669828 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:12:34.669839 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:12:34.669850 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:12:34.669860 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:12:34.669871 | orchestrator | 2026-04-03 05:12:34.669883 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-03 05:12:34.669894 | orchestrator | Friday 03 April 2026 05:12:26 +0000 (0:00:01.818) 0:01:45.405 ********** 2026-04-03 05:12:34.669905 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:34.669916 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:34.669927 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:34.669938 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:12:34.669949 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:12:34.669960 | orchestrator | changed: [testbed-manager] 2026-04-03 05:12:34.669971 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:12:34.669982 | orchestrator | 2026-04-03 05:12:34.669993 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:12:34.670005 | orchestrator | testbed-manager : ok=22  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670088 | orchestrator | testbed-node-0 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670111 | orchestrator | testbed-node-1 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670132 | orchestrator | testbed-node-2 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670143 | orchestrator | testbed-node-3 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670154 | orchestrator | testbed-node-4 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670165 | orchestrator | testbed-node-5 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 05:12:34.670176 | orchestrator | 2026-04-03 05:12:34.670188 | orchestrator | 2026-04-03 05:12:34.670199 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:12:34.670210 | orchestrator | Friday 03 April 2026 05:12:34 +0000 (0:00:08.522) 0:01:53.927 ********** 2026-04-03 05:12:34.670222 | orchestrator | =============================================================================== 2026-04-03 05:12:34.670233 | orchestrator | common : Restart fluentd container ------------------------------------- 37.94s 2026-04-03 05:12:34.670244 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 28.10s 2026-04-03 05:12:34.670255 | orchestrator | common : Restart cron container ----------------------------------------- 8.52s 2026-04-03 05:12:34.670266 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 3.60s 2026-04-03 05:12:34.670277 | orchestrator | common : Copying over config.json files for services -------------------- 3.33s 2026-04-03 05:12:34.670288 | orchestrator | common : Ensuring config directories exist ------------------------------ 2.65s 2026-04-03 05:12:34.670299 | orchestrator | common : Check common containers ---------------------------------------- 2.60s 2026-04-03 05:12:34.670310 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 2.46s 2026-04-03 05:12:34.670321 | orchestrator | common : Copying over cron logrotate config file ------------------------ 2.01s 2026-04-03 05:12:34.670332 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 1.89s 2026-04-03 05:12:34.670343 | orchestrator | common : Initializing toolbox container using normal user --------------- 1.82s 2026-04-03 05:12:34.670354 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 1.81s 2026-04-03 05:12:34.670365 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 1.78s 2026-04-03 05:12:34.670376 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 1.65s 2026-04-03 05:12:34.670387 | orchestrator | common : Ensuring config directories have correct owner and permission --- 1.51s 2026-04-03 05:12:34.670398 | orchestrator | common : include_tasks -------------------------------------------------- 1.32s 2026-04-03 05:12:34.670417 | orchestrator | common : Creating log volume -------------------------------------------- 1.30s 2026-04-03 05:12:35.068711 | orchestrator | common : include_tasks -------------------------------------------------- 1.28s 2026-04-03 05:12:35.068813 | orchestrator | common : Find custom fluentd filter config files ------------------------ 1.20s 2026-04-03 05:12:35.068829 | orchestrator | common : Link kolla_logs volume to /var/log/kolla ----------------------- 1.06s 2026-04-03 05:12:37.374945 | orchestrator | 2026-04-03 05:12:37 | INFO  | Task f3d56842-c145-457f-869a-0edc63f95b12 (loadbalancer) was prepared for execution. 2026-04-03 05:12:37.375042 | orchestrator | 2026-04-03 05:12:37 | INFO  | It takes a moment until task f3d56842-c145-457f-869a-0edc63f95b12 (loadbalancer) has been started and output is visible here. 2026-04-03 05:12:51.040236 | orchestrator | 2026-04-03 05:12:51.040349 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:12:51.040366 | orchestrator | 2026-04-03 05:12:51.040379 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:12:51.040391 | orchestrator | Friday 03 April 2026 05:12:41 +0000 (0:00:00.245) 0:00:00.245 ********** 2026-04-03 05:12:51.040423 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:12:51.040436 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:12:51.040447 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:12:51.040458 | orchestrator | 2026-04-03 05:12:51.040479 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:12:51.040491 | orchestrator | Friday 03 April 2026 05:12:41 +0000 (0:00:00.305) 0:00:00.551 ********** 2026-04-03 05:12:51.040503 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-03 05:12:51.040514 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-03 05:12:51.040525 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-03 05:12:51.040536 | orchestrator | 2026-04-03 05:12:51.040595 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-03 05:12:51.040607 | orchestrator | 2026-04-03 05:12:51.040618 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-03 05:12:51.040643 | orchestrator | Friday 03 April 2026 05:12:42 +0000 (0:00:00.441) 0:00:00.993 ********** 2026-04-03 05:12:51.040655 | orchestrator | included: /ansible/roles/loadbalancer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:12:51.040666 | orchestrator | 2026-04-03 05:12:51.040677 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-03 05:12:51.040688 | orchestrator | Friday 03 April 2026 05:12:42 +0000 (0:00:00.548) 0:00:01.541 ********** 2026-04-03 05:12:51.040699 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:12:51.040710 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:12:51.040721 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:12:51.040732 | orchestrator | 2026-04-03 05:12:51.040743 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-03 05:12:51.040754 | orchestrator | Friday 03 April 2026 05:12:43 +0000 (0:00:00.602) 0:00:02.144 ********** 2026-04-03 05:12:51.040765 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:12:51.040778 | orchestrator | 2026-04-03 05:12:51.040791 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-03 05:12:51.040804 | orchestrator | Friday 03 April 2026 05:12:44 +0000 (0:00:00.669) 0:00:02.813 ********** 2026-04-03 05:12:51.040817 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:12:51.040829 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:12:51.040841 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:12:51.040854 | orchestrator | 2026-04-03 05:12:51.040867 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-03 05:12:51.040879 | orchestrator | Friday 03 April 2026 05:12:44 +0000 (0:00:00.576) 0:00:03.390 ********** 2026-04-03 05:12:51.040892 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040905 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040918 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040931 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040944 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040956 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 05:12:51.040969 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 05:12:51.040983 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 05:12:51.040995 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 05:12:51.041008 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 05:12:51.041029 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 05:12:51.041042 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 05:12:51.041054 | orchestrator | 2026-04-03 05:12:51.041066 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 05:12:51.041080 | orchestrator | Friday 03 April 2026 05:12:46 +0000 (0:00:02.023) 0:00:05.413 ********** 2026-04-03 05:12:51.041092 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-03 05:12:51.041106 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-03 05:12:51.041119 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-03 05:12:51.041132 | orchestrator | 2026-04-03 05:12:51.041146 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 05:12:51.041159 | orchestrator | Friday 03 April 2026 05:12:47 +0000 (0:00:00.679) 0:00:06.093 ********** 2026-04-03 05:12:51.041170 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-03 05:12:51.041181 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-03 05:12:51.041192 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-03 05:12:51.041203 | orchestrator | 2026-04-03 05:12:51.041214 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 05:12:51.041225 | orchestrator | Friday 03 April 2026 05:12:48 +0000 (0:00:01.239) 0:00:07.332 ********** 2026-04-03 05:12:51.041236 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-03 05:12:51.041247 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:12:51.041276 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-03 05:12:51.041287 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:12:51.041299 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-03 05:12:51.041309 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:12:51.041320 | orchestrator | 2026-04-03 05:12:51.041331 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-03 05:12:51.041342 | orchestrator | Friday 03 April 2026 05:12:49 +0000 (0:00:00.527) 0:00:07.860 ********** 2026-04-03 05:12:51.041362 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:51.041382 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:51.041394 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:51.041414 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:12:51.041427 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:12:51.041446 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:12:56.226447 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:12:56.226715 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:12:56.226762 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:12:56.226777 | orchestrator | 2026-04-03 05:12:56.226792 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-03 05:12:56.226805 | orchestrator | Friday 03 April 2026 05:12:51 +0000 (0:00:01.848) 0:00:09.708 ********** 2026-04-03 05:12:56.226816 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:56.226849 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:56.226860 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:56.226872 | orchestrator | 2026-04-03 05:12:56.226884 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-03 05:12:56.226895 | orchestrator | Friday 03 April 2026 05:12:51 +0000 (0:00:00.901) 0:00:10.610 ********** 2026-04-03 05:12:56.226906 | orchestrator | changed: [testbed-node-0] => (item=users) 2026-04-03 05:12:56.226917 | orchestrator | changed: [testbed-node-1] => (item=users) 2026-04-03 05:12:56.226928 | orchestrator | changed: [testbed-node-2] => (item=users) 2026-04-03 05:12:56.226939 | orchestrator | changed: [testbed-node-0] => (item=rules) 2026-04-03 05:12:56.226950 | orchestrator | changed: [testbed-node-1] => (item=rules) 2026-04-03 05:12:56.226963 | orchestrator | changed: [testbed-node-2] => (item=rules) 2026-04-03 05:12:56.226975 | orchestrator | 2026-04-03 05:12:56.226988 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-03 05:12:56.227000 | orchestrator | Friday 03 April 2026 05:12:53 +0000 (0:00:01.431) 0:00:12.042 ********** 2026-04-03 05:12:56.227012 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:12:56.227025 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:12:56.227037 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:12:56.227049 | orchestrator | 2026-04-03 05:12:56.227062 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-03 05:12:56.227075 | orchestrator | Friday 03 April 2026 05:12:54 +0000 (0:00:00.912) 0:00:12.954 ********** 2026-04-03 05:12:56.227087 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:12:56.227100 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:12:56.227112 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:12:56.227124 | orchestrator | 2026-04-03 05:12:56.227136 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-03 05:12:56.227148 | orchestrator | Friday 03 April 2026 05:12:55 +0000 (0:00:01.369) 0:00:14.323 ********** 2026-04-03 05:12:56.227162 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:12:56.227199 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:12:56.227214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:12:56.227230 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:12:56.227251 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:12:56.227265 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:12:56.227315 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:12:56.227329 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:12:56.227343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:12:56.227355 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:12:56.227374 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:12:58.944753 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:12:58.944895 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:12:58.944913 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:12:58.944926 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:12:58.944940 | orchestrator | 2026-04-03 05:12:58.944952 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-03 05:12:58.944964 | orchestrator | Friday 03 April 2026 05:12:56 +0000 (0:00:00.576) 0:00:14.900 ********** 2026-04-03 05:12:58.944976 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:58.944988 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:58.945000 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 05:12:58.945056 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:12:58.945070 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:12:58.945082 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:12:58.945093 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:12:58.945105 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:12:58.945116 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:12:58.945158 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089116 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:07.089227 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503', '__omit_place_holder__4917b07036f1be89b56d9ceae1a0ab81e9559503'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 05:13:07.089247 | orchestrator | 2026-04-03 05:13:07.089262 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-03 05:13:07.089274 | orchestrator | Friday 03 April 2026 05:12:58 +0000 (0:00:02.717) 0:00:17.617 ********** 2026-04-03 05:13:07.089286 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089299 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089311 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089360 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089392 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089405 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:07.089417 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:07.089429 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:07.089440 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:07.089452 | orchestrator | 2026-04-03 05:13:07.089463 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-03 05:13:07.089474 | orchestrator | Friday 03 April 2026 05:13:02 +0000 (0:00:03.117) 0:00:20.735 ********** 2026-04-03 05:13:07.089495 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 05:13:07.089507 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 05:13:07.089518 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 05:13:07.089529 | orchestrator | 2026-04-03 05:13:07.089540 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-03 05:13:07.089552 | orchestrator | Friday 03 April 2026 05:13:03 +0000 (0:00:01.830) 0:00:22.565 ********** 2026-04-03 05:13:07.089593 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 05:13:07.089604 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 05:13:07.089615 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 05:13:07.089626 | orchestrator | 2026-04-03 05:13:07.089638 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-03 05:13:07.089652 | orchestrator | Friday 03 April 2026 05:13:06 +0000 (0:00:02.651) 0:00:25.217 ********** 2026-04-03 05:13:07.089665 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:07.089681 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:07.089694 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:07.089708 | orchestrator | 2026-04-03 05:13:07.089729 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-03 05:13:18.217507 | orchestrator | Friday 03 April 2026 05:13:07 +0000 (0:00:00.549) 0:00:25.766 ********** 2026-04-03 05:13:18.217722 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 05:13:18.217764 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 05:13:18.217784 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 05:13:18.217802 | orchestrator | 2026-04-03 05:13:18.217821 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-03 05:13:18.217838 | orchestrator | Friday 03 April 2026 05:13:09 +0000 (0:00:02.006) 0:00:27.772 ********** 2026-04-03 05:13:18.217855 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 05:13:18.217873 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 05:13:18.217891 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 05:13:18.217909 | orchestrator | 2026-04-03 05:13:18.217927 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-03 05:13:18.217945 | orchestrator | Friday 03 April 2026 05:13:11 +0000 (0:00:02.022) 0:00:29.794 ********** 2026-04-03 05:13:18.217964 | orchestrator | changed: [testbed-node-0] => (item=haproxy.pem) 2026-04-03 05:13:18.217982 | orchestrator | changed: [testbed-node-1] => (item=haproxy.pem) 2026-04-03 05:13:18.217999 | orchestrator | changed: [testbed-node-2] => (item=haproxy.pem) 2026-04-03 05:13:18.218124 | orchestrator | 2026-04-03 05:13:18.218168 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-03 05:13:18.218188 | orchestrator | Friday 03 April 2026 05:13:12 +0000 (0:00:01.390) 0:00:31.184 ********** 2026-04-03 05:13:18.218209 | orchestrator | changed: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-03 05:13:18.218227 | orchestrator | changed: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-03 05:13:18.218244 | orchestrator | changed: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-03 05:13:18.218261 | orchestrator | 2026-04-03 05:13:18.218311 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-03 05:13:18.218328 | orchestrator | Friday 03 April 2026 05:13:13 +0000 (0:00:01.383) 0:00:32.568 ********** 2026-04-03 05:13:18.218347 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:13:18.218363 | orchestrator | 2026-04-03 05:13:18.218381 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over extra CA certificates] *** 2026-04-03 05:13:18.218398 | orchestrator | Friday 03 April 2026 05:13:14 +0000 (0:00:00.509) 0:00:33.078 ********** 2026-04-03 05:13:18.218421 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218444 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218471 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218521 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218541 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218557 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:18.218618 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:18.218639 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:18.218657 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:18.218675 | orchestrator | 2026-04-03 05:13:18.218707 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS certificate] *** 2026-04-03 05:13:18.218718 | orchestrator | Friday 03 April 2026 05:13:17 +0000 (0:00:03.234) 0:00:36.312 ********** 2026-04-03 05:13:18.218746 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:18.988527 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:18.988663 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:18.988695 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:18.988706 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:18.988714 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:18.988722 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:18.988730 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:18.988750 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:18.988774 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:18.988783 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:18.988796 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:18.988804 | orchestrator | 2026-04-03 05:13:18.988812 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS key] *** 2026-04-03 05:13:18.988821 | orchestrator | Friday 03 April 2026 05:13:18 +0000 (0:00:00.579) 0:00:36.892 ********** 2026-04-03 05:13:18.988830 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:18.988838 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:18.988846 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:18.988853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:18.988861 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:18.988877 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:19.794285 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:19.794406 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:19.794424 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:19.794436 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:19.794448 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:19.794458 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:19.794469 | orchestrator | 2026-04-03 05:13:19.794480 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-03 05:13:19.794494 | orchestrator | Friday 03 April 2026 05:13:18 +0000 (0:00:00.769) 0:00:37.661 ********** 2026-04-03 05:13:19.794512 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:19.794530 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:19.794617 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:19.794653 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:19.794667 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:19.794678 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:19.794689 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:19.794699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:19.794709 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:19.794733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:19.794749 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:19.794773 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:21.131182 | orchestrator | 2026-04-03 05:13:21.131288 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-03 05:13:21.131306 | orchestrator | Friday 03 April 2026 05:13:19 +0000 (0:00:00.799) 0:00:38.461 ********** 2026-04-03 05:13:21.131323 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:21.131363 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:21.131377 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:21.131390 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:21.131403 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:21.131415 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:21.131451 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:21.131483 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:21.131516 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:21.131529 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:21.131541 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:21.131552 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:21.131563 | orchestrator | 2026-04-03 05:13:21.131735 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-03 05:13:21.131750 | orchestrator | Friday 03 April 2026 05:13:20 +0000 (0:00:00.572) 0:00:39.033 ********** 2026-04-03 05:13:21.131764 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:21.131778 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:21.131815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:21.131829 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:21.131853 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:22.099076 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:22.099181 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:22.099199 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:22.099214 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:22.099226 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:22.099238 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:22.099274 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:22.099286 | orchestrator | 2026-04-03 05:13:22.099298 | orchestrator | TASK [service-cert-copy : proxysql | Copying over extra CA certificates] ******* 2026-04-03 05:13:22.099311 | orchestrator | Friday 03 April 2026 05:13:21 +0000 (0:00:00.773) 0:00:39.806 ********** 2026-04-03 05:13:22.099337 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:22.099373 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:22.099386 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:22.099399 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:22.099412 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:22.099424 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:22.099444 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:22.099457 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:22.099475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:22.099497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:23.483211 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:23.483336 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:23.483355 | orchestrator | 2026-04-03 05:13:23.483408 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS certificate] *** 2026-04-03 05:13:23.483423 | orchestrator | Friday 03 April 2026 05:13:22 +0000 (0:00:00.963) 0:00:40.770 ********** 2026-04-03 05:13:23.483436 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:23.483450 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:23.483485 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:23.483497 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:23.483509 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:23.483536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:23.483568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:23.483634 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:23.483646 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:23.483658 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:23.483678 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:23.483690 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:23.483701 | orchestrator | 2026-04-03 05:13:23.483712 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS key] **** 2026-04-03 05:13:23.483724 | orchestrator | Friday 03 April 2026 05:13:22 +0000 (0:00:00.578) 0:00:41.349 ********** 2026-04-03 05:13:23.483735 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 05:13:23.483747 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:23.483774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:29.825794 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:29.825948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 05:13:29.825985 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:29.826167 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:29.826198 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:29.826221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 05:13:29.826262 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 05:13:29.826283 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 05:13:29.826304 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:29.826327 | orchestrator | 2026-04-03 05:13:29.826348 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-03 05:13:29.826367 | orchestrator | Friday 03 April 2026 05:13:23 +0000 (0:00:00.807) 0:00:42.156 ********** 2026-04-03 05:13:29.826380 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 05:13:29.826415 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 05:13:29.826429 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 05:13:29.826441 | orchestrator | 2026-04-03 05:13:29.826453 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-03 05:13:29.826467 | orchestrator | Friday 03 April 2026 05:13:25 +0000 (0:00:01.693) 0:00:43.850 ********** 2026-04-03 05:13:29.826481 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 05:13:29.826493 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 05:13:29.826506 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 05:13:29.826519 | orchestrator | 2026-04-03 05:13:29.826543 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-03 05:13:29.826554 | orchestrator | Friday 03 April 2026 05:13:26 +0000 (0:00:01.633) 0:00:45.484 ********** 2026-04-03 05:13:29.826565 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 05:13:29.826576 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 05:13:29.826610 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 05:13:29.826621 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 05:13:29.826632 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:29.826643 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 05:13:29.826653 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:29.826664 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 05:13:29.826675 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:29.826686 | orchestrator | 2026-04-03 05:13:29.826696 | orchestrator | TASK [loadbalancer : Check loadbalancer containers] **************************** 2026-04-03 05:13:29.826707 | orchestrator | Friday 03 April 2026 05:13:27 +0000 (0:00:00.764) 0:00:46.248 ********** 2026-04-03 05:13:29.826719 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:29.826731 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:29.826749 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 05:13:29.826772 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:33.881174 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:33.881249 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 05:13:33.881257 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:33.881262 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:33.881290 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 05:13:33.881295 | orchestrator | 2026-04-03 05:13:33.881300 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-03 05:13:33.881312 | orchestrator | Friday 03 April 2026 05:13:29 +0000 (0:00:02.253) 0:00:48.502 ********** 2026-04-03 05:13:33.881317 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:13:33.881321 | orchestrator | 2026-04-03 05:13:33.881325 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-03 05:13:33.881329 | orchestrator | Friday 03 April 2026 05:13:30 +0000 (0:00:00.811) 0:00:49.314 ********** 2026-04-03 05:13:33.881347 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 05:13:33.881364 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:33.881375 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:33.881379 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:33.881383 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 05:13:33.881391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:33.881395 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:33.881408 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551103 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 05:13:34.551205 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:34.551223 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551264 | orchestrator | 2026-04-03 05:13:34.551277 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-03 05:13:34.551290 | orchestrator | Friday 03 April 2026 05:13:33 +0000 (0:00:03.241) 0:00:52.556 ********** 2026-04-03 05:13:34.551304 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 05:13:34.551359 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:34.551373 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551385 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551397 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:34.551410 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 05:13:34.551428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:34.551447 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551459 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:34.551470 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:34.551492 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 05:13:42.719894 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 05:13:42.720039 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:42.720068 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 05:13:42.720106 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:42.720122 | orchestrator | 2026-04-03 05:13:42.720134 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-03 05:13:42.720147 | orchestrator | Friday 03 April 2026 05:13:34 +0000 (0:00:00.667) 0:00:53.223 ********** 2026-04-03 05:13:42.720159 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720174 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720187 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:42.720217 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720240 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:42.720251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720262 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-03 05:13:42.720293 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:42.720304 | orchestrator | 2026-04-03 05:13:42.720316 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-03 05:13:42.720327 | orchestrator | Friday 03 April 2026 05:13:35 +0000 (0:00:01.064) 0:00:54.288 ********** 2026-04-03 05:13:42.720338 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:13:42.720349 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:13:42.720360 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:13:42.720371 | orchestrator | 2026-04-03 05:13:42.720383 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-03 05:13:42.720397 | orchestrator | Friday 03 April 2026 05:13:36 +0000 (0:00:01.221) 0:00:55.510 ********** 2026-04-03 05:13:42.720410 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:13:42.720429 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:13:42.720455 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:13:42.720479 | orchestrator | 2026-04-03 05:13:42.720500 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-03 05:13:42.720519 | orchestrator | Friday 03 April 2026 05:13:38 +0000 (0:00:01.991) 0:00:57.501 ********** 2026-04-03 05:13:42.720539 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:13:42.720556 | orchestrator | 2026-04-03 05:13:42.720628 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-03 05:13:42.720652 | orchestrator | Friday 03 April 2026 05:13:39 +0000 (0:00:00.642) 0:00:58.144 ********** 2026-04-03 05:13:42.720676 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 05:13:42.720730 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:42.720753 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:42.720766 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 05:13:42.720778 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:42.720801 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.318712 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 05:13:43.318837 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.318856 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.318870 | orchestrator | 2026-04-03 05:13:43.318883 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-03 05:13:43.318895 | orchestrator | Friday 03 April 2026 05:13:42 +0000 (0:00:03.251) 0:01:01.396 ********** 2026-04-03 05:13:43.318908 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 05:13:43.318921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.318975 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.318989 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:43.319008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 05:13:43.319020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.319032 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:43.319043 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:43.319054 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 05:13:43.319082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 05:13:52.576520 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:13:52.576660 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:52.576674 | orchestrator | 2026-04-03 05:13:52.576682 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-03 05:13:52.576690 | orchestrator | Friday 03 April 2026 05:13:43 +0000 (0:00:00.596) 0:01:01.992 ********** 2026-04-03 05:13:52.576710 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576719 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576726 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:52.576732 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576738 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576744 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:52.576750 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576756 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-03 05:13:52.576762 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:52.576767 | orchestrator | 2026-04-03 05:13:52.576773 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-03 05:13:52.576779 | orchestrator | Friday 03 April 2026 05:13:44 +0000 (0:00:00.821) 0:01:02.813 ********** 2026-04-03 05:13:52.576785 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:13:52.576791 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:13:52.576797 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:13:52.576803 | orchestrator | 2026-04-03 05:13:52.576809 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-03 05:13:52.576815 | orchestrator | Friday 03 April 2026 05:13:45 +0000 (0:00:01.461) 0:01:04.274 ********** 2026-04-03 05:13:52.576834 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:13:52.576840 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:13:52.576846 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:13:52.576852 | orchestrator | 2026-04-03 05:13:52.576858 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-03 05:13:52.576863 | orchestrator | Friday 03 April 2026 05:13:47 +0000 (0:00:01.928) 0:01:06.202 ********** 2026-04-03 05:13:52.576869 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:52.576875 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:52.576881 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:13:52.576886 | orchestrator | 2026-04-03 05:13:52.576892 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-03 05:13:52.576898 | orchestrator | Friday 03 April 2026 05:13:47 +0000 (0:00:00.310) 0:01:06.513 ********** 2026-04-03 05:13:52.576904 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:13:52.576909 | orchestrator | 2026-04-03 05:13:52.576915 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-03 05:13:52.576921 | orchestrator | Friday 03 April 2026 05:13:48 +0000 (0:00:00.708) 0:01:07.222 ********** 2026-04-03 05:13:52.576942 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 05:13:52.576953 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 05:13:52.576960 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 05:13:52.576966 | orchestrator | 2026-04-03 05:13:52.576972 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-03 05:13:52.576979 | orchestrator | Friday 03 April 2026 05:13:51 +0000 (0:00:02.676) 0:01:09.899 ********** 2026-04-03 05:13:52.576990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 05:13:52.576997 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:13:52.577003 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 05:13:52.577009 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:13:52.577020 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 05:14:00.263737 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:00.263852 | orchestrator | 2026-04-03 05:14:00.263871 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-03 05:14:00.263885 | orchestrator | Friday 03 April 2026 05:13:52 +0000 (0:00:01.352) 0:01:11.252 ********** 2026-04-03 05:14:00.263942 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.263960 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.263973 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:00.263985 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.264016 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.264029 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:00.264040 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.264052 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-03 05:14:00.264063 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:00.264074 | orchestrator | 2026-04-03 05:14:00.264086 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-03 05:14:00.264097 | orchestrator | Friday 03 April 2026 05:13:54 +0000 (0:00:01.743) 0:01:12.995 ********** 2026-04-03 05:14:00.264108 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:00.264119 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:00.264130 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:00.264140 | orchestrator | 2026-04-03 05:14:00.264156 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-03 05:14:00.264167 | orchestrator | Friday 03 April 2026 05:13:54 +0000 (0:00:00.441) 0:01:13.436 ********** 2026-04-03 05:14:00.264178 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:00.264189 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:00.264200 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:00.264214 | orchestrator | 2026-04-03 05:14:00.264227 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-03 05:14:00.264239 | orchestrator | Friday 03 April 2026 05:13:56 +0000 (0:00:01.279) 0:01:14.715 ********** 2026-04-03 05:14:00.264253 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:00.264266 | orchestrator | 2026-04-03 05:14:00.264279 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-03 05:14:00.264292 | orchestrator | Friday 03 April 2026 05:13:56 +0000 (0:00:00.951) 0:01:15.667 ********** 2026-04-03 05:14:00.264331 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 05:14:00.264358 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.264373 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.264388 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.264402 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 05:14:00.264424 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940732 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940861 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940880 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 05:14:00.940894 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940906 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940946 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.940967 | orchestrator | 2026-04-03 05:14:00.940981 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-03 05:14:00.940993 | orchestrator | Friday 03 April 2026 05:14:00 +0000 (0:00:03.350) 0:01:19.017 ********** 2026-04-03 05:14:00.941007 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 05:14:00.941019 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.941031 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.941042 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:00.941054 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:00.941080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 05:14:06.950228 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950358 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950382 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950398 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:06.950416 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 05:14:06.950431 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950513 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950533 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 05:14:06.950547 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:06.950561 | orchestrator | 2026-04-03 05:14:06.950638 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-03 05:14:06.950656 | orchestrator | Friday 03 April 2026 05:14:01 +0000 (0:00:00.699) 0:01:19.716 ********** 2026-04-03 05:14:06.950672 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950686 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950702 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:06.950716 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950730 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950744 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:06.950756 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950770 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-03 05:14:06.950783 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:06.950796 | orchestrator | 2026-04-03 05:14:06.950810 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-03 05:14:06.950823 | orchestrator | Friday 03 April 2026 05:14:02 +0000 (0:00:01.101) 0:01:20.818 ********** 2026-04-03 05:14:06.950837 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:06.950863 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:06.950877 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:06.950890 | orchestrator | 2026-04-03 05:14:06.950905 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-03 05:14:06.950918 | orchestrator | Friday 03 April 2026 05:14:03 +0000 (0:00:01.278) 0:01:22.096 ********** 2026-04-03 05:14:06.950931 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:06.950945 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:06.950959 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:06.950973 | orchestrator | 2026-04-03 05:14:06.950986 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-03 05:14:06.951000 | orchestrator | Friday 03 April 2026 05:14:05 +0000 (0:00:01.968) 0:01:24.064 ********** 2026-04-03 05:14:06.951012 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:06.951025 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:06.951038 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:06.951051 | orchestrator | 2026-04-03 05:14:06.951065 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-03 05:14:06.951079 | orchestrator | Friday 03 April 2026 05:14:05 +0000 (0:00:00.297) 0:01:24.362 ********** 2026-04-03 05:14:06.951092 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:06.951105 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:06.951118 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:06.951131 | orchestrator | 2026-04-03 05:14:06.951144 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-03 05:14:06.951158 | orchestrator | Friday 03 April 2026 05:14:05 +0000 (0:00:00.292) 0:01:24.654 ********** 2026-04-03 05:14:06.951170 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:06.951184 | orchestrator | 2026-04-03 05:14:06.951197 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-03 05:14:06.951220 | orchestrator | Friday 03 April 2026 05:14:06 +0000 (0:00:00.969) 0:01:25.623 ********** 2026-04-03 05:14:10.070235 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 05:14:10.070330 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:10.070347 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 05:14:10.070393 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:10.070465 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070478 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070489 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070508 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070520 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070531 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.070556 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910252 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910334 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 05:14:10.910363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:10.910371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910396 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910417 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910425 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910436 | orchestrator | 2026-04-03 05:14:10.910445 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-03 05:14:10.910452 | orchestrator | Friday 03 April 2026 05:14:10 +0000 (0:00:03.375) 0:01:28.999 ********** 2026-04-03 05:14:10.910459 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 05:14:10.910466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:10.910473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910479 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:10.910491 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.345682 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.345809 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.345827 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:11.345843 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 05:14:11.345856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:11.346469 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346496 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346558 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346575 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346587 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:11.346600 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 05:14:11.346612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 05:14:11.346699 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 05:14:11.346730 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 05:14:20.861511 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 05:14:20.861738 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:14:20.861767 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 05:14:20.861787 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:20.861808 | orchestrator | 2026-04-03 05:14:20.861829 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-03 05:14:20.861848 | orchestrator | Friday 03 April 2026 05:14:11 +0000 (0:00:01.019) 0:01:30.018 ********** 2026-04-03 05:14:20.861867 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.861887 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.861906 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:20.861923 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.861941 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.861960 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:20.861984 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.862158 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-03 05:14:20.862186 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:20.862213 | orchestrator | 2026-04-03 05:14:20.862244 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-03 05:14:20.862266 | orchestrator | Friday 03 April 2026 05:14:12 +0000 (0:00:01.215) 0:01:31.233 ********** 2026-04-03 05:14:20.862285 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:20.862304 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:20.862321 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:20.862339 | orchestrator | 2026-04-03 05:14:20.862357 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-03 05:14:20.862375 | orchestrator | Friday 03 April 2026 05:14:13 +0000 (0:00:01.228) 0:01:32.461 ********** 2026-04-03 05:14:20.862393 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:20.862410 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:20.862428 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:20.862447 | orchestrator | 2026-04-03 05:14:20.862466 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-03 05:14:20.862484 | orchestrator | Friday 03 April 2026 05:14:15 +0000 (0:00:01.987) 0:01:34.448 ********** 2026-04-03 05:14:20.862529 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:20.862550 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:20.862569 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:20.862587 | orchestrator | 2026-04-03 05:14:20.862604 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-03 05:14:20.862622 | orchestrator | Friday 03 April 2026 05:14:16 +0000 (0:00:00.314) 0:01:34.763 ********** 2026-04-03 05:14:20.862671 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:20.862691 | orchestrator | 2026-04-03 05:14:20.862709 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-03 05:14:20.862727 | orchestrator | Friday 03 April 2026 05:14:17 +0000 (0:00:01.017) 0:01:35.781 ********** 2026-04-03 05:14:20.862760 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 05:14:20.862785 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:20.862843 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 05:14:23.793244 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:23.793382 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 05:14:23.793418 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:23.793436 | orchestrator | 2026-04-03 05:14:23.793446 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-03 05:14:23.793456 | orchestrator | Friday 03 April 2026 05:14:20 +0000 (0:00:03.870) 0:01:39.652 ********** 2026-04-03 05:14:23.793473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 05:14:23.793491 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:27.352616 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:27.352773 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 05:14:27.352817 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:27.352853 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:27.352891 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 05:14:27.352912 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 05:14:27.352942 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:27.352954 | orchestrator | 2026-04-03 05:14:27.352968 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-03 05:14:27.352980 | orchestrator | Friday 03 April 2026 05:14:23 +0000 (0:00:02.919) 0:01:42.571 ********** 2026-04-03 05:14:27.352994 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:27.353017 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:35.475138 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:35.475248 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:35.475265 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:35.475275 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:35.475283 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:35.475305 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 05:14:35.475312 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:35.475320 | orchestrator | 2026-04-03 05:14:35.475329 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-03 05:14:35.475337 | orchestrator | Friday 03 April 2026 05:14:27 +0000 (0:00:03.457) 0:01:46.029 ********** 2026-04-03 05:14:35.475363 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:35.475370 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:35.475378 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:35.475384 | orchestrator | 2026-04-03 05:14:35.475392 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-03 05:14:35.475399 | orchestrator | Friday 03 April 2026 05:14:28 +0000 (0:00:01.282) 0:01:47.311 ********** 2026-04-03 05:14:35.475405 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:35.475412 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:35.475418 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:35.475426 | orchestrator | 2026-04-03 05:14:35.475433 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-03 05:14:35.475439 | orchestrator | Friday 03 April 2026 05:14:30 +0000 (0:00:02.008) 0:01:49.319 ********** 2026-04-03 05:14:35.475447 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:35.475453 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:35.475460 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:35.475467 | orchestrator | 2026-04-03 05:14:35.475473 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-03 05:14:35.475480 | orchestrator | Friday 03 April 2026 05:14:30 +0000 (0:00:00.307) 0:01:49.626 ********** 2026-04-03 05:14:35.475487 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:35.475494 | orchestrator | 2026-04-03 05:14:35.475501 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-03 05:14:35.475508 | orchestrator | Friday 03 April 2026 05:14:31 +0000 (0:00:01.049) 0:01:50.676 ********** 2026-04-03 05:14:35.475533 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 05:14:35.475544 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 05:14:35.475551 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 05:14:35.475558 | orchestrator | 2026-04-03 05:14:35.475565 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-03 05:14:35.475579 | orchestrator | Friday 03 April 2026 05:14:34 +0000 (0:00:02.883) 0:01:53.559 ********** 2026-04-03 05:14:35.475587 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 05:14:35.475595 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:35.475602 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 05:14:35.475609 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:35.475616 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 05:14:35.475721 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:35.475738 | orchestrator | 2026-04-03 05:14:35.475745 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-03 05:14:35.475753 | orchestrator | Friday 03 April 2026 05:14:35 +0000 (0:00:00.376) 0:01:53.936 ********** 2026-04-03 05:14:35.475761 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:35.475779 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:43.825981 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:43.826157 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:43.826175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:43.826184 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:43.826192 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:43.826200 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-03 05:14:43.826225 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:43.826233 | orchestrator | 2026-04-03 05:14:43.826241 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-03 05:14:43.826250 | orchestrator | Friday 03 April 2026 05:14:36 +0000 (0:00:00.837) 0:01:54.773 ********** 2026-04-03 05:14:43.826257 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:43.826264 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:43.826272 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:43.826279 | orchestrator | 2026-04-03 05:14:43.826286 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-03 05:14:43.826293 | orchestrator | Friday 03 April 2026 05:14:37 +0000 (0:00:01.303) 0:01:56.077 ********** 2026-04-03 05:14:43.826301 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:43.826308 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:43.826315 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:43.826322 | orchestrator | 2026-04-03 05:14:43.826329 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-03 05:14:43.826348 | orchestrator | Friday 03 April 2026 05:14:39 +0000 (0:00:01.948) 0:01:58.025 ********** 2026-04-03 05:14:43.826356 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:43.826363 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:43.826370 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:43.826378 | orchestrator | 2026-04-03 05:14:43.826385 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-03 05:14:43.826392 | orchestrator | Friday 03 April 2026 05:14:39 +0000 (0:00:00.305) 0:01:58.330 ********** 2026-04-03 05:14:43.826399 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:43.826407 | orchestrator | 2026-04-03 05:14:43.826414 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-03 05:14:43.826421 | orchestrator | Friday 03 April 2026 05:14:40 +0000 (0:00:01.058) 0:01:59.389 ********** 2026-04-03 05:14:43.826451 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 05:14:43.826476 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 05:14:43.826493 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 05:14:45.392516 | orchestrator | 2026-04-03 05:14:45.392622 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-03 05:14:45.392639 | orchestrator | Friday 03 April 2026 05:14:43 +0000 (0:00:03.114) 0:02:02.503 ********** 2026-04-03 05:14:45.392746 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 05:14:45.392768 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:45.392803 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 05:14:45.392844 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:45.392872 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 05:14:45.392886 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:45.392898 | orchestrator | 2026-04-03 05:14:45.392910 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-03 05:14:45.392922 | orchestrator | Friday 03 April 2026 05:14:44 +0000 (0:00:00.629) 0:02:03.133 ********** 2026-04-03 05:14:45.392936 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:45.392959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:45.392974 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:45.392995 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:53.970890 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 05:14:53.971011 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:53.971033 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:53.971049 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:53.971084 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:53.971101 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:53.971118 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 05:14:53.971132 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:53.971146 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:53.971159 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:53.971173 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-03 05:14:53.971221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 05:14:53.971236 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 05:14:53.971251 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:53.971264 | orchestrator | 2026-04-03 05:14:53.971278 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-03 05:14:53.971293 | orchestrator | Friday 03 April 2026 05:14:45 +0000 (0:00:00.935) 0:02:04.069 ********** 2026-04-03 05:14:53.971306 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:53.971320 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:53.971333 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:53.971347 | orchestrator | 2026-04-03 05:14:53.971361 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-03 05:14:53.971374 | orchestrator | Friday 03 April 2026 05:14:47 +0000 (0:00:01.653) 0:02:05.723 ********** 2026-04-03 05:14:53.971388 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:14:53.971402 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:14:53.971416 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:14:53.971429 | orchestrator | 2026-04-03 05:14:53.971442 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-03 05:14:53.971455 | orchestrator | Friday 03 April 2026 05:14:49 +0000 (0:00:01.979) 0:02:07.702 ********** 2026-04-03 05:14:53.971469 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:53.971483 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:53.971519 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:53.971534 | orchestrator | 2026-04-03 05:14:53.971549 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-03 05:14:53.971562 | orchestrator | Friday 03 April 2026 05:14:49 +0000 (0:00:00.314) 0:02:08.016 ********** 2026-04-03 05:14:53.971575 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:53.971588 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:14:53.971601 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:14:53.971614 | orchestrator | 2026-04-03 05:14:53.971628 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-03 05:14:53.971641 | orchestrator | Friday 03 April 2026 05:14:49 +0000 (0:00:00.287) 0:02:08.304 ********** 2026-04-03 05:14:53.971654 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:14:53.971713 | orchestrator | 2026-04-03 05:14:53.971728 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-03 05:14:53.971742 | orchestrator | Friday 03 April 2026 05:14:50 +0000 (0:00:01.156) 0:02:09.460 ********** 2026-04-03 05:14:53.971770 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:14:53.971795 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:14:53.971805 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:14:53.971815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:14:53.971833 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:14:54.619166 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:14:54.619298 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:14:54.619343 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:14:54.619356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:14:54.619369 | orchestrator | 2026-04-03 05:14:54.619383 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-03 05:14:54.619396 | orchestrator | Friday 03 April 2026 05:14:53 +0000 (0:00:03.185) 0:02:12.645 ********** 2026-04-03 05:14:54.619429 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:14:54.619451 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:14:54.619464 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:14:54.619482 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:14:54.619497 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:14:54.619509 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:14:54.619522 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:14:54.619547 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:15:03.677342 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:03.677455 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:15:03.677475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:15:03.677489 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:03.677501 | orchestrator | 2026-04-03 05:15:03.677513 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-03 05:15:03.677527 | orchestrator | Friday 03 April 2026 05:14:54 +0000 (0:00:00.647) 0:02:13.293 ********** 2026-04-03 05:15:03.677540 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677554 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677567 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:03.677579 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677602 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:03.677613 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677624 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-03 05:15:03.677636 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:03.677684 | orchestrator | 2026-04-03 05:15:03.677696 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-03 05:15:03.677708 | orchestrator | Friday 03 April 2026 05:14:55 +0000 (0:00:01.064) 0:02:14.357 ********** 2026-04-03 05:15:03.677719 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:03.677730 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:03.677767 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:03.677779 | orchestrator | 2026-04-03 05:15:03.677790 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-03 05:15:03.677801 | orchestrator | Friday 03 April 2026 05:14:56 +0000 (0:00:01.268) 0:02:15.626 ********** 2026-04-03 05:15:03.677812 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:03.677823 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:03.677834 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:03.677845 | orchestrator | 2026-04-03 05:15:03.677858 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-03 05:15:03.677872 | orchestrator | Friday 03 April 2026 05:14:58 +0000 (0:00:02.034) 0:02:17.661 ********** 2026-04-03 05:15:03.677884 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:03.677911 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:03.677923 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:03.677937 | orchestrator | 2026-04-03 05:15:03.677966 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-03 05:15:03.677980 | orchestrator | Friday 03 April 2026 05:14:59 +0000 (0:00:00.353) 0:02:18.014 ********** 2026-04-03 05:15:03.677993 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:03.678006 | orchestrator | 2026-04-03 05:15:03.678074 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-03 05:15:03.678089 | orchestrator | Friday 03 April 2026 05:15:00 +0000 (0:00:01.209) 0:02:19.224 ********** 2026-04-03 05:15:03.678103 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 05:15:03.678122 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:03.678137 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 05:15:03.678162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:03.678185 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 05:15:08.523471 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:08.523544 | orchestrator | 2026-04-03 05:15:08.523556 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-03 05:15:08.523567 | orchestrator | Friday 03 April 2026 05:15:03 +0000 (0:00:03.123) 0:02:22.347 ********** 2026-04-03 05:15:08.523577 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 05:15:08.523652 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:08.523679 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:08.523692 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 05:15:08.523715 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:08.523724 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:08.523733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 05:15:08.523742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:15:08.523755 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:08.523764 | orchestrator | 2026-04-03 05:15:08.523773 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-03 05:15:08.523781 | orchestrator | Friday 03 April 2026 05:15:04 +0000 (0:00:00.617) 0:02:22.964 ********** 2026-04-03 05:15:08.523790 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523799 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523808 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:08.523817 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523825 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523833 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:08.523841 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523849 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-03 05:15:08.523858 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:08.523865 | orchestrator | 2026-04-03 05:15:08.523877 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-03 05:15:08.523885 | orchestrator | Friday 03 April 2026 05:15:05 +0000 (0:00:00.945) 0:02:23.910 ********** 2026-04-03 05:15:08.523894 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:08.523902 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:08.523909 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:08.523917 | orchestrator | 2026-04-03 05:15:08.523925 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-03 05:15:08.523933 | orchestrator | Friday 03 April 2026 05:15:06 +0000 (0:00:01.478) 0:02:25.389 ********** 2026-04-03 05:15:08.523941 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:08.523949 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:08.523957 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:08.523965 | orchestrator | 2026-04-03 05:15:08.523973 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-03 05:15:08.523986 | orchestrator | Friday 03 April 2026 05:15:08 +0000 (0:00:01.800) 0:02:27.189 ********** 2026-04-03 05:15:12.473007 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:12.473118 | orchestrator | 2026-04-03 05:15:12.473136 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-03 05:15:12.473149 | orchestrator | Friday 03 April 2026 05:15:09 +0000 (0:00:00.943) 0:02:28.133 ********** 2026-04-03 05:15:12.473164 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 05:15:12.473204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473220 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473233 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 05:15:12.473262 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473297 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473311 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473331 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473343 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 05:15:12.473356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473373 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:12.473396 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.415746 | orchestrator | 2026-04-03 05:15:13.415844 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-03 05:15:13.415862 | orchestrator | Friday 03 April 2026 05:15:12 +0000 (0:00:03.097) 0:02:31.230 ********** 2026-04-03 05:15:13.415901 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 05:15:13.415918 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.415932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.415946 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.415959 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:13.415987 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 05:15:13.416018 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.416039 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.416051 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.416062 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:13.416074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 05:15:13.416086 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.416103 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 05:15:13.416123 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 05:15:24.346338 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:24.346447 | orchestrator | 2026-04-03 05:15:24.346463 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-03 05:15:24.346475 | orchestrator | Friday 03 April 2026 05:15:13 +0000 (0:00:00.956) 0:02:32.187 ********** 2026-04-03 05:15:24.346486 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346498 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346562 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:24.346575 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346585 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346596 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:24.346606 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346616 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-03 05:15:24.346626 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:24.346636 | orchestrator | 2026-04-03 05:15:24.346646 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-03 05:15:24.346656 | orchestrator | Friday 03 April 2026 05:15:14 +0000 (0:00:00.854) 0:02:33.042 ********** 2026-04-03 05:15:24.346666 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:24.346675 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:24.346685 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:24.346695 | orchestrator | 2026-04-03 05:15:24.346705 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-03 05:15:24.346715 | orchestrator | Friday 03 April 2026 05:15:15 +0000 (0:00:01.276) 0:02:34.318 ********** 2026-04-03 05:15:24.346724 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:24.346734 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:24.346744 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:24.346754 | orchestrator | 2026-04-03 05:15:24.346764 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-03 05:15:24.346774 | orchestrator | Friday 03 April 2026 05:15:17 +0000 (0:00:01.986) 0:02:36.304 ********** 2026-04-03 05:15:24.346784 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:24.346794 | orchestrator | 2026-04-03 05:15:24.346803 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-03 05:15:24.346813 | orchestrator | Friday 03 April 2026 05:15:18 +0000 (0:00:01.339) 0:02:37.644 ********** 2026-04-03 05:15:24.346823 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 05:15:24.346834 | orchestrator | 2026-04-03 05:15:24.346844 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-03 05:15:24.346874 | orchestrator | Friday 03 April 2026 05:15:21 +0000 (0:00:03.019) 0:02:40.663 ********** 2026-04-03 05:15:24.346925 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:24.346943 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:24.346956 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:24.346974 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:24.346995 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:24.347007 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:24.347028 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:26.712487 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:26.712628 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:26.712645 | orchestrator | 2026-04-03 05:15:26.712658 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-03 05:15:26.712671 | orchestrator | Friday 03 April 2026 05:15:24 +0000 (0:00:02.351) 0:02:43.015 ********** 2026-04-03 05:15:26.712724 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:26.712740 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:26.712752 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:26.712784 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:26.712814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:26.712827 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:26.712839 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:15:26.712858 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 05:15:36.302781 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:36.302899 | orchestrator | 2026-04-03 05:15:36.302917 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-03 05:15:36.302931 | orchestrator | Friday 03 April 2026 05:15:26 +0000 (0:00:02.371) 0:02:45.387 ********** 2026-04-03 05:15:36.302946 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.302982 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.303010 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:36.303022 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.303035 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.303046 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:36.303058 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.303069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 05:15:36.303081 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:36.303092 | orchestrator | 2026-04-03 05:15:36.303103 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-03 05:15:36.303115 | orchestrator | Friday 03 April 2026 05:15:29 +0000 (0:00:02.797) 0:02:48.184 ********** 2026-04-03 05:15:36.303126 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:36.303165 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:36.303177 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:36.303188 | orchestrator | 2026-04-03 05:15:36.303200 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-03 05:15:36.303211 | orchestrator | Friday 03 April 2026 05:15:31 +0000 (0:00:02.029) 0:02:50.214 ********** 2026-04-03 05:15:36.303222 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:36.303233 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:36.303244 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:36.303255 | orchestrator | 2026-04-03 05:15:36.303266 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-03 05:15:36.303277 | orchestrator | Friday 03 April 2026 05:15:32 +0000 (0:00:01.406) 0:02:51.621 ********** 2026-04-03 05:15:36.303288 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:36.303299 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:36.303310 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:36.303321 | orchestrator | 2026-04-03 05:15:36.303332 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-03 05:15:36.303349 | orchestrator | Friday 03 April 2026 05:15:33 +0000 (0:00:00.311) 0:02:51.933 ********** 2026-04-03 05:15:36.303368 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:36.303387 | orchestrator | 2026-04-03 05:15:36.303406 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-03 05:15:36.303425 | orchestrator | Friday 03 April 2026 05:15:34 +0000 (0:00:01.411) 0:02:53.344 ********** 2026-04-03 05:15:36.303480 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 05:15:36.303506 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 05:15:36.303526 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 05:15:36.303546 | orchestrator | 2026-04-03 05:15:36.303563 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-03 05:15:36.303584 | orchestrator | Friday 03 April 2026 05:15:36 +0000 (0:00:01.448) 0:02:54.792 ********** 2026-04-03 05:15:36.303605 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 05:15:44.567710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:44.567810 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 05:15:44.567823 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:44.567831 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 05:15:44.567839 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:44.567845 | orchestrator | 2026-04-03 05:15:44.567853 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-03 05:15:44.567863 | orchestrator | Friday 03 April 2026 05:15:36 +0000 (0:00:00.380) 0:02:55.172 ********** 2026-04-03 05:15:44.567870 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 05:15:44.567878 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:44.567889 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 05:15:44.567896 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:44.567903 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 05:15:44.567928 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:44.567935 | orchestrator | 2026-04-03 05:15:44.567979 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-03 05:15:44.567986 | orchestrator | Friday 03 April 2026 05:15:37 +0000 (0:00:00.858) 0:02:56.030 ********** 2026-04-03 05:15:44.567993 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:44.567999 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:44.568005 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:44.568011 | orchestrator | 2026-04-03 05:15:44.568017 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-03 05:15:44.568023 | orchestrator | Friday 03 April 2026 05:15:37 +0000 (0:00:00.426) 0:02:56.457 ********** 2026-04-03 05:15:44.568029 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:44.568035 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:44.568041 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:44.568047 | orchestrator | 2026-04-03 05:15:44.568053 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-03 05:15:44.568059 | orchestrator | Friday 03 April 2026 05:15:39 +0000 (0:00:01.263) 0:02:57.720 ********** 2026-04-03 05:15:44.568065 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:44.568070 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:44.568076 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:44.568082 | orchestrator | 2026-04-03 05:15:44.568088 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-03 05:15:44.568093 | orchestrator | Friday 03 April 2026 05:15:39 +0000 (0:00:00.331) 0:02:58.052 ********** 2026-04-03 05:15:44.568099 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:44.568105 | orchestrator | 2026-04-03 05:15:44.568112 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-03 05:15:44.568118 | orchestrator | Friday 03 April 2026 05:15:40 +0000 (0:00:01.450) 0:02:59.503 ********** 2026-04-03 05:15:44.568141 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:15:44.568154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.568161 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.568174 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:15:44.568180 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.568192 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665694 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:44.665781 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665809 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665818 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.665849 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:44.665862 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.665870 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665884 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.665891 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.665899 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.665906 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:15:44.665921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:44.740209 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740319 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740328 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:44.740336 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:44.740361 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740374 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740382 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.740433 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740441 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:44.740448 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.740461 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:44.984059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.984158 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:44.984177 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.984191 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.984205 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:44.984218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.984284 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:44.984299 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:44.984312 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:44.984324 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:44.984337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:44.984361 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.043687 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:46.043813 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.043840 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.043855 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:46.043872 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.043884 | orchestrator | 2026-04-03 05:15:46.043897 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-03 05:15:46.043933 | orchestrator | Friday 03 April 2026 05:15:44 +0000 (0:00:04.157) 0:03:03.661 ********** 2026-04-03 05:15:46.043981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:15:46.043997 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.044010 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.044023 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.044035 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:46.044068 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116282 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.116425 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:15:46.116453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.116474 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116496 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116589 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.116633 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116653 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.116674 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:46.116706 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:46.116746 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.194766 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.194864 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.194881 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.194895 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:46.194934 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.194960 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:15:46.194993 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.195006 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.195018 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:46.195032 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.195045 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.195064 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.195085 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.424336 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.424525 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:46.424618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-03 05:15:46.424671 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.424696 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.424726 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.424776 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.424801 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:46.424825 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:46.424847 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.424877 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:46.424901 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:46.424929 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:46.424960 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:56.692710 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-03 05:15:56.692820 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-03 05:15:56.692845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 05:15:56.692890 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 05:15:56.692930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:15:56.692948 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:56.692960 | orchestrator | 2026-04-03 05:15:56.692970 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-03 05:15:56.692980 | orchestrator | Friday 03 April 2026 05:15:46 +0000 (0:00:01.438) 0:03:05.099 ********** 2026-04-03 05:15:56.692990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693001 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693011 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:15:56.693038 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693048 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693057 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:15:56.693066 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693075 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-03 05:15:56.693091 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:15:56.693100 | orchestrator | 2026-04-03 05:15:56.693109 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-03 05:15:56.693118 | orchestrator | Friday 03 April 2026 05:15:48 +0000 (0:00:02.011) 0:03:07.110 ********** 2026-04-03 05:15:56.693127 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:56.693135 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:56.693145 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:56.693154 | orchestrator | 2026-04-03 05:15:56.693162 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-03 05:15:56.693171 | orchestrator | Friday 03 April 2026 05:15:49 +0000 (0:00:01.365) 0:03:08.476 ********** 2026-04-03 05:15:56.693180 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:15:56.693189 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:15:56.693197 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:15:56.693206 | orchestrator | 2026-04-03 05:15:56.693215 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-03 05:15:56.693223 | orchestrator | Friday 03 April 2026 05:15:51 +0000 (0:00:02.090) 0:03:10.566 ********** 2026-04-03 05:15:56.693232 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:15:56.693241 | orchestrator | 2026-04-03 05:15:56.693249 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-03 05:15:56.693258 | orchestrator | Friday 03 April 2026 05:15:53 +0000 (0:00:01.240) 0:03:11.806 ********** 2026-04-03 05:15:56.693268 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:15:56.693285 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:15:56.693303 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:07.266358 | orchestrator | 2026-04-03 05:16:07.266471 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-03 05:16:07.266492 | orchestrator | Friday 03 April 2026 05:15:56 +0000 (0:00:03.560) 0:03:15.367 ********** 2026-04-03 05:16:07.266509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:16:07.266528 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:07.266545 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:16:07.266559 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:07.266584 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:16:07.266602 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:07.266617 | orchestrator | 2026-04-03 05:16:07.266631 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-03 05:16:07.266647 | orchestrator | Friday 03 April 2026 05:15:57 +0000 (0:00:00.517) 0:03:15.884 ********** 2026-04-03 05:16:07.266664 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266703 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266721 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:07.266737 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266772 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266787 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:07.266802 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266815 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-03 05:16:07.266829 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:07.266843 | orchestrator | 2026-04-03 05:16:07.266857 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-03 05:16:07.266872 | orchestrator | Friday 03 April 2026 05:15:57 +0000 (0:00:00.750) 0:03:16.635 ********** 2026-04-03 05:16:07.266888 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:07.266902 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:07.266917 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:07.266932 | orchestrator | 2026-04-03 05:16:07.266947 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-03 05:16:07.266961 | orchestrator | Friday 03 April 2026 05:15:59 +0000 (0:00:01.855) 0:03:18.490 ********** 2026-04-03 05:16:07.266976 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:07.266992 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:07.267006 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:07.267022 | orchestrator | 2026-04-03 05:16:07.267037 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-03 05:16:07.267052 | orchestrator | Friday 03 April 2026 05:16:01 +0000 (0:00:01.779) 0:03:20.269 ********** 2026-04-03 05:16:07.267067 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:16:07.267081 | orchestrator | 2026-04-03 05:16:07.267095 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-03 05:16:07.267110 | orchestrator | Friday 03 April 2026 05:16:03 +0000 (0:00:01.595) 0:03:21.864 ********** 2026-04-03 05:16:07.267129 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:07.267170 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:07.267187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:07.267217 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:08.422320 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422409 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422459 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:08.422472 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422481 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422491 | orchestrator | 2026-04-03 05:16:08.422502 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-03 05:16:08.422512 | orchestrator | Friday 03 April 2026 05:16:07 +0000 (0:00:04.069) 0:03:25.934 ********** 2026-04-03 05:16:08.422539 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 05:16:08.422559 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422573 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:08.422583 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:08.422594 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 05:16:08.422610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:18.865476 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:18.865594 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:18.865634 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 05:16:18.865670 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 05:16:18.865683 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 05:16:18.865695 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:18.865707 | orchestrator | 2026-04-03 05:16:18.865719 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-03 05:16:18.865732 | orchestrator | Friday 03 April 2026 05:16:08 +0000 (0:00:01.159) 0:03:27.093 ********** 2026-04-03 05:16:18.865745 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865759 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865773 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865801 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865815 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:18.865826 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865837 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865868 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865879 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:18.865890 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865901 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865917 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865929 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-03 05:16:18.865940 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:18.865951 | orchestrator | 2026-04-03 05:16:18.865962 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-03 05:16:18.865973 | orchestrator | Friday 03 April 2026 05:16:09 +0000 (0:00:00.895) 0:03:27.988 ********** 2026-04-03 05:16:18.865984 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:18.865995 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:18.866008 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:18.866085 | orchestrator | 2026-04-03 05:16:18.866098 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-03 05:16:18.866112 | orchestrator | Friday 03 April 2026 05:16:10 +0000 (0:00:01.339) 0:03:29.327 ********** 2026-04-03 05:16:18.866126 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:18.866138 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:18.866151 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:18.866164 | orchestrator | 2026-04-03 05:16:18.866186 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-03 05:16:18.866229 | orchestrator | Friday 03 April 2026 05:16:12 +0000 (0:00:02.063) 0:03:31.390 ********** 2026-04-03 05:16:18.866242 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:16:18.866255 | orchestrator | 2026-04-03 05:16:18.866267 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-03 05:16:18.866279 | orchestrator | Friday 03 April 2026 05:16:14 +0000 (0:00:01.552) 0:03:32.943 ********** 2026-04-03 05:16:18.866292 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-03 05:16:18.866306 | orchestrator | 2026-04-03 05:16:18.866318 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-03 05:16:18.866330 | orchestrator | Friday 03 April 2026 05:16:15 +0000 (0:00:00.836) 0:03:33.780 ********** 2026-04-03 05:16:18.866345 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 05:16:18.866376 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 05:16:30.399241 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 05:16:30.399384 | orchestrator | 2026-04-03 05:16:30.399410 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-03 05:16:30.399427 | orchestrator | Friday 03 April 2026 05:16:18 +0000 (0:00:03.761) 0:03:37.541 ********** 2026-04-03 05:16:30.399444 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.399460 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:30.399495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.399512 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:30.399527 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.399541 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:30.399555 | orchestrator | 2026-04-03 05:16:30.399569 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-03 05:16:30.399583 | orchestrator | Friday 03 April 2026 05:16:20 +0000 (0:00:01.365) 0:03:38.906 ********** 2026-04-03 05:16:30.399598 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399615 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399654 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:30.399670 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399685 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:30.399714 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399728 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 05:16:30.399764 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:30.399780 | orchestrator | 2026-04-03 05:16:30.399795 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 05:16:30.399811 | orchestrator | Friday 03 April 2026 05:16:21 +0000 (0:00:01.540) 0:03:40.446 ********** 2026-04-03 05:16:30.399825 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:30.399840 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:30.399854 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:30.399868 | orchestrator | 2026-04-03 05:16:30.399883 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 05:16:30.399898 | orchestrator | Friday 03 April 2026 05:16:24 +0000 (0:00:02.369) 0:03:42.816 ********** 2026-04-03 05:16:30.399913 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:16:30.399927 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:16:30.399942 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:16:30.399956 | orchestrator | 2026-04-03 05:16:30.399971 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-03 05:16:30.399986 | orchestrator | Friday 03 April 2026 05:16:26 +0000 (0:00:02.841) 0:03:45.658 ********** 2026-04-03 05:16:30.400001 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-03 05:16:30.400017 | orchestrator | 2026-04-03 05:16:30.400033 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-03 05:16:30.400047 | orchestrator | Friday 03 April 2026 05:16:28 +0000 (0:00:01.073) 0:03:46.731 ********** 2026-04-03 05:16:30.400073 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.400089 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:30.400105 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.400158 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:30.400174 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.400189 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:30.400203 | orchestrator | 2026-04-03 05:16:30.400218 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-03 05:16:30.400232 | orchestrator | Friday 03 April 2026 05:16:29 +0000 (0:00:01.039) 0:03:47.771 ********** 2026-04-03 05:16:30.400246 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.400261 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:30.400276 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:30.400301 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:53.433966 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 05:16:53.434189 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:53.434210 | orchestrator | 2026-04-03 05:16:53.434224 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-03 05:16:53.434237 | orchestrator | Friday 03 April 2026 05:16:30 +0000 (0:00:01.296) 0:03:49.067 ********** 2026-04-03 05:16:53.434249 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:53.434260 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:53.434271 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:53.434282 | orchestrator | 2026-04-03 05:16:53.434293 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 05:16:53.434304 | orchestrator | Friday 03 April 2026 05:16:31 +0000 (0:00:01.479) 0:03:50.547 ********** 2026-04-03 05:16:53.434315 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:16:53.434327 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:16:53.434338 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:16:53.434349 | orchestrator | 2026-04-03 05:16:53.434360 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 05:16:53.434371 | orchestrator | Friday 03 April 2026 05:16:34 +0000 (0:00:02.598) 0:03:53.145 ********** 2026-04-03 05:16:53.434408 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:16:53.434419 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:16:53.434430 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:16:53.434441 | orchestrator | 2026-04-03 05:16:53.434466 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-03 05:16:53.434477 | orchestrator | Friday 03 April 2026 05:16:37 +0000 (0:00:02.737) 0:03:55.883 ********** 2026-04-03 05:16:53.434489 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-03 05:16:53.434503 | orchestrator | 2026-04-03 05:16:53.434516 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-03 05:16:53.434529 | orchestrator | Friday 03 April 2026 05:16:38 +0000 (0:00:01.198) 0:03:57.081 ********** 2026-04-03 05:16:53.434544 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434559 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:53.434573 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434586 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:53.434599 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434612 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:53.434625 | orchestrator | 2026-04-03 05:16:53.434638 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-03 05:16:53.434652 | orchestrator | Friday 03 April 2026 05:16:39 +0000 (0:00:01.298) 0:03:58.379 ********** 2026-04-03 05:16:53.434684 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434696 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:53.434707 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434726 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:53.434738 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 05:16:53.434749 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:53.434760 | orchestrator | 2026-04-03 05:16:53.434777 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-03 05:16:53.434788 | orchestrator | Friday 03 April 2026 05:16:41 +0000 (0:00:01.318) 0:03:59.698 ********** 2026-04-03 05:16:53.434799 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:53.434810 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:53.434820 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:16:53.434831 | orchestrator | 2026-04-03 05:16:53.434842 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 05:16:53.434853 | orchestrator | Friday 03 April 2026 05:16:42 +0000 (0:00:01.980) 0:04:01.678 ********** 2026-04-03 05:16:53.434864 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:16:53.434875 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:16:53.434886 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:16:53.434897 | orchestrator | 2026-04-03 05:16:53.434908 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 05:16:53.434919 | orchestrator | Friday 03 April 2026 05:16:45 +0000 (0:00:02.310) 0:04:03.989 ********** 2026-04-03 05:16:53.434930 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:16:53.434940 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:16:53.434951 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:16:53.434962 | orchestrator | 2026-04-03 05:16:53.434973 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-03 05:16:53.434984 | orchestrator | Friday 03 April 2026 05:16:48 +0000 (0:00:03.289) 0:04:07.278 ********** 2026-04-03 05:16:53.434995 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:16:53.435026 | orchestrator | 2026-04-03 05:16:53.435038 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-03 05:16:53.435050 | orchestrator | Friday 03 April 2026 05:16:50 +0000 (0:00:01.613) 0:04:08.891 ********** 2026-04-03 05:16:53.435062 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:53.435075 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:53.435106 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:54.166219 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166355 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166386 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:54.166409 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:16:54.166432 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166484 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:16:54.166556 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 05:16:54.166577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:54.166599 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166667 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.166708 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:16:54.166728 | orchestrator | 2026-04-03 05:16:54.166750 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-03 05:16:54.166772 | orchestrator | Friday 03 April 2026 05:16:53 +0000 (0:00:03.353) 0:04:12.245 ********** 2026-04-03 05:16:54.166810 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 05:16:54.303438 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:54.303543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.303561 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.303575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:16:54.303643 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:16:54.303660 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 05:16:54.303674 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:54.303713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.303727 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.303786 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:16:54.303807 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 05:16:54.303819 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:16:54.303831 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 05:16:54.303843 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 05:16:54.303872 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 05:17:05.434534 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 05:17:05.434675 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:05.434697 | orchestrator | 2026-04-03 05:17:05.434710 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-03 05:17:05.434723 | orchestrator | Friday 03 April 2026 05:16:54 +0000 (0:00:00.734) 0:04:12.980 ********** 2026-04-03 05:17:05.434736 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434775 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434788 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:05.434800 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434811 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434823 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:05.434834 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 05:17:05.434856 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:05.434867 | orchestrator | 2026-04-03 05:17:05.434878 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-03 05:17:05.434889 | orchestrator | Friday 03 April 2026 05:16:55 +0000 (0:00:00.914) 0:04:13.894 ********** 2026-04-03 05:17:05.434900 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:17:05.434911 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:17:05.434922 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:17:05.434933 | orchestrator | 2026-04-03 05:17:05.434969 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-03 05:17:05.434982 | orchestrator | Friday 03 April 2026 05:16:56 +0000 (0:00:01.645) 0:04:15.540 ********** 2026-04-03 05:17:05.434993 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:17:05.435003 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:17:05.435015 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:17:05.435026 | orchestrator | 2026-04-03 05:17:05.435037 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-03 05:17:05.435048 | orchestrator | Friday 03 April 2026 05:16:58 +0000 (0:00:02.062) 0:04:17.603 ********** 2026-04-03 05:17:05.435062 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:17:05.435075 | orchestrator | 2026-04-03 05:17:05.435088 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-03 05:17:05.435101 | orchestrator | Friday 03 April 2026 05:17:00 +0000 (0:00:01.358) 0:04:18.961 ********** 2026-04-03 05:17:05.435134 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:17:05.435170 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:17:05.435196 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:17:05.435212 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:17:05.435235 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:17:05.435260 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:17:07.336219 | orchestrator | 2026-04-03 05:17:07.336333 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-03 05:17:07.336351 | orchestrator | Friday 03 April 2026 05:17:05 +0000 (0:00:05.133) 0:04:24.095 ********** 2026-04-03 05:17:07.336366 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:17:07.336385 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:17:07.336398 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:07.336430 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:17:07.336443 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:17:07.336495 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:07.336509 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:17:07.336522 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:17:07.336534 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:07.336546 | orchestrator | 2026-04-03 05:17:07.336588 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-03 05:17:07.336600 | orchestrator | Friday 03 April 2026 05:17:06 +0000 (0:00:01.007) 0:04:25.102 ********** 2026-04-03 05:17:07.336613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-03 05:17:07.336626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:07.336663 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:07.336686 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:07.336704 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-03 05:17:07.336715 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:07.336727 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:07.336738 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:07.336749 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-03 05:17:07.336760 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:07.336787 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-03 05:17:13.278969 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:13.279079 | orchestrator | 2026-04-03 05:17:13.279097 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-03 05:17:13.279111 | orchestrator | Friday 03 April 2026 05:17:07 +0000 (0:00:00.904) 0:04:26.006 ********** 2026-04-03 05:17:13.279122 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:13.279134 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:13.279145 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:13.279156 | orchestrator | 2026-04-03 05:17:13.279168 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-03 05:17:13.279179 | orchestrator | Friday 03 April 2026 05:17:07 +0000 (0:00:00.433) 0:04:26.440 ********** 2026-04-03 05:17:13.279190 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:13.279202 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:13.279213 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:13.279224 | orchestrator | 2026-04-03 05:17:13.279235 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-03 05:17:13.279246 | orchestrator | Friday 03 April 2026 05:17:09 +0000 (0:00:01.406) 0:04:27.846 ********** 2026-04-03 05:17:13.279258 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:17:13.279270 | orchestrator | 2026-04-03 05:17:13.279281 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-03 05:17:13.279292 | orchestrator | Friday 03 April 2026 05:17:10 +0000 (0:00:01.704) 0:04:29.550 ********** 2026-04-03 05:17:13.279306 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 05:17:13.279344 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:13.279373 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:13.279386 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:13.279399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:13.279428 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 05:17:13.279441 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:13.279455 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:13.279477 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:13.279490 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:13.279509 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 05:17:13.279523 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:13.279546 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846606 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846707 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:14.846746 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 05:17:14.846780 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:14.846793 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 05:17:14.846823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846837 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:14.846856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846873 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846884 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:14.846895 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:14.846967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:14.846990 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 05:17:15.529248 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:15.529352 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.529388 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.529402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:15.529414 | orchestrator | 2026-04-03 05:17:15.529428 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-03 05:17:15.529440 | orchestrator | Friday 03 April 2026 05:17:14 +0000 (0:00:04.118) 0:04:33.669 ********** 2026-04-03 05:17:15.529453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-03 05:17:15.529466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:15.529517 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.529531 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.529545 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:15.529565 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-03 05:17:15.529580 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:15.529600 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-03 05:17:15.699812 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.699965 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:15.700002 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.700016 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.700029 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:15.700041 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.700054 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:15.700069 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:15.700129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-03 05:17:15.700145 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:15.700163 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.700175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:15.700187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-03 05:17:15.700206 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:15.700217 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:15.700239 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 05:17:17.244011 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:17.244138 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:17.244181 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 05:17:17.244204 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-03 05:17:17.244224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-03 05:17:17.244272 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:17.244315 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 05:17:17.244335 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 05:17:17.244355 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:17.244375 | orchestrator | 2026-04-03 05:17:17.244395 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-03 05:17:17.244413 | orchestrator | Friday 03 April 2026 05:17:15 +0000 (0:00:00.840) 0:04:34.509 ********** 2026-04-03 05:17:17.244437 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244457 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:17.244497 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:17.244515 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:17.244533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244561 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:17.244598 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:17.244616 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:17.244634 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244652 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-03 05:17:17.244671 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:17.244701 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-03 05:17:24.795002 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:24.795112 | orchestrator | 2026-04-03 05:17:24.795129 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-03 05:17:24.795144 | orchestrator | Friday 03 April 2026 05:17:17 +0000 (0:00:01.388) 0:04:35.898 ********** 2026-04-03 05:17:24.795155 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:24.795167 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:24.795178 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:24.795189 | orchestrator | 2026-04-03 05:17:24.795200 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-03 05:17:24.795212 | orchestrator | Friday 03 April 2026 05:17:17 +0000 (0:00:00.470) 0:04:36.368 ********** 2026-04-03 05:17:24.795223 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:24.795234 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:24.795245 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:24.795256 | orchestrator | 2026-04-03 05:17:24.795268 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-03 05:17:24.795279 | orchestrator | Friday 03 April 2026 05:17:18 +0000 (0:00:01.317) 0:04:37.686 ********** 2026-04-03 05:17:24.795290 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:17:24.795301 | orchestrator | 2026-04-03 05:17:24.795312 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-03 05:17:24.795324 | orchestrator | Friday 03 April 2026 05:17:20 +0000 (0:00:01.758) 0:04:39.444 ********** 2026-04-03 05:17:24.795339 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:17:24.795382 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:17:24.795435 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:17:24.795450 | orchestrator | 2026-04-03 05:17:24.795462 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-03 05:17:24.795493 | orchestrator | Friday 03 April 2026 05:17:22 +0000 (0:00:02.141) 0:04:41.585 ********** 2026-04-03 05:17:24.795509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 05:17:24.795537 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 05:17:24.795551 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:24.795565 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:24.795577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 05:17:24.795591 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:24.795603 | orchestrator | 2026-04-03 05:17:24.795617 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-03 05:17:24.795629 | orchestrator | Friday 03 April 2026 05:17:23 +0000 (0:00:00.442) 0:04:42.027 ********** 2026-04-03 05:17:24.795643 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 05:17:24.795657 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:24.795671 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 05:17:24.795685 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:24.795698 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 05:17:24.795709 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:24.795720 | orchestrator | 2026-04-03 05:17:24.795731 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-03 05:17:24.795742 | orchestrator | Friday 03 April 2026 05:17:24 +0000 (0:00:00.965) 0:04:42.993 ********** 2026-04-03 05:17:24.795760 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:34.623512 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:34.623643 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:34.623661 | orchestrator | 2026-04-03 05:17:34.623675 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-03 05:17:34.623688 | orchestrator | Friday 03 April 2026 05:17:24 +0000 (0:00:00.483) 0:04:43.476 ********** 2026-04-03 05:17:34.623699 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:34.623732 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:34.623753 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:34.623772 | orchestrator | 2026-04-03 05:17:34.623791 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-03 05:17:34.623840 | orchestrator | Friday 03 April 2026 05:17:26 +0000 (0:00:01.391) 0:04:44.868 ********** 2026-04-03 05:17:34.623861 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:17:34.623882 | orchestrator | 2026-04-03 05:17:34.623901 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-03 05:17:34.623914 | orchestrator | Friday 03 April 2026 05:17:27 +0000 (0:00:01.505) 0:04:46.373 ********** 2026-04-03 05:17:34.623945 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.623965 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.623977 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.624008 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.624039 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.624054 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 05:17:34.624068 | orchestrator | 2026-04-03 05:17:34.624083 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-03 05:17:34.624103 | orchestrator | Friday 03 April 2026 05:17:33 +0000 (0:00:06.272) 0:04:52.646 ********** 2026-04-03 05:17:34.624125 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 05:17:34.624160 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 05:17:40.308865 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:40.308970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 05:17:40.308983 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 05:17:40.308992 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:40.309000 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 05:17:40.309007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 05:17:40.309029 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:40.309036 | orchestrator | 2026-04-03 05:17:40.309044 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-03 05:17:40.309052 | orchestrator | Friday 03 April 2026 05:17:34 +0000 (0:00:00.657) 0:04:53.304 ********** 2026-04-03 05:17:40.309071 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309100 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309107 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:40.309113 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309120 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309127 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309133 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309140 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:40.309146 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309152 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309159 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309165 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-03 05:17:40.309172 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:40.309178 | orchestrator | 2026-04-03 05:17:40.309190 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-03 05:17:40.309197 | orchestrator | Friday 03 April 2026 05:17:35 +0000 (0:00:00.914) 0:04:54.219 ********** 2026-04-03 05:17:40.309203 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:17:40.309210 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:17:40.309216 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:17:40.309222 | orchestrator | 2026-04-03 05:17:40.309229 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-03 05:17:40.309235 | orchestrator | Friday 03 April 2026 05:17:36 +0000 (0:00:01.285) 0:04:55.504 ********** 2026-04-03 05:17:40.309253 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:17:40.309259 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:17:40.309266 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:17:40.309272 | orchestrator | 2026-04-03 05:17:40.309279 | orchestrator | TASK [include_role : swift] **************************************************** 2026-04-03 05:17:40.309293 | orchestrator | Friday 03 April 2026 05:17:38 +0000 (0:00:02.159) 0:04:57.664 ********** 2026-04-03 05:17:40.309300 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:40.309306 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:40.309313 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:40.309319 | orchestrator | 2026-04-03 05:17:40.309325 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-03 05:17:40.309332 | orchestrator | Friday 03 April 2026 05:17:39 +0000 (0:00:00.656) 0:04:58.321 ********** 2026-04-03 05:17:40.309338 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:40.309344 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:17:40.309351 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:17:40.309357 | orchestrator | 2026-04-03 05:17:40.309363 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-03 05:17:40.309370 | orchestrator | Friday 03 April 2026 05:17:39 +0000 (0:00:00.318) 0:04:58.640 ********** 2026-04-03 05:17:40.309376 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:17:40.309388 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.577402 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.577516 | orchestrator | 2026-04-03 05:18:22.577534 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-03 05:18:22.577547 | orchestrator | Friday 03 April 2026 05:17:40 +0000 (0:00:00.348) 0:04:58.989 ********** 2026-04-03 05:18:22.577559 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.577570 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.577581 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.577644 | orchestrator | 2026-04-03 05:18:22.577657 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-03 05:18:22.577668 | orchestrator | Friday 03 April 2026 05:17:40 +0000 (0:00:00.330) 0:04:59.319 ********** 2026-04-03 05:18:22.577679 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.577690 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.577701 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.577712 | orchestrator | 2026-04-03 05:18:22.577723 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-03 05:18:22.577751 | orchestrator | Friday 03 April 2026 05:17:41 +0000 (0:00:00.662) 0:04:59.982 ********** 2026-04-03 05:18:22.577764 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.577775 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.577786 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.577797 | orchestrator | 2026-04-03 05:18:22.577808 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-03 05:18:22.577819 | orchestrator | Friday 03 April 2026 05:17:41 +0000 (0:00:00.552) 0:05:00.534 ********** 2026-04-03 05:18:22.577831 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.577842 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.577853 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.577864 | orchestrator | 2026-04-03 05:18:22.577875 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-03 05:18:22.577909 | orchestrator | Friday 03 April 2026 05:17:42 +0000 (0:00:00.633) 0:05:01.168 ********** 2026-04-03 05:18:22.577921 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.577931 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.577944 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.577956 | orchestrator | 2026-04-03 05:18:22.577969 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-03 05:18:22.577982 | orchestrator | Friday 03 April 2026 05:17:43 +0000 (0:00:00.680) 0:05:01.849 ********** 2026-04-03 05:18:22.577995 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.578007 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.578081 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.578095 | orchestrator | 2026-04-03 05:18:22.578107 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-03 05:18:22.578120 | orchestrator | Friday 03 April 2026 05:17:44 +0000 (0:00:00.856) 0:05:02.705 ********** 2026-04-03 05:18:22.578133 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.578145 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.578158 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.578170 | orchestrator | 2026-04-03 05:18:22.578183 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-03 05:18:22.578196 | orchestrator | Friday 03 April 2026 05:17:44 +0000 (0:00:00.856) 0:05:03.562 ********** 2026-04-03 05:18:22.578209 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.578221 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.578234 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.578246 | orchestrator | 2026-04-03 05:18:22.578258 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-03 05:18:22.578271 | orchestrator | Friday 03 April 2026 05:17:45 +0000 (0:00:00.842) 0:05:04.405 ********** 2026-04-03 05:18:22.578283 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:18:22.578296 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:18:22.578309 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:18:22.578320 | orchestrator | 2026-04-03 05:18:22.578330 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-03 05:18:22.578341 | orchestrator | Friday 03 April 2026 05:17:50 +0000 (0:00:04.443) 0:05:08.849 ********** 2026-04-03 05:18:22.578352 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.578363 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.578374 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.578385 | orchestrator | 2026-04-03 05:18:22.578396 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-03 05:18:22.578407 | orchestrator | Friday 03 April 2026 05:17:53 +0000 (0:00:03.167) 0:05:12.016 ********** 2026-04-03 05:18:22.578418 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:18:22.578429 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:18:22.578439 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:18:22.578450 | orchestrator | 2026-04-03 05:18:22.578462 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-03 05:18:22.578473 | orchestrator | Friday 03 April 2026 05:18:08 +0000 (0:00:15.098) 0:05:27.115 ********** 2026-04-03 05:18:22.578484 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.578495 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.578506 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.578517 | orchestrator | 2026-04-03 05:18:22.578528 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-03 05:18:22.578539 | orchestrator | Friday 03 April 2026 05:18:09 +0000 (0:00:00.732) 0:05:27.847 ********** 2026-04-03 05:18:22.578550 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:18:22.578561 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:18:22.578571 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:18:22.578582 | orchestrator | 2026-04-03 05:18:22.578616 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-03 05:18:22.578628 | orchestrator | Friday 03 April 2026 05:18:13 +0000 (0:00:04.167) 0:05:32.015 ********** 2026-04-03 05:18:22.578651 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.578662 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.578673 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.578684 | orchestrator | 2026-04-03 05:18:22.578695 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-03 05:18:22.578706 | orchestrator | Friday 03 April 2026 05:18:14 +0000 (0:00:00.720) 0:05:32.736 ********** 2026-04-03 05:18:22.578717 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.578728 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.578739 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.578749 | orchestrator | 2026-04-03 05:18:22.578801 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-03 05:18:22.578814 | orchestrator | Friday 03 April 2026 05:18:14 +0000 (0:00:00.376) 0:05:33.112 ********** 2026-04-03 05:18:22.578825 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.578836 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.578847 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.578858 | orchestrator | 2026-04-03 05:18:22.578869 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-03 05:18:22.578880 | orchestrator | Friday 03 April 2026 05:18:14 +0000 (0:00:00.349) 0:05:33.461 ********** 2026-04-03 05:18:22.578891 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.578902 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.578913 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.578924 | orchestrator | 2026-04-03 05:18:22.578935 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-03 05:18:22.578991 | orchestrator | Friday 03 April 2026 05:18:15 +0000 (0:00:00.332) 0:05:33.793 ********** 2026-04-03 05:18:22.579005 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.579023 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.579034 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.579045 | orchestrator | 2026-04-03 05:18:22.579056 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-03 05:18:22.579066 | orchestrator | Friday 03 April 2026 05:18:15 +0000 (0:00:00.695) 0:05:34.489 ********** 2026-04-03 05:18:22.579077 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:22.579088 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:22.579099 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:22.579109 | orchestrator | 2026-04-03 05:18:22.579120 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-03 05:18:22.579131 | orchestrator | Friday 03 April 2026 05:18:16 +0000 (0:00:00.391) 0:05:34.880 ********** 2026-04-03 05:18:22.579142 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.579153 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.579163 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.579174 | orchestrator | 2026-04-03 05:18:22.579185 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-03 05:18:22.579196 | orchestrator | Friday 03 April 2026 05:18:20 +0000 (0:00:04.737) 0:05:39.618 ********** 2026-04-03 05:18:22.579207 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:22.579217 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:22.579228 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:22.579239 | orchestrator | 2026-04-03 05:18:22.579250 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:18:22.579262 | orchestrator | testbed-node-0 : ok=123  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-03 05:18:22.579275 | orchestrator | testbed-node-1 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-03 05:18:22.579286 | orchestrator | testbed-node-2 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-03 05:18:22.579296 | orchestrator | 2026-04-03 05:18:22.579315 | orchestrator | 2026-04-03 05:18:22.579326 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:18:22.579337 | orchestrator | Friday 03 April 2026 05:18:21 +0000 (0:00:00.820) 0:05:40.438 ********** 2026-04-03 05:18:22.579348 | orchestrator | =============================================================================== 2026-04-03 05:18:22.579359 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 15.10s 2026-04-03 05:18:22.579370 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 6.27s 2026-04-03 05:18:22.579381 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 5.13s 2026-04-03 05:18:22.579392 | orchestrator | loadbalancer : Wait for haproxy to listen on VIP ------------------------ 4.74s 2026-04-03 05:18:22.579402 | orchestrator | loadbalancer : Start backup haproxy container --------------------------- 4.44s 2026-04-03 05:18:22.579413 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 4.17s 2026-04-03 05:18:22.579424 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 4.16s 2026-04-03 05:18:22.579434 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 4.12s 2026-04-03 05:18:22.579445 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 4.07s 2026-04-03 05:18:22.579456 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 3.87s 2026-04-03 05:18:22.579467 | orchestrator | haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config --- 3.76s 2026-04-03 05:18:22.579477 | orchestrator | haproxy-config : Copying over placement haproxy config ------------------ 3.56s 2026-04-03 05:18:22.579488 | orchestrator | haproxy-config : Configuring firewall for glance ------------------------ 3.46s 2026-04-03 05:18:22.579499 | orchestrator | haproxy-config : Copying over designate haproxy config ------------------ 3.38s 2026-04-03 05:18:22.579510 | orchestrator | haproxy-config : Copying over octavia haproxy config -------------------- 3.35s 2026-04-03 05:18:22.579520 | orchestrator | haproxy-config : Copying over cinder haproxy config --------------------- 3.35s 2026-04-03 05:18:22.579531 | orchestrator | proxysql-config : Copying over nova-cell ProxySQL rules config ---------- 3.29s 2026-04-03 05:18:22.579542 | orchestrator | haproxy-config : Copying over barbican haproxy config ------------------- 3.25s 2026-04-03 05:18:22.579552 | orchestrator | haproxy-config : Copying over aodh haproxy config ----------------------- 3.24s 2026-04-03 05:18:22.579563 | orchestrator | service-cert-copy : loadbalancer | Copying over extra CA certificates --- 3.23s 2026-04-03 05:18:24.968524 | orchestrator | 2026-04-03 05:18:24 | INFO  | Task f6d02e3b-25e7-45c6-b7d0-208e1a798e93 (opensearch) was prepared for execution. 2026-04-03 05:18:24.968686 | orchestrator | 2026-04-03 05:18:24 | INFO  | It takes a moment until task f6d02e3b-25e7-45c6-b7d0-208e1a798e93 (opensearch) has been started and output is visible here. 2026-04-03 05:18:35.463617 | orchestrator | 2026-04-03 05:18:35.463732 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:18:35.463750 | orchestrator | 2026-04-03 05:18:35.463763 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:18:35.463775 | orchestrator | Friday 03 April 2026 05:18:29 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-03 05:18:35.463786 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:18:35.463798 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:18:35.463809 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:18:35.463820 | orchestrator | 2026-04-03 05:18:35.463832 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:18:35.463843 | orchestrator | Friday 03 April 2026 05:18:29 +0000 (0:00:00.321) 0:00:00.583 ********** 2026-04-03 05:18:35.463871 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-03 05:18:35.463883 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-03 05:18:35.463894 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-03 05:18:35.463905 | orchestrator | 2026-04-03 05:18:35.463916 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-03 05:18:35.463947 | orchestrator | 2026-04-03 05:18:35.463959 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 05:18:35.463970 | orchestrator | Friday 03 April 2026 05:18:29 +0000 (0:00:00.422) 0:00:01.005 ********** 2026-04-03 05:18:35.463981 | orchestrator | included: /ansible/roles/opensearch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:18:35.463993 | orchestrator | 2026-04-03 05:18:35.464004 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-03 05:18:35.464014 | orchestrator | Friday 03 April 2026 05:18:30 +0000 (0:00:00.493) 0:00:01.499 ********** 2026-04-03 05:18:35.464025 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 05:18:35.464036 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 05:18:35.464048 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 05:18:35.464059 | orchestrator | 2026-04-03 05:18:35.464070 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-03 05:18:35.464094 | orchestrator | Friday 03 April 2026 05:18:30 +0000 (0:00:00.645) 0:00:02.144 ********** 2026-04-03 05:18:35.464112 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:35.464130 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:35.464163 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:35.464186 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:35.464212 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:35.464227 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:35.464241 | orchestrator | 2026-04-03 05:18:35.464254 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 05:18:35.464265 | orchestrator | Friday 03 April 2026 05:18:32 +0000 (0:00:01.609) 0:00:03.754 ********** 2026-04-03 05:18:35.464277 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:18:35.464288 | orchestrator | 2026-04-03 05:18:35.464299 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-03 05:18:35.464310 | orchestrator | Friday 03 April 2026 05:18:33 +0000 (0:00:00.540) 0:00:04.294 ********** 2026-04-03 05:18:35.464335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:36.307239 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:36.307341 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:36.307360 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:36.307375 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:36.307445 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:36.307462 | orchestrator | 2026-04-03 05:18:36.307475 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-03 05:18:36.307487 | orchestrator | Friday 03 April 2026 05:18:35 +0000 (0:00:02.325) 0:00:06.620 ********** 2026-04-03 05:18:36.307500 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:36.307514 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:36.307526 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:36.307590 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:36.307627 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:37.304791 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:37.304882 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:37.304899 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:37.304911 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:37.304919 | orchestrator | 2026-04-03 05:18:37.304929 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-03 05:18:37.304940 | orchestrator | Friday 03 April 2026 05:18:36 +0000 (0:00:00.847) 0:00:07.467 ********** 2026-04-03 05:18:37.304972 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:37.304996 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:37.305021 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:18:37.305030 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:37.305040 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:37.305050 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:18:37.305064 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-03 05:18:37.305078 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-03 05:18:37.305088 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:18:37.305096 | orchestrator | 2026-04-03 05:18:37.305105 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-03 05:18:37.305119 | orchestrator | Friday 03 April 2026 05:18:37 +0000 (0:00:00.990) 0:00:08.458 ********** 2026-04-03 05:18:45.103141 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:45.103288 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:45.103305 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:45.103369 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:45.103406 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:45.103421 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:18:45.103441 | orchestrator | 2026-04-03 05:18:45.103456 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-03 05:18:45.103469 | orchestrator | Friday 03 April 2026 05:18:39 +0000 (0:00:02.255) 0:00:10.714 ********** 2026-04-03 05:18:45.103480 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:18:45.103493 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:18:45.103534 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:18:45.103550 | orchestrator | 2026-04-03 05:18:45.103569 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-03 05:18:45.103587 | orchestrator | Friday 03 April 2026 05:18:41 +0000 (0:00:02.249) 0:00:12.964 ********** 2026-04-03 05:18:45.103606 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:18:45.103624 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:18:45.103642 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:18:45.103660 | orchestrator | 2026-04-03 05:18:45.103679 | orchestrator | TASK [opensearch : Check opensearch containers] ******************************** 2026-04-03 05:18:45.103697 | orchestrator | Friday 03 April 2026 05:18:43 +0000 (0:00:01.709) 0:00:14.673 ********** 2026-04-03 05:18:45.103717 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:45.103749 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:18:45.103784 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-03 05:21:19.870407 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:21:19.870554 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:21:19.870600 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-03 05:21:19.870613 | orchestrator | 2026-04-03 05:21:19.870625 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 05:21:19.870636 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:01.585) 0:00:16.258 ********** 2026-04-03 05:21:19.870647 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:21:19.870657 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:21:19.870667 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:21:19.870677 | orchestrator | 2026-04-03 05:21:19.870688 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 05:21:19.870698 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:00.290) 0:00:16.549 ********** 2026-04-03 05:21:19.870708 | orchestrator | 2026-04-03 05:21:19.870718 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 05:21:19.870728 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:00.064) 0:00:16.613 ********** 2026-04-03 05:21:19.870738 | orchestrator | 2026-04-03 05:21:19.870747 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 05:21:19.870765 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:00.075) 0:00:16.689 ********** 2026-04-03 05:21:19.870775 | orchestrator | 2026-04-03 05:21:19.870784 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-03 05:21:19.870810 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:00.063) 0:00:16.753 ********** 2026-04-03 05:21:19.870820 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:21:19.870830 | orchestrator | 2026-04-03 05:21:19.870840 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-03 05:21:19.870850 | orchestrator | Friday 03 April 2026 05:18:45 +0000 (0:00:00.194) 0:00:16.947 ********** 2026-04-03 05:21:19.870859 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:21:19.870869 | orchestrator | 2026-04-03 05:21:19.870879 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-03 05:21:19.870889 | orchestrator | Friday 03 April 2026 05:18:46 +0000 (0:00:00.597) 0:00:17.544 ********** 2026-04-03 05:21:19.870899 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:19.870908 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:21:19.870918 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:21:19.870929 | orchestrator | 2026-04-03 05:21:19.870940 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-03 05:21:19.870951 | orchestrator | Friday 03 April 2026 05:19:52 +0000 (0:01:05.911) 0:01:23.456 ********** 2026-04-03 05:21:19.871029 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:19.871051 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:21:19.871067 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:21:19.871077 | orchestrator | 2026-04-03 05:21:19.871087 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 05:21:19.871097 | orchestrator | Friday 03 April 2026 05:21:09 +0000 (0:01:17.065) 0:02:40.521 ********** 2026-04-03 05:21:19.871107 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:21:19.871117 | orchestrator | 2026-04-03 05:21:19.871127 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-03 05:21:19.871137 | orchestrator | Friday 03 April 2026 05:21:09 +0000 (0:00:00.520) 0:02:41.042 ********** 2026-04-03 05:21:19.871147 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:21:19.871157 | orchestrator | 2026-04-03 05:21:19.871166 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-03 05:21:19.871176 | orchestrator | Friday 03 April 2026 05:21:12 +0000 (0:00:02.733) 0:02:43.775 ********** 2026-04-03 05:21:19.871186 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:21:19.871195 | orchestrator | 2026-04-03 05:21:19.871205 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-03 05:21:19.871215 | orchestrator | Friday 03 April 2026 05:21:14 +0000 (0:00:02.138) 0:02:45.913 ********** 2026-04-03 05:21:19.871225 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:19.871235 | orchestrator | 2026-04-03 05:21:19.871244 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-03 05:21:19.871254 | orchestrator | Friday 03 April 2026 05:21:17 +0000 (0:00:02.690) 0:02:48.603 ********** 2026-04-03 05:21:19.871264 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:19.871274 | orchestrator | 2026-04-03 05:21:19.871283 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:21:19.871295 | orchestrator | testbed-node-0 : ok=18  changed=11  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:21:19.871306 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 05:21:19.871323 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 05:21:19.871333 | orchestrator | 2026-04-03 05:21:19.871343 | orchestrator | 2026-04-03 05:21:19.871360 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:21:19.871370 | orchestrator | Friday 03 April 2026 05:21:19 +0000 (0:00:02.397) 0:02:51.001 ********** 2026-04-03 05:21:19.871381 | orchestrator | =============================================================================== 2026-04-03 05:21:19.871392 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 77.07s 2026-04-03 05:21:19.871403 | orchestrator | opensearch : Restart opensearch container ------------------------------ 65.91s 2026-04-03 05:21:19.871413 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 2.73s 2026-04-03 05:21:19.871424 | orchestrator | opensearch : Create new log retention policy ---------------------------- 2.69s 2026-04-03 05:21:19.871435 | orchestrator | opensearch : Apply retention policy to existing indices ----------------- 2.40s 2026-04-03 05:21:19.871446 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 2.33s 2026-04-03 05:21:19.871457 | orchestrator | opensearch : Copying over config.json files for services ---------------- 2.26s 2026-04-03 05:21:19.871467 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 2.25s 2026-04-03 05:21:19.871478 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 2.14s 2026-04-03 05:21:19.871489 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 1.71s 2026-04-03 05:21:19.871500 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 1.61s 2026-04-03 05:21:19.871511 | orchestrator | opensearch : Check opensearch containers -------------------------------- 1.59s 2026-04-03 05:21:19.871522 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 0.99s 2026-04-03 05:21:19.871533 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS certificate --- 0.85s 2026-04-03 05:21:19.871544 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 0.65s 2026-04-03 05:21:19.871555 | orchestrator | opensearch : Perform a flush -------------------------------------------- 0.60s 2026-04-03 05:21:19.871574 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.54s 2026-04-03 05:21:20.205160 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.52s 2026-04-03 05:21:20.205258 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.49s 2026-04-03 05:21:20.205273 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.42s 2026-04-03 05:21:22.560537 | orchestrator | 2026-04-03 05:21:22 | INFO  | Task 9eec7893-a7e5-464b-b8da-c70cdd1241bb (memcached) was prepared for execution. 2026-04-03 05:21:22.560621 | orchestrator | 2026-04-03 05:21:22 | INFO  | It takes a moment until task 9eec7893-a7e5-464b-b8da-c70cdd1241bb (memcached) has been started and output is visible here. 2026-04-03 05:21:34.328882 | orchestrator | 2026-04-03 05:21:34.329112 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:21:34.329131 | orchestrator | 2026-04-03 05:21:34.329144 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:21:34.329157 | orchestrator | Friday 03 April 2026 05:21:26 +0000 (0:00:00.257) 0:00:00.257 ********** 2026-04-03 05:21:34.329169 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:21:34.329181 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:21:34.329192 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:21:34.329249 | orchestrator | 2026-04-03 05:21:34.329263 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:21:34.329275 | orchestrator | Friday 03 April 2026 05:21:27 +0000 (0:00:00.300) 0:00:00.557 ********** 2026-04-03 05:21:34.329296 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-03 05:21:34.329312 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-03 05:21:34.329345 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-03 05:21:34.329363 | orchestrator | 2026-04-03 05:21:34.329381 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-03 05:21:34.329431 | orchestrator | 2026-04-03 05:21:34.329452 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-03 05:21:34.329471 | orchestrator | Friday 03 April 2026 05:21:27 +0000 (0:00:00.424) 0:00:00.982 ********** 2026-04-03 05:21:34.329491 | orchestrator | included: /ansible/roles/memcached/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:21:34.329512 | orchestrator | 2026-04-03 05:21:34.329532 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-03 05:21:34.329554 | orchestrator | Friday 03 April 2026 05:21:28 +0000 (0:00:00.499) 0:00:01.481 ********** 2026-04-03 05:21:34.329573 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-03 05:21:34.329593 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-03 05:21:34.329605 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-03 05:21:34.329616 | orchestrator | 2026-04-03 05:21:34.329627 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-03 05:21:34.329638 | orchestrator | Friday 03 April 2026 05:21:28 +0000 (0:00:00.643) 0:00:02.124 ********** 2026-04-03 05:21:34.329649 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-03 05:21:34.329660 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-03 05:21:34.329671 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-03 05:21:34.329682 | orchestrator | 2026-04-03 05:21:34.329693 | orchestrator | TASK [memcached : Check memcached container] *********************************** 2026-04-03 05:21:34.329704 | orchestrator | Friday 03 April 2026 05:21:30 +0000 (0:00:01.698) 0:00:03.823 ********** 2026-04-03 05:21:34.329730 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:21:34.329742 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:34.329753 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:21:34.329763 | orchestrator | 2026-04-03 05:21:34.329774 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-03 05:21:34.329785 | orchestrator | Friday 03 April 2026 05:21:31 +0000 (0:00:01.436) 0:00:05.259 ********** 2026-04-03 05:21:34.329796 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:21:34.329807 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:21:34.329818 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:21:34.329829 | orchestrator | 2026-04-03 05:21:34.329840 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:21:34.329852 | orchestrator | testbed-node-0 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:21:34.329864 | orchestrator | testbed-node-1 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:21:34.329875 | orchestrator | testbed-node-2 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:21:34.329886 | orchestrator | 2026-04-03 05:21:34.329897 | orchestrator | 2026-04-03 05:21:34.329908 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:21:34.329920 | orchestrator | Friday 03 April 2026 05:21:33 +0000 (0:00:02.068) 0:00:07.327 ********** 2026-04-03 05:21:34.329965 | orchestrator | =============================================================================== 2026-04-03 05:21:34.329977 | orchestrator | memcached : Restart memcached container --------------------------------- 2.07s 2026-04-03 05:21:34.329988 | orchestrator | memcached : Copying over config.json files for services ----------------- 1.70s 2026-04-03 05:21:34.330000 | orchestrator | memcached : Check memcached container ----------------------------------- 1.44s 2026-04-03 05:21:34.330011 | orchestrator | memcached : Ensuring config directories exist --------------------------- 0.64s 2026-04-03 05:21:34.330079 | orchestrator | memcached : include_tasks ----------------------------------------------- 0.50s 2026-04-03 05:21:34.330091 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.42s 2026-04-03 05:21:34.330102 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.30s 2026-04-03 05:21:36.710347 | orchestrator | 2026-04-03 05:21:36 | INFO  | Task ee8f912e-c689-4da3-a2f7-7108045bcc84 (redis) was prepared for execution. 2026-04-03 05:21:36.710445 | orchestrator | 2026-04-03 05:21:36 | INFO  | It takes a moment until task ee8f912e-c689-4da3-a2f7-7108045bcc84 (redis) has been started and output is visible here. 2026-04-03 05:21:45.556452 | orchestrator | 2026-04-03 05:21:45.556574 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:21:45.556589 | orchestrator | 2026-04-03 05:21:45.556600 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:21:45.556611 | orchestrator | Friday 03 April 2026 05:21:40 +0000 (0:00:00.248) 0:00:00.248 ********** 2026-04-03 05:21:45.556622 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:21:45.556640 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:21:45.556671 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:21:45.556696 | orchestrator | 2026-04-03 05:21:45.556712 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:21:45.556728 | orchestrator | Friday 03 April 2026 05:21:41 +0000 (0:00:00.308) 0:00:00.557 ********** 2026-04-03 05:21:45.556744 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-03 05:21:45.556759 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-03 05:21:45.556774 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-03 05:21:45.556791 | orchestrator | 2026-04-03 05:21:45.556807 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-03 05:21:45.556823 | orchestrator | 2026-04-03 05:21:45.556838 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-03 05:21:45.556855 | orchestrator | Friday 03 April 2026 05:21:41 +0000 (0:00:00.424) 0:00:00.982 ********** 2026-04-03 05:21:45.556871 | orchestrator | included: /ansible/roles/redis/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:21:45.556931 | orchestrator | 2026-04-03 05:21:45.556945 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-03 05:21:45.556955 | orchestrator | Friday 03 April 2026 05:21:42 +0000 (0:00:00.490) 0:00:01.472 ********** 2026-04-03 05:21:45.556968 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.556985 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.556997 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557035 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557068 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557081 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557093 | orchestrator | 2026-04-03 05:21:45.557105 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-03 05:21:45.557116 | orchestrator | Friday 03 April 2026 05:21:43 +0000 (0:00:01.030) 0:00:02.503 ********** 2026-04-03 05:21:45.557128 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557256 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557283 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557307 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:45.557330 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524650 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524756 | orchestrator | 2026-04-03 05:21:49.524773 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-03 05:21:49.524786 | orchestrator | Friday 03 April 2026 05:21:45 +0000 (0:00:02.459) 0:00:04.963 ********** 2026-04-03 05:21:49.524800 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524829 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524842 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524876 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524935 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524966 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.524979 | orchestrator | 2026-04-03 05:21:49.524990 | orchestrator | TASK [redis : Check redis containers] ****************************************** 2026-04-03 05:21:49.525002 | orchestrator | Friday 03 April 2026 05:21:47 +0000 (0:00:02.346) 0:00:07.310 ********** 2026-04-03 05:21:49.525014 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.525026 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.525043 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.525064 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.525076 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:21:49.525096 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 05:22:00.798732 | orchestrator | 2026-04-03 05:22:00.798847 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 05:22:00.798918 | orchestrator | Friday 03 April 2026 05:21:49 +0000 (0:00:01.407) 0:00:08.717 ********** 2026-04-03 05:22:00.798931 | orchestrator | 2026-04-03 05:22:00.798942 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 05:22:00.798954 | orchestrator | Friday 03 April 2026 05:21:49 +0000 (0:00:00.077) 0:00:08.794 ********** 2026-04-03 05:22:00.798965 | orchestrator | 2026-04-03 05:22:00.798977 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 05:22:00.798988 | orchestrator | Friday 03 April 2026 05:21:49 +0000 (0:00:00.064) 0:00:08.859 ********** 2026-04-03 05:22:00.798999 | orchestrator | 2026-04-03 05:22:00.799010 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-03 05:22:00.799022 | orchestrator | Friday 03 April 2026 05:21:49 +0000 (0:00:00.066) 0:00:08.926 ********** 2026-04-03 05:22:00.799033 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:00.799045 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:22:00.799068 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:22:00.799080 | orchestrator | 2026-04-03 05:22:00.799091 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-03 05:22:00.799102 | orchestrator | Friday 03 April 2026 05:21:52 +0000 (0:00:02.842) 0:00:11.768 ********** 2026-04-03 05:22:00.799140 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:00.799151 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:22:00.799162 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:22:00.799173 | orchestrator | 2026-04-03 05:22:00.799185 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:22:00.799196 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:22:00.799209 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:22:00.799236 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:22:00.799247 | orchestrator | 2026-04-03 05:22:00.799258 | orchestrator | 2026-04-03 05:22:00.799269 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:22:00.799280 | orchestrator | Friday 03 April 2026 05:22:00 +0000 (0:00:08.100) 0:00:19.868 ********** 2026-04-03 05:22:00.799291 | orchestrator | =============================================================================== 2026-04-03 05:22:00.799302 | orchestrator | redis : Restart redis-sentinel container -------------------------------- 8.10s 2026-04-03 05:22:00.799313 | orchestrator | redis : Restart redis container ----------------------------------------- 2.84s 2026-04-03 05:22:00.799323 | orchestrator | redis : Copying over default config.json files -------------------------- 2.46s 2026-04-03 05:22:00.799334 | orchestrator | redis : Copying over redis config files --------------------------------- 2.35s 2026-04-03 05:22:00.799345 | orchestrator | redis : Check redis containers ------------------------------------------ 1.41s 2026-04-03 05:22:00.799356 | orchestrator | redis : Ensuring config directories exist ------------------------------- 1.03s 2026-04-03 05:22:00.799366 | orchestrator | redis : include_tasks --------------------------------------------------- 0.49s 2026-04-03 05:22:00.799377 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.42s 2026-04-03 05:22:00.799388 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.31s 2026-04-03 05:22:00.799399 | orchestrator | redis : Flush handlers -------------------------------------------------- 0.21s 2026-04-03 05:22:03.141755 | orchestrator | 2026-04-03 05:22:03 | INFO  | Task cf1cc7b6-8235-4805-bb45-bdea7ee529c2 (mariadb) was prepared for execution. 2026-04-03 05:22:03.141900 | orchestrator | 2026-04-03 05:22:03 | INFO  | It takes a moment until task cf1cc7b6-8235-4805-bb45-bdea7ee529c2 (mariadb) has been started and output is visible here. 2026-04-03 05:22:16.661950 | orchestrator | 2026-04-03 05:22:16.662117 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:22:16.662136 | orchestrator | 2026-04-03 05:22:16.662148 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:22:16.662160 | orchestrator | Friday 03 April 2026 05:22:07 +0000 (0:00:00.166) 0:00:00.166 ********** 2026-04-03 05:22:16.662172 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:22:16.662184 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:22:16.662196 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:22:16.662215 | orchestrator | 2026-04-03 05:22:16.662232 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:22:16.662252 | orchestrator | Friday 03 April 2026 05:22:07 +0000 (0:00:00.307) 0:00:00.473 ********** 2026-04-03 05:22:16.662271 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-03 05:22:16.662291 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-03 05:22:16.662309 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-03 05:22:16.662320 | orchestrator | 2026-04-03 05:22:16.662332 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-03 05:22:16.662343 | orchestrator | 2026-04-03 05:22:16.662354 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-03 05:22:16.662390 | orchestrator | Friday 03 April 2026 05:22:08 +0000 (0:00:00.543) 0:00:01.016 ********** 2026-04-03 05:22:16.662404 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 05:22:16.662428 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 05:22:16.662455 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 05:22:16.662473 | orchestrator | 2026-04-03 05:22:16.662492 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 05:22:16.662509 | orchestrator | Friday 03 April 2026 05:22:08 +0000 (0:00:00.367) 0:00:01.383 ********** 2026-04-03 05:22:16.662528 | orchestrator | included: /ansible/roles/mariadb/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:22:16.662547 | orchestrator | 2026-04-03 05:22:16.662565 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-03 05:22:16.662584 | orchestrator | Friday 03 April 2026 05:22:09 +0000 (0:00:00.533) 0:00:01.917 ********** 2026-04-03 05:22:16.662630 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:16.662687 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:16.662735 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:16.662757 | orchestrator | 2026-04-03 05:22:16.662776 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-03 05:22:16.662796 | orchestrator | Friday 03 April 2026 05:22:11 +0000 (0:00:02.559) 0:00:04.477 ********** 2026-04-03 05:22:16.662886 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:16.662903 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:16.662914 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:16.662925 | orchestrator | 2026-04-03 05:22:16.662936 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-03 05:22:16.662947 | orchestrator | Friday 03 April 2026 05:22:12 +0000 (0:00:00.611) 0:00:05.089 ********** 2026-04-03 05:22:16.662958 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:16.662969 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:16.662985 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:16.663003 | orchestrator | 2026-04-03 05:22:16.663031 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-03 05:22:16.663054 | orchestrator | Friday 03 April 2026 05:22:13 +0000 (0:00:01.382) 0:00:06.471 ********** 2026-04-03 05:22:16.663089 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:24.102770 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:24.102924 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:24.102966 | orchestrator | 2026-04-03 05:22:24.102982 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-03 05:22:24.102996 | orchestrator | Friday 03 April 2026 05:22:16 +0000 (0:00:03.026) 0:00:09.497 ********** 2026-04-03 05:22:24.103008 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:24.103021 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:24.103032 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:24.103043 | orchestrator | 2026-04-03 05:22:24.103055 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-03 05:22:24.103083 | orchestrator | Friday 03 April 2026 05:22:17 +0000 (0:00:01.018) 0:00:10.516 ********** 2026-04-03 05:22:24.103095 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:22:24.103106 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:22:24.103117 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:22:24.103128 | orchestrator | 2026-04-03 05:22:24.103140 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 05:22:24.103152 | orchestrator | Friday 03 April 2026 05:22:21 +0000 (0:00:03.674) 0:00:14.190 ********** 2026-04-03 05:22:24.103171 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:22:24.103190 | orchestrator | 2026-04-03 05:22:24.103201 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-03 05:22:24.103212 | orchestrator | Friday 03 April 2026 05:22:21 +0000 (0:00:00.563) 0:00:14.754 ********** 2026-04-03 05:22:24.103231 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:24.103254 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:22:24.103276 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:29.027283 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:29.027416 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:29.027461 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:29.027476 | orchestrator | 2026-04-03 05:22:29.027489 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-03 05:22:29.027502 | orchestrator | Friday 03 April 2026 05:22:24 +0000 (0:00:02.185) 0:00:16.940 ********** 2026-04-03 05:22:29.027515 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:29.027527 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:22:29.027568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:29.027601 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:29.027619 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:29.027638 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:29.027656 | orchestrator | 2026-04-03 05:22:29.027677 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-03 05:22:29.027700 | orchestrator | Friday 03 April 2026 05:22:26 +0000 (0:00:02.638) 0:00:19.578 ********** 2026-04-03 05:22:29.027739 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:31.750960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:31.751062 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:22:31.751077 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:22:31.751107 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 05:22:31.751139 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:22:31.751149 | orchestrator | 2026-04-03 05:22:31.751160 | orchestrator | TASK [mariadb : Check mariadb containers] ************************************** 2026-04-03 05:22:31.751173 | orchestrator | Friday 03 April 2026 05:22:29 +0000 (0:00:02.289) 0:00:21.868 ********** 2026-04-03 05:22:31.751200 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:31.751211 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:22:31.751232 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 05:24:43.723750 | orchestrator | 2026-04-03 05:24:43.723865 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-03 05:24:43.723883 | orchestrator | Friday 03 April 2026 05:22:31 +0000 (0:00:02.723) 0:00:24.592 ********** 2026-04-03 05:24:43.723895 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:43.723908 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:24:43.723918 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:24:43.723930 | orchestrator | 2026-04-03 05:24:43.723941 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-03 05:24:43.723952 | orchestrator | Friday 03 April 2026 05:22:32 +0000 (0:00:00.800) 0:00:25.392 ********** 2026-04-03 05:24:43.723963 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.723975 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.723986 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.723997 | orchestrator | 2026-04-03 05:24:43.724008 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-03 05:24:43.724019 | orchestrator | Friday 03 April 2026 05:22:33 +0000 (0:00:00.520) 0:00:25.912 ********** 2026-04-03 05:24:43.724030 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.724041 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.724051 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.724062 | orchestrator | 2026-04-03 05:24:43.724073 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-03 05:24:43.724084 | orchestrator | Friday 03 April 2026 05:22:33 +0000 (0:00:00.313) 0:00:26.226 ********** 2026-04-03 05:24:43.724096 | orchestrator | fatal: [testbed-node-0]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.10:3306"} 2026-04-03 05:24:43.724109 | orchestrator | ...ignoring 2026-04-03 05:24:43.724120 | orchestrator | fatal: [testbed-node-1]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.11:3306"} 2026-04-03 05:24:43.724131 | orchestrator | ...ignoring 2026-04-03 05:24:43.724142 | orchestrator | fatal: [testbed-node-2]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.12:3306"} 2026-04-03 05:24:43.724153 | orchestrator | ...ignoring 2026-04-03 05:24:43.724185 | orchestrator | 2026-04-03 05:24:43.724197 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-03 05:24:43.724208 | orchestrator | Friday 03 April 2026 05:22:44 +0000 (0:00:10.828) 0:00:37.054 ********** 2026-04-03 05:24:43.724219 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.724230 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.724241 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.724252 | orchestrator | 2026-04-03 05:24:43.724263 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-03 05:24:43.724274 | orchestrator | Friday 03 April 2026 05:22:44 +0000 (0:00:00.443) 0:00:37.498 ********** 2026-04-03 05:24:43.724287 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.724299 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724311 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724323 | orchestrator | 2026-04-03 05:24:43.724336 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-03 05:24:43.724348 | orchestrator | Friday 03 April 2026 05:22:45 +0000 (0:00:00.620) 0:00:38.118 ********** 2026-04-03 05:24:43.724360 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.724373 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724385 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724397 | orchestrator | 2026-04-03 05:24:43.724423 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-03 05:24:43.724437 | orchestrator | Friday 03 April 2026 05:22:45 +0000 (0:00:00.441) 0:00:38.560 ********** 2026-04-03 05:24:43.724449 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.724462 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724474 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724516 | orchestrator | 2026-04-03 05:24:43.724530 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-03 05:24:43.724543 | orchestrator | Friday 03 April 2026 05:22:46 +0000 (0:00:00.442) 0:00:39.003 ********** 2026-04-03 05:24:43.724555 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.724567 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.724579 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.724591 | orchestrator | 2026-04-03 05:24:43.724603 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-03 05:24:43.724617 | orchestrator | Friday 03 April 2026 05:22:46 +0000 (0:00:00.404) 0:00:39.407 ********** 2026-04-03 05:24:43.724630 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.724642 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724653 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724664 | orchestrator | 2026-04-03 05:24:43.724675 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 05:24:43.724686 | orchestrator | Friday 03 April 2026 05:22:47 +0000 (0:00:00.854) 0:00:40.262 ********** 2026-04-03 05:24:43.724697 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724708 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724719 | orchestrator | included: /ansible/roles/mariadb/tasks/bootstrap_cluster.yml for testbed-node-0 2026-04-03 05:24:43.724730 | orchestrator | 2026-04-03 05:24:43.724741 | orchestrator | TASK [mariadb : Running MariaDB bootstrap container] *************************** 2026-04-03 05:24:43.724752 | orchestrator | Friday 03 April 2026 05:22:47 +0000 (0:00:00.391) 0:00:40.653 ********** 2026-04-03 05:24:43.724763 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:43.724774 | orchestrator | 2026-04-03 05:24:43.724785 | orchestrator | TASK [mariadb : Store bootstrap host name into facts] ************************** 2026-04-03 05:24:43.724796 | orchestrator | Friday 03 April 2026 05:22:57 +0000 (0:00:09.810) 0:00:50.464 ********** 2026-04-03 05:24:43.724807 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.724818 | orchestrator | 2026-04-03 05:24:43.724829 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 05:24:43.724841 | orchestrator | Friday 03 April 2026 05:22:57 +0000 (0:00:00.129) 0:00:50.593 ********** 2026-04-03 05:24:43.724852 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.724889 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.724901 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.724912 | orchestrator | 2026-04-03 05:24:43.724923 | orchestrator | RUNNING HANDLER [mariadb : Starting first MariaDB container] ******************* 2026-04-03 05:24:43.724934 | orchestrator | Friday 03 April 2026 05:22:58 +0000 (0:00:00.983) 0:00:51.577 ********** 2026-04-03 05:24:43.724945 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:43.724956 | orchestrator | 2026-04-03 05:24:43.724967 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service port liveness] ******* 2026-04-03 05:24:43.724978 | orchestrator | Friday 03 April 2026 05:23:06 +0000 (0:00:07.441) 0:00:59.019 ********** 2026-04-03 05:24:43.724989 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.725000 | orchestrator | 2026-04-03 05:24:43.725011 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service to sync WSREP] ******* 2026-04-03 05:24:43.725022 | orchestrator | Friday 03 April 2026 05:23:07 +0000 (0:00:01.550) 0:01:00.569 ********** 2026-04-03 05:24:43.725033 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.725043 | orchestrator | 2026-04-03 05:24:43.725054 | orchestrator | RUNNING HANDLER [mariadb : Ensure MariaDB is running normally on bootstrap host] *** 2026-04-03 05:24:43.725065 | orchestrator | Friday 03 April 2026 05:23:10 +0000 (0:00:02.459) 0:01:03.029 ********** 2026-04-03 05:24:43.725076 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:43.725087 | orchestrator | 2026-04-03 05:24:43.725098 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-03 05:24:43.725109 | orchestrator | Friday 03 April 2026 05:23:10 +0000 (0:00:00.127) 0:01:03.156 ********** 2026-04-03 05:24:43.725120 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.725131 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:43.725142 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:43.725152 | orchestrator | 2026-04-03 05:24:43.725163 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-03 05:24:43.725174 | orchestrator | Friday 03 April 2026 05:23:10 +0000 (0:00:00.298) 0:01:03.455 ********** 2026-04-03 05:24:43.725185 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:43.725196 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-03 05:24:43.725207 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:24:43.725218 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:24:43.725228 | orchestrator | 2026-04-03 05:24:43.725239 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 05:24:43.725250 | orchestrator | skipping: no hosts matched 2026-04-03 05:24:43.725261 | orchestrator | 2026-04-03 05:24:43.725272 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-03 05:24:43.725283 | orchestrator | 2026-04-03 05:24:43.725294 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 05:24:43.725305 | orchestrator | Friday 03 April 2026 05:23:11 +0000 (0:00:00.554) 0:01:04.009 ********** 2026-04-03 05:24:43.725316 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:24:43.725327 | orchestrator | 2026-04-03 05:24:43.725338 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 05:24:43.725349 | orchestrator | Friday 03 April 2026 05:23:28 +0000 (0:00:17.633) 0:01:21.643 ********** 2026-04-03 05:24:43.725360 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.725371 | orchestrator | 2026-04-03 05:24:43.725382 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 05:24:43.725392 | orchestrator | Friday 03 April 2026 05:23:44 +0000 (0:00:15.593) 0:01:37.237 ********** 2026-04-03 05:24:43.725403 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:43.725414 | orchestrator | 2026-04-03 05:24:43.725429 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-03 05:24:43.725440 | orchestrator | 2026-04-03 05:24:43.725457 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 05:24:43.725468 | orchestrator | Friday 03 April 2026 05:23:46 +0000 (0:00:02.358) 0:01:39.595 ********** 2026-04-03 05:24:43.725529 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:24:43.725548 | orchestrator | 2026-04-03 05:24:43.725566 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 05:24:43.725585 | orchestrator | Friday 03 April 2026 05:24:04 +0000 (0:00:17.520) 0:01:57.116 ********** 2026-04-03 05:24:43.725605 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.725623 | orchestrator | 2026-04-03 05:24:43.725639 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 05:24:43.725698 | orchestrator | Friday 03 April 2026 05:24:20 +0000 (0:00:16.576) 0:02:13.692 ********** 2026-04-03 05:24:43.725711 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:43.725722 | orchestrator | 2026-04-03 05:24:43.725733 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-03 05:24:43.725744 | orchestrator | 2026-04-03 05:24:43.725755 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 05:24:43.725766 | orchestrator | Friday 03 April 2026 05:24:23 +0000 (0:00:02.513) 0:02:16.206 ********** 2026-04-03 05:24:43.725776 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:43.725787 | orchestrator | 2026-04-03 05:24:43.725798 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 05:24:43.725809 | orchestrator | Friday 03 April 2026 05:24:36 +0000 (0:00:12.652) 0:02:28.858 ********** 2026-04-03 05:24:43.725820 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.725831 | orchestrator | 2026-04-03 05:24:43.725842 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 05:24:43.725853 | orchestrator | Friday 03 April 2026 05:24:40 +0000 (0:00:04.555) 0:02:33.414 ********** 2026-04-03 05:24:43.725864 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:43.725874 | orchestrator | 2026-04-03 05:24:43.725885 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-03 05:24:43.725896 | orchestrator | 2026-04-03 05:24:43.725907 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-03 05:24:43.725918 | orchestrator | Friday 03 April 2026 05:24:43 +0000 (0:00:02.439) 0:02:35.854 ********** 2026-04-03 05:24:43.725929 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:24:43.725940 | orchestrator | 2026-04-03 05:24:43.725951 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-03 05:24:43.725972 | orchestrator | Friday 03 April 2026 05:24:43 +0000 (0:00:00.702) 0:02:36.556 ********** 2026-04-03 05:24:56.054359 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:56.054509 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:56.054525 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:56.054536 | orchestrator | 2026-04-03 05:24:56.054547 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-03 05:24:56.054559 | orchestrator | Friday 03 April 2026 05:24:45 +0000 (0:00:02.212) 0:02:38.769 ********** 2026-04-03 05:24:56.054569 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:56.054579 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:56.054589 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:56.054598 | orchestrator | 2026-04-03 05:24:56.054608 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-03 05:24:56.054618 | orchestrator | Friday 03 April 2026 05:24:48 +0000 (0:00:02.146) 0:02:40.915 ********** 2026-04-03 05:24:56.054628 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:56.054638 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:56.054648 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:56.054657 | orchestrator | 2026-04-03 05:24:56.054667 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-03 05:24:56.054677 | orchestrator | Friday 03 April 2026 05:24:50 +0000 (0:00:02.300) 0:02:43.216 ********** 2026-04-03 05:24:56.054687 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:56.054697 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:56.054706 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:24:56.054716 | orchestrator | 2026-04-03 05:24:56.054749 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-03 05:24:56.054760 | orchestrator | Friday 03 April 2026 05:24:52 +0000 (0:00:02.006) 0:02:45.222 ********** 2026-04-03 05:24:56.054770 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:24:56.054780 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:24:56.054790 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:24:56.054799 | orchestrator | 2026-04-03 05:24:56.054809 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-03 05:24:56.054819 | orchestrator | Friday 03 April 2026 05:24:55 +0000 (0:00:02.863) 0:02:48.085 ********** 2026-04-03 05:24:56.054829 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:24:56.054838 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:24:56.054848 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:24:56.054858 | orchestrator | 2026-04-03 05:24:56.054867 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:24:56.054878 | orchestrator | testbed-node-0 : ok=34  changed=16  unreachable=0 failed=0 skipped=11  rescued=0 ignored=1  2026-04-03 05:24:56.054890 | orchestrator | testbed-node-1 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-03 05:24:56.054900 | orchestrator | testbed-node-2 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-03 05:24:56.054910 | orchestrator | 2026-04-03 05:24:56.054922 | orchestrator | 2026-04-03 05:24:56.054934 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:24:56.054946 | orchestrator | Friday 03 April 2026 05:24:55 +0000 (0:00:00.453) 0:02:48.539 ********** 2026-04-03 05:24:56.054957 | orchestrator | =============================================================================== 2026-04-03 05:24:56.054982 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 35.15s 2026-04-03 05:24:56.054993 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 32.17s 2026-04-03 05:24:56.055005 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 12.65s 2026-04-03 05:24:56.055016 | orchestrator | mariadb : Check MariaDB service port liveness -------------------------- 10.83s 2026-04-03 05:24:56.055027 | orchestrator | mariadb : Running MariaDB bootstrap container --------------------------- 9.81s 2026-04-03 05:24:56.055038 | orchestrator | mariadb : Starting first MariaDB container ------------------------------ 7.44s 2026-04-03 05:24:56.055050 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 4.87s 2026-04-03 05:24:56.055061 | orchestrator | mariadb : Wait for MariaDB service port liveness ------------------------ 4.56s 2026-04-03 05:24:56.055072 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 3.67s 2026-04-03 05:24:56.055084 | orchestrator | mariadb : Copying over config.json files for services ------------------- 3.03s 2026-04-03 05:24:56.055095 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 2.86s 2026-04-03 05:24:56.055106 | orchestrator | mariadb : Check mariadb containers -------------------------------------- 2.72s 2026-04-03 05:24:56.055117 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 2.64s 2026-04-03 05:24:56.055130 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 2.56s 2026-04-03 05:24:56.055142 | orchestrator | mariadb : Wait for first MariaDB service to sync WSREP ------------------ 2.46s 2026-04-03 05:24:56.055153 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 2.44s 2026-04-03 05:24:56.055164 | orchestrator | mariadb : Creating database backup user and setting permissions --------- 2.30s 2026-04-03 05:24:56.055175 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 2.29s 2026-04-03 05:24:56.055186 | orchestrator | mariadb : Creating shard root mysql user -------------------------------- 2.21s 2026-04-03 05:24:56.055198 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 2.19s 2026-04-03 05:24:58.439870 | orchestrator | 2026-04-03 05:24:58 | INFO  | Task 58c76efa-3f4c-4566-a79f-de1e024222d9 (rabbitmq) was prepared for execution. 2026-04-03 05:24:58.439943 | orchestrator | 2026-04-03 05:24:58 | INFO  | It takes a moment until task 58c76efa-3f4c-4566-a79f-de1e024222d9 (rabbitmq) has been started and output is visible here. 2026-04-03 05:25:11.098996 | orchestrator | 2026-04-03 05:25:11.099112 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:25:11.099129 | orchestrator | 2026-04-03 05:25:11.099142 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:25:11.099154 | orchestrator | Friday 03 April 2026 05:25:02 +0000 (0:00:00.170) 0:00:00.170 ********** 2026-04-03 05:25:11.099165 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:25:11.099177 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:25:11.099188 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:25:11.099199 | orchestrator | 2026-04-03 05:25:11.099210 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:25:11.099221 | orchestrator | Friday 03 April 2026 05:25:02 +0000 (0:00:00.339) 0:00:00.509 ********** 2026-04-03 05:25:11.099232 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-03 05:25:11.099243 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-03 05:25:11.099254 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-03 05:25:11.099265 | orchestrator | 2026-04-03 05:25:11.099276 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-03 05:25:11.099288 | orchestrator | 2026-04-03 05:25:11.099299 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 05:25:11.099310 | orchestrator | Friday 03 April 2026 05:25:03 +0000 (0:00:00.541) 0:00:01.051 ********** 2026-04-03 05:25:11.099322 | orchestrator | included: /ansible/roles/rabbitmq/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:25:11.099333 | orchestrator | 2026-04-03 05:25:11.099345 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-03 05:25:11.099356 | orchestrator | Friday 03 April 2026 05:25:03 +0000 (0:00:00.526) 0:00:01.578 ********** 2026-04-03 05:25:11.099366 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:25:11.099377 | orchestrator | 2026-04-03 05:25:11.099388 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-03 05:25:11.099399 | orchestrator | Friday 03 April 2026 05:25:04 +0000 (0:00:00.939) 0:00:02.517 ********** 2026-04-03 05:25:11.099410 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099422 | orchestrator | 2026-04-03 05:25:11.099462 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-03 05:25:11.099475 | orchestrator | Friday 03 April 2026 05:25:05 +0000 (0:00:00.394) 0:00:02.912 ********** 2026-04-03 05:25:11.099487 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099500 | orchestrator | 2026-04-03 05:25:11.099515 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-03 05:25:11.099527 | orchestrator | Friday 03 April 2026 05:25:05 +0000 (0:00:00.378) 0:00:03.290 ********** 2026-04-03 05:25:11.099541 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099554 | orchestrator | 2026-04-03 05:25:11.099567 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-03 05:25:11.099581 | orchestrator | Friday 03 April 2026 05:25:06 +0000 (0:00:00.358) 0:00:03.649 ********** 2026-04-03 05:25:11.099593 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099606 | orchestrator | 2026-04-03 05:25:11.099619 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 05:25:11.099632 | orchestrator | Friday 03 April 2026 05:25:06 +0000 (0:00:00.580) 0:00:04.229 ********** 2026-04-03 05:25:11.099661 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:25:11.099698 | orchestrator | 2026-04-03 05:25:11.099711 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-03 05:25:11.099724 | orchestrator | Friday 03 April 2026 05:25:07 +0000 (0:00:00.858) 0:00:05.088 ********** 2026-04-03 05:25:11.099737 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:25:11.099750 | orchestrator | 2026-04-03 05:25:11.099763 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-03 05:25:11.099776 | orchestrator | Friday 03 April 2026 05:25:08 +0000 (0:00:00.799) 0:00:05.888 ********** 2026-04-03 05:25:11.099789 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099801 | orchestrator | 2026-04-03 05:25:11.099814 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-03 05:25:11.099828 | orchestrator | Friday 03 April 2026 05:25:08 +0000 (0:00:00.331) 0:00:06.219 ********** 2026-04-03 05:25:11.099841 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:11.099852 | orchestrator | 2026-04-03 05:25:11.099863 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-03 05:25:11.099874 | orchestrator | Friday 03 April 2026 05:25:08 +0000 (0:00:00.330) 0:00:06.550 ********** 2026-04-03 05:25:11.099911 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:11.099929 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:11.099943 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:11.099963 | orchestrator | 2026-04-03 05:25:11.099980 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-03 05:25:11.099991 | orchestrator | Friday 03 April 2026 05:25:09 +0000 (0:00:00.723) 0:00:07.273 ********** 2026-04-03 05:25:11.100003 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:11.100026 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:28.689247 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:28.689389 | orchestrator | 2026-04-03 05:25:28.689470 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-03 05:25:28.689493 | orchestrator | Friday 03 April 2026 05:25:11 +0000 (0:00:01.423) 0:00:08.697 ********** 2026-04-03 05:25:28.689542 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 05:25:28.689563 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 05:25:28.689582 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 05:25:28.689602 | orchestrator | 2026-04-03 05:25:28.689621 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-03 05:25:28.689641 | orchestrator | Friday 03 April 2026 05:25:12 +0000 (0:00:01.394) 0:00:10.092 ********** 2026-04-03 05:25:28.689676 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 05:25:28.689697 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 05:25:28.689716 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 05:25:28.689735 | orchestrator | 2026-04-03 05:25:28.689754 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-03 05:25:28.689773 | orchestrator | Friday 03 April 2026 05:25:14 +0000 (0:00:01.629) 0:00:11.721 ********** 2026-04-03 05:25:28.689793 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 05:25:28.689812 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 05:25:28.689832 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 05:25:28.689852 | orchestrator | 2026-04-03 05:25:28.689871 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-03 05:25:28.689890 | orchestrator | Friday 03 April 2026 05:25:15 +0000 (0:00:01.302) 0:00:13.024 ********** 2026-04-03 05:25:28.689909 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 05:25:28.689929 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 05:25:28.689949 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 05:25:28.689969 | orchestrator | 2026-04-03 05:25:28.689988 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-03 05:25:28.690008 | orchestrator | Friday 03 April 2026 05:25:16 +0000 (0:00:01.585) 0:00:14.610 ********** 2026-04-03 05:25:28.690097 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 05:25:28.690118 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 05:25:28.690138 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 05:25:28.690158 | orchestrator | 2026-04-03 05:25:28.690178 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-03 05:25:28.690199 | orchestrator | Friday 03 April 2026 05:25:18 +0000 (0:00:01.368) 0:00:15.978 ********** 2026-04-03 05:25:28.690217 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 05:25:28.690236 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 05:25:28.690256 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 05:25:28.690276 | orchestrator | 2026-04-03 05:25:28.690296 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 05:25:28.690316 | orchestrator | Friday 03 April 2026 05:25:19 +0000 (0:00:01.312) 0:00:17.290 ********** 2026-04-03 05:25:28.690337 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:25:28.690359 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:25:28.690400 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:25:28.690462 | orchestrator | 2026-04-03 05:25:28.690482 | orchestrator | TASK [rabbitmq : Check rabbitmq containers] ************************************ 2026-04-03 05:25:28.690502 | orchestrator | Friday 03 April 2026 05:25:20 +0000 (0:00:00.411) 0:00:17.701 ********** 2026-04-03 05:25:28.690524 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:28.690555 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:28.690578 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 05:25:28.690599 | orchestrator | 2026-04-03 05:25:28.690619 | orchestrator | TASK [rabbitmq : Creating rabbitmq volume] ************************************* 2026-04-03 05:25:28.690638 | orchestrator | Friday 03 April 2026 05:25:21 +0000 (0:00:01.136) 0:00:18.838 ********** 2026-04-03 05:25:28.690657 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:25:28.690676 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:25:28.690695 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:25:28.690714 | orchestrator | 2026-04-03 05:25:28.690734 | orchestrator | TASK [rabbitmq : Running RabbitMQ bootstrap container] ************************* 2026-04-03 05:25:28.690762 | orchestrator | Friday 03 April 2026 05:25:22 +0000 (0:00:00.804) 0:00:19.643 ********** 2026-04-03 05:25:28.690782 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:25:28.690800 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:25:28.690818 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:25:28.690835 | orchestrator | 2026-04-03 05:25:28.690852 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-03 05:25:28.690880 | orchestrator | Friday 03 April 2026 05:25:28 +0000 (0:00:06.639) 0:00:26.282 ********** 2026-04-03 05:26:58.857432 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:26:58.857527 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:26:58.857536 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:26:58.857544 | orchestrator | 2026-04-03 05:26:58.857551 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 05:26:58.857559 | orchestrator | 2026-04-03 05:26:58.857566 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 05:26:58.857572 | orchestrator | Friday 03 April 2026 05:25:29 +0000 (0:00:00.498) 0:00:26.781 ********** 2026-04-03 05:26:58.857579 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:26:58.857586 | orchestrator | 2026-04-03 05:26:58.857592 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 05:26:58.857598 | orchestrator | Friday 03 April 2026 05:25:29 +0000 (0:00:00.589) 0:00:27.370 ********** 2026-04-03 05:26:58.857605 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:26:58.857611 | orchestrator | 2026-04-03 05:26:58.857617 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 05:26:58.857624 | orchestrator | Friday 03 April 2026 05:25:30 +0000 (0:00:00.247) 0:00:27.618 ********** 2026-04-03 05:26:58.857630 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:26:58.857636 | orchestrator | 2026-04-03 05:26:58.857642 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 05:26:58.857648 | orchestrator | Friday 03 April 2026 05:25:31 +0000 (0:00:01.562) 0:00:29.180 ********** 2026-04-03 05:26:58.857655 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:26:58.857661 | orchestrator | 2026-04-03 05:26:58.857668 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 05:26:58.857674 | orchestrator | 2026-04-03 05:26:58.857680 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 05:26:58.857686 | orchestrator | Friday 03 April 2026 05:26:25 +0000 (0:00:53.512) 0:01:22.692 ********** 2026-04-03 05:26:58.857693 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:26:58.857699 | orchestrator | 2026-04-03 05:26:58.857705 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 05:26:58.857711 | orchestrator | Friday 03 April 2026 05:26:25 +0000 (0:00:00.608) 0:01:23.301 ********** 2026-04-03 05:26:58.857717 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:26:58.857724 | orchestrator | 2026-04-03 05:26:58.857730 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 05:26:58.857736 | orchestrator | Friday 03 April 2026 05:26:25 +0000 (0:00:00.243) 0:01:23.544 ********** 2026-04-03 05:26:58.857743 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:26:58.857749 | orchestrator | 2026-04-03 05:26:58.857776 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 05:26:58.857796 | orchestrator | Friday 03 April 2026 05:26:27 +0000 (0:00:01.534) 0:01:25.079 ********** 2026-04-03 05:26:58.857802 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:26:58.857809 | orchestrator | 2026-04-03 05:26:58.857815 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 05:26:58.857822 | orchestrator | 2026-04-03 05:26:58.857828 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 05:26:58.857835 | orchestrator | Friday 03 April 2026 05:26:40 +0000 (0:00:13.410) 0:01:38.489 ********** 2026-04-03 05:26:58.857841 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:26:58.857847 | orchestrator | 2026-04-03 05:26:58.857868 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 05:26:58.857875 | orchestrator | Friday 03 April 2026 05:26:41 +0000 (0:00:00.748) 0:01:39.238 ********** 2026-04-03 05:26:58.857881 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:26:58.857888 | orchestrator | 2026-04-03 05:26:58.857894 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 05:26:58.857900 | orchestrator | Friday 03 April 2026 05:26:41 +0000 (0:00:00.236) 0:01:39.474 ********** 2026-04-03 05:26:58.857907 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:26:58.857913 | orchestrator | 2026-04-03 05:26:58.857920 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 05:26:58.857926 | orchestrator | Friday 03 April 2026 05:26:43 +0000 (0:00:01.510) 0:01:40.985 ********** 2026-04-03 05:26:58.857933 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:26:58.857939 | orchestrator | 2026-04-03 05:26:58.857945 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-03 05:26:58.857951 | orchestrator | 2026-04-03 05:26:58.857958 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-03 05:26:58.857964 | orchestrator | Friday 03 April 2026 05:26:55 +0000 (0:00:12.468) 0:01:53.453 ********** 2026-04-03 05:26:58.857971 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:26:58.857977 | orchestrator | 2026-04-03 05:26:58.857983 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-03 05:26:58.857990 | orchestrator | Friday 03 April 2026 05:26:56 +0000 (0:00:00.541) 0:01:53.995 ********** 2026-04-03 05:26:58.857996 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-03 05:26:58.858002 | orchestrator | enable_outward_rabbitmq_True 2026-04-03 05:26:58.858009 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-03 05:26:58.858067 | orchestrator | outward_rabbitmq_restart 2026-04-03 05:26:58.858081 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:26:58.858092 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:26:58.858103 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:26:58.858115 | orchestrator | 2026-04-03 05:26:58.858125 | orchestrator | PLAY [Apply role rabbitmq (outward)] ******************************************* 2026-04-03 05:26:58.858132 | orchestrator | skipping: no hosts matched 2026-04-03 05:26:58.858138 | orchestrator | 2026-04-03 05:26:58.858144 | orchestrator | PLAY [Restart rabbitmq (outward) services] ************************************* 2026-04-03 05:26:58.858150 | orchestrator | skipping: no hosts matched 2026-04-03 05:26:58.858156 | orchestrator | 2026-04-03 05:26:58.858162 | orchestrator | PLAY [Apply rabbitmq (outward) post-configuration] ***************************** 2026-04-03 05:26:58.858169 | orchestrator | skipping: no hosts matched 2026-04-03 05:26:58.858175 | orchestrator | 2026-04-03 05:26:58.858181 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:26:58.858201 | orchestrator | testbed-node-0 : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-03 05:26:58.858210 | orchestrator | testbed-node-1 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:26:58.858217 | orchestrator | testbed-node-2 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:26:58.858223 | orchestrator | 2026-04-03 05:26:58.858229 | orchestrator | 2026-04-03 05:26:58.858235 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:26:58.858242 | orchestrator | Friday 03 April 2026 05:26:58 +0000 (0:00:02.099) 0:01:56.095 ********** 2026-04-03 05:26:58.858248 | orchestrator | =============================================================================== 2026-04-03 05:26:58.858254 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 79.39s 2026-04-03 05:26:58.858260 | orchestrator | rabbitmq : Running RabbitMQ bootstrap container ------------------------- 6.64s 2026-04-03 05:26:58.858293 | orchestrator | rabbitmq : Restart rabbitmq container ----------------------------------- 4.61s 2026-04-03 05:26:58.858300 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 2.10s 2026-04-03 05:26:58.858310 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 1.95s 2026-04-03 05:26:58.858320 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 1.63s 2026-04-03 05:26:58.858330 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 1.59s 2026-04-03 05:26:58.858341 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 1.42s 2026-04-03 05:26:58.858351 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 1.39s 2026-04-03 05:26:58.858360 | orchestrator | rabbitmq : Copying over definitions.json -------------------------------- 1.37s 2026-04-03 05:26:58.858366 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 1.31s 2026-04-03 05:26:58.858373 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 1.30s 2026-04-03 05:26:58.858379 | orchestrator | rabbitmq : Check rabbitmq containers ------------------------------------ 1.14s 2026-04-03 05:26:58.858385 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.94s 2026-04-03 05:26:58.858396 | orchestrator | rabbitmq : include_tasks ------------------------------------------------ 0.86s 2026-04-03 05:26:58.858403 | orchestrator | rabbitmq : Creating rabbitmq volume ------------------------------------- 0.80s 2026-04-03 05:26:58.858409 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.80s 2026-04-03 05:26:58.858415 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode ---------------------- 0.73s 2026-04-03 05:26:58.858421 | orchestrator | rabbitmq : Ensuring config directories exist ---------------------------- 0.72s 2026-04-03 05:26:58.858428 | orchestrator | rabbitmq : Catch when RabbitMQ is being downgraded ---------------------- 0.58s 2026-04-03 05:27:01.236772 | orchestrator | 2026-04-03 05:27:01 | INFO  | Task 156626a0-2f2f-4391-94f4-2f3676069c09 (openvswitch) was prepared for execution. 2026-04-03 05:27:01.236871 | orchestrator | 2026-04-03 05:27:01 | INFO  | It takes a moment until task 156626a0-2f2f-4391-94f4-2f3676069c09 (openvswitch) has been started and output is visible here. 2026-04-03 05:27:13.676681 | orchestrator | 2026-04-03 05:27:13.676810 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:27:13.676828 | orchestrator | 2026-04-03 05:27:13.676840 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:27:13.676852 | orchestrator | Friday 03 April 2026 05:27:05 +0000 (0:00:00.253) 0:00:00.253 ********** 2026-04-03 05:27:13.676863 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:27:13.676875 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:27:13.676886 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:27:13.676897 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:27:13.676908 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:27:13.676919 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:27:13.676930 | orchestrator | 2026-04-03 05:27:13.676941 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:27:13.676952 | orchestrator | Friday 03 April 2026 05:27:06 +0000 (0:00:00.679) 0:00:00.932 ********** 2026-04-03 05:27:13.676963 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.676974 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.676985 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.676996 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.677007 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.677017 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 05:27:13.677028 | orchestrator | 2026-04-03 05:27:13.677063 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-03 05:27:13.677074 | orchestrator | 2026-04-03 05:27:13.677086 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-03 05:27:13.677097 | orchestrator | Friday 03 April 2026 05:27:06 +0000 (0:00:00.616) 0:00:01.549 ********** 2026-04-03 05:27:13.677109 | orchestrator | included: /ansible/roles/openvswitch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:27:13.677122 | orchestrator | 2026-04-03 05:27:13.677133 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 05:27:13.677144 | orchestrator | Friday 03 April 2026 05:27:07 +0000 (0:00:01.105) 0:00:02.655 ********** 2026-04-03 05:27:13.677155 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-03 05:27:13.677166 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-03 05:27:13.677177 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-03 05:27:13.677188 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-03 05:27:13.677199 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-03 05:27:13.677210 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-03 05:27:13.677223 | orchestrator | 2026-04-03 05:27:13.677236 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 05:27:13.677281 | orchestrator | Friday 03 April 2026 05:27:09 +0000 (0:00:01.161) 0:00:03.816 ********** 2026-04-03 05:27:13.677296 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-03 05:27:13.677309 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-03 05:27:13.677322 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-03 05:27:13.677334 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-03 05:27:13.677344 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-03 05:27:13.677355 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-03 05:27:13.677366 | orchestrator | 2026-04-03 05:27:13.677377 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 05:27:13.677388 | orchestrator | Friday 03 April 2026 05:27:10 +0000 (0:00:01.448) 0:00:05.265 ********** 2026-04-03 05:27:13.677398 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-03 05:27:13.677409 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:27:13.677421 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-03 05:27:13.677432 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:27:13.677443 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-03 05:27:13.677454 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:27:13.677465 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-03 05:27:13.677476 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:27:13.677486 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-03 05:27:13.677497 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:27:13.677508 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-03 05:27:13.677518 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:27:13.677529 | orchestrator | 2026-04-03 05:27:13.677540 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-03 05:27:13.677551 | orchestrator | Friday 03 April 2026 05:27:11 +0000 (0:00:01.140) 0:00:06.406 ********** 2026-04-03 05:27:13.677562 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:27:13.677573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:27:13.677584 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:27:13.677595 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:27:13.677606 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:27:13.677617 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:27:13.677627 | orchestrator | 2026-04-03 05:27:13.677638 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-03 05:27:13.677657 | orchestrator | Friday 03 April 2026 05:27:12 +0000 (0:00:00.734) 0:00:07.140 ********** 2026-04-03 05:27:13.677690 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:13.677709 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:13.677721 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:13.677812 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:13.677838 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:13.677861 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970126 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970229 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970296 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970311 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970340 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970392 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970406 | orchestrator | 2026-04-03 05:27:15.970419 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-03 05:27:15.970432 | orchestrator | Friday 03 April 2026 05:27:13 +0000 (0:00:01.356) 0:00:08.497 ********** 2026-04-03 05:27:15.970444 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970457 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970469 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970481 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970505 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:15.970525 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535683 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535759 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535766 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535783 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535801 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535814 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535819 | orchestrator | 2026-04-03 05:27:18.535824 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-03 05:27:18.535830 | orchestrator | Friday 03 April 2026 05:27:16 +0000 (0:00:02.299) 0:00:10.797 ********** 2026-04-03 05:27:18.535834 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:27:18.535839 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:27:18.535843 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:27:18.535847 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:27:18.535850 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:27:18.535854 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:27:18.535859 | orchestrator | 2026-04-03 05:27:18.535863 | orchestrator | TASK [openvswitch : Check openvswitch containers] ****************************** 2026-04-03 05:27:18.535867 | orchestrator | Friday 03 April 2026 05:27:16 +0000 (0:00:00.923) 0:00:11.720 ********** 2026-04-03 05:27:18.535871 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535876 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535887 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535891 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:18.535899 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796675 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796789 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796806 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796858 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796872 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796900 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796913 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 05:27:42.796925 | orchestrator | 2026-04-03 05:27:42.796938 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.796951 | orchestrator | Friday 03 April 2026 05:27:18 +0000 (0:00:01.645) 0:00:13.365 ********** 2026-04-03 05:27:42.796962 | orchestrator | 2026-04-03 05:27:42.796974 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.796985 | orchestrator | Friday 03 April 2026 05:27:18 +0000 (0:00:00.299) 0:00:13.665 ********** 2026-04-03 05:27:42.797004 | orchestrator | 2026-04-03 05:27:42.797015 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.797026 | orchestrator | Friday 03 April 2026 05:27:19 +0000 (0:00:00.131) 0:00:13.797 ********** 2026-04-03 05:27:42.797037 | orchestrator | 2026-04-03 05:27:42.797048 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.797058 | orchestrator | Friday 03 April 2026 05:27:19 +0000 (0:00:00.125) 0:00:13.923 ********** 2026-04-03 05:27:42.797069 | orchestrator | 2026-04-03 05:27:42.797080 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.797091 | orchestrator | Friday 03 April 2026 05:27:19 +0000 (0:00:00.126) 0:00:14.049 ********** 2026-04-03 05:27:42.797102 | orchestrator | 2026-04-03 05:27:42.797113 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 05:27:42.797124 | orchestrator | Friday 03 April 2026 05:27:19 +0000 (0:00:00.130) 0:00:14.179 ********** 2026-04-03 05:27:42.797135 | orchestrator | 2026-04-03 05:27:42.797146 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-03 05:27:42.797157 | orchestrator | Friday 03 April 2026 05:27:19 +0000 (0:00:00.129) 0:00:14.308 ********** 2026-04-03 05:27:42.797168 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:27:42.797180 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:27:42.797191 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:27:42.797202 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:27:42.797249 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:27:42.797263 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:27:42.797275 | orchestrator | 2026-04-03 05:27:42.797288 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-03 05:27:42.797302 | orchestrator | Friday 03 April 2026 05:27:27 +0000 (0:00:08.307) 0:00:22.615 ********** 2026-04-03 05:27:42.797314 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:27:42.797333 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:27:42.797346 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:27:42.797358 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:27:42.797370 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:27:42.797382 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:27:42.797394 | orchestrator | 2026-04-03 05:27:42.797407 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-03 05:27:42.797421 | orchestrator | Friday 03 April 2026 05:27:28 +0000 (0:00:01.076) 0:00:23.692 ********** 2026-04-03 05:27:42.797433 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:27:42.797445 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:27:42.797457 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:27:42.797470 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:27:42.797482 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:27:42.797495 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:27:42.797507 | orchestrator | 2026-04-03 05:27:42.797519 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-03 05:27:42.797532 | orchestrator | Friday 03 April 2026 05:27:36 +0000 (0:00:07.785) 0:00:31.477 ********** 2026-04-03 05:27:42.797545 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-03 05:27:42.797558 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-03 05:27:42.797571 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-03 05:27:42.797582 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-03 05:27:42.797593 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-03 05:27:42.797604 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-03 05:27:42.797615 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-03 05:27:42.797639 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-03 05:27:55.294099 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-03 05:27:55.294192 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-03 05:27:55.294225 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-03 05:27:55.294232 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-03 05:27:55.294239 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294245 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294251 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294257 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294264 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294270 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 05:27:55.294277 | orchestrator | 2026-04-03 05:27:55.294284 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-03 05:27:55.294292 | orchestrator | Friday 03 April 2026 05:27:42 +0000 (0:00:06.051) 0:00:37.528 ********** 2026-04-03 05:27:55.294301 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-03 05:27:55.294307 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:27:55.294316 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-03 05:27:55.294323 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:27:55.294329 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-03 05:27:55.294336 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:27:55.294343 | orchestrator | changed: [testbed-node-1] => (item=br-ex) 2026-04-03 05:27:55.294349 | orchestrator | changed: [testbed-node-0] => (item=br-ex) 2026-04-03 05:27:55.294356 | orchestrator | changed: [testbed-node-2] => (item=br-ex) 2026-04-03 05:27:55.294362 | orchestrator | 2026-04-03 05:27:55.294368 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-03 05:27:55.294374 | orchestrator | Friday 03 April 2026 05:27:45 +0000 (0:00:02.232) 0:00:39.760 ********** 2026-04-03 05:27:55.294380 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-03 05:27:55.294386 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:27:55.294393 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-03 05:27:55.294398 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:27:55.294405 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-03 05:27:55.294411 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:27:55.294417 | orchestrator | changed: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-03 05:27:55.294423 | orchestrator | changed: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-03 05:27:55.294442 | orchestrator | changed: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-03 05:27:55.294448 | orchestrator | 2026-04-03 05:27:55.294454 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-03 05:27:55.294460 | orchestrator | Friday 03 April 2026 05:27:47 +0000 (0:00:02.939) 0:00:42.700 ********** 2026-04-03 05:27:55.294466 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:27:55.294472 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:27:55.294497 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:27:55.294503 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:27:55.294509 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:27:55.294515 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:27:55.294521 | orchestrator | 2026-04-03 05:27:55.294528 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:27:55.294535 | orchestrator | testbed-node-0 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 05:27:55.294542 | orchestrator | testbed-node-1 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 05:27:55.294548 | orchestrator | testbed-node-2 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 05:27:55.294554 | orchestrator | testbed-node-3 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:27:55.294560 | orchestrator | testbed-node-4 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:27:55.294566 | orchestrator | testbed-node-5 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:27:55.294572 | orchestrator | 2026-04-03 05:27:55.294578 | orchestrator | 2026-04-03 05:27:55.294584 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:27:55.294590 | orchestrator | Friday 03 April 2026 05:27:54 +0000 (0:00:06.945) 0:00:49.645 ********** 2026-04-03 05:27:55.294610 | orchestrator | =============================================================================== 2026-04-03 05:27:55.294616 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 14.73s 2026-04-03 05:27:55.294622 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------- 8.31s 2026-04-03 05:27:55.294627 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 6.05s 2026-04-03 05:27:55.294633 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 2.94s 2026-04-03 05:27:55.294639 | orchestrator | openvswitch : Copying over config.json files for services --------------- 2.30s 2026-04-03 05:27:55.294646 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 2.23s 2026-04-03 05:27:55.294652 | orchestrator | openvswitch : Check openvswitch containers ------------------------------ 1.65s 2026-04-03 05:27:55.294657 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 1.45s 2026-04-03 05:27:55.294663 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 1.36s 2026-04-03 05:27:55.294669 | orchestrator | module-load : Load modules ---------------------------------------------- 1.16s 2026-04-03 05:27:55.294675 | orchestrator | module-load : Drop module persistence ----------------------------------- 1.14s 2026-04-03 05:27:55.294680 | orchestrator | openvswitch : include_tasks --------------------------------------------- 1.11s 2026-04-03 05:27:55.294686 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 1.08s 2026-04-03 05:27:55.294692 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 0.94s 2026-04-03 05:27:55.294698 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 0.92s 2026-04-03 05:27:55.294704 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 0.73s 2026-04-03 05:27:55.294709 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.68s 2026-04-03 05:27:55.294715 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.62s 2026-04-03 05:27:57.685659 | orchestrator | 2026-04-03 05:27:57 | INFO  | Task 73dc8728-58f9-4430-aa9d-b957890949a4 (ovn) was prepared for execution. 2026-04-03 05:27:57.685789 | orchestrator | 2026-04-03 05:27:57 | INFO  | It takes a moment until task 73dc8728-58f9-4430-aa9d-b957890949a4 (ovn) has been started and output is visible here. 2026-04-03 05:28:08.168922 | orchestrator | 2026-04-03 05:28:08.169070 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:28:08.169103 | orchestrator | 2026-04-03 05:28:08.169123 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:28:08.169144 | orchestrator | Friday 03 April 2026 05:28:01 +0000 (0:00:00.162) 0:00:00.163 ********** 2026-04-03 05:28:08.169162 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:28:08.169222 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:28:08.169244 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:28:08.169264 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:28:08.169283 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:28:08.169301 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:28:08.169318 | orchestrator | 2026-04-03 05:28:08.169336 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:28:08.169355 | orchestrator | Friday 03 April 2026 05:28:02 +0000 (0:00:00.704) 0:00:00.867 ********** 2026-04-03 05:28:08.169395 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-03 05:28:08.169416 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-03 05:28:08.169436 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-03 05:28:08.169458 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-03 05:28:08.169477 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-03 05:28:08.169495 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-03 05:28:08.169509 | orchestrator | 2026-04-03 05:28:08.169524 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-03 05:28:08.169537 | orchestrator | 2026-04-03 05:28:08.169550 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-03 05:28:08.169564 | orchestrator | Friday 03 April 2026 05:28:03 +0000 (0:00:00.826) 0:00:01.693 ********** 2026-04-03 05:28:08.169579 | orchestrator | included: /ansible/roles/ovn-controller/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:28:08.169593 | orchestrator | 2026-04-03 05:28:08.169607 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-03 05:28:08.169620 | orchestrator | Friday 03 April 2026 05:28:04 +0000 (0:00:01.085) 0:00:02.778 ********** 2026-04-03 05:28:08.169635 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169651 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169665 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169678 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169719 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169754 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169768 | orchestrator | 2026-04-03 05:28:08.169781 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-03 05:28:08.169792 | orchestrator | Friday 03 April 2026 05:28:05 +0000 (0:00:01.131) 0:00:03.910 ********** 2026-04-03 05:28:08.169810 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169822 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169834 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169845 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169856 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169867 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169886 | orchestrator | 2026-04-03 05:28:08.169898 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-03 05:28:08.169909 | orchestrator | Friday 03 April 2026 05:28:07 +0000 (0:00:01.462) 0:00:05.373 ********** 2026-04-03 05:28:08.169920 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169932 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:08.169951 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853077 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853238 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853251 | orchestrator | 2026-04-03 05:28:30.853265 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-03 05:28:30.853277 | orchestrator | Friday 03 April 2026 05:28:08 +0000 (0:00:01.068) 0:00:06.442 ********** 2026-04-03 05:28:30.853289 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853300 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853333 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853345 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853356 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853384 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853396 | orchestrator | 2026-04-03 05:28:30.853407 | orchestrator | TASK [ovn-controller : Check ovn-controller containers] ************************ 2026-04-03 05:28:30.853419 | orchestrator | Friday 03 April 2026 05:28:09 +0000 (0:00:01.493) 0:00:07.935 ********** 2026-04-03 05:28:30.853437 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853448 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853459 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853471 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853489 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853500 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:28:30.853511 | orchestrator | 2026-04-03 05:28:30.853523 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-03 05:28:30.853534 | orchestrator | Friday 03 April 2026 05:28:10 +0000 (0:00:01.308) 0:00:09.244 ********** 2026-04-03 05:28:30.853546 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:28:30.853558 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:28:30.853569 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:28:30.853580 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:28:30.853590 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:28:30.853603 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:28:30.853616 | orchestrator | 2026-04-03 05:28:30.853629 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-03 05:28:30.853642 | orchestrator | Friday 03 April 2026 05:28:13 +0000 (0:00:02.359) 0:00:11.604 ********** 2026-04-03 05:28:30.853655 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-03 05:28:30.853668 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-03 05:28:30.853680 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-03 05:28:30.853692 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-03 05:28:30.853704 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-03 05:28:30.853716 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-03 05:28:30.853734 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413202 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413339 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413371 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413382 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413392 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 05:29:10.413403 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413414 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413446 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413457 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413467 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413476 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-03 05:29:10.413487 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413499 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413508 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413518 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413528 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413538 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 05:29:10.413548 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413558 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413567 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413577 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413587 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413596 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 05:29:10.413606 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413616 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413625 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413638 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413654 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413669 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 05:29:10.413686 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 05:29:10.413702 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 05:29:10.413713 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 05:29:10.413725 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 05:29:10.413737 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 05:29:10.413748 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 05:29:10.413759 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-03 05:29:10.413796 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-03 05:29:10.413808 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-03 05:29:10.413825 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-03 05:29:10.413836 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-03 05:29:10.413848 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-03 05:29:10.413859 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 05:29:10.413871 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 05:29:10.413882 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 05:29:10.413894 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 05:29:10.413905 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 05:29:10.413917 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 05:29:10.413929 | orchestrator | 2026-04-03 05:29:10.413941 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.413953 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:16.942) 0:00:28.547 ********** 2026-04-03 05:29:10.413964 | orchestrator | 2026-04-03 05:29:10.413975 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.413986 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.247) 0:00:28.794 ********** 2026-04-03 05:29:10.413997 | orchestrator | 2026-04-03 05:29:10.414008 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.414078 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.065) 0:00:28.860 ********** 2026-04-03 05:29:10.414090 | orchestrator | 2026-04-03 05:29:10.414101 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.414129 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.065) 0:00:28.925 ********** 2026-04-03 05:29:10.414139 | orchestrator | 2026-04-03 05:29:10.414149 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.414159 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.063) 0:00:28.989 ********** 2026-04-03 05:29:10.414169 | orchestrator | 2026-04-03 05:29:10.414178 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 05:29:10.414188 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.063) 0:00:29.053 ********** 2026-04-03 05:29:10.414198 | orchestrator | 2026-04-03 05:29:10.414208 | orchestrator | RUNNING HANDLER [ovn-controller : Reload systemd config] *********************** 2026-04-03 05:29:10.414217 | orchestrator | Friday 03 April 2026 05:28:30 +0000 (0:00:00.063) 0:00:29.116 ********** 2026-04-03 05:29:10.414228 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:29:10.414239 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:29:10.414248 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:29:10.414258 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:10.414267 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:10.414277 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:10.414287 | orchestrator | 2026-04-03 05:29:10.414297 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-03 05:29:10.414307 | orchestrator | Friday 03 April 2026 05:28:32 +0000 (0:00:01.543) 0:00:30.660 ********** 2026-04-03 05:29:10.414324 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:10.414334 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:29:10.414344 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:29:10.414353 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:29:10.414363 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:29:10.414373 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:29:10.414382 | orchestrator | 2026-04-03 05:29:10.414392 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-03 05:29:10.414402 | orchestrator | 2026-04-03 05:29:10.414412 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 05:29:10.414422 | orchestrator | Friday 03 April 2026 05:29:08 +0000 (0:00:35.974) 0:01:06.634 ********** 2026-04-03 05:29:10.414432 | orchestrator | included: /ansible/roles/ovn-db/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:29:10.414442 | orchestrator | 2026-04-03 05:29:10.414451 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 05:29:10.414461 | orchestrator | Friday 03 April 2026 05:29:09 +0000 (0:00:00.658) 0:01:07.293 ********** 2026-04-03 05:29:10.414471 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:29:10.414481 | orchestrator | 2026-04-03 05:29:10.414491 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-03 05:29:10.414500 | orchestrator | Friday 03 April 2026 05:29:09 +0000 (0:00:00.526) 0:01:07.819 ********** 2026-04-03 05:29:10.414510 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:10.414520 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:10.414530 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:10.414539 | orchestrator | 2026-04-03 05:29:10.414550 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-03 05:29:10.414567 | orchestrator | Friday 03 April 2026 05:29:10 +0000 (0:00:00.860) 0:01:08.680 ********** 2026-04-03 05:29:21.341226 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.341344 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.341359 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.341371 | orchestrator | 2026-04-03 05:29:21.341384 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-03 05:29:21.341415 | orchestrator | Friday 03 April 2026 05:29:10 +0000 (0:00:00.323) 0:01:09.004 ********** 2026-04-03 05:29:21.341427 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.341438 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.341448 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.341459 | orchestrator | 2026-04-03 05:29:21.341471 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-03 05:29:21.341482 | orchestrator | Friday 03 April 2026 05:29:11 +0000 (0:00:00.316) 0:01:09.320 ********** 2026-04-03 05:29:21.341493 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.341504 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.341515 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.341526 | orchestrator | 2026-04-03 05:29:21.341537 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-03 05:29:21.341548 | orchestrator | Friday 03 April 2026 05:29:11 +0000 (0:00:00.315) 0:01:09.635 ********** 2026-04-03 05:29:21.341559 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.341570 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.341580 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.341591 | orchestrator | 2026-04-03 05:29:21.341602 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-03 05:29:21.341613 | orchestrator | Friday 03 April 2026 05:29:11 +0000 (0:00:00.531) 0:01:10.166 ********** 2026-04-03 05:29:21.341625 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341637 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341647 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341660 | orchestrator | 2026-04-03 05:29:21.341674 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-03 05:29:21.341708 | orchestrator | Friday 03 April 2026 05:29:12 +0000 (0:00:00.293) 0:01:10.460 ********** 2026-04-03 05:29:21.341719 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341730 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341740 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341751 | orchestrator | 2026-04-03 05:29:21.341762 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-03 05:29:21.341774 | orchestrator | Friday 03 April 2026 05:29:12 +0000 (0:00:00.300) 0:01:10.761 ********** 2026-04-03 05:29:21.341785 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341796 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341808 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341819 | orchestrator | 2026-04-03 05:29:21.341831 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-03 05:29:21.341840 | orchestrator | Friday 03 April 2026 05:29:12 +0000 (0:00:00.331) 0:01:11.093 ********** 2026-04-03 05:29:21.341850 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341860 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341870 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341879 | orchestrator | 2026-04-03 05:29:21.341889 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-03 05:29:21.341899 | orchestrator | Friday 03 April 2026 05:29:13 +0000 (0:00:00.301) 0:01:11.394 ********** 2026-04-03 05:29:21.341909 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341919 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341929 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341939 | orchestrator | 2026-04-03 05:29:21.341949 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-03 05:29:21.341959 | orchestrator | Friday 03 April 2026 05:29:13 +0000 (0:00:00.502) 0:01:11.897 ********** 2026-04-03 05:29:21.341969 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.341979 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.341988 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.341998 | orchestrator | 2026-04-03 05:29:21.342007 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-03 05:29:21.342073 | orchestrator | Friday 03 April 2026 05:29:13 +0000 (0:00:00.284) 0:01:12.181 ********** 2026-04-03 05:29:21.342085 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342123 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342133 | orchestrator | 2026-04-03 05:29:21.342143 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-03 05:29:21.342152 | orchestrator | Friday 03 April 2026 05:29:14 +0000 (0:00:00.297) 0:01:12.479 ********** 2026-04-03 05:29:21.342162 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342172 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342181 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342191 | orchestrator | 2026-04-03 05:29:21.342200 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-03 05:29:21.342210 | orchestrator | Friday 03 April 2026 05:29:14 +0000 (0:00:00.298) 0:01:12.778 ********** 2026-04-03 05:29:21.342220 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342230 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342239 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342249 | orchestrator | 2026-04-03 05:29:21.342258 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-03 05:29:21.342268 | orchestrator | Friday 03 April 2026 05:29:15 +0000 (0:00:00.532) 0:01:13.310 ********** 2026-04-03 05:29:21.342278 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342288 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342297 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342307 | orchestrator | 2026-04-03 05:29:21.342317 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-03 05:29:21.342334 | orchestrator | Friday 03 April 2026 05:29:15 +0000 (0:00:00.352) 0:01:13.663 ********** 2026-04-03 05:29:21.342344 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342354 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342363 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342373 | orchestrator | 2026-04-03 05:29:21.342383 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-03 05:29:21.342392 | orchestrator | Friday 03 April 2026 05:29:15 +0000 (0:00:00.294) 0:01:13.957 ********** 2026-04-03 05:29:21.342420 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342431 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342440 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342450 | orchestrator | 2026-04-03 05:29:21.342460 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 05:29:21.342475 | orchestrator | Friday 03 April 2026 05:29:15 +0000 (0:00:00.288) 0:01:14.246 ********** 2026-04-03 05:29:21.342486 | orchestrator | included: /ansible/roles/ovn-db/tasks/bootstrap-initial.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:29:21.342496 | orchestrator | 2026-04-03 05:29:21.342506 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new cluster)] ******************* 2026-04-03 05:29:21.342516 | orchestrator | Friday 03 April 2026 05:29:16 +0000 (0:00:00.783) 0:01:15.030 ********** 2026-04-03 05:29:21.342525 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.342535 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.342545 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.342554 | orchestrator | 2026-04-03 05:29:21.342564 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new cluster)] ******************* 2026-04-03 05:29:21.342574 | orchestrator | Friday 03 April 2026 05:29:17 +0000 (0:00:00.421) 0:01:15.451 ********** 2026-04-03 05:29:21.342583 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:21.342593 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:21.342603 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:21.342612 | orchestrator | 2026-04-03 05:29:21.342622 | orchestrator | TASK [ovn-db : Check NB cluster status] **************************************** 2026-04-03 05:29:21.342632 | orchestrator | Friday 03 April 2026 05:29:17 +0000 (0:00:00.437) 0:01:15.889 ********** 2026-04-03 05:29:21.342642 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342652 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342661 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342671 | orchestrator | 2026-04-03 05:29:21.342680 | orchestrator | TASK [ovn-db : Check SB cluster status] **************************************** 2026-04-03 05:29:21.342690 | orchestrator | Friday 03 April 2026 05:29:17 +0000 (0:00:00.337) 0:01:16.226 ********** 2026-04-03 05:29:21.342700 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342709 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342719 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342729 | orchestrator | 2026-04-03 05:29:21.342738 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in NB DB] *** 2026-04-03 05:29:21.342748 | orchestrator | Friday 03 April 2026 05:29:18 +0000 (0:00:00.539) 0:01:16.766 ********** 2026-04-03 05:29:21.342758 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342767 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342777 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342787 | orchestrator | 2026-04-03 05:29:21.342796 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in SB DB] *** 2026-04-03 05:29:21.342806 | orchestrator | Friday 03 April 2026 05:29:18 +0000 (0:00:00.329) 0:01:17.096 ********** 2026-04-03 05:29:21.342816 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342825 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342835 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342845 | orchestrator | 2026-04-03 05:29:21.342855 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new member)] ******************** 2026-04-03 05:29:21.342864 | orchestrator | Friday 03 April 2026 05:29:19 +0000 (0:00:00.337) 0:01:17.433 ********** 2026-04-03 05:29:21.342884 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342894 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342903 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342913 | orchestrator | 2026-04-03 05:29:21.342923 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new member)] ******************** 2026-04-03 05:29:21.342933 | orchestrator | Friday 03 April 2026 05:29:19 +0000 (0:00:00.310) 0:01:17.744 ********** 2026-04-03 05:29:21.342942 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:21.342952 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:21.342962 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:21.342971 | orchestrator | 2026-04-03 05:29:21.342981 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-03 05:29:21.342991 | orchestrator | Friday 03 April 2026 05:29:19 +0000 (0:00:00.506) 0:01:18.250 ********** 2026-04-03 05:29:21.343003 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:21.343016 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:21.343026 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:21.343049 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421306 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421438 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421466 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421480 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421517 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421529 | orchestrator | 2026-04-03 05:29:27.421543 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-03 05:29:27.421555 | orchestrator | Friday 03 April 2026 05:29:21 +0000 (0:00:01.363) 0:01:19.614 ********** 2026-04-03 05:29:27.421569 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421582 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421594 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421605 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421650 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421664 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421676 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421688 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421707 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421719 | orchestrator | 2026-04-03 05:29:27.421730 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-03 05:29:27.421745 | orchestrator | Friday 03 April 2026 05:29:25 +0000 (0:00:03.731) 0:01:23.345 ********** 2026-04-03 05:29:27.421764 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421783 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421803 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421843 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:27.421873 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.338002 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.338226 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.338246 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.338265 | orchestrator | 2026-04-03 05:29:55.338287 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:29:55.338310 | orchestrator | Friday 03 April 2026 05:29:26 +0000 (0:00:01.920) 0:01:25.266 ********** 2026-04-03 05:29:55.338329 | orchestrator | 2026-04-03 05:29:55.338349 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:29:55.338370 | orchestrator | Friday 03 April 2026 05:29:27 +0000 (0:00:00.062) 0:01:25.329 ********** 2026-04-03 05:29:55.338389 | orchestrator | 2026-04-03 05:29:55.338404 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:29:55.338415 | orchestrator | Friday 03 April 2026 05:29:27 +0000 (0:00:00.279) 0:01:25.608 ********** 2026-04-03 05:29:55.338426 | orchestrator | 2026-04-03 05:29:55.338437 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-03 05:29:55.338448 | orchestrator | Friday 03 April 2026 05:29:27 +0000 (0:00:00.078) 0:01:25.687 ********** 2026-04-03 05:29:55.338459 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:29:55.338474 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:29:55.338492 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:55.338511 | orchestrator | 2026-04-03 05:29:55.338530 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-03 05:29:55.338550 | orchestrator | Friday 03 April 2026 05:29:33 +0000 (0:00:06.558) 0:01:32.246 ********** 2026-04-03 05:29:55.338569 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:55.338584 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:29:55.338596 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:29:55.338609 | orchestrator | 2026-04-03 05:29:55.338622 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-03 05:29:55.338635 | orchestrator | Friday 03 April 2026 05:29:41 +0000 (0:00:07.443) 0:01:39.689 ********** 2026-04-03 05:29:55.338648 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:55.338660 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:29:55.338673 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:29:55.338685 | orchestrator | 2026-04-03 05:29:55.338698 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-03 05:29:55.338710 | orchestrator | Friday 03 April 2026 05:29:48 +0000 (0:00:07.364) 0:01:47.054 ********** 2026-04-03 05:29:55.338723 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:29:55.338735 | orchestrator | 2026-04-03 05:29:55.338747 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-03 05:29:55.338759 | orchestrator | Friday 03 April 2026 05:29:48 +0000 (0:00:00.132) 0:01:47.186 ********** 2026-04-03 05:29:55.338772 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:55.338784 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:55.338798 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:55.338810 | orchestrator | 2026-04-03 05:29:55.338823 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-03 05:29:55.338835 | orchestrator | Friday 03 April 2026 05:29:49 +0000 (0:00:00.974) 0:01:48.160 ********** 2026-04-03 05:29:55.338847 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:55.338868 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:55.338879 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:55.338890 | orchestrator | 2026-04-03 05:29:55.338901 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-03 05:29:55.338912 | orchestrator | Friday 03 April 2026 05:29:50 +0000 (0:00:00.622) 0:01:48.782 ********** 2026-04-03 05:29:55.338922 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:55.338933 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:55.338944 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:55.338955 | orchestrator | 2026-04-03 05:29:55.338966 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-03 05:29:55.338991 | orchestrator | Friday 03 April 2026 05:29:51 +0000 (0:00:00.742) 0:01:49.524 ********** 2026-04-03 05:29:55.339003 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:29:55.339013 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:29:55.339024 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:29:55.339035 | orchestrator | 2026-04-03 05:29:55.339046 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-03 05:29:55.339057 | orchestrator | Friday 03 April 2026 05:29:51 +0000 (0:00:00.594) 0:01:50.119 ********** 2026-04-03 05:29:55.339068 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:55.339128 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:55.339157 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:55.339169 | orchestrator | 2026-04-03 05:29:55.339180 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-03 05:29:55.339192 | orchestrator | Friday 03 April 2026 05:29:52 +0000 (0:00:01.140) 0:01:51.259 ********** 2026-04-03 05:29:55.339203 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:55.339213 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:55.339224 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:55.339235 | orchestrator | 2026-04-03 05:29:55.339247 | orchestrator | TASK [ovn-db : Unset bootstrap args fact] ************************************** 2026-04-03 05:29:55.339258 | orchestrator | Friday 03 April 2026 05:29:53 +0000 (0:00:00.739) 0:01:51.998 ********** 2026-04-03 05:29:55.339269 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:29:55.339280 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:29:55.339291 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:29:55.339302 | orchestrator | 2026-04-03 05:29:55.339313 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-03 05:29:55.339324 | orchestrator | Friday 03 April 2026 05:29:54 +0000 (0:00:00.297) 0:01:52.296 ********** 2026-04-03 05:29:55.339337 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339351 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339363 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339375 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339394 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339406 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339417 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339434 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:29:55.339454 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.184875 | orchestrator | 2026-04-03 05:30:02.184952 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-03 05:30:02.184961 | orchestrator | Friday 03 April 2026 05:29:55 +0000 (0:00:01.310) 0:01:53.606 ********** 2026-04-03 05:30:02.184968 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.184976 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.184981 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.184986 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185011 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185016 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185021 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185026 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185041 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185046 | orchestrator | 2026-04-03 05:30:02.185051 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-03 05:30:02.185056 | orchestrator | Friday 03 April 2026 05:29:58 +0000 (0:00:03.678) 0:01:57.285 ********** 2026-04-03 05:30:02.185111 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185121 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185130 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185135 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185146 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185150 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185155 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185160 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185168 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 05:30:02.185173 | orchestrator | 2026-04-03 05:30:02.185178 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:30:02.185182 | orchestrator | Friday 03 April 2026 05:30:01 +0000 (0:00:02.948) 0:02:00.233 ********** 2026-04-03 05:30:02.185187 | orchestrator | 2026-04-03 05:30:02.185192 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:30:02.185196 | orchestrator | Friday 03 April 2026 05:30:02 +0000 (0:00:00.085) 0:02:00.318 ********** 2026-04-03 05:30:02.185201 | orchestrator | 2026-04-03 05:30:02.185206 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 05:30:02.185210 | orchestrator | Friday 03 April 2026 05:30:02 +0000 (0:00:00.065) 0:02:00.384 ********** 2026-04-03 05:30:02.185215 | orchestrator | 2026-04-03 05:30:02.185223 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-03 05:30:25.968676 | orchestrator | Friday 03 April 2026 05:30:02 +0000 (0:00:00.065) 0:02:00.450 ********** 2026-04-03 05:30:25.968789 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:30:25.968806 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:30:25.968819 | orchestrator | 2026-04-03 05:30:25.968831 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-03 05:30:25.968843 | orchestrator | Friday 03 April 2026 05:30:08 +0000 (0:00:06.132) 0:02:06.582 ********** 2026-04-03 05:30:25.968855 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:30:25.968866 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:30:25.968877 | orchestrator | 2026-04-03 05:30:25.968889 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-03 05:30:25.968923 | orchestrator | Friday 03 April 2026 05:30:14 +0000 (0:00:06.140) 0:02:12.723 ********** 2026-04-03 05:30:25.968935 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:30:25.968946 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:30:25.968957 | orchestrator | 2026-04-03 05:30:25.968967 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-03 05:30:25.968978 | orchestrator | Friday 03 April 2026 05:30:20 +0000 (0:00:06.178) 0:02:18.901 ********** 2026-04-03 05:30:25.968989 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:30:25.969001 | orchestrator | 2026-04-03 05:30:25.969012 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-03 05:30:25.969023 | orchestrator | Friday 03 April 2026 05:30:20 +0000 (0:00:00.140) 0:02:19.041 ********** 2026-04-03 05:30:25.969034 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:30:25.969093 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:30:25.969105 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:30:25.969116 | orchestrator | 2026-04-03 05:30:25.969127 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-03 05:30:25.969138 | orchestrator | Friday 03 April 2026 05:30:21 +0000 (0:00:00.976) 0:02:20.018 ********** 2026-04-03 05:30:25.969150 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:30:25.969161 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:30:25.969172 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:30:25.969182 | orchestrator | 2026-04-03 05:30:25.969193 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-03 05:30:25.969205 | orchestrator | Friday 03 April 2026 05:30:22 +0000 (0:00:00.600) 0:02:20.619 ********** 2026-04-03 05:30:25.969216 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:30:25.969229 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:30:25.969242 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:30:25.969255 | orchestrator | 2026-04-03 05:30:25.969269 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-03 05:30:25.969282 | orchestrator | Friday 03 April 2026 05:30:23 +0000 (0:00:00.756) 0:02:21.376 ********** 2026-04-03 05:30:25.969294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:30:25.969307 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:30:25.969320 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:30:25.969332 | orchestrator | 2026-04-03 05:30:25.969346 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-03 05:30:25.969358 | orchestrator | Friday 03 April 2026 05:30:23 +0000 (0:00:00.625) 0:02:22.002 ********** 2026-04-03 05:30:25.969371 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:30:25.969384 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:30:25.969396 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:30:25.969409 | orchestrator | 2026-04-03 05:30:25.969422 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-03 05:30:25.969435 | orchestrator | Friday 03 April 2026 05:30:24 +0000 (0:00:01.004) 0:02:23.007 ********** 2026-04-03 05:30:25.969447 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:30:25.969460 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:30:25.969471 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:30:25.969482 | orchestrator | 2026-04-03 05:30:25.969493 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:30:25.969506 | orchestrator | testbed-node-0 : ok=44  changed=18  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-03 05:30:25.969519 | orchestrator | testbed-node-1 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-03 05:30:25.969530 | orchestrator | testbed-node-2 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-03 05:30:25.969541 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:30:25.969561 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:30:25.969572 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:30:25.969583 | orchestrator | 2026-04-03 05:30:25.969594 | orchestrator | 2026-04-03 05:30:25.969619 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:30:25.969630 | orchestrator | Friday 03 April 2026 05:30:25 +0000 (0:00:00.847) 0:02:23.854 ********** 2026-04-03 05:30:25.969641 | orchestrator | =============================================================================== 2026-04-03 05:30:25.969653 | orchestrator | ovn-controller : Restart ovn-controller container ---------------------- 35.97s 2026-04-03 05:30:25.969664 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 16.94s 2026-04-03 05:30:25.969675 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 13.58s 2026-04-03 05:30:25.969686 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 13.54s 2026-04-03 05:30:25.969697 | orchestrator | ovn-db : Restart ovn-nb-db container ----------------------------------- 12.69s 2026-04-03 05:30:25.969725 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.73s 2026-04-03 05:30:25.969737 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.68s 2026-04-03 05:30:25.969748 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 2.95s 2026-04-03 05:30:25.969759 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 2.36s 2026-04-03 05:30:25.969770 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 1.92s 2026-04-03 05:30:25.969781 | orchestrator | ovn-controller : Reload systemd config ---------------------------------- 1.54s 2026-04-03 05:30:25.969792 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 1.49s 2026-04-03 05:30:25.969803 | orchestrator | ovn-controller : Copying over config.json files for services ------------ 1.46s 2026-04-03 05:30:25.969814 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.36s 2026-04-03 05:30:25.969825 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.31s 2026-04-03 05:30:25.969836 | orchestrator | ovn-controller : Check ovn-controller containers ------------------------ 1.31s 2026-04-03 05:30:25.969847 | orchestrator | ovn-db : Wait for ovn-nb-db --------------------------------------------- 1.14s 2026-04-03 05:30:25.969858 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 1.13s 2026-04-03 05:30:25.969869 | orchestrator | ovn-controller : include_tasks ------------------------------------------ 1.09s 2026-04-03 05:30:25.969880 | orchestrator | ovn-controller : Ensuring systemd override directory exists ------------- 1.07s 2026-04-03 05:30:26.282874 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 05:30:26.282964 | orchestrator | + sh -c /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh 2026-04-03 05:30:28.445302 | orchestrator | 2026-04-03 05:30:28 | INFO  | Trying to run play wipe-partitions in environment custom 2026-04-03 05:30:38.667522 | orchestrator | 2026-04-03 05:30:38 | INFO  | Task b1285149-c5c5-4291-92fe-e17df0438104 (wipe-partitions) was prepared for execution. 2026-04-03 05:30:38.667656 | orchestrator | 2026-04-03 05:30:38 | INFO  | It takes a moment until task b1285149-c5c5-4291-92fe-e17df0438104 (wipe-partitions) has been started and output is visible here. 2026-04-03 05:30:51.085929 | orchestrator | 2026-04-03 05:30:51.086119 | orchestrator | PLAY [Wipe partitions] ********************************************************* 2026-04-03 05:30:51.086140 | orchestrator | 2026-04-03 05:30:51.086152 | orchestrator | TASK [Find all logical devices owned by UID 167] ******************************* 2026-04-03 05:30:51.086164 | orchestrator | Friday 03 April 2026 05:30:42 +0000 (0:00:00.129) 0:00:00.129 ********** 2026-04-03 05:30:51.086202 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:30:51.086216 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:30:51.086227 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:30:51.086238 | orchestrator | 2026-04-03 05:30:51.086248 | orchestrator | TASK [Remove all rook related logical devices] ********************************* 2026-04-03 05:30:51.086259 | orchestrator | Friday 03 April 2026 05:30:43 +0000 (0:00:00.585) 0:00:00.715 ********** 2026-04-03 05:30:51.086270 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:30:51.086281 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:30:51.086292 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:30:51.086302 | orchestrator | 2026-04-03 05:30:51.086313 | orchestrator | TASK [Find all logical devices with prefix ceph] ******************************* 2026-04-03 05:30:51.086325 | orchestrator | Friday 03 April 2026 05:30:43 +0000 (0:00:00.371) 0:00:01.087 ********** 2026-04-03 05:30:51.086336 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:30:51.086348 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:30:51.086358 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:30:51.086369 | orchestrator | 2026-04-03 05:30:51.086380 | orchestrator | TASK [Remove all ceph related logical devices] ********************************* 2026-04-03 05:30:51.086391 | orchestrator | Friday 03 April 2026 05:30:44 +0000 (0:00:00.573) 0:00:01.660 ********** 2026-04-03 05:30:51.086402 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:30:51.086413 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:30:51.086424 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:30:51.086435 | orchestrator | 2026-04-03 05:30:51.086446 | orchestrator | TASK [Check device availability] *********************************************** 2026-04-03 05:30:51.086457 | orchestrator | Friday 03 April 2026 05:30:44 +0000 (0:00:00.266) 0:00:01.926 ********** 2026-04-03 05:30:51.086470 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-03 05:30:51.086484 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-03 05:30:51.086496 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-03 05:30:51.086509 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-03 05:30:51.086521 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-03 05:30:51.086534 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-03 05:30:51.086561 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-03 05:30:51.086574 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-03 05:30:51.086586 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-03 05:30:51.086599 | orchestrator | 2026-04-03 05:30:51.086611 | orchestrator | TASK [Wipe partitions with wipefs] ********************************************* 2026-04-03 05:30:51.086624 | orchestrator | Friday 03 April 2026 05:30:45 +0000 (0:00:01.179) 0:00:03.106 ********** 2026-04-03 05:30:51.086638 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdb) 2026-04-03 05:30:51.086651 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdb) 2026-04-03 05:30:51.086663 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdb) 2026-04-03 05:30:51.086676 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdc) 2026-04-03 05:30:51.086689 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdc) 2026-04-03 05:30:51.086701 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdc) 2026-04-03 05:30:51.086714 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdd) 2026-04-03 05:30:51.086726 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdd) 2026-04-03 05:30:51.086739 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdd) 2026-04-03 05:30:51.086752 | orchestrator | 2026-04-03 05:30:51.086766 | orchestrator | TASK [Overwrite first 32M with zeros] ****************************************** 2026-04-03 05:30:51.086779 | orchestrator | Friday 03 April 2026 05:30:47 +0000 (0:00:01.568) 0:00:04.675 ********** 2026-04-03 05:30:51.086791 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-03 05:30:51.086804 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-03 05:30:51.086817 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-03 05:30:51.086828 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-03 05:30:51.086848 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-03 05:30:51.086859 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-03 05:30:51.086869 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-03 05:30:51.086880 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-03 05:30:51.086891 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-03 05:30:51.086902 | orchestrator | 2026-04-03 05:30:51.086913 | orchestrator | TASK [Reload udev rules] ******************************************************* 2026-04-03 05:30:51.086924 | orchestrator | Friday 03 April 2026 05:30:49 +0000 (0:00:02.076) 0:00:06.751 ********** 2026-04-03 05:30:51.086935 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:30:51.086946 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:30:51.086956 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:30:51.086967 | orchestrator | 2026-04-03 05:30:51.086978 | orchestrator | TASK [Request device events from the kernel] *********************************** 2026-04-03 05:30:51.086989 | orchestrator | Friday 03 April 2026 05:30:50 +0000 (0:00:00.626) 0:00:07.378 ********** 2026-04-03 05:30:51.087000 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:30:51.087011 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:30:51.087021 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:30:51.087050 | orchestrator | 2026-04-03 05:30:51.087061 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:30:51.087074 | orchestrator | testbed-node-3 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:30:51.087085 | orchestrator | testbed-node-4 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:30:51.087114 | orchestrator | testbed-node-5 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:30:51.087126 | orchestrator | 2026-04-03 05:30:51.087137 | orchestrator | 2026-04-03 05:30:51.087149 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:30:51.087160 | orchestrator | Friday 03 April 2026 05:30:50 +0000 (0:00:00.633) 0:00:08.012 ********** 2026-04-03 05:30:51.087171 | orchestrator | =============================================================================== 2026-04-03 05:30:51.087182 | orchestrator | Overwrite first 32M with zeros ------------------------------------------ 2.08s 2026-04-03 05:30:51.087193 | orchestrator | Wipe partitions with wipefs --------------------------------------------- 1.57s 2026-04-03 05:30:51.087204 | orchestrator | Check device availability ----------------------------------------------- 1.18s 2026-04-03 05:30:51.087215 | orchestrator | Request device events from the kernel ----------------------------------- 0.63s 2026-04-03 05:30:51.087226 | orchestrator | Reload udev rules ------------------------------------------------------- 0.63s 2026-04-03 05:30:51.087237 | orchestrator | Find all logical devices owned by UID 167 ------------------------------- 0.59s 2026-04-03 05:30:51.087248 | orchestrator | Find all logical devices with prefix ceph ------------------------------- 0.57s 2026-04-03 05:30:51.087259 | orchestrator | Remove all rook related logical devices --------------------------------- 0.37s 2026-04-03 05:30:51.087270 | orchestrator | Remove all ceph related logical devices --------------------------------- 0.27s 2026-04-03 05:31:03.474375 | orchestrator | 2026-04-03 05:31:03 | INFO  | Task 5b3b229f-307e-45f1-8f56-bdc9784321ab (facts) was prepared for execution. 2026-04-03 05:31:03.474477 | orchestrator | 2026-04-03 05:31:03 | INFO  | It takes a moment until task 5b3b229f-307e-45f1-8f56-bdc9784321ab (facts) has been started and output is visible here. 2026-04-03 05:31:15.951873 | orchestrator | 2026-04-03 05:31:15.951981 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-03 05:31:15.951999 | orchestrator | 2026-04-03 05:31:15.952106 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 05:31:15.952120 | orchestrator | Friday 03 April 2026 05:31:07 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-03 05:31:15.952157 | orchestrator | ok: [testbed-manager] 2026-04-03 05:31:15.952170 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:31:15.952181 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:31:15.952192 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:31:15.952203 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:15.952214 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:15.952225 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:31:15.952236 | orchestrator | 2026-04-03 05:31:15.952247 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 05:31:15.952260 | orchestrator | Friday 03 April 2026 05:31:08 +0000 (0:00:01.133) 0:00:01.395 ********** 2026-04-03 05:31:15.952272 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:31:15.952284 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:31:15.952295 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:31:15.952306 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:31:15.952317 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:15.952328 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:15.952340 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:31:15.952351 | orchestrator | 2026-04-03 05:31:15.952362 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 05:31:15.952373 | orchestrator | 2026-04-03 05:31:15.952384 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 05:31:15.952395 | orchestrator | Friday 03 April 2026 05:31:10 +0000 (0:00:01.275) 0:00:02.671 ********** 2026-04-03 05:31:15.952406 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:31:15.952417 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:31:15.952429 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:31:15.952442 | orchestrator | ok: [testbed-manager] 2026-04-03 05:31:15.952454 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:15.952467 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:31:15.952480 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:15.952492 | orchestrator | 2026-04-03 05:31:15.952505 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 05:31:15.952517 | orchestrator | 2026-04-03 05:31:15.952530 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 05:31:15.952543 | orchestrator | Friday 03 April 2026 05:31:14 +0000 (0:00:04.862) 0:00:07.533 ********** 2026-04-03 05:31:15.952556 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:31:15.952568 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:31:15.952580 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:31:15.952593 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:31:15.952606 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:15.952618 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:15.952630 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:31:15.952642 | orchestrator | 2026-04-03 05:31:15.952655 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:31:15.952669 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952766 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952788 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952800 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952811 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952822 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952841 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:31:15.952852 | orchestrator | 2026-04-03 05:31:15.952863 | orchestrator | 2026-04-03 05:31:15.952874 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:31:15.952885 | orchestrator | Friday 03 April 2026 05:31:15 +0000 (0:00:00.555) 0:00:08.089 ********** 2026-04-03 05:31:15.952897 | orchestrator | =============================================================================== 2026-04-03 05:31:15.952908 | orchestrator | Gathers facts about hosts ----------------------------------------------- 4.86s 2026-04-03 05:31:15.952919 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.28s 2026-04-03 05:31:15.952930 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.13s 2026-04-03 05:31:15.952941 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.56s 2026-04-03 05:31:18.333732 | orchestrator | 2026-04-03 05:31:18 | INFO  | Task 7013e047-a233-4abe-b13b-08a77e5b18b0 (ceph-configure-lvm-volumes) was prepared for execution. 2026-04-03 05:31:18.333850 | orchestrator | 2026-04-03 05:31:18 | INFO  | It takes a moment until task 7013e047-a233-4abe-b13b-08a77e5b18b0 (ceph-configure-lvm-volumes) has been started and output is visible here. 2026-04-03 05:31:31.318328 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 05:31:31.318441 | orchestrator | 2.16.14 2026-04-03 05:31:31.318459 | orchestrator | 2026-04-03 05:31:31.318472 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-03 05:31:31.318484 | orchestrator | 2026-04-03 05:31:31.318495 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:31:31.318507 | orchestrator | Friday 03 April 2026 05:31:22 +0000 (0:00:00.354) 0:00:00.354 ********** 2026-04-03 05:31:31.318519 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 05:31:31.318530 | orchestrator | 2026-04-03 05:31:31.318557 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:31:31.318569 | orchestrator | Friday 03 April 2026 05:31:23 +0000 (0:00:00.261) 0:00:00.615 ********** 2026-04-03 05:31:31.318581 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:31.318592 | orchestrator | 2026-04-03 05:31:31.318604 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.318615 | orchestrator | Friday 03 April 2026 05:31:23 +0000 (0:00:00.245) 0:00:00.861 ********** 2026-04-03 05:31:31.318627 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-03 05:31:31.318638 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-03 05:31:31.318650 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-03 05:31:31.318661 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-03 05:31:31.318673 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-03 05:31:31.318684 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-03 05:31:31.318695 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-03 05:31:31.318707 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-03 05:31:31.318718 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-03 05:31:31.318730 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-03 05:31:31.318741 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-03 05:31:31.318753 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-03 05:31:31.318787 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-03 05:31:31.318799 | orchestrator | 2026-04-03 05:31:31.318810 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.318822 | orchestrator | Friday 03 April 2026 05:31:23 +0000 (0:00:00.512) 0:00:01.374 ********** 2026-04-03 05:31:31.318833 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.318846 | orchestrator | 2026-04-03 05:31:31.318857 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.318871 | orchestrator | Friday 03 April 2026 05:31:24 +0000 (0:00:00.226) 0:00:01.600 ********** 2026-04-03 05:31:31.318884 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.318897 | orchestrator | 2026-04-03 05:31:31.318910 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.318923 | orchestrator | Friday 03 April 2026 05:31:24 +0000 (0:00:00.256) 0:00:01.856 ********** 2026-04-03 05:31:31.318936 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.318950 | orchestrator | 2026-04-03 05:31:31.318963 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.318976 | orchestrator | Friday 03 April 2026 05:31:24 +0000 (0:00:00.216) 0:00:02.073 ********** 2026-04-03 05:31:31.318990 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319064 | orchestrator | 2026-04-03 05:31:31.319077 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319091 | orchestrator | Friday 03 April 2026 05:31:24 +0000 (0:00:00.219) 0:00:02.292 ********** 2026-04-03 05:31:31.319103 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319115 | orchestrator | 2026-04-03 05:31:31.319128 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319140 | orchestrator | Friday 03 April 2026 05:31:25 +0000 (0:00:00.226) 0:00:02.518 ********** 2026-04-03 05:31:31.319153 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319166 | orchestrator | 2026-04-03 05:31:31.319178 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319191 | orchestrator | Friday 03 April 2026 05:31:25 +0000 (0:00:00.216) 0:00:02.735 ********** 2026-04-03 05:31:31.319203 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319216 | orchestrator | 2026-04-03 05:31:31.319229 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319242 | orchestrator | Friday 03 April 2026 05:31:25 +0000 (0:00:00.231) 0:00:02.967 ********** 2026-04-03 05:31:31.319255 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319266 | orchestrator | 2026-04-03 05:31:31.319277 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319288 | orchestrator | Friday 03 April 2026 05:31:25 +0000 (0:00:00.231) 0:00:03.199 ********** 2026-04-03 05:31:31.319299 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a) 2026-04-03 05:31:31.319311 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a) 2026-04-03 05:31:31.319322 | orchestrator | 2026-04-03 05:31:31.319333 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319361 | orchestrator | Friday 03 April 2026 05:31:26 +0000 (0:00:00.685) 0:00:03.884 ********** 2026-04-03 05:31:31.319373 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9) 2026-04-03 05:31:31.319384 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9) 2026-04-03 05:31:31.319395 | orchestrator | 2026-04-03 05:31:31.319406 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319418 | orchestrator | Friday 03 April 2026 05:31:27 +0000 (0:00:00.729) 0:00:04.614 ********** 2026-04-03 05:31:31.319434 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733) 2026-04-03 05:31:31.319458 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733) 2026-04-03 05:31:31.319469 | orchestrator | 2026-04-03 05:31:31.319480 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319491 | orchestrator | Friday 03 April 2026 05:31:28 +0000 (0:00:00.967) 0:00:05.582 ********** 2026-04-03 05:31:31.319502 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065) 2026-04-03 05:31:31.319513 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065) 2026-04-03 05:31:31.319524 | orchestrator | 2026-04-03 05:31:31.319535 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:31.319546 | orchestrator | Friday 03 April 2026 05:31:28 +0000 (0:00:00.480) 0:00:06.062 ********** 2026-04-03 05:31:31.319557 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:31:31.319568 | orchestrator | 2026-04-03 05:31:31.319579 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.319590 | orchestrator | Friday 03 April 2026 05:31:28 +0000 (0:00:00.356) 0:00:06.419 ********** 2026-04-03 05:31:31.319601 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-03 05:31:31.319612 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-03 05:31:31.319623 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-03 05:31:31.319634 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-03 05:31:31.319645 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-03 05:31:31.319656 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-03 05:31:31.319667 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-03 05:31:31.319678 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-03 05:31:31.319688 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-03 05:31:31.319699 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-03 05:31:31.319710 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-03 05:31:31.319721 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-03 05:31:31.319732 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-03 05:31:31.319750 | orchestrator | 2026-04-03 05:31:31.319769 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.319788 | orchestrator | Friday 03 April 2026 05:31:29 +0000 (0:00:00.395) 0:00:06.815 ********** 2026-04-03 05:31:31.319807 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319826 | orchestrator | 2026-04-03 05:31:31.319844 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.319862 | orchestrator | Friday 03 April 2026 05:31:29 +0000 (0:00:00.212) 0:00:07.027 ********** 2026-04-03 05:31:31.319882 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319901 | orchestrator | 2026-04-03 05:31:31.319920 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.319941 | orchestrator | Friday 03 April 2026 05:31:29 +0000 (0:00:00.206) 0:00:07.233 ********** 2026-04-03 05:31:31.319955 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.319967 | orchestrator | 2026-04-03 05:31:31.319978 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.319989 | orchestrator | Friday 03 April 2026 05:31:30 +0000 (0:00:00.237) 0:00:07.471 ********** 2026-04-03 05:31:31.320037 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.320050 | orchestrator | 2026-04-03 05:31:31.320061 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.320072 | orchestrator | Friday 03 April 2026 05:31:30 +0000 (0:00:00.234) 0:00:07.705 ********** 2026-04-03 05:31:31.320084 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.320095 | orchestrator | 2026-04-03 05:31:31.320106 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.320117 | orchestrator | Friday 03 April 2026 05:31:30 +0000 (0:00:00.214) 0:00:07.919 ********** 2026-04-03 05:31:31.320128 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.320139 | orchestrator | 2026-04-03 05:31:31.320150 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:31.320161 | orchestrator | Friday 03 April 2026 05:31:31 +0000 (0:00:00.626) 0:00:08.545 ********** 2026-04-03 05:31:31.320172 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:31.320184 | orchestrator | 2026-04-03 05:31:31.320203 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.026622 | orchestrator | Friday 03 April 2026 05:31:31 +0000 (0:00:00.222) 0:00:08.768 ********** 2026-04-03 05:31:39.026718 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.026731 | orchestrator | 2026-04-03 05:31:39.026742 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.026751 | orchestrator | Friday 03 April 2026 05:31:31 +0000 (0:00:00.218) 0:00:08.986 ********** 2026-04-03 05:31:39.026760 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-03 05:31:39.026770 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-03 05:31:39.026779 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-03 05:31:39.026808 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-03 05:31:39.026824 | orchestrator | 2026-04-03 05:31:39.026845 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.026859 | orchestrator | Friday 03 April 2026 05:31:32 +0000 (0:00:00.676) 0:00:09.663 ********** 2026-04-03 05:31:39.026874 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.026888 | orchestrator | 2026-04-03 05:31:39.026902 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.026915 | orchestrator | Friday 03 April 2026 05:31:32 +0000 (0:00:00.225) 0:00:09.888 ********** 2026-04-03 05:31:39.026929 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.026945 | orchestrator | 2026-04-03 05:31:39.026962 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.026977 | orchestrator | Friday 03 April 2026 05:31:32 +0000 (0:00:00.236) 0:00:10.125 ********** 2026-04-03 05:31:39.027044 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027062 | orchestrator | 2026-04-03 05:31:39.027075 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:39.027089 | orchestrator | Friday 03 April 2026 05:31:32 +0000 (0:00:00.281) 0:00:10.407 ********** 2026-04-03 05:31:39.027104 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027118 | orchestrator | 2026-04-03 05:31:39.027132 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-03 05:31:39.027145 | orchestrator | Friday 03 April 2026 05:31:33 +0000 (0:00:00.219) 0:00:10.626 ********** 2026-04-03 05:31:39.027160 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': None}) 2026-04-03 05:31:39.027174 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': None}) 2026-04-03 05:31:39.027189 | orchestrator | 2026-04-03 05:31:39.027203 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-03 05:31:39.027216 | orchestrator | Friday 03 April 2026 05:31:33 +0000 (0:00:00.191) 0:00:10.817 ********** 2026-04-03 05:31:39.027231 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027248 | orchestrator | 2026-04-03 05:31:39.027262 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-03 05:31:39.027278 | orchestrator | Friday 03 April 2026 05:31:33 +0000 (0:00:00.151) 0:00:10.969 ********** 2026-04-03 05:31:39.027320 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027337 | orchestrator | 2026-04-03 05:31:39.027352 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-03 05:31:39.027369 | orchestrator | Friday 03 April 2026 05:31:33 +0000 (0:00:00.146) 0:00:11.115 ********** 2026-04-03 05:31:39.027385 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027402 | orchestrator | 2026-04-03 05:31:39.027418 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-03 05:31:39.027435 | orchestrator | Friday 03 April 2026 05:31:33 +0000 (0:00:00.345) 0:00:11.460 ********** 2026-04-03 05:31:39.027451 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:39.027467 | orchestrator | 2026-04-03 05:31:39.027482 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-03 05:31:39.027499 | orchestrator | Friday 03 April 2026 05:31:34 +0000 (0:00:00.153) 0:00:11.613 ********** 2026-04-03 05:31:39.027517 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '6e05808f-fb53-52d6-a83f-27c91ff5177e'}}) 2026-04-03 05:31:39.027534 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'dc85739a-96e8-5e43-9ed8-b11ad01343fb'}}) 2026-04-03 05:31:39.027548 | orchestrator | 2026-04-03 05:31:39.027563 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-03 05:31:39.027578 | orchestrator | Friday 03 April 2026 05:31:34 +0000 (0:00:00.178) 0:00:11.792 ********** 2026-04-03 05:31:39.027593 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '6e05808f-fb53-52d6-a83f-27c91ff5177e'}})  2026-04-03 05:31:39.027609 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'dc85739a-96e8-5e43-9ed8-b11ad01343fb'}})  2026-04-03 05:31:39.027624 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027639 | orchestrator | 2026-04-03 05:31:39.027654 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-03 05:31:39.027668 | orchestrator | Friday 03 April 2026 05:31:34 +0000 (0:00:00.165) 0:00:11.957 ********** 2026-04-03 05:31:39.027682 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '6e05808f-fb53-52d6-a83f-27c91ff5177e'}})  2026-04-03 05:31:39.027698 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'dc85739a-96e8-5e43-9ed8-b11ad01343fb'}})  2026-04-03 05:31:39.027712 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027727 | orchestrator | 2026-04-03 05:31:39.027742 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-03 05:31:39.027755 | orchestrator | Friday 03 April 2026 05:31:34 +0000 (0:00:00.167) 0:00:12.125 ********** 2026-04-03 05:31:39.027768 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '6e05808f-fb53-52d6-a83f-27c91ff5177e'}})  2026-04-03 05:31:39.027804 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'dc85739a-96e8-5e43-9ed8-b11ad01343fb'}})  2026-04-03 05:31:39.027817 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.027830 | orchestrator | 2026-04-03 05:31:39.027844 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-03 05:31:39.027857 | orchestrator | Friday 03 April 2026 05:31:34 +0000 (0:00:00.193) 0:00:12.318 ********** 2026-04-03 05:31:39.027871 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:39.027886 | orchestrator | 2026-04-03 05:31:39.027900 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-03 05:31:39.027926 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.154) 0:00:12.472 ********** 2026-04-03 05:31:39.027940 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:31:39.027954 | orchestrator | 2026-04-03 05:31:39.027969 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-03 05:31:39.027984 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.159) 0:00:12.632 ********** 2026-04-03 05:31:39.028064 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028079 | orchestrator | 2026-04-03 05:31:39.028094 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-03 05:31:39.028109 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.139) 0:00:12.771 ********** 2026-04-03 05:31:39.028123 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028138 | orchestrator | 2026-04-03 05:31:39.028153 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-03 05:31:39.028168 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.140) 0:00:12.911 ********** 2026-04-03 05:31:39.028182 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028197 | orchestrator | 2026-04-03 05:31:39.028212 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-03 05:31:39.028226 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.147) 0:00:13.059 ********** 2026-04-03 05:31:39.028241 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:31:39.028256 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:31:39.028271 | orchestrator |  "sdb": { 2026-04-03 05:31:39.028286 | orchestrator |  "osd_lvm_uuid": "6e05808f-fb53-52d6-a83f-27c91ff5177e" 2026-04-03 05:31:39.028301 | orchestrator |  }, 2026-04-03 05:31:39.028316 | orchestrator |  "sdc": { 2026-04-03 05:31:39.028331 | orchestrator |  "osd_lvm_uuid": "dc85739a-96e8-5e43-9ed8-b11ad01343fb" 2026-04-03 05:31:39.028345 | orchestrator |  } 2026-04-03 05:31:39.028360 | orchestrator |  } 2026-04-03 05:31:39.028375 | orchestrator | } 2026-04-03 05:31:39.028389 | orchestrator | 2026-04-03 05:31:39.028402 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-03 05:31:39.028415 | orchestrator | Friday 03 April 2026 05:31:35 +0000 (0:00:00.356) 0:00:13.415 ********** 2026-04-03 05:31:39.028428 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028441 | orchestrator | 2026-04-03 05:31:39.028454 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-03 05:31:39.028467 | orchestrator | Friday 03 April 2026 05:31:36 +0000 (0:00:00.149) 0:00:13.565 ********** 2026-04-03 05:31:39.028480 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028493 | orchestrator | 2026-04-03 05:31:39.028507 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-03 05:31:39.028520 | orchestrator | Friday 03 April 2026 05:31:36 +0000 (0:00:00.157) 0:00:13.722 ********** 2026-04-03 05:31:39.028533 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:31:39.028546 | orchestrator | 2026-04-03 05:31:39.028558 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-03 05:31:39.028571 | orchestrator | Friday 03 April 2026 05:31:36 +0000 (0:00:00.169) 0:00:13.892 ********** 2026-04-03 05:31:39.028585 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 05:31:39.028598 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-03 05:31:39.028610 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:31:39.028623 | orchestrator |  "sdb": { 2026-04-03 05:31:39.028635 | orchestrator |  "osd_lvm_uuid": "6e05808f-fb53-52d6-a83f-27c91ff5177e" 2026-04-03 05:31:39.028649 | orchestrator |  }, 2026-04-03 05:31:39.028662 | orchestrator |  "sdc": { 2026-04-03 05:31:39.028675 | orchestrator |  "osd_lvm_uuid": "dc85739a-96e8-5e43-9ed8-b11ad01343fb" 2026-04-03 05:31:39.028689 | orchestrator |  } 2026-04-03 05:31:39.028703 | orchestrator |  }, 2026-04-03 05:31:39.028716 | orchestrator |  "lvm_volumes": [ 2026-04-03 05:31:39.028730 | orchestrator |  { 2026-04-03 05:31:39.028739 | orchestrator |  "data": "osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e", 2026-04-03 05:31:39.028747 | orchestrator |  "data_vg": "ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e" 2026-04-03 05:31:39.028755 | orchestrator |  }, 2026-04-03 05:31:39.028763 | orchestrator |  { 2026-04-03 05:31:39.028771 | orchestrator |  "data": "osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb", 2026-04-03 05:31:39.028787 | orchestrator |  "data_vg": "ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb" 2026-04-03 05:31:39.028797 | orchestrator |  } 2026-04-03 05:31:39.028810 | orchestrator |  ] 2026-04-03 05:31:39.028824 | orchestrator |  } 2026-04-03 05:31:39.028844 | orchestrator | } 2026-04-03 05:31:39.028858 | orchestrator | 2026-04-03 05:31:39.028871 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-03 05:31:39.028883 | orchestrator | Friday 03 April 2026 05:31:36 +0000 (0:00:00.217) 0:00:14.109 ********** 2026-04-03 05:31:39.028896 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 05:31:39.028909 | orchestrator | 2026-04-03 05:31:39.028921 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-03 05:31:39.028934 | orchestrator | 2026-04-03 05:31:39.028947 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:31:39.028960 | orchestrator | Friday 03 April 2026 05:31:38 +0000 (0:00:01.845) 0:00:15.955 ********** 2026-04-03 05:31:39.028973 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-03 05:31:39.028987 | orchestrator | 2026-04-03 05:31:39.029023 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:31:39.029037 | orchestrator | Friday 03 April 2026 05:31:38 +0000 (0:00:00.283) 0:00:16.238 ********** 2026-04-03 05:31:39.029046 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:39.029054 | orchestrator | 2026-04-03 05:31:39.029075 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.017782 | orchestrator | Friday 03 April 2026 05:31:39 +0000 (0:00:00.243) 0:00:16.482 ********** 2026-04-03 05:31:48.017895 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-03 05:31:48.017911 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-03 05:31:48.017923 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-03 05:31:48.017951 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-03 05:31:48.017962 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-03 05:31:48.017974 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-03 05:31:48.018093 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-03 05:31:48.018109 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-03 05:31:48.018121 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-03 05:31:48.018133 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-03 05:31:48.018144 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-03 05:31:48.018155 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-03 05:31:48.018167 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-03 05:31:48.018178 | orchestrator | 2026-04-03 05:31:48.018191 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018202 | orchestrator | Friday 03 April 2026 05:31:39 +0000 (0:00:00.613) 0:00:17.096 ********** 2026-04-03 05:31:48.018214 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018226 | orchestrator | 2026-04-03 05:31:48.018238 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018249 | orchestrator | Friday 03 April 2026 05:31:39 +0000 (0:00:00.214) 0:00:17.310 ********** 2026-04-03 05:31:48.018261 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018272 | orchestrator | 2026-04-03 05:31:48.018283 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018295 | orchestrator | Friday 03 April 2026 05:31:40 +0000 (0:00:00.212) 0:00:17.523 ********** 2026-04-03 05:31:48.018330 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018344 | orchestrator | 2026-04-03 05:31:48.018357 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018370 | orchestrator | Friday 03 April 2026 05:31:40 +0000 (0:00:00.214) 0:00:17.737 ********** 2026-04-03 05:31:48.018383 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018396 | orchestrator | 2026-04-03 05:31:48.018411 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018424 | orchestrator | Friday 03 April 2026 05:31:40 +0000 (0:00:00.207) 0:00:17.945 ********** 2026-04-03 05:31:48.018437 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018450 | orchestrator | 2026-04-03 05:31:48.018463 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018476 | orchestrator | Friday 03 April 2026 05:31:40 +0000 (0:00:00.235) 0:00:18.180 ********** 2026-04-03 05:31:48.018488 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018501 | orchestrator | 2026-04-03 05:31:48.018514 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018527 | orchestrator | Friday 03 April 2026 05:31:40 +0000 (0:00:00.217) 0:00:18.398 ********** 2026-04-03 05:31:48.018540 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018553 | orchestrator | 2026-04-03 05:31:48.018566 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018579 | orchestrator | Friday 03 April 2026 05:31:41 +0000 (0:00:00.240) 0:00:18.639 ********** 2026-04-03 05:31:48.018591 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.018603 | orchestrator | 2026-04-03 05:31:48.018616 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018629 | orchestrator | Friday 03 April 2026 05:31:41 +0000 (0:00:00.213) 0:00:18.852 ********** 2026-04-03 05:31:48.018642 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df) 2026-04-03 05:31:48.018656 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df) 2026-04-03 05:31:48.018669 | orchestrator | 2026-04-03 05:31:48.018683 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018694 | orchestrator | Friday 03 April 2026 05:31:42 +0000 (0:00:00.649) 0:00:19.502 ********** 2026-04-03 05:31:48.018705 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506) 2026-04-03 05:31:48.018716 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506) 2026-04-03 05:31:48.018727 | orchestrator | 2026-04-03 05:31:48.018738 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018749 | orchestrator | Friday 03 April 2026 05:31:42 +0000 (0:00:00.682) 0:00:20.184 ********** 2026-04-03 05:31:48.018761 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243) 2026-04-03 05:31:48.018772 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243) 2026-04-03 05:31:48.018783 | orchestrator | 2026-04-03 05:31:48.018794 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018822 | orchestrator | Friday 03 April 2026 05:31:43 +0000 (0:00:00.912) 0:00:21.096 ********** 2026-04-03 05:31:48.018834 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7) 2026-04-03 05:31:48.018845 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7) 2026-04-03 05:31:48.018857 | orchestrator | 2026-04-03 05:31:48.018868 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:48.018885 | orchestrator | Friday 03 April 2026 05:31:44 +0000 (0:00:00.468) 0:00:21.565 ********** 2026-04-03 05:31:48.018896 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:31:48.018915 | orchestrator | 2026-04-03 05:31:48.018927 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.018938 | orchestrator | Friday 03 April 2026 05:31:44 +0000 (0:00:00.363) 0:00:21.929 ********** 2026-04-03 05:31:48.018950 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-03 05:31:48.018961 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-03 05:31:48.018972 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-03 05:31:48.018983 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-03 05:31:48.019017 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-03 05:31:48.019028 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-03 05:31:48.019039 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-03 05:31:48.019050 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-03 05:31:48.019061 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-03 05:31:48.019072 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-03 05:31:48.019084 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-03 05:31:48.019095 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-03 05:31:48.019106 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-03 05:31:48.019118 | orchestrator | 2026-04-03 05:31:48.019129 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019140 | orchestrator | Friday 03 April 2026 05:31:44 +0000 (0:00:00.413) 0:00:22.342 ********** 2026-04-03 05:31:48.019151 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019162 | orchestrator | 2026-04-03 05:31:48.019173 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019185 | orchestrator | Friday 03 April 2026 05:31:45 +0000 (0:00:00.199) 0:00:22.541 ********** 2026-04-03 05:31:48.019196 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019207 | orchestrator | 2026-04-03 05:31:48.019218 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019229 | orchestrator | Friday 03 April 2026 05:31:45 +0000 (0:00:00.207) 0:00:22.748 ********** 2026-04-03 05:31:48.019240 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019251 | orchestrator | 2026-04-03 05:31:48.019262 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019273 | orchestrator | Friday 03 April 2026 05:31:45 +0000 (0:00:00.200) 0:00:22.948 ********** 2026-04-03 05:31:48.019285 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019296 | orchestrator | 2026-04-03 05:31:48.019307 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019318 | orchestrator | Friday 03 April 2026 05:31:45 +0000 (0:00:00.241) 0:00:23.189 ********** 2026-04-03 05:31:48.019329 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019340 | orchestrator | 2026-04-03 05:31:48.019351 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019363 | orchestrator | Friday 03 April 2026 05:31:45 +0000 (0:00:00.216) 0:00:23.406 ********** 2026-04-03 05:31:48.019374 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019385 | orchestrator | 2026-04-03 05:31:48.019396 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019407 | orchestrator | Friday 03 April 2026 05:31:46 +0000 (0:00:00.211) 0:00:23.617 ********** 2026-04-03 05:31:48.019418 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019436 | orchestrator | 2026-04-03 05:31:48.019447 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019458 | orchestrator | Friday 03 April 2026 05:31:46 +0000 (0:00:00.209) 0:00:23.827 ********** 2026-04-03 05:31:48.019469 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:48.019480 | orchestrator | 2026-04-03 05:31:48.019491 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019503 | orchestrator | Friday 03 April 2026 05:31:47 +0000 (0:00:00.679) 0:00:24.506 ********** 2026-04-03 05:31:48.019514 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-03 05:31:48.019525 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-03 05:31:48.019536 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-03 05:31:48.019547 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-03 05:31:48.019558 | orchestrator | 2026-04-03 05:31:48.019570 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:48.019581 | orchestrator | Friday 03 April 2026 05:31:47 +0000 (0:00:00.749) 0:00:25.256 ********** 2026-04-03 05:31:48.019592 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.202787 | orchestrator | 2026-04-03 05:31:54.202883 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:54.202895 | orchestrator | Friday 03 April 2026 05:31:48 +0000 (0:00:00.218) 0:00:25.474 ********** 2026-04-03 05:31:54.202904 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.202914 | orchestrator | 2026-04-03 05:31:54.202922 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:54.202931 | orchestrator | Friday 03 April 2026 05:31:48 +0000 (0:00:00.251) 0:00:25.726 ********** 2026-04-03 05:31:54.202954 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.202962 | orchestrator | 2026-04-03 05:31:54.202971 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:31:54.203025 | orchestrator | Friday 03 April 2026 05:31:48 +0000 (0:00:00.258) 0:00:25.984 ********** 2026-04-03 05:31:54.203036 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203044 | orchestrator | 2026-04-03 05:31:54.203052 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-03 05:31:54.203060 | orchestrator | Friday 03 April 2026 05:31:48 +0000 (0:00:00.241) 0:00:26.226 ********** 2026-04-03 05:31:54.203068 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': None}) 2026-04-03 05:31:54.203076 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': None}) 2026-04-03 05:31:54.203084 | orchestrator | 2026-04-03 05:31:54.203092 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-03 05:31:54.203100 | orchestrator | Friday 03 April 2026 05:31:48 +0000 (0:00:00.179) 0:00:26.405 ********** 2026-04-03 05:31:54.203108 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203116 | orchestrator | 2026-04-03 05:31:54.203123 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-03 05:31:54.203131 | orchestrator | Friday 03 April 2026 05:31:49 +0000 (0:00:00.154) 0:00:26.559 ********** 2026-04-03 05:31:54.203139 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203147 | orchestrator | 2026-04-03 05:31:54.203155 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-03 05:31:54.203163 | orchestrator | Friday 03 April 2026 05:31:49 +0000 (0:00:00.136) 0:00:26.695 ********** 2026-04-03 05:31:54.203171 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203179 | orchestrator | 2026-04-03 05:31:54.203187 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-03 05:31:54.203195 | orchestrator | Friday 03 April 2026 05:31:49 +0000 (0:00:00.138) 0:00:26.834 ********** 2026-04-03 05:31:54.203203 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:54.203211 | orchestrator | 2026-04-03 05:31:54.203219 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-03 05:31:54.203227 | orchestrator | Friday 03 April 2026 05:31:49 +0000 (0:00:00.152) 0:00:26.986 ********** 2026-04-03 05:31:54.203257 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '22674541-64cc-5df8-a9f8-30ff652f1dce'}}) 2026-04-03 05:31:54.203266 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'd44e23ea-2eda-5203-86ef-10b85847f309'}}) 2026-04-03 05:31:54.203274 | orchestrator | 2026-04-03 05:31:54.203282 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-03 05:31:54.203291 | orchestrator | Friday 03 April 2026 05:31:49 +0000 (0:00:00.178) 0:00:27.165 ********** 2026-04-03 05:31:54.203299 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '22674541-64cc-5df8-a9f8-30ff652f1dce'}})  2026-04-03 05:31:54.203309 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'd44e23ea-2eda-5203-86ef-10b85847f309'}})  2026-04-03 05:31:54.203317 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203325 | orchestrator | 2026-04-03 05:31:54.203333 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-03 05:31:54.203341 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.372) 0:00:27.537 ********** 2026-04-03 05:31:54.203351 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '22674541-64cc-5df8-a9f8-30ff652f1dce'}})  2026-04-03 05:31:54.203361 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'd44e23ea-2eda-5203-86ef-10b85847f309'}})  2026-04-03 05:31:54.203370 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203379 | orchestrator | 2026-04-03 05:31:54.203388 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-03 05:31:54.203398 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.166) 0:00:27.704 ********** 2026-04-03 05:31:54.203407 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '22674541-64cc-5df8-a9f8-30ff652f1dce'}})  2026-04-03 05:31:54.203417 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'd44e23ea-2eda-5203-86ef-10b85847f309'}})  2026-04-03 05:31:54.203425 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203433 | orchestrator | 2026-04-03 05:31:54.203441 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-03 05:31:54.203449 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.163) 0:00:27.868 ********** 2026-04-03 05:31:54.203457 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:54.203465 | orchestrator | 2026-04-03 05:31:54.203473 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-03 05:31:54.203480 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.149) 0:00:28.017 ********** 2026-04-03 05:31:54.203488 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:31:54.203496 | orchestrator | 2026-04-03 05:31:54.203504 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-03 05:31:54.203512 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.161) 0:00:28.179 ********** 2026-04-03 05:31:54.203533 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203542 | orchestrator | 2026-04-03 05:31:54.203550 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-03 05:31:54.203558 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.148) 0:00:28.327 ********** 2026-04-03 05:31:54.203566 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203574 | orchestrator | 2026-04-03 05:31:54.203582 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-03 05:31:54.203590 | orchestrator | Friday 03 April 2026 05:31:50 +0000 (0:00:00.133) 0:00:28.460 ********** 2026-04-03 05:31:54.203603 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203611 | orchestrator | 2026-04-03 05:31:54.203619 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-03 05:31:54.203627 | orchestrator | Friday 03 April 2026 05:31:51 +0000 (0:00:00.146) 0:00:28.607 ********** 2026-04-03 05:31:54.203641 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:31:54.203649 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:31:54.203657 | orchestrator |  "sdb": { 2026-04-03 05:31:54.203665 | orchestrator |  "osd_lvm_uuid": "22674541-64cc-5df8-a9f8-30ff652f1dce" 2026-04-03 05:31:54.203674 | orchestrator |  }, 2026-04-03 05:31:54.203682 | orchestrator |  "sdc": { 2026-04-03 05:31:54.203690 | orchestrator |  "osd_lvm_uuid": "d44e23ea-2eda-5203-86ef-10b85847f309" 2026-04-03 05:31:54.203698 | orchestrator |  } 2026-04-03 05:31:54.203705 | orchestrator |  } 2026-04-03 05:31:54.203714 | orchestrator | } 2026-04-03 05:31:54.203722 | orchestrator | 2026-04-03 05:31:54.203730 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-03 05:31:54.203738 | orchestrator | Friday 03 April 2026 05:31:51 +0000 (0:00:00.151) 0:00:28.759 ********** 2026-04-03 05:31:54.203746 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203755 | orchestrator | 2026-04-03 05:31:54.203763 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-03 05:31:54.203771 | orchestrator | Friday 03 April 2026 05:31:51 +0000 (0:00:00.141) 0:00:28.901 ********** 2026-04-03 05:31:54.203779 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203787 | orchestrator | 2026-04-03 05:31:54.203795 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-03 05:31:54.203803 | orchestrator | Friday 03 April 2026 05:31:51 +0000 (0:00:00.146) 0:00:29.047 ********** 2026-04-03 05:31:54.203811 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:31:54.203819 | orchestrator | 2026-04-03 05:31:54.203827 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-03 05:31:54.203835 | orchestrator | Friday 03 April 2026 05:31:51 +0000 (0:00:00.139) 0:00:29.187 ********** 2026-04-03 05:31:54.203843 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 05:31:54.203851 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-03 05:31:54.203859 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:31:54.203867 | orchestrator |  "sdb": { 2026-04-03 05:31:54.203875 | orchestrator |  "osd_lvm_uuid": "22674541-64cc-5df8-a9f8-30ff652f1dce" 2026-04-03 05:31:54.203883 | orchestrator |  }, 2026-04-03 05:31:54.203891 | orchestrator |  "sdc": { 2026-04-03 05:31:54.203899 | orchestrator |  "osd_lvm_uuid": "d44e23ea-2eda-5203-86ef-10b85847f309" 2026-04-03 05:31:54.203908 | orchestrator |  } 2026-04-03 05:31:54.203916 | orchestrator |  }, 2026-04-03 05:31:54.203923 | orchestrator |  "lvm_volumes": [ 2026-04-03 05:31:54.203931 | orchestrator |  { 2026-04-03 05:31:54.203940 | orchestrator |  "data": "osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce", 2026-04-03 05:31:54.203948 | orchestrator |  "data_vg": "ceph-22674541-64cc-5df8-a9f8-30ff652f1dce" 2026-04-03 05:31:54.203956 | orchestrator |  }, 2026-04-03 05:31:54.203964 | orchestrator |  { 2026-04-03 05:31:54.203972 | orchestrator |  "data": "osd-block-d44e23ea-2eda-5203-86ef-10b85847f309", 2026-04-03 05:31:54.203994 | orchestrator |  "data_vg": "ceph-d44e23ea-2eda-5203-86ef-10b85847f309" 2026-04-03 05:31:54.204002 | orchestrator |  } 2026-04-03 05:31:54.204010 | orchestrator |  ] 2026-04-03 05:31:54.204019 | orchestrator |  } 2026-04-03 05:31:54.204027 | orchestrator | } 2026-04-03 05:31:54.204035 | orchestrator | 2026-04-03 05:31:54.204043 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-03 05:31:54.204051 | orchestrator | Friday 03 April 2026 05:31:52 +0000 (0:00:00.429) 0:00:29.616 ********** 2026-04-03 05:31:54.204059 | orchestrator | changed: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-03 05:31:54.204067 | orchestrator | 2026-04-03 05:31:54.204075 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-03 05:31:54.204083 | orchestrator | 2026-04-03 05:31:54.204091 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:31:54.204099 | orchestrator | Friday 03 April 2026 05:31:53 +0000 (0:00:01.154) 0:00:30.771 ********** 2026-04-03 05:31:54.204114 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-03 05:31:54.204122 | orchestrator | 2026-04-03 05:31:54.204130 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:31:54.204138 | orchestrator | Friday 03 April 2026 05:31:53 +0000 (0:00:00.252) 0:00:31.023 ********** 2026-04-03 05:31:54.204146 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:31:54.204154 | orchestrator | 2026-04-03 05:31:54.204162 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:31:54.204170 | orchestrator | Friday 03 April 2026 05:31:53 +0000 (0:00:00.246) 0:00:31.269 ********** 2026-04-03 05:31:54.204178 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-03 05:31:54.204186 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-03 05:31:54.204194 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-03 05:31:54.204202 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-03 05:31:54.204210 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-03 05:31:54.204223 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-03 05:32:03.325745 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-03 05:32:03.325836 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-03 05:32:03.325845 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-03 05:32:03.325854 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-03 05:32:03.325875 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-03 05:32:03.325884 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-03 05:32:03.325891 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-03 05:32:03.325899 | orchestrator | 2026-04-03 05:32:03.325907 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.325915 | orchestrator | Friday 03 April 2026 05:31:54 +0000 (0:00:00.386) 0:00:31.655 ********** 2026-04-03 05:32:03.325923 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.325931 | orchestrator | 2026-04-03 05:32:03.325939 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.325946 | orchestrator | Friday 03 April 2026 05:31:54 +0000 (0:00:00.204) 0:00:31.860 ********** 2026-04-03 05:32:03.325953 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.325960 | orchestrator | 2026-04-03 05:32:03.325967 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326069 | orchestrator | Friday 03 April 2026 05:31:54 +0000 (0:00:00.208) 0:00:32.069 ********** 2026-04-03 05:32:03.326079 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326086 | orchestrator | 2026-04-03 05:32:03.326094 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326101 | orchestrator | Friday 03 April 2026 05:31:54 +0000 (0:00:00.277) 0:00:32.346 ********** 2026-04-03 05:32:03.326108 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326115 | orchestrator | 2026-04-03 05:32:03.326123 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326130 | orchestrator | Friday 03 April 2026 05:31:55 +0000 (0:00:00.635) 0:00:32.981 ********** 2026-04-03 05:32:03.326137 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326145 | orchestrator | 2026-04-03 05:32:03.326152 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326159 | orchestrator | Friday 03 April 2026 05:31:55 +0000 (0:00:00.242) 0:00:33.224 ********** 2026-04-03 05:32:03.326188 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326196 | orchestrator | 2026-04-03 05:32:03.326203 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326210 | orchestrator | Friday 03 April 2026 05:31:56 +0000 (0:00:00.247) 0:00:33.471 ********** 2026-04-03 05:32:03.326217 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326224 | orchestrator | 2026-04-03 05:32:03.326232 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326239 | orchestrator | Friday 03 April 2026 05:31:56 +0000 (0:00:00.204) 0:00:33.676 ********** 2026-04-03 05:32:03.326246 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326253 | orchestrator | 2026-04-03 05:32:03.326260 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326268 | orchestrator | Friday 03 April 2026 05:31:56 +0000 (0:00:00.226) 0:00:33.902 ********** 2026-04-03 05:32:03.326275 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6) 2026-04-03 05:32:03.326284 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6) 2026-04-03 05:32:03.326291 | orchestrator | 2026-04-03 05:32:03.326298 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326305 | orchestrator | Friday 03 April 2026 05:31:56 +0000 (0:00:00.487) 0:00:34.389 ********** 2026-04-03 05:32:03.326313 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7) 2026-04-03 05:32:03.326320 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7) 2026-04-03 05:32:03.326327 | orchestrator | 2026-04-03 05:32:03.326334 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326341 | orchestrator | Friday 03 April 2026 05:31:57 +0000 (0:00:00.462) 0:00:34.852 ********** 2026-04-03 05:32:03.326348 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d) 2026-04-03 05:32:03.326356 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d) 2026-04-03 05:32:03.326363 | orchestrator | 2026-04-03 05:32:03.326370 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326377 | orchestrator | Friday 03 April 2026 05:31:57 +0000 (0:00:00.476) 0:00:35.328 ********** 2026-04-03 05:32:03.326385 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4) 2026-04-03 05:32:03.326392 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4) 2026-04-03 05:32:03.326399 | orchestrator | 2026-04-03 05:32:03.326407 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:32:03.326414 | orchestrator | Friday 03 April 2026 05:31:58 +0000 (0:00:00.479) 0:00:35.808 ********** 2026-04-03 05:32:03.326421 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:32:03.326428 | orchestrator | 2026-04-03 05:32:03.326435 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326456 | orchestrator | Friday 03 April 2026 05:31:58 +0000 (0:00:00.344) 0:00:36.153 ********** 2026-04-03 05:32:03.326464 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-03 05:32:03.326471 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-03 05:32:03.326478 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-03 05:32:03.326490 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-03 05:32:03.326498 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-03 05:32:03.326505 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-03 05:32:03.326518 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-03 05:32:03.326525 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-03 05:32:03.326532 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-03 05:32:03.326539 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-03 05:32:03.326546 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-03 05:32:03.326554 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-03 05:32:03.326561 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-03 05:32:03.326568 | orchestrator | 2026-04-03 05:32:03.326575 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326582 | orchestrator | Friday 03 April 2026 05:31:59 +0000 (0:00:00.630) 0:00:36.784 ********** 2026-04-03 05:32:03.326590 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326597 | orchestrator | 2026-04-03 05:32:03.326604 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326611 | orchestrator | Friday 03 April 2026 05:31:59 +0000 (0:00:00.205) 0:00:36.989 ********** 2026-04-03 05:32:03.326618 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326626 | orchestrator | 2026-04-03 05:32:03.326633 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326640 | orchestrator | Friday 03 April 2026 05:31:59 +0000 (0:00:00.200) 0:00:37.190 ********** 2026-04-03 05:32:03.326647 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326654 | orchestrator | 2026-04-03 05:32:03.326662 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326669 | orchestrator | Friday 03 April 2026 05:31:59 +0000 (0:00:00.212) 0:00:37.403 ********** 2026-04-03 05:32:03.326676 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326683 | orchestrator | 2026-04-03 05:32:03.326690 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326698 | orchestrator | Friday 03 April 2026 05:32:00 +0000 (0:00:00.216) 0:00:37.619 ********** 2026-04-03 05:32:03.326705 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326712 | orchestrator | 2026-04-03 05:32:03.326719 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326726 | orchestrator | Friday 03 April 2026 05:32:00 +0000 (0:00:00.203) 0:00:37.823 ********** 2026-04-03 05:32:03.326734 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326741 | orchestrator | 2026-04-03 05:32:03.326748 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326755 | orchestrator | Friday 03 April 2026 05:32:00 +0000 (0:00:00.212) 0:00:38.035 ********** 2026-04-03 05:32:03.326764 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326776 | orchestrator | 2026-04-03 05:32:03.326788 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326800 | orchestrator | Friday 03 April 2026 05:32:00 +0000 (0:00:00.238) 0:00:38.274 ********** 2026-04-03 05:32:03.326813 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326824 | orchestrator | 2026-04-03 05:32:03.326835 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326847 | orchestrator | Friday 03 April 2026 05:32:01 +0000 (0:00:00.223) 0:00:38.497 ********** 2026-04-03 05:32:03.326859 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-03 05:32:03.326870 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-03 05:32:03.326882 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-03 05:32:03.326894 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-03 05:32:03.326905 | orchestrator | 2026-04-03 05:32:03.326924 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.326935 | orchestrator | Friday 03 April 2026 05:32:01 +0000 (0:00:00.894) 0:00:39.392 ********** 2026-04-03 05:32:03.326947 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.326958 | orchestrator | 2026-04-03 05:32:03.326970 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.327000 | orchestrator | Friday 03 April 2026 05:32:02 +0000 (0:00:00.213) 0:00:39.605 ********** 2026-04-03 05:32:03.327014 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.327026 | orchestrator | 2026-04-03 05:32:03.327038 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.327050 | orchestrator | Friday 03 April 2026 05:32:02 +0000 (0:00:00.241) 0:00:39.847 ********** 2026-04-03 05:32:03.327058 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.327065 | orchestrator | 2026-04-03 05:32:03.327072 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:32:03.327080 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.715) 0:00:40.562 ********** 2026-04-03 05:32:03.327087 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:03.327094 | orchestrator | 2026-04-03 05:32:03.327109 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-03 05:32:07.644407 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.220) 0:00:40.782 ********** 2026-04-03 05:32:07.644510 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': None}) 2026-04-03 05:32:07.644532 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': None}) 2026-04-03 05:32:07.644549 | orchestrator | 2026-04-03 05:32:07.644566 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-03 05:32:07.644605 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.188) 0:00:40.971 ********** 2026-04-03 05:32:07.644625 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.644644 | orchestrator | 2026-04-03 05:32:07.644663 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-03 05:32:07.644680 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.152) 0:00:41.123 ********** 2026-04-03 05:32:07.644697 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.644715 | orchestrator | 2026-04-03 05:32:07.644737 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-03 05:32:07.644756 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.148) 0:00:41.272 ********** 2026-04-03 05:32:07.644766 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.644776 | orchestrator | 2026-04-03 05:32:07.644786 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-03 05:32:07.644796 | orchestrator | Friday 03 April 2026 05:32:03 +0000 (0:00:00.151) 0:00:41.423 ********** 2026-04-03 05:32:07.644806 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:32:07.644816 | orchestrator | 2026-04-03 05:32:07.644826 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-03 05:32:07.644836 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.158) 0:00:41.582 ********** 2026-04-03 05:32:07.644846 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '0168ecd7-dd70-56c3-8572-150117512a85'}}) 2026-04-03 05:32:07.644857 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}}) 2026-04-03 05:32:07.644866 | orchestrator | 2026-04-03 05:32:07.644876 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-03 05:32:07.644899 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.180) 0:00:41.763 ********** 2026-04-03 05:32:07.644911 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '0168ecd7-dd70-56c3-8572-150117512a85'}})  2026-04-03 05:32:07.644923 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}})  2026-04-03 05:32:07.644932 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.644965 | orchestrator | 2026-04-03 05:32:07.645018 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-03 05:32:07.645031 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.163) 0:00:41.926 ********** 2026-04-03 05:32:07.645042 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '0168ecd7-dd70-56c3-8572-150117512a85'}})  2026-04-03 05:32:07.645053 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}})  2026-04-03 05:32:07.645064 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645076 | orchestrator | 2026-04-03 05:32:07.645088 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-03 05:32:07.645101 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.159) 0:00:42.086 ********** 2026-04-03 05:32:07.645112 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '0168ecd7-dd70-56c3-8572-150117512a85'}})  2026-04-03 05:32:07.645124 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}})  2026-04-03 05:32:07.645136 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645147 | orchestrator | 2026-04-03 05:32:07.645160 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-03 05:32:07.645171 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.171) 0:00:42.257 ********** 2026-04-03 05:32:07.645183 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:32:07.645194 | orchestrator | 2026-04-03 05:32:07.645205 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-03 05:32:07.645217 | orchestrator | Friday 03 April 2026 05:32:04 +0000 (0:00:00.141) 0:00:42.399 ********** 2026-04-03 05:32:07.645229 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:32:07.645240 | orchestrator | 2026-04-03 05:32:07.645252 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-03 05:32:07.645264 | orchestrator | Friday 03 April 2026 05:32:05 +0000 (0:00:00.364) 0:00:42.763 ********** 2026-04-03 05:32:07.645276 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645287 | orchestrator | 2026-04-03 05:32:07.645299 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-03 05:32:07.645309 | orchestrator | Friday 03 April 2026 05:32:05 +0000 (0:00:00.138) 0:00:42.901 ********** 2026-04-03 05:32:07.645319 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645329 | orchestrator | 2026-04-03 05:32:07.645339 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-03 05:32:07.645349 | orchestrator | Friday 03 April 2026 05:32:05 +0000 (0:00:00.145) 0:00:43.047 ********** 2026-04-03 05:32:07.645359 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645368 | orchestrator | 2026-04-03 05:32:07.645378 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-03 05:32:07.645388 | orchestrator | Friday 03 April 2026 05:32:05 +0000 (0:00:00.187) 0:00:43.234 ********** 2026-04-03 05:32:07.645398 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:32:07.645407 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:32:07.645417 | orchestrator |  "sdb": { 2026-04-03 05:32:07.645443 | orchestrator |  "osd_lvm_uuid": "0168ecd7-dd70-56c3-8572-150117512a85" 2026-04-03 05:32:07.645454 | orchestrator |  }, 2026-04-03 05:32:07.645464 | orchestrator |  "sdc": { 2026-04-03 05:32:07.645474 | orchestrator |  "osd_lvm_uuid": "7e0184c0-0e73-56db-b9bd-1c5b3e3cac29" 2026-04-03 05:32:07.645483 | orchestrator |  } 2026-04-03 05:32:07.645493 | orchestrator |  } 2026-04-03 05:32:07.645503 | orchestrator | } 2026-04-03 05:32:07.645513 | orchestrator | 2026-04-03 05:32:07.645530 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-03 05:32:07.645540 | orchestrator | Friday 03 April 2026 05:32:05 +0000 (0:00:00.145) 0:00:43.380 ********** 2026-04-03 05:32:07.645550 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645568 | orchestrator | 2026-04-03 05:32:07.645578 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-03 05:32:07.645588 | orchestrator | Friday 03 April 2026 05:32:06 +0000 (0:00:00.146) 0:00:43.526 ********** 2026-04-03 05:32:07.645597 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645607 | orchestrator | 2026-04-03 05:32:07.645617 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-03 05:32:07.645626 | orchestrator | Friday 03 April 2026 05:32:06 +0000 (0:00:00.149) 0:00:43.675 ********** 2026-04-03 05:32:07.645636 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:32:07.645647 | orchestrator | 2026-04-03 05:32:07.645665 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-03 05:32:07.645682 | orchestrator | Friday 03 April 2026 05:32:06 +0000 (0:00:00.141) 0:00:43.817 ********** 2026-04-03 05:32:07.645699 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 05:32:07.645718 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-03 05:32:07.645736 | orchestrator |  "ceph_osd_devices": { 2026-04-03 05:32:07.645754 | orchestrator |  "sdb": { 2026-04-03 05:32:07.645766 | orchestrator |  "osd_lvm_uuid": "0168ecd7-dd70-56c3-8572-150117512a85" 2026-04-03 05:32:07.645776 | orchestrator |  }, 2026-04-03 05:32:07.645786 | orchestrator |  "sdc": { 2026-04-03 05:32:07.645795 | orchestrator |  "osd_lvm_uuid": "7e0184c0-0e73-56db-b9bd-1c5b3e3cac29" 2026-04-03 05:32:07.645805 | orchestrator |  } 2026-04-03 05:32:07.645815 | orchestrator |  }, 2026-04-03 05:32:07.645825 | orchestrator |  "lvm_volumes": [ 2026-04-03 05:32:07.645834 | orchestrator |  { 2026-04-03 05:32:07.645844 | orchestrator |  "data": "osd-block-0168ecd7-dd70-56c3-8572-150117512a85", 2026-04-03 05:32:07.645853 | orchestrator |  "data_vg": "ceph-0168ecd7-dd70-56c3-8572-150117512a85" 2026-04-03 05:32:07.645863 | orchestrator |  }, 2026-04-03 05:32:07.645873 | orchestrator |  { 2026-04-03 05:32:07.645883 | orchestrator |  "data": "osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29", 2026-04-03 05:32:07.645892 | orchestrator |  "data_vg": "ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29" 2026-04-03 05:32:07.645902 | orchestrator |  } 2026-04-03 05:32:07.645912 | orchestrator |  ] 2026-04-03 05:32:07.645922 | orchestrator |  } 2026-04-03 05:32:07.645931 | orchestrator | } 2026-04-03 05:32:07.645941 | orchestrator | 2026-04-03 05:32:07.645951 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-03 05:32:07.645960 | orchestrator | Friday 03 April 2026 05:32:06 +0000 (0:00:00.245) 0:00:44.062 ********** 2026-04-03 05:32:07.645970 | orchestrator | changed: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-03 05:32:07.646070 | orchestrator | 2026-04-03 05:32:07.646084 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:32:07.646094 | orchestrator | testbed-node-3 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:32:07.646105 | orchestrator | testbed-node-4 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:32:07.646115 | orchestrator | testbed-node-5 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:32:07.646125 | orchestrator | 2026-04-03 05:32:07.646135 | orchestrator | 2026-04-03 05:32:07.646144 | orchestrator | 2026-04-03 05:32:07.646154 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:32:07.646164 | orchestrator | Friday 03 April 2026 05:32:07 +0000 (0:00:01.021) 0:00:45.083 ********** 2026-04-03 05:32:07.646173 | orchestrator | =============================================================================== 2026-04-03 05:32:07.646183 | orchestrator | Write configuration file ------------------------------------------------ 4.02s 2026-04-03 05:32:07.646202 | orchestrator | Add known links to the list of available block devices ------------------ 1.51s 2026-04-03 05:32:07.646212 | orchestrator | Add known partitions to the list of available block devices ------------- 1.44s 2026-04-03 05:32:07.646221 | orchestrator | Add known links to the list of available block devices ------------------ 0.97s 2026-04-03 05:32:07.646231 | orchestrator | Add known links to the list of available block devices ------------------ 0.91s 2026-04-03 05:32:07.646241 | orchestrator | Add known partitions to the list of available block devices ------------- 0.89s 2026-04-03 05:32:07.646251 | orchestrator | Print configuration data ------------------------------------------------ 0.89s 2026-04-03 05:32:07.646260 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.80s 2026-04-03 05:32:07.646270 | orchestrator | Add known partitions to the list of available block devices ------------- 0.75s 2026-04-03 05:32:07.646280 | orchestrator | Get initial list of available block devices ----------------------------- 0.74s 2026-04-03 05:32:07.646289 | orchestrator | Add known links to the list of available block devices ------------------ 0.73s 2026-04-03 05:32:07.646299 | orchestrator | Add known partitions to the list of available block devices ------------- 0.72s 2026-04-03 05:32:07.646309 | orchestrator | Generate lvm_volumes structure (block + db) ----------------------------- 0.70s 2026-04-03 05:32:07.646327 | orchestrator | Add known links to the list of available block devices ------------------ 0.69s 2026-04-03 05:32:08.044683 | orchestrator | Set OSD devices config data --------------------------------------------- 0.69s 2026-04-03 05:32:08.044828 | orchestrator | Add known links to the list of available block devices ------------------ 0.68s 2026-04-03 05:32:08.044855 | orchestrator | Add known partitions to the list of available block devices ------------- 0.68s 2026-04-03 05:32:08.044895 | orchestrator | Add known partitions to the list of available block devices ------------- 0.68s 2026-04-03 05:32:08.044907 | orchestrator | Print ceph_osd_devices -------------------------------------------------- 0.65s 2026-04-03 05:32:08.044919 | orchestrator | Add known links to the list of available block devices ------------------ 0.65s 2026-04-03 05:32:30.586398 | orchestrator | 2026-04-03 05:32:30 | INFO  | Task 46700fc8-f346-4f2c-8a5b-82b1ed8e8719 (sync inventory) is running in background. Output coming soon. 2026-04-03 05:32:59.869996 | orchestrator | 2026-04-03 05:32:32 | INFO  | Starting group_vars file reorganization 2026-04-03 05:32:59.870119 | orchestrator | 2026-04-03 05:32:32 | INFO  | Moved 0 file(s) to their respective directories 2026-04-03 05:32:59.870133 | orchestrator | 2026-04-03 05:32:32 | INFO  | Group_vars file reorganization completed 2026-04-03 05:32:59.870141 | orchestrator | 2026-04-03 05:32:35 | INFO  | Starting variable preparation from inventory 2026-04-03 05:32:59.870150 | orchestrator | 2026-04-03 05:32:38 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-03 05:32:59.870159 | orchestrator | 2026-04-03 05:32:38 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-03 05:32:59.870167 | orchestrator | 2026-04-03 05:32:38 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-03 05:32:59.870175 | orchestrator | 2026-04-03 05:32:38 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-03 05:32:59.870184 | orchestrator | 2026-04-03 05:32:38 | INFO  | Variable preparation completed 2026-04-03 05:32:59.870192 | orchestrator | 2026-04-03 05:32:39 | INFO  | Starting inventory overwrite handling 2026-04-03 05:32:59.870201 | orchestrator | 2026-04-03 05:32:39 | INFO  | Handling group overwrites in 99-overwrite 2026-04-03 05:32:59.870210 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removing group frr:children from 60-generic 2026-04-03 05:32:59.870219 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-03 05:32:59.870229 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-03 05:32:59.870263 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-03 05:32:59.870273 | orchestrator | 2026-04-03 05:32:39 | INFO  | Handling group overwrites in 20-roles 2026-04-03 05:32:59.870283 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-03 05:32:59.870293 | orchestrator | 2026-04-03 05:32:39 | INFO  | Removed 5 group(s) in total 2026-04-03 05:32:59.870302 | orchestrator | 2026-04-03 05:32:39 | INFO  | Inventory overwrite handling completed 2026-04-03 05:32:59.870310 | orchestrator | 2026-04-03 05:32:41 | INFO  | Starting merge of inventory files 2026-04-03 05:32:59.870318 | orchestrator | 2026-04-03 05:32:41 | INFO  | Inventory files merged successfully 2026-04-03 05:32:59.870327 | orchestrator | 2026-04-03 05:32:46 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-03 05:32:59.870336 | orchestrator | 2026-04-03 05:32:58 | INFO  | Successfully wrote ClusterShell configuration 2026-04-03 05:32:59.870345 | orchestrator | [master af121b1] 2026-04-03-05-32 2026-04-03 05:32:59.870355 | orchestrator | 1 file changed, 30 insertions(+), 9 deletions(-) 2026-04-03 05:33:02.194728 | orchestrator | 2026-04-03 05:33:02 | INFO  | Task f3faff60-724e-471b-b852-eaf0f547406f (ceph-create-lvm-devices) was prepared for execution. 2026-04-03 05:33:02.194838 | orchestrator | 2026-04-03 05:33:02 | INFO  | It takes a moment until task f3faff60-724e-471b-b852-eaf0f547406f (ceph-create-lvm-devices) has been started and output is visible here. 2026-04-03 05:33:14.823518 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 05:33:14.823640 | orchestrator | 2.16.14 2026-04-03 05:33:14.823665 | orchestrator | 2026-04-03 05:33:14.823685 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-03 05:33:14.823705 | orchestrator | 2026-04-03 05:33:14.823724 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:33:14.823743 | orchestrator | Friday 03 April 2026 05:33:06 +0000 (0:00:00.317) 0:00:00.317 ********** 2026-04-03 05:33:14.823762 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 05:33:14.823782 | orchestrator | 2026-04-03 05:33:14.823794 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:33:14.823805 | orchestrator | Friday 03 April 2026 05:33:06 +0000 (0:00:00.250) 0:00:00.568 ********** 2026-04-03 05:33:14.823817 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:14.823828 | orchestrator | 2026-04-03 05:33:14.823839 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.823858 | orchestrator | Friday 03 April 2026 05:33:06 +0000 (0:00:00.236) 0:00:00.804 ********** 2026-04-03 05:33:14.823876 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-03 05:33:14.823894 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-03 05:33:14.823964 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-03 05:33:14.823989 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-03 05:33:14.824008 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-03 05:33:14.824024 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-03 05:33:14.824035 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-03 05:33:14.824046 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-03 05:33:14.824072 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-03 05:33:14.824085 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-03 05:33:14.824132 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-03 05:33:14.824144 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-03 05:33:14.824155 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-03 05:33:14.824166 | orchestrator | 2026-04-03 05:33:14.824177 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824188 | orchestrator | Friday 03 April 2026 05:33:07 +0000 (0:00:00.547) 0:00:01.352 ********** 2026-04-03 05:33:14.824199 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824210 | orchestrator | 2026-04-03 05:33:14.824221 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824232 | orchestrator | Friday 03 April 2026 05:33:07 +0000 (0:00:00.219) 0:00:01.571 ********** 2026-04-03 05:33:14.824243 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824254 | orchestrator | 2026-04-03 05:33:14.824265 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824276 | orchestrator | Friday 03 April 2026 05:33:08 +0000 (0:00:00.238) 0:00:01.810 ********** 2026-04-03 05:33:14.824287 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824298 | orchestrator | 2026-04-03 05:33:14.824309 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824320 | orchestrator | Friday 03 April 2026 05:33:08 +0000 (0:00:00.216) 0:00:02.026 ********** 2026-04-03 05:33:14.824331 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824342 | orchestrator | 2026-04-03 05:33:14.824353 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824364 | orchestrator | Friday 03 April 2026 05:33:08 +0000 (0:00:00.226) 0:00:02.253 ********** 2026-04-03 05:33:14.824375 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824386 | orchestrator | 2026-04-03 05:33:14.824396 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824408 | orchestrator | Friday 03 April 2026 05:33:08 +0000 (0:00:00.222) 0:00:02.475 ********** 2026-04-03 05:33:14.824419 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824430 | orchestrator | 2026-04-03 05:33:14.824441 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824452 | orchestrator | Friday 03 April 2026 05:33:08 +0000 (0:00:00.221) 0:00:02.697 ********** 2026-04-03 05:33:14.824463 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824474 | orchestrator | 2026-04-03 05:33:14.824485 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824496 | orchestrator | Friday 03 April 2026 05:33:09 +0000 (0:00:00.241) 0:00:02.938 ********** 2026-04-03 05:33:14.824507 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.824518 | orchestrator | 2026-04-03 05:33:14.824529 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824540 | orchestrator | Friday 03 April 2026 05:33:09 +0000 (0:00:00.223) 0:00:03.162 ********** 2026-04-03 05:33:14.824551 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a) 2026-04-03 05:33:14.824563 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a) 2026-04-03 05:33:14.824574 | orchestrator | 2026-04-03 05:33:14.824585 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824615 | orchestrator | Friday 03 April 2026 05:33:10 +0000 (0:00:00.667) 0:00:03.830 ********** 2026-04-03 05:33:14.824626 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9) 2026-04-03 05:33:14.824637 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9) 2026-04-03 05:33:14.824648 | orchestrator | 2026-04-03 05:33:14.824659 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824678 | orchestrator | Friday 03 April 2026 05:33:10 +0000 (0:00:00.682) 0:00:04.512 ********** 2026-04-03 05:33:14.824689 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733) 2026-04-03 05:33:14.824699 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733) 2026-04-03 05:33:14.824710 | orchestrator | 2026-04-03 05:33:14.824721 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824732 | orchestrator | Friday 03 April 2026 05:33:11 +0000 (0:00:00.930) 0:00:05.443 ********** 2026-04-03 05:33:14.824743 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065) 2026-04-03 05:33:14.824759 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065) 2026-04-03 05:33:14.824770 | orchestrator | 2026-04-03 05:33:14.824782 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:14.824794 | orchestrator | Friday 03 April 2026 05:33:12 +0000 (0:00:00.467) 0:00:05.911 ********** 2026-04-03 05:33:14.824814 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:33:14.824835 | orchestrator | 2026-04-03 05:33:14.824854 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.824873 | orchestrator | Friday 03 April 2026 05:33:12 +0000 (0:00:00.341) 0:00:06.252 ********** 2026-04-03 05:33:14.824892 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-03 05:33:14.824911 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-03 05:33:14.824929 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-03 05:33:14.824998 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-03 05:33:14.825017 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-03 05:33:14.825037 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-03 05:33:14.825057 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-03 05:33:14.825073 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-03 05:33:14.825092 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-03 05:33:14.825104 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-03 05:33:14.825115 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-03 05:33:14.825126 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-03 05:33:14.825137 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-03 05:33:14.825147 | orchestrator | 2026-04-03 05:33:14.825158 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825169 | orchestrator | Friday 03 April 2026 05:33:12 +0000 (0:00:00.435) 0:00:06.687 ********** 2026-04-03 05:33:14.825180 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825191 | orchestrator | 2026-04-03 05:33:14.825202 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825213 | orchestrator | Friday 03 April 2026 05:33:13 +0000 (0:00:00.231) 0:00:06.919 ********** 2026-04-03 05:33:14.825224 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825235 | orchestrator | 2026-04-03 05:33:14.825246 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825257 | orchestrator | Friday 03 April 2026 05:33:13 +0000 (0:00:00.228) 0:00:07.148 ********** 2026-04-03 05:33:14.825268 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825289 | orchestrator | 2026-04-03 05:33:14.825299 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825310 | orchestrator | Friday 03 April 2026 05:33:13 +0000 (0:00:00.213) 0:00:07.361 ********** 2026-04-03 05:33:14.825321 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825332 | orchestrator | 2026-04-03 05:33:14.825343 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825354 | orchestrator | Friday 03 April 2026 05:33:13 +0000 (0:00:00.197) 0:00:07.558 ********** 2026-04-03 05:33:14.825365 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825376 | orchestrator | 2026-04-03 05:33:14.825387 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825398 | orchestrator | Friday 03 April 2026 05:33:13 +0000 (0:00:00.204) 0:00:07.762 ********** 2026-04-03 05:33:14.825409 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825420 | orchestrator | 2026-04-03 05:33:14.825430 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:14.825441 | orchestrator | Friday 03 April 2026 05:33:14 +0000 (0:00:00.622) 0:00:08.385 ********** 2026-04-03 05:33:14.825452 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:14.825463 | orchestrator | 2026-04-03 05:33:14.825483 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094226 | orchestrator | Friday 03 April 2026 05:33:14 +0000 (0:00:00.226) 0:00:08.611 ********** 2026-04-03 05:33:24.094334 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094350 | orchestrator | 2026-04-03 05:33:24.094363 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094375 | orchestrator | Friday 03 April 2026 05:33:15 +0000 (0:00:00.219) 0:00:08.831 ********** 2026-04-03 05:33:24.094387 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-03 05:33:24.094399 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-03 05:33:24.094410 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-03 05:33:24.094421 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-03 05:33:24.094432 | orchestrator | 2026-04-03 05:33:24.094444 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094455 | orchestrator | Friday 03 April 2026 05:33:15 +0000 (0:00:00.717) 0:00:09.549 ********** 2026-04-03 05:33:24.094466 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094477 | orchestrator | 2026-04-03 05:33:24.094488 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094499 | orchestrator | Friday 03 April 2026 05:33:15 +0000 (0:00:00.214) 0:00:09.763 ********** 2026-04-03 05:33:24.094510 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094521 | orchestrator | 2026-04-03 05:33:24.094553 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094574 | orchestrator | Friday 03 April 2026 05:33:16 +0000 (0:00:00.221) 0:00:09.984 ********** 2026-04-03 05:33:24.094591 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094610 | orchestrator | 2026-04-03 05:33:24.094627 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:24.094644 | orchestrator | Friday 03 April 2026 05:33:16 +0000 (0:00:00.241) 0:00:10.226 ********** 2026-04-03 05:33:24.094661 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094680 | orchestrator | 2026-04-03 05:33:24.094697 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-03 05:33:24.094714 | orchestrator | Friday 03 April 2026 05:33:16 +0000 (0:00:00.238) 0:00:10.465 ********** 2026-04-03 05:33:24.094732 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.094751 | orchestrator | 2026-04-03 05:33:24.094769 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-03 05:33:24.094789 | orchestrator | Friday 03 April 2026 05:33:16 +0000 (0:00:00.144) 0:00:10.609 ********** 2026-04-03 05:33:24.094806 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '6e05808f-fb53-52d6-a83f-27c91ff5177e'}}) 2026-04-03 05:33:24.094845 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'dc85739a-96e8-5e43-9ed8-b11ad01343fb'}}) 2026-04-03 05:33:24.094858 | orchestrator | 2026-04-03 05:33:24.094872 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-03 05:33:24.094885 | orchestrator | Friday 03 April 2026 05:33:17 +0000 (0:00:00.197) 0:00:10.807 ********** 2026-04-03 05:33:24.094897 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}) 2026-04-03 05:33:24.094910 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}) 2026-04-03 05:33:24.094921 | orchestrator | 2026-04-03 05:33:24.094979 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-03 05:33:24.094993 | orchestrator | Friday 03 April 2026 05:33:20 +0000 (0:00:03.045) 0:00:13.852 ********** 2026-04-03 05:33:24.095004 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095016 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095027 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095038 | orchestrator | 2026-04-03 05:33:24.095049 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-03 05:33:24.095060 | orchestrator | Friday 03 April 2026 05:33:20 +0000 (0:00:00.403) 0:00:14.255 ********** 2026-04-03 05:33:24.095072 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}) 2026-04-03 05:33:24.095083 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}) 2026-04-03 05:33:24.095094 | orchestrator | 2026-04-03 05:33:24.095104 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-03 05:33:24.095115 | orchestrator | Friday 03 April 2026 05:33:21 +0000 (0:00:01.451) 0:00:15.707 ********** 2026-04-03 05:33:24.095127 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095138 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095149 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095160 | orchestrator | 2026-04-03 05:33:24.095171 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-03 05:33:24.095182 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.171) 0:00:15.879 ********** 2026-04-03 05:33:24.095210 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095222 | orchestrator | 2026-04-03 05:33:24.095233 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-03 05:33:24.095244 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.152) 0:00:16.032 ********** 2026-04-03 05:33:24.095255 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095267 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095278 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095289 | orchestrator | 2026-04-03 05:33:24.095300 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-03 05:33:24.095311 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.164) 0:00:16.196 ********** 2026-04-03 05:33:24.095331 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095342 | orchestrator | 2026-04-03 05:33:24.095353 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-03 05:33:24.095364 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.153) 0:00:16.350 ********** 2026-04-03 05:33:24.095382 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095393 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095405 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095416 | orchestrator | 2026-04-03 05:33:24.095427 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-03 05:33:24.095438 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.178) 0:00:16.529 ********** 2026-04-03 05:33:24.095449 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095460 | orchestrator | 2026-04-03 05:33:24.095471 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-03 05:33:24.095482 | orchestrator | Friday 03 April 2026 05:33:22 +0000 (0:00:00.143) 0:00:16.673 ********** 2026-04-03 05:33:24.095493 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095504 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095515 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095526 | orchestrator | 2026-04-03 05:33:24.095537 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-03 05:33:24.095549 | orchestrator | Friday 03 April 2026 05:33:23 +0000 (0:00:00.158) 0:00:16.832 ********** 2026-04-03 05:33:24.095560 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:24.095571 | orchestrator | 2026-04-03 05:33:24.095582 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-03 05:33:24.095593 | orchestrator | Friday 03 April 2026 05:33:23 +0000 (0:00:00.157) 0:00:16.990 ********** 2026-04-03 05:33:24.095604 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095615 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095627 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095638 | orchestrator | 2026-04-03 05:33:24.095649 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-03 05:33:24.095660 | orchestrator | Friday 03 April 2026 05:33:23 +0000 (0:00:00.177) 0:00:17.167 ********** 2026-04-03 05:33:24.095671 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095682 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095693 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095704 | orchestrator | 2026-04-03 05:33:24.095715 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-03 05:33:24.095726 | orchestrator | Friday 03 April 2026 05:33:23 +0000 (0:00:00.392) 0:00:17.560 ********** 2026-04-03 05:33:24.095737 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:24.095749 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:24.095766 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095777 | orchestrator | 2026-04-03 05:33:24.095788 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-03 05:33:24.095799 | orchestrator | Friday 03 April 2026 05:33:23 +0000 (0:00:00.176) 0:00:17.736 ********** 2026-04-03 05:33:24.095811 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:24.095822 | orchestrator | 2026-04-03 05:33:24.095833 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-03 05:33:24.095850 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.153) 0:00:17.889 ********** 2026-04-03 05:33:30.883794 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.883889 | orchestrator | 2026-04-03 05:33:30.883903 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-03 05:33:30.883914 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.151) 0:00:18.041 ********** 2026-04-03 05:33:30.883924 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884000 | orchestrator | 2026-04-03 05:33:30.884010 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-03 05:33:30.884020 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.158) 0:00:18.199 ********** 2026-04-03 05:33:30.884029 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:33:30.884039 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-03 05:33:30.884048 | orchestrator | } 2026-04-03 05:33:30.884057 | orchestrator | 2026-04-03 05:33:30.884066 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-03 05:33:30.884076 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.162) 0:00:18.362 ********** 2026-04-03 05:33:30.884085 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:33:30.884093 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-03 05:33:30.884102 | orchestrator | } 2026-04-03 05:33:30.884111 | orchestrator | 2026-04-03 05:33:30.884120 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-03 05:33:30.884144 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.149) 0:00:18.512 ********** 2026-04-03 05:33:30.884153 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:33:30.884162 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-03 05:33:30.884171 | orchestrator | } 2026-04-03 05:33:30.884211 | orchestrator | 2026-04-03 05:33:30.884227 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-03 05:33:30.884241 | orchestrator | Friday 03 April 2026 05:33:24 +0000 (0:00:00.182) 0:00:18.695 ********** 2026-04-03 05:33:30.884255 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:30.884270 | orchestrator | 2026-04-03 05:33:30.884283 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-03 05:33:30.884297 | orchestrator | Friday 03 April 2026 05:33:25 +0000 (0:00:00.692) 0:00:19.387 ********** 2026-04-03 05:33:30.884313 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:30.884328 | orchestrator | 2026-04-03 05:33:30.884343 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-03 05:33:30.884358 | orchestrator | Friday 03 April 2026 05:33:26 +0000 (0:00:00.512) 0:00:19.900 ********** 2026-04-03 05:33:30.884374 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:30.884391 | orchestrator | 2026-04-03 05:33:30.884407 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-03 05:33:30.884421 | orchestrator | Friday 03 April 2026 05:33:26 +0000 (0:00:00.518) 0:00:20.418 ********** 2026-04-03 05:33:30.884431 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:30.884441 | orchestrator | 2026-04-03 05:33:30.884452 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-03 05:33:30.884463 | orchestrator | Friday 03 April 2026 05:33:26 +0000 (0:00:00.355) 0:00:20.774 ********** 2026-04-03 05:33:30.884473 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884483 | orchestrator | 2026-04-03 05:33:30.884493 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-03 05:33:30.884524 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.141) 0:00:20.915 ********** 2026-04-03 05:33:30.884534 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884544 | orchestrator | 2026-04-03 05:33:30.884554 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-03 05:33:30.884565 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.125) 0:00:21.040 ********** 2026-04-03 05:33:30.884574 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:33:30.884585 | orchestrator |  "vgs_report": { 2026-04-03 05:33:30.884594 | orchestrator |  "vg": [] 2026-04-03 05:33:30.884604 | orchestrator |  } 2026-04-03 05:33:30.884614 | orchestrator | } 2026-04-03 05:33:30.884624 | orchestrator | 2026-04-03 05:33:30.884634 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-03 05:33:30.884645 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.151) 0:00:21.192 ********** 2026-04-03 05:33:30.884655 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884665 | orchestrator | 2026-04-03 05:33:30.884676 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-03 05:33:30.884686 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.146) 0:00:21.338 ********** 2026-04-03 05:33:30.884695 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884703 | orchestrator | 2026-04-03 05:33:30.884712 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-03 05:33:30.884721 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.142) 0:00:21.480 ********** 2026-04-03 05:33:30.884729 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884738 | orchestrator | 2026-04-03 05:33:30.884746 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-03 05:33:30.884755 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.137) 0:00:21.618 ********** 2026-04-03 05:33:30.884764 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884772 | orchestrator | 2026-04-03 05:33:30.884781 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-03 05:33:30.884790 | orchestrator | Friday 03 April 2026 05:33:27 +0000 (0:00:00.151) 0:00:21.770 ********** 2026-04-03 05:33:30.884799 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884807 | orchestrator | 2026-04-03 05:33:30.884816 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-03 05:33:30.884825 | orchestrator | Friday 03 April 2026 05:33:28 +0000 (0:00:00.157) 0:00:21.927 ********** 2026-04-03 05:33:30.884833 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884842 | orchestrator | 2026-04-03 05:33:30.884851 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-03 05:33:30.884859 | orchestrator | Friday 03 April 2026 05:33:28 +0000 (0:00:00.142) 0:00:22.070 ********** 2026-04-03 05:33:30.884868 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884877 | orchestrator | 2026-04-03 05:33:30.884885 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-03 05:33:30.884894 | orchestrator | Friday 03 April 2026 05:33:28 +0000 (0:00:00.170) 0:00:22.241 ********** 2026-04-03 05:33:30.884919 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884953 | orchestrator | 2026-04-03 05:33:30.884963 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-03 05:33:30.884972 | orchestrator | Friday 03 April 2026 05:33:28 +0000 (0:00:00.356) 0:00:22.598 ********** 2026-04-03 05:33:30.884981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.884990 | orchestrator | 2026-04-03 05:33:30.884998 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-03 05:33:30.885007 | orchestrator | Friday 03 April 2026 05:33:28 +0000 (0:00:00.133) 0:00:22.731 ********** 2026-04-03 05:33:30.885016 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885024 | orchestrator | 2026-04-03 05:33:30.885033 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-03 05:33:30.885042 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.136) 0:00:22.868 ********** 2026-04-03 05:33:30.885058 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885066 | orchestrator | 2026-04-03 05:33:30.885075 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-03 05:33:30.885084 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.146) 0:00:23.015 ********** 2026-04-03 05:33:30.885092 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885101 | orchestrator | 2026-04-03 05:33:30.885116 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-03 05:33:30.885125 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.165) 0:00:23.181 ********** 2026-04-03 05:33:30.885134 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885143 | orchestrator | 2026-04-03 05:33:30.885151 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-03 05:33:30.885160 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.149) 0:00:23.330 ********** 2026-04-03 05:33:30.885168 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885177 | orchestrator | 2026-04-03 05:33:30.885186 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-03 05:33:30.885195 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.149) 0:00:23.479 ********** 2026-04-03 05:33:30.885205 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:30.885215 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:30.885224 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885233 | orchestrator | 2026-04-03 05:33:30.885241 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-03 05:33:30.885250 | orchestrator | Friday 03 April 2026 05:33:29 +0000 (0:00:00.166) 0:00:23.646 ********** 2026-04-03 05:33:30.885259 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:30.885268 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:30.885277 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885285 | orchestrator | 2026-04-03 05:33:30.885294 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-03 05:33:30.885303 | orchestrator | Friday 03 April 2026 05:33:30 +0000 (0:00:00.162) 0:00:23.809 ********** 2026-04-03 05:33:30.885311 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:30.885320 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:30.885329 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885338 | orchestrator | 2026-04-03 05:33:30.885346 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-03 05:33:30.885355 | orchestrator | Friday 03 April 2026 05:33:30 +0000 (0:00:00.162) 0:00:23.971 ********** 2026-04-03 05:33:30.885367 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:30.885382 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:30.885396 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885411 | orchestrator | 2026-04-03 05:33:30.885425 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-03 05:33:30.885440 | orchestrator | Friday 03 April 2026 05:33:30 +0000 (0:00:00.163) 0:00:24.135 ********** 2026-04-03 05:33:30.885465 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:30.885482 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:30.885497 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:30.885513 | orchestrator | 2026-04-03 05:33:30.885522 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-03 05:33:30.885531 | orchestrator | Friday 03 April 2026 05:33:30 +0000 (0:00:00.384) 0:00:24.520 ********** 2026-04-03 05:33:30.885548 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.306651 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.306754 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.306769 | orchestrator | 2026-04-03 05:33:36.306781 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-03 05:33:36.306796 | orchestrator | Friday 03 April 2026 05:33:30 +0000 (0:00:00.162) 0:00:24.682 ********** 2026-04-03 05:33:36.306813 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.306831 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.306847 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.306866 | orchestrator | 2026-04-03 05:33:36.306904 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-03 05:33:36.306917 | orchestrator | Friday 03 April 2026 05:33:31 +0000 (0:00:00.158) 0:00:24.841 ********** 2026-04-03 05:33:36.306993 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.307004 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.307014 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.307024 | orchestrator | 2026-04-03 05:33:36.307034 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-03 05:33:36.307044 | orchestrator | Friday 03 April 2026 05:33:31 +0000 (0:00:00.166) 0:00:25.008 ********** 2026-04-03 05:33:36.307054 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:36.307064 | orchestrator | 2026-04-03 05:33:36.307074 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-03 05:33:36.307084 | orchestrator | Friday 03 April 2026 05:33:31 +0000 (0:00:00.528) 0:00:25.537 ********** 2026-04-03 05:33:36.307094 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:36.307104 | orchestrator | 2026-04-03 05:33:36.307114 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-03 05:33:36.307123 | orchestrator | Friday 03 April 2026 05:33:32 +0000 (0:00:00.509) 0:00:26.046 ********** 2026-04-03 05:33:36.307133 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:33:36.307143 | orchestrator | 2026-04-03 05:33:36.307153 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-03 05:33:36.307163 | orchestrator | Friday 03 April 2026 05:33:32 +0000 (0:00:00.158) 0:00:26.204 ********** 2026-04-03 05:33:36.307174 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'vg_name': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}) 2026-04-03 05:33:36.307185 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'vg_name': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}) 2026-04-03 05:33:36.307217 | orchestrator | 2026-04-03 05:33:36.307229 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-03 05:33:36.307240 | orchestrator | Friday 03 April 2026 05:33:32 +0000 (0:00:00.177) 0:00:26.382 ********** 2026-04-03 05:33:36.307251 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.307262 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.307274 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.307286 | orchestrator | 2026-04-03 05:33:36.307297 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-03 05:33:36.307308 | orchestrator | Friday 03 April 2026 05:33:32 +0000 (0:00:00.178) 0:00:26.561 ********** 2026-04-03 05:33:36.307319 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.307330 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.307342 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.307353 | orchestrator | 2026-04-03 05:33:36.307365 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-03 05:33:36.307376 | orchestrator | Friday 03 April 2026 05:33:32 +0000 (0:00:00.167) 0:00:26.728 ********** 2026-04-03 05:33:36.307387 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 05:33:36.307399 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 05:33:36.307409 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:33:36.307420 | orchestrator | 2026-04-03 05:33:36.307431 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-03 05:33:36.307443 | orchestrator | Friday 03 April 2026 05:33:33 +0000 (0:00:00.170) 0:00:26.899 ********** 2026-04-03 05:33:36.307470 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:33:36.307482 | orchestrator |  "lvm_report": { 2026-04-03 05:33:36.307493 | orchestrator |  "lv": [ 2026-04-03 05:33:36.307504 | orchestrator |  { 2026-04-03 05:33:36.307515 | orchestrator |  "lv_name": "osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e", 2026-04-03 05:33:36.307526 | orchestrator |  "vg_name": "ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e" 2026-04-03 05:33:36.307537 | orchestrator |  }, 2026-04-03 05:33:36.307548 | orchestrator |  { 2026-04-03 05:33:36.307559 | orchestrator |  "lv_name": "osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb", 2026-04-03 05:33:36.307570 | orchestrator |  "vg_name": "ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb" 2026-04-03 05:33:36.307581 | orchestrator |  } 2026-04-03 05:33:36.307593 | orchestrator |  ], 2026-04-03 05:33:36.307602 | orchestrator |  "pv": [ 2026-04-03 05:33:36.307612 | orchestrator |  { 2026-04-03 05:33:36.307622 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-03 05:33:36.307631 | orchestrator |  "vg_name": "ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e" 2026-04-03 05:33:36.307641 | orchestrator |  }, 2026-04-03 05:33:36.307651 | orchestrator |  { 2026-04-03 05:33:36.307667 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-03 05:33:36.307677 | orchestrator |  "vg_name": "ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb" 2026-04-03 05:33:36.307687 | orchestrator |  } 2026-04-03 05:33:36.307696 | orchestrator |  ] 2026-04-03 05:33:36.307706 | orchestrator |  } 2026-04-03 05:33:36.307716 | orchestrator | } 2026-04-03 05:33:36.307733 | orchestrator | 2026-04-03 05:33:36.307743 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-03 05:33:36.307752 | orchestrator | 2026-04-03 05:33:36.307762 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:33:36.307772 | orchestrator | Friday 03 April 2026 05:33:33 +0000 (0:00:00.522) 0:00:27.422 ********** 2026-04-03 05:33:36.307783 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-03 05:33:36.307792 | orchestrator | 2026-04-03 05:33:36.307802 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:33:36.307812 | orchestrator | Friday 03 April 2026 05:33:33 +0000 (0:00:00.265) 0:00:27.687 ********** 2026-04-03 05:33:36.307822 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:36.307831 | orchestrator | 2026-04-03 05:33:36.307841 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.307851 | orchestrator | Friday 03 April 2026 05:33:34 +0000 (0:00:00.248) 0:00:27.936 ********** 2026-04-03 05:33:36.307860 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-03 05:33:36.307870 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-03 05:33:36.307880 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-03 05:33:36.307890 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-03 05:33:36.307899 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-03 05:33:36.307909 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-03 05:33:36.307918 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-03 05:33:36.307947 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-03 05:33:36.307958 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-03 05:33:36.307967 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-03 05:33:36.307977 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-03 05:33:36.307986 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-03 05:33:36.307996 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-03 05:33:36.308006 | orchestrator | 2026-04-03 05:33:36.308016 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308025 | orchestrator | Friday 03 April 2026 05:33:34 +0000 (0:00:00.417) 0:00:28.353 ********** 2026-04-03 05:33:36.308035 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308045 | orchestrator | 2026-04-03 05:33:36.308054 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308064 | orchestrator | Friday 03 April 2026 05:33:34 +0000 (0:00:00.208) 0:00:28.562 ********** 2026-04-03 05:33:36.308074 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308083 | orchestrator | 2026-04-03 05:33:36.308093 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308103 | orchestrator | Friday 03 April 2026 05:33:34 +0000 (0:00:00.225) 0:00:28.788 ********** 2026-04-03 05:33:36.308113 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308122 | orchestrator | 2026-04-03 05:33:36.308132 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308142 | orchestrator | Friday 03 April 2026 05:33:35 +0000 (0:00:00.209) 0:00:28.997 ********** 2026-04-03 05:33:36.308152 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308162 | orchestrator | 2026-04-03 05:33:36.308171 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308181 | orchestrator | Friday 03 April 2026 05:33:35 +0000 (0:00:00.229) 0:00:29.226 ********** 2026-04-03 05:33:36.308197 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308207 | orchestrator | 2026-04-03 05:33:36.308216 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:36.308226 | orchestrator | Friday 03 April 2026 05:33:35 +0000 (0:00:00.231) 0:00:29.458 ********** 2026-04-03 05:33:36.308236 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:36.308245 | orchestrator | 2026-04-03 05:33:36.308261 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.941774 | orchestrator | Friday 03 April 2026 05:33:36 +0000 (0:00:00.646) 0:00:30.105 ********** 2026-04-03 05:33:46.941874 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.941889 | orchestrator | 2026-04-03 05:33:46.941900 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.941911 | orchestrator | Friday 03 April 2026 05:33:36 +0000 (0:00:00.204) 0:00:30.309 ********** 2026-04-03 05:33:46.941953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.941964 | orchestrator | 2026-04-03 05:33:46.941975 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.941985 | orchestrator | Friday 03 April 2026 05:33:36 +0000 (0:00:00.215) 0:00:30.524 ********** 2026-04-03 05:33:46.941995 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df) 2026-04-03 05:33:46.942005 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df) 2026-04-03 05:33:46.942077 | orchestrator | 2026-04-03 05:33:46.942097 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.942107 | orchestrator | Friday 03 April 2026 05:33:37 +0000 (0:00:00.461) 0:00:30.986 ********** 2026-04-03 05:33:46.942117 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506) 2026-04-03 05:33:46.942127 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506) 2026-04-03 05:33:46.942137 | orchestrator | 2026-04-03 05:33:46.942147 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.942157 | orchestrator | Friday 03 April 2026 05:33:37 +0000 (0:00:00.460) 0:00:31.447 ********** 2026-04-03 05:33:46.942167 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243) 2026-04-03 05:33:46.942177 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243) 2026-04-03 05:33:46.942187 | orchestrator | 2026-04-03 05:33:46.942196 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.942206 | orchestrator | Friday 03 April 2026 05:33:38 +0000 (0:00:00.506) 0:00:31.953 ********** 2026-04-03 05:33:46.942216 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7) 2026-04-03 05:33:46.942226 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7) 2026-04-03 05:33:46.942236 | orchestrator | 2026-04-03 05:33:46.942245 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:33:46.942255 | orchestrator | Friday 03 April 2026 05:33:38 +0000 (0:00:00.490) 0:00:32.443 ********** 2026-04-03 05:33:46.942265 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:33:46.942274 | orchestrator | 2026-04-03 05:33:46.942284 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942294 | orchestrator | Friday 03 April 2026 05:33:38 +0000 (0:00:00.352) 0:00:32.796 ********** 2026-04-03 05:33:46.942304 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-03 05:33:46.942314 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-03 05:33:46.942324 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-03 05:33:46.942355 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-03 05:33:46.942367 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-03 05:33:46.942377 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-03 05:33:46.942388 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-03 05:33:46.942400 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-03 05:33:46.942411 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-03 05:33:46.942422 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-03 05:33:46.942433 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-03 05:33:46.942444 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-03 05:33:46.942456 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-03 05:33:46.942467 | orchestrator | 2026-04-03 05:33:46.942478 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942489 | orchestrator | Friday 03 April 2026 05:33:39 +0000 (0:00:00.468) 0:00:33.264 ********** 2026-04-03 05:33:46.942500 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942511 | orchestrator | 2026-04-03 05:33:46.942522 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942533 | orchestrator | Friday 03 April 2026 05:33:39 +0000 (0:00:00.195) 0:00:33.460 ********** 2026-04-03 05:33:46.942544 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942555 | orchestrator | 2026-04-03 05:33:46.942566 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942577 | orchestrator | Friday 03 April 2026 05:33:39 +0000 (0:00:00.224) 0:00:33.685 ********** 2026-04-03 05:33:46.942589 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942600 | orchestrator | 2026-04-03 05:33:46.942691 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942703 | orchestrator | Friday 03 April 2026 05:33:40 +0000 (0:00:00.636) 0:00:34.321 ********** 2026-04-03 05:33:46.942712 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942722 | orchestrator | 2026-04-03 05:33:46.942732 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942741 | orchestrator | Friday 03 April 2026 05:33:40 +0000 (0:00:00.213) 0:00:34.534 ********** 2026-04-03 05:33:46.942751 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942761 | orchestrator | 2026-04-03 05:33:46.942770 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942781 | orchestrator | Friday 03 April 2026 05:33:40 +0000 (0:00:00.206) 0:00:34.741 ********** 2026-04-03 05:33:46.942791 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942800 | orchestrator | 2026-04-03 05:33:46.942810 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942820 | orchestrator | Friday 03 April 2026 05:33:41 +0000 (0:00:00.208) 0:00:34.949 ********** 2026-04-03 05:33:46.942835 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942845 | orchestrator | 2026-04-03 05:33:46.942855 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942865 | orchestrator | Friday 03 April 2026 05:33:41 +0000 (0:00:00.209) 0:00:35.159 ********** 2026-04-03 05:33:46.942875 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.942884 | orchestrator | 2026-04-03 05:33:46.942894 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.942904 | orchestrator | Friday 03 April 2026 05:33:41 +0000 (0:00:00.215) 0:00:35.375 ********** 2026-04-03 05:33:46.942914 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-03 05:33:46.942987 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-03 05:33:46.943006 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-03 05:33:46.943022 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-03 05:33:46.943034 | orchestrator | 2026-04-03 05:33:46.943062 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.943072 | orchestrator | Friday 03 April 2026 05:33:42 +0000 (0:00:00.664) 0:00:36.039 ********** 2026-04-03 05:33:46.943082 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943092 | orchestrator | 2026-04-03 05:33:46.943102 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.943112 | orchestrator | Friday 03 April 2026 05:33:42 +0000 (0:00:00.214) 0:00:36.254 ********** 2026-04-03 05:33:46.943121 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943131 | orchestrator | 2026-04-03 05:33:46.943141 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.943187 | orchestrator | Friday 03 April 2026 05:33:42 +0000 (0:00:00.208) 0:00:36.462 ********** 2026-04-03 05:33:46.943197 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943207 | orchestrator | 2026-04-03 05:33:46.943217 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:33:46.943227 | orchestrator | Friday 03 April 2026 05:33:42 +0000 (0:00:00.211) 0:00:36.674 ********** 2026-04-03 05:33:46.943236 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943246 | orchestrator | 2026-04-03 05:33:46.943256 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-03 05:33:46.943266 | orchestrator | Friday 03 April 2026 05:33:43 +0000 (0:00:00.227) 0:00:36.901 ********** 2026-04-03 05:33:46.943276 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943285 | orchestrator | 2026-04-03 05:33:46.943295 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-03 05:33:46.943305 | orchestrator | Friday 03 April 2026 05:33:43 +0000 (0:00:00.350) 0:00:37.251 ********** 2026-04-03 05:33:46.943316 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '22674541-64cc-5df8-a9f8-30ff652f1dce'}}) 2026-04-03 05:33:46.943326 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'd44e23ea-2eda-5203-86ef-10b85847f309'}}) 2026-04-03 05:33:46.943336 | orchestrator | 2026-04-03 05:33:46.943345 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-03 05:33:46.943355 | orchestrator | Friday 03 April 2026 05:33:43 +0000 (0:00:00.211) 0:00:37.463 ********** 2026-04-03 05:33:46.943366 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}) 2026-04-03 05:33:46.943378 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}) 2026-04-03 05:33:46.943388 | orchestrator | 2026-04-03 05:33:46.943398 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-03 05:33:46.943408 | orchestrator | Friday 03 April 2026 05:33:45 +0000 (0:00:01.814) 0:00:39.277 ********** 2026-04-03 05:33:46.943418 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:46.943429 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:46.943439 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:46.943449 | orchestrator | 2026-04-03 05:33:46.943463 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-03 05:33:46.943480 | orchestrator | Friday 03 April 2026 05:33:45 +0000 (0:00:00.163) 0:00:39.441 ********** 2026-04-03 05:33:46.943495 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}) 2026-04-03 05:33:46.943535 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}) 2026-04-03 05:33:52.791966 | orchestrator | 2026-04-03 05:33:52.792065 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-03 05:33:52.792077 | orchestrator | Friday 03 April 2026 05:33:46 +0000 (0:00:01.290) 0:00:40.732 ********** 2026-04-03 05:33:52.792085 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792094 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792101 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792109 | orchestrator | 2026-04-03 05:33:52.792133 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-03 05:33:52.792140 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.168) 0:00:40.900 ********** 2026-04-03 05:33:52.792146 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792153 | orchestrator | 2026-04-03 05:33:52.792158 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-03 05:33:52.792165 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.145) 0:00:41.046 ********** 2026-04-03 05:33:52.792171 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792177 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792184 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792190 | orchestrator | 2026-04-03 05:33:52.792197 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-03 05:33:52.792204 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.168) 0:00:41.215 ********** 2026-04-03 05:33:52.792210 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792217 | orchestrator | 2026-04-03 05:33:52.792224 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-03 05:33:52.792230 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.153) 0:00:41.368 ********** 2026-04-03 05:33:52.792236 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792243 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792250 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792257 | orchestrator | 2026-04-03 05:33:52.792264 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-03 05:33:52.792270 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.170) 0:00:41.539 ********** 2026-04-03 05:33:52.792277 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792284 | orchestrator | 2026-04-03 05:33:52.792290 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-03 05:33:52.792296 | orchestrator | Friday 03 April 2026 05:33:47 +0000 (0:00:00.151) 0:00:41.690 ********** 2026-04-03 05:33:52.792303 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792309 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792316 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792322 | orchestrator | 2026-04-03 05:33:52.792328 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-03 05:33:52.792355 | orchestrator | Friday 03 April 2026 05:33:48 +0000 (0:00:00.160) 0:00:41.851 ********** 2026-04-03 05:33:52.792362 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:52.792369 | orchestrator | 2026-04-03 05:33:52.792375 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-03 05:33:52.792382 | orchestrator | Friday 03 April 2026 05:33:48 +0000 (0:00:00.147) 0:00:41.998 ********** 2026-04-03 05:33:52.792388 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792395 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792401 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792408 | orchestrator | 2026-04-03 05:33:52.792415 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-03 05:33:52.792422 | orchestrator | Friday 03 April 2026 05:33:48 +0000 (0:00:00.415) 0:00:42.414 ********** 2026-04-03 05:33:52.792428 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792434 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792441 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792448 | orchestrator | 2026-04-03 05:33:52.792454 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-03 05:33:52.792478 | orchestrator | Friday 03 April 2026 05:33:48 +0000 (0:00:00.166) 0:00:42.581 ********** 2026-04-03 05:33:52.792486 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:52.792494 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:52.792501 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792508 | orchestrator | 2026-04-03 05:33:52.792515 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-03 05:33:52.792522 | orchestrator | Friday 03 April 2026 05:33:48 +0000 (0:00:00.152) 0:00:42.733 ********** 2026-04-03 05:33:52.792536 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792543 | orchestrator | 2026-04-03 05:33:52.792550 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-03 05:33:52.792556 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.156) 0:00:42.889 ********** 2026-04-03 05:33:52.792562 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792568 | orchestrator | 2026-04-03 05:33:52.792574 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-03 05:33:52.792580 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.145) 0:00:43.035 ********** 2026-04-03 05:33:52.792587 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792593 | orchestrator | 2026-04-03 05:33:52.792601 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-03 05:33:52.792609 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.147) 0:00:43.182 ********** 2026-04-03 05:33:52.792616 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:33:52.792624 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-03 05:33:52.792632 | orchestrator | } 2026-04-03 05:33:52.792639 | orchestrator | 2026-04-03 05:33:52.792647 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-03 05:33:52.792653 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.147) 0:00:43.330 ********** 2026-04-03 05:33:52.792660 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:33:52.792668 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-03 05:33:52.792683 | orchestrator | } 2026-04-03 05:33:52.792691 | orchestrator | 2026-04-03 05:33:52.792699 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-03 05:33:52.792706 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.144) 0:00:43.474 ********** 2026-04-03 05:33:52.792713 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:33:52.792720 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-03 05:33:52.792727 | orchestrator | } 2026-04-03 05:33:52.792733 | orchestrator | 2026-04-03 05:33:52.792740 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-03 05:33:52.792748 | orchestrator | Friday 03 April 2026 05:33:49 +0000 (0:00:00.162) 0:00:43.637 ********** 2026-04-03 05:33:52.792755 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:52.792762 | orchestrator | 2026-04-03 05:33:52.792769 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-03 05:33:52.792776 | orchestrator | Friday 03 April 2026 05:33:50 +0000 (0:00:00.542) 0:00:44.180 ********** 2026-04-03 05:33:52.792782 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:52.792787 | orchestrator | 2026-04-03 05:33:52.792793 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-03 05:33:52.792799 | orchestrator | Friday 03 April 2026 05:33:50 +0000 (0:00:00.506) 0:00:44.686 ********** 2026-04-03 05:33:52.792805 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:52.792811 | orchestrator | 2026-04-03 05:33:52.792817 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-03 05:33:52.792822 | orchestrator | Friday 03 April 2026 05:33:51 +0000 (0:00:00.507) 0:00:45.194 ********** 2026-04-03 05:33:52.792828 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:52.792835 | orchestrator | 2026-04-03 05:33:52.792841 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-03 05:33:52.792848 | orchestrator | Friday 03 April 2026 05:33:51 +0000 (0:00:00.374) 0:00:45.569 ********** 2026-04-03 05:33:52.792852 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792856 | orchestrator | 2026-04-03 05:33:52.792860 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-03 05:33:52.792864 | orchestrator | Friday 03 April 2026 05:33:51 +0000 (0:00:00.143) 0:00:45.713 ********** 2026-04-03 05:33:52.792868 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792872 | orchestrator | 2026-04-03 05:33:52.792876 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-03 05:33:52.792880 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.119) 0:00:45.832 ********** 2026-04-03 05:33:52.792884 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:33:52.792888 | orchestrator |  "vgs_report": { 2026-04-03 05:33:52.792892 | orchestrator |  "vg": [] 2026-04-03 05:33:52.792896 | orchestrator |  } 2026-04-03 05:33:52.792900 | orchestrator | } 2026-04-03 05:33:52.792903 | orchestrator | 2026-04-03 05:33:52.792907 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-03 05:33:52.792911 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.166) 0:00:45.998 ********** 2026-04-03 05:33:52.792932 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792939 | orchestrator | 2026-04-03 05:33:52.792946 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-03 05:33:52.792951 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.137) 0:00:46.136 ********** 2026-04-03 05:33:52.792954 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792958 | orchestrator | 2026-04-03 05:33:52.792962 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-03 05:33:52.792966 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.146) 0:00:46.282 ********** 2026-04-03 05:33:52.792970 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792974 | orchestrator | 2026-04-03 05:33:52.792977 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-03 05:33:52.792981 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.162) 0:00:46.445 ********** 2026-04-03 05:33:52.792991 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:52.792994 | orchestrator | 2026-04-03 05:33:52.793005 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-03 05:33:57.788857 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.141) 0:00:46.586 ********** 2026-04-03 05:33:57.789015 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789032 | orchestrator | 2026-04-03 05:33:57.789045 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-03 05:33:57.789057 | orchestrator | Friday 03 April 2026 05:33:52 +0000 (0:00:00.143) 0:00:46.730 ********** 2026-04-03 05:33:57.789068 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789079 | orchestrator | 2026-04-03 05:33:57.789090 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-03 05:33:57.789101 | orchestrator | Friday 03 April 2026 05:33:53 +0000 (0:00:00.147) 0:00:46.878 ********** 2026-04-03 05:33:57.789112 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789123 | orchestrator | 2026-04-03 05:33:57.789152 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-03 05:33:57.789163 | orchestrator | Friday 03 April 2026 05:33:53 +0000 (0:00:00.143) 0:00:47.022 ********** 2026-04-03 05:33:57.789174 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789185 | orchestrator | 2026-04-03 05:33:57.789196 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-03 05:33:57.789207 | orchestrator | Friday 03 April 2026 05:33:53 +0000 (0:00:00.154) 0:00:47.176 ********** 2026-04-03 05:33:57.789218 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789229 | orchestrator | 2026-04-03 05:33:57.789240 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-03 05:33:57.789251 | orchestrator | Friday 03 April 2026 05:33:53 +0000 (0:00:00.347) 0:00:47.523 ********** 2026-04-03 05:33:57.789261 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789272 | orchestrator | 2026-04-03 05:33:57.789283 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-03 05:33:57.789295 | orchestrator | Friday 03 April 2026 05:33:53 +0000 (0:00:00.147) 0:00:47.671 ********** 2026-04-03 05:33:57.789306 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789317 | orchestrator | 2026-04-03 05:33:57.789328 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-03 05:33:57.789338 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.148) 0:00:47.819 ********** 2026-04-03 05:33:57.789364 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789375 | orchestrator | 2026-04-03 05:33:57.789397 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-03 05:33:57.789411 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.150) 0:00:47.970 ********** 2026-04-03 05:33:57.789424 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789437 | orchestrator | 2026-04-03 05:33:57.789449 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-03 05:33:57.789461 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.150) 0:00:48.121 ********** 2026-04-03 05:33:57.789474 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789486 | orchestrator | 2026-04-03 05:33:57.789572 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-03 05:33:57.789588 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.145) 0:00:48.267 ********** 2026-04-03 05:33:57.789602 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.789617 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.789630 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789642 | orchestrator | 2026-04-03 05:33:57.789655 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-03 05:33:57.789689 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.162) 0:00:48.429 ********** 2026-04-03 05:33:57.789702 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.789715 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.789729 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789742 | orchestrator | 2026-04-03 05:33:57.789754 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-03 05:33:57.789765 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.148) 0:00:48.578 ********** 2026-04-03 05:33:57.789776 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.789787 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.789798 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789810 | orchestrator | 2026-04-03 05:33:57.789821 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-03 05:33:57.789832 | orchestrator | Friday 03 April 2026 05:33:54 +0000 (0:00:00.197) 0:00:48.776 ********** 2026-04-03 05:33:57.789843 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.789855 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.789866 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789877 | orchestrator | 2026-04-03 05:33:57.789906 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-03 05:33:57.789937 | orchestrator | Friday 03 April 2026 05:33:55 +0000 (0:00:00.173) 0:00:48.949 ********** 2026-04-03 05:33:57.789949 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.789960 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.789971 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.789982 | orchestrator | 2026-04-03 05:33:57.790000 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-03 05:33:57.790011 | orchestrator | Friday 03 April 2026 05:33:55 +0000 (0:00:00.173) 0:00:49.122 ********** 2026-04-03 05:33:57.790084 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.790096 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.790107 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.790118 | orchestrator | 2026-04-03 05:33:57.790129 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-03 05:33:57.790140 | orchestrator | Friday 03 April 2026 05:33:55 +0000 (0:00:00.176) 0:00:49.298 ********** 2026-04-03 05:33:57.790151 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.790162 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.790173 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.790193 | orchestrator | 2026-04-03 05:33:57.790204 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-03 05:33:57.790215 | orchestrator | Friday 03 April 2026 05:33:55 +0000 (0:00:00.370) 0:00:49.669 ********** 2026-04-03 05:33:57.790226 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.790237 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.790248 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.790259 | orchestrator | 2026-04-03 05:33:57.790270 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-03 05:33:57.790281 | orchestrator | Friday 03 April 2026 05:33:56 +0000 (0:00:00.176) 0:00:49.846 ********** 2026-04-03 05:33:57.790292 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:57.790303 | orchestrator | 2026-04-03 05:33:57.790314 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-03 05:33:57.790325 | orchestrator | Friday 03 April 2026 05:33:56 +0000 (0:00:00.514) 0:00:50.361 ********** 2026-04-03 05:33:57.790336 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:57.790346 | orchestrator | 2026-04-03 05:33:57.790357 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-03 05:33:57.790368 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.529) 0:00:50.890 ********** 2026-04-03 05:33:57.790379 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:33:57.790390 | orchestrator | 2026-04-03 05:33:57.790401 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-03 05:33:57.790412 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.178) 0:00:51.069 ********** 2026-04-03 05:33:57.790423 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'vg_name': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}) 2026-04-03 05:33:57.790435 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'vg_name': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}) 2026-04-03 05:33:57.790446 | orchestrator | 2026-04-03 05:33:57.790457 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-03 05:33:57.790468 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.187) 0:00:51.256 ********** 2026-04-03 05:33:57.790479 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.790490 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:33:57.790501 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:33:57.790512 | orchestrator | 2026-04-03 05:33:57.790523 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-03 05:33:57.790534 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.166) 0:00:51.423 ********** 2026-04-03 05:33:57.790545 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:33:57.790563 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:34:04.444349 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:34:04.444441 | orchestrator | 2026-04-03 05:34:04.444453 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-03 05:34:04.444462 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.163) 0:00:51.586 ********** 2026-04-03 05:34:04.444469 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 05:34:04.444507 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 05:34:04.444516 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:34:04.444522 | orchestrator | 2026-04-03 05:34:04.444529 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-03 05:34:04.444536 | orchestrator | Friday 03 April 2026 05:33:57 +0000 (0:00:00.159) 0:00:51.746 ********** 2026-04-03 05:34:04.444543 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:34:04.444550 | orchestrator |  "lvm_report": { 2026-04-03 05:34:04.444558 | orchestrator |  "lv": [ 2026-04-03 05:34:04.444565 | orchestrator |  { 2026-04-03 05:34:04.444572 | orchestrator |  "lv_name": "osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce", 2026-04-03 05:34:04.444580 | orchestrator |  "vg_name": "ceph-22674541-64cc-5df8-a9f8-30ff652f1dce" 2026-04-03 05:34:04.444587 | orchestrator |  }, 2026-04-03 05:34:04.444593 | orchestrator |  { 2026-04-03 05:34:04.444600 | orchestrator |  "lv_name": "osd-block-d44e23ea-2eda-5203-86ef-10b85847f309", 2026-04-03 05:34:04.444607 | orchestrator |  "vg_name": "ceph-d44e23ea-2eda-5203-86ef-10b85847f309" 2026-04-03 05:34:04.444614 | orchestrator |  } 2026-04-03 05:34:04.444620 | orchestrator |  ], 2026-04-03 05:34:04.444627 | orchestrator |  "pv": [ 2026-04-03 05:34:04.444634 | orchestrator |  { 2026-04-03 05:34:04.444641 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-03 05:34:04.444648 | orchestrator |  "vg_name": "ceph-22674541-64cc-5df8-a9f8-30ff652f1dce" 2026-04-03 05:34:04.444655 | orchestrator |  }, 2026-04-03 05:34:04.444662 | orchestrator |  { 2026-04-03 05:34:04.444669 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-03 05:34:04.444676 | orchestrator |  "vg_name": "ceph-d44e23ea-2eda-5203-86ef-10b85847f309" 2026-04-03 05:34:04.444682 | orchestrator |  } 2026-04-03 05:34:04.444689 | orchestrator |  ] 2026-04-03 05:34:04.444696 | orchestrator |  } 2026-04-03 05:34:04.444703 | orchestrator | } 2026-04-03 05:34:04.444710 | orchestrator | 2026-04-03 05:34:04.444717 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-03 05:34:04.444723 | orchestrator | 2026-04-03 05:34:04.444730 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 05:34:04.444737 | orchestrator | Friday 03 April 2026 05:33:58 +0000 (0:00:00.336) 0:00:52.083 ********** 2026-04-03 05:34:04.444744 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-03 05:34:04.444751 | orchestrator | 2026-04-03 05:34:04.444758 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-03 05:34:04.444764 | orchestrator | Friday 03 April 2026 05:33:59 +0000 (0:00:00.740) 0:00:52.823 ********** 2026-04-03 05:34:04.444771 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:04.444778 | orchestrator | 2026-04-03 05:34:04.444785 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.444791 | orchestrator | Friday 03 April 2026 05:33:59 +0000 (0:00:00.247) 0:00:53.071 ********** 2026-04-03 05:34:04.444798 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-03 05:34:04.444805 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-03 05:34:04.444812 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-03 05:34:04.444819 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-03 05:34:04.444825 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-03 05:34:04.444832 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-03 05:34:04.444839 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-03 05:34:04.444851 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-03 05:34:04.444858 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-03 05:34:04.444865 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-03 05:34:04.444872 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-03 05:34:04.444878 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-03 05:34:04.444885 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-03 05:34:04.444892 | orchestrator | 2026-04-03 05:34:04.444899 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.444905 | orchestrator | Friday 03 April 2026 05:33:59 +0000 (0:00:00.437) 0:00:53.508 ********** 2026-04-03 05:34:04.444952 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.444961 | orchestrator | 2026-04-03 05:34:04.444969 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.444977 | orchestrator | Friday 03 April 2026 05:33:59 +0000 (0:00:00.206) 0:00:53.714 ********** 2026-04-03 05:34:04.444985 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.444993 | orchestrator | 2026-04-03 05:34:04.445001 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445021 | orchestrator | Friday 03 April 2026 05:34:00 +0000 (0:00:00.207) 0:00:53.922 ********** 2026-04-03 05:34:04.445029 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445037 | orchestrator | 2026-04-03 05:34:04.445046 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445054 | orchestrator | Friday 03 April 2026 05:34:00 +0000 (0:00:00.220) 0:00:54.142 ********** 2026-04-03 05:34:04.445062 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445070 | orchestrator | 2026-04-03 05:34:04.445079 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445087 | orchestrator | Friday 03 April 2026 05:34:00 +0000 (0:00:00.204) 0:00:54.347 ********** 2026-04-03 05:34:04.445095 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445104 | orchestrator | 2026-04-03 05:34:04.445116 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445128 | orchestrator | Friday 03 April 2026 05:34:00 +0000 (0:00:00.200) 0:00:54.547 ********** 2026-04-03 05:34:04.445139 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445151 | orchestrator | 2026-04-03 05:34:04.445163 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445174 | orchestrator | Friday 03 April 2026 05:34:00 +0000 (0:00:00.204) 0:00:54.752 ********** 2026-04-03 05:34:04.445187 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445198 | orchestrator | 2026-04-03 05:34:04.445211 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445221 | orchestrator | Friday 03 April 2026 05:34:01 +0000 (0:00:00.217) 0:00:54.969 ********** 2026-04-03 05:34:04.445231 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:04.445243 | orchestrator | 2026-04-03 05:34:04.445251 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445258 | orchestrator | Friday 03 April 2026 05:34:01 +0000 (0:00:00.203) 0:00:55.172 ********** 2026-04-03 05:34:04.445264 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6) 2026-04-03 05:34:04.445272 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6) 2026-04-03 05:34:04.445279 | orchestrator | 2026-04-03 05:34:04.445286 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445292 | orchestrator | Friday 03 April 2026 05:34:02 +0000 (0:00:00.891) 0:00:56.063 ********** 2026-04-03 05:34:04.445356 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7) 2026-04-03 05:34:04.445375 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7) 2026-04-03 05:34:04.445382 | orchestrator | 2026-04-03 05:34:04.445389 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445396 | orchestrator | Friday 03 April 2026 05:34:02 +0000 (0:00:00.456) 0:00:56.520 ********** 2026-04-03 05:34:04.445403 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d) 2026-04-03 05:34:04.445409 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d) 2026-04-03 05:34:04.445416 | orchestrator | 2026-04-03 05:34:04.445423 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445429 | orchestrator | Friday 03 April 2026 05:34:03 +0000 (0:00:00.488) 0:00:57.009 ********** 2026-04-03 05:34:04.445436 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4) 2026-04-03 05:34:04.445443 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4) 2026-04-03 05:34:04.445450 | orchestrator | 2026-04-03 05:34:04.445457 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-03 05:34:04.445463 | orchestrator | Friday 03 April 2026 05:34:03 +0000 (0:00:00.451) 0:00:57.461 ********** 2026-04-03 05:34:04.445470 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-03 05:34:04.445477 | orchestrator | 2026-04-03 05:34:04.445483 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:04.445490 | orchestrator | Friday 03 April 2026 05:34:03 +0000 (0:00:00.340) 0:00:57.801 ********** 2026-04-03 05:34:04.445497 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-03 05:34:04.445504 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-03 05:34:04.445511 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-03 05:34:04.445517 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-03 05:34:04.445524 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-03 05:34:04.445531 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-03 05:34:04.445537 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-03 05:34:04.445544 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-03 05:34:04.445551 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-03 05:34:04.445557 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-03 05:34:04.445564 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-03 05:34:04.445577 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-03 05:34:13.622094 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-03 05:34:13.622204 | orchestrator | 2026-04-03 05:34:13.622219 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622231 | orchestrator | Friday 03 April 2026 05:34:04 +0000 (0:00:00.429) 0:00:58.231 ********** 2026-04-03 05:34:13.622241 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622252 | orchestrator | 2026-04-03 05:34:13.622263 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622288 | orchestrator | Friday 03 April 2026 05:34:04 +0000 (0:00:00.216) 0:00:58.447 ********** 2026-04-03 05:34:13.622299 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622329 | orchestrator | 2026-04-03 05:34:13.622339 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622349 | orchestrator | Friday 03 April 2026 05:34:04 +0000 (0:00:00.192) 0:00:58.639 ********** 2026-04-03 05:34:13.622359 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622369 | orchestrator | 2026-04-03 05:34:13.622379 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622389 | orchestrator | Friday 03 April 2026 05:34:05 +0000 (0:00:00.227) 0:00:58.867 ********** 2026-04-03 05:34:13.622399 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622408 | orchestrator | 2026-04-03 05:34:13.622418 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622428 | orchestrator | Friday 03 April 2026 05:34:05 +0000 (0:00:00.218) 0:00:59.085 ********** 2026-04-03 05:34:13.622438 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622448 | orchestrator | 2026-04-03 05:34:13.622457 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622467 | orchestrator | Friday 03 April 2026 05:34:05 +0000 (0:00:00.670) 0:00:59.756 ********** 2026-04-03 05:34:13.622477 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622487 | orchestrator | 2026-04-03 05:34:13.622498 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622510 | orchestrator | Friday 03 April 2026 05:34:06 +0000 (0:00:00.235) 0:00:59.992 ********** 2026-04-03 05:34:13.622523 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622534 | orchestrator | 2026-04-03 05:34:13.622545 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622557 | orchestrator | Friday 03 April 2026 05:34:06 +0000 (0:00:00.251) 0:01:00.244 ********** 2026-04-03 05:34:13.622569 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622578 | orchestrator | 2026-04-03 05:34:13.622588 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622598 | orchestrator | Friday 03 April 2026 05:34:06 +0000 (0:00:00.224) 0:01:00.468 ********** 2026-04-03 05:34:13.622608 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-03 05:34:13.622618 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-03 05:34:13.622629 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-03 05:34:13.622639 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-03 05:34:13.622648 | orchestrator | 2026-04-03 05:34:13.622658 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622668 | orchestrator | Friday 03 April 2026 05:34:07 +0000 (0:00:00.687) 0:01:01.156 ********** 2026-04-03 05:34:13.622678 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622688 | orchestrator | 2026-04-03 05:34:13.622698 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622708 | orchestrator | Friday 03 April 2026 05:34:07 +0000 (0:00:00.240) 0:01:01.396 ********** 2026-04-03 05:34:13.622718 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622728 | orchestrator | 2026-04-03 05:34:13.622738 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622748 | orchestrator | Friday 03 April 2026 05:34:07 +0000 (0:00:00.227) 0:01:01.623 ********** 2026-04-03 05:34:13.622758 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622767 | orchestrator | 2026-04-03 05:34:13.622777 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-03 05:34:13.622787 | orchestrator | Friday 03 April 2026 05:34:08 +0000 (0:00:00.225) 0:01:01.848 ********** 2026-04-03 05:34:13.622797 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622807 | orchestrator | 2026-04-03 05:34:13.622817 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-03 05:34:13.622827 | orchestrator | Friday 03 April 2026 05:34:08 +0000 (0:00:00.211) 0:01:02.060 ********** 2026-04-03 05:34:13.622837 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.622847 | orchestrator | 2026-04-03 05:34:13.622863 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-03 05:34:13.622873 | orchestrator | Friday 03 April 2026 05:34:08 +0000 (0:00:00.147) 0:01:02.207 ********** 2026-04-03 05:34:13.622884 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '0168ecd7-dd70-56c3-8572-150117512a85'}}) 2026-04-03 05:34:13.622894 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}}) 2026-04-03 05:34:13.622904 | orchestrator | 2026-04-03 05:34:13.622937 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-03 05:34:13.622947 | orchestrator | Friday 03 April 2026 05:34:08 +0000 (0:00:00.209) 0:01:02.416 ********** 2026-04-03 05:34:13.622959 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}) 2026-04-03 05:34:13.622969 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}) 2026-04-03 05:34:13.622979 | orchestrator | 2026-04-03 05:34:13.622989 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-03 05:34:13.623017 | orchestrator | Friday 03 April 2026 05:34:10 +0000 (0:00:01.819) 0:01:04.236 ********** 2026-04-03 05:34:13.623028 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:13.623039 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:13.623049 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623059 | orchestrator | 2026-04-03 05:34:13.623074 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-03 05:34:13.623085 | orchestrator | Friday 03 April 2026 05:34:10 +0000 (0:00:00.368) 0:01:04.605 ********** 2026-04-03 05:34:13.623095 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}) 2026-04-03 05:34:13.623105 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}) 2026-04-03 05:34:13.623115 | orchestrator | 2026-04-03 05:34:13.623124 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-03 05:34:13.623134 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:01.298) 0:01:05.903 ********** 2026-04-03 05:34:13.623145 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:13.623155 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:13.623165 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623175 | orchestrator | 2026-04-03 05:34:13.623185 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-03 05:34:13.623195 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:00.229) 0:01:06.133 ********** 2026-04-03 05:34:13.623205 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623214 | orchestrator | 2026-04-03 05:34:13.623224 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-03 05:34:13.623234 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:00.167) 0:01:06.301 ********** 2026-04-03 05:34:13.623244 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:13.623255 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:13.623271 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623281 | orchestrator | 2026-04-03 05:34:13.623291 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-03 05:34:13.623301 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:00.174) 0:01:06.475 ********** 2026-04-03 05:34:13.623311 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623321 | orchestrator | 2026-04-03 05:34:13.623330 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-03 05:34:13.623340 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:00.157) 0:01:06.632 ********** 2026-04-03 05:34:13.623350 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:13.623361 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:13.623371 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623381 | orchestrator | 2026-04-03 05:34:13.623391 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-03 05:34:13.623401 | orchestrator | Friday 03 April 2026 05:34:12 +0000 (0:00:00.166) 0:01:06.799 ********** 2026-04-03 05:34:13.623411 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623421 | orchestrator | 2026-04-03 05:34:13.623431 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-03 05:34:13.623441 | orchestrator | Friday 03 April 2026 05:34:13 +0000 (0:00:00.155) 0:01:06.955 ********** 2026-04-03 05:34:13.623451 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:13.623461 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:13.623471 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:13.623481 | orchestrator | 2026-04-03 05:34:13.623491 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-03 05:34:13.623501 | orchestrator | Friday 03 April 2026 05:34:13 +0000 (0:00:00.158) 0:01:07.113 ********** 2026-04-03 05:34:13.623510 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:13.623520 | orchestrator | 2026-04-03 05:34:13.623530 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-03 05:34:13.623540 | orchestrator | Friday 03 April 2026 05:34:13 +0000 (0:00:00.140) 0:01:07.254 ********** 2026-04-03 05:34:13.623557 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:20.386978 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:20.387089 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387107 | orchestrator | 2026-04-03 05:34:20.387120 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-03 05:34:20.387133 | orchestrator | Friday 03 April 2026 05:34:13 +0000 (0:00:00.163) 0:01:07.417 ********** 2026-04-03 05:34:20.387160 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:20.387172 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:20.387183 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387194 | orchestrator | 2026-04-03 05:34:20.387206 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-03 05:34:20.387217 | orchestrator | Friday 03 April 2026 05:34:13 +0000 (0:00:00.164) 0:01:07.582 ********** 2026-04-03 05:34:20.387250 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:20.387262 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:20.387273 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387284 | orchestrator | 2026-04-03 05:34:20.387295 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-03 05:34:20.387306 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.387) 0:01:07.970 ********** 2026-04-03 05:34:20.387317 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387328 | orchestrator | 2026-04-03 05:34:20.387339 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-03 05:34:20.387350 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.147) 0:01:08.117 ********** 2026-04-03 05:34:20.387361 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387372 | orchestrator | 2026-04-03 05:34:20.387383 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-03 05:34:20.387394 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.152) 0:01:08.269 ********** 2026-04-03 05:34:20.387405 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387416 | orchestrator | 2026-04-03 05:34:20.387427 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-03 05:34:20.387438 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.159) 0:01:08.429 ********** 2026-04-03 05:34:20.387449 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:34:20.387461 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-03 05:34:20.387473 | orchestrator | } 2026-04-03 05:34:20.387486 | orchestrator | 2026-04-03 05:34:20.387499 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-03 05:34:20.387512 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.168) 0:01:08.598 ********** 2026-04-03 05:34:20.387524 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:34:20.387537 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-03 05:34:20.387549 | orchestrator | } 2026-04-03 05:34:20.387562 | orchestrator | 2026-04-03 05:34:20.387575 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-03 05:34:20.387587 | orchestrator | Friday 03 April 2026 05:34:14 +0000 (0:00:00.165) 0:01:08.764 ********** 2026-04-03 05:34:20.387600 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:34:20.387612 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-03 05:34:20.387625 | orchestrator | } 2026-04-03 05:34:20.387638 | orchestrator | 2026-04-03 05:34:20.387652 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-03 05:34:20.387665 | orchestrator | Friday 03 April 2026 05:34:15 +0000 (0:00:00.158) 0:01:08.922 ********** 2026-04-03 05:34:20.387677 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:20.387690 | orchestrator | 2026-04-03 05:34:20.387703 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-03 05:34:20.387716 | orchestrator | Friday 03 April 2026 05:34:15 +0000 (0:00:00.534) 0:01:09.457 ********** 2026-04-03 05:34:20.387729 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:20.387741 | orchestrator | 2026-04-03 05:34:20.387754 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-03 05:34:20.387767 | orchestrator | Friday 03 April 2026 05:34:16 +0000 (0:00:00.525) 0:01:09.982 ********** 2026-04-03 05:34:20.387779 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:20.387791 | orchestrator | 2026-04-03 05:34:20.387804 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-03 05:34:20.387816 | orchestrator | Friday 03 April 2026 05:34:16 +0000 (0:00:00.501) 0:01:10.484 ********** 2026-04-03 05:34:20.387829 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:20.387842 | orchestrator | 2026-04-03 05:34:20.387853 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-03 05:34:20.387872 | orchestrator | Friday 03 April 2026 05:34:16 +0000 (0:00:00.149) 0:01:10.633 ********** 2026-04-03 05:34:20.387884 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387894 | orchestrator | 2026-04-03 05:34:20.387923 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-03 05:34:20.387935 | orchestrator | Friday 03 April 2026 05:34:16 +0000 (0:00:00.118) 0:01:10.752 ********** 2026-04-03 05:34:20.387946 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.387957 | orchestrator | 2026-04-03 05:34:20.387968 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-03 05:34:20.387979 | orchestrator | Friday 03 April 2026 05:34:17 +0000 (0:00:00.338) 0:01:11.091 ********** 2026-04-03 05:34:20.387990 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:34:20.388001 | orchestrator |  "vgs_report": { 2026-04-03 05:34:20.388012 | orchestrator |  "vg": [] 2026-04-03 05:34:20.388041 | orchestrator |  } 2026-04-03 05:34:20.388053 | orchestrator | } 2026-04-03 05:34:20.388064 | orchestrator | 2026-04-03 05:34:20.388075 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-03 05:34:20.388086 | orchestrator | Friday 03 April 2026 05:34:17 +0000 (0:00:00.183) 0:01:11.275 ********** 2026-04-03 05:34:20.388097 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388108 | orchestrator | 2026-04-03 05:34:20.388119 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-03 05:34:20.388130 | orchestrator | Friday 03 April 2026 05:34:17 +0000 (0:00:00.138) 0:01:11.413 ********** 2026-04-03 05:34:20.388146 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388157 | orchestrator | 2026-04-03 05:34:20.388168 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-03 05:34:20.388179 | orchestrator | Friday 03 April 2026 05:34:17 +0000 (0:00:00.177) 0:01:11.591 ********** 2026-04-03 05:34:20.388190 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388201 | orchestrator | 2026-04-03 05:34:20.388212 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-03 05:34:20.388223 | orchestrator | Friday 03 April 2026 05:34:17 +0000 (0:00:00.169) 0:01:11.760 ********** 2026-04-03 05:34:20.388233 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388244 | orchestrator | 2026-04-03 05:34:20.388255 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-03 05:34:20.388266 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.167) 0:01:11.928 ********** 2026-04-03 05:34:20.388277 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388288 | orchestrator | 2026-04-03 05:34:20.388299 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-03 05:34:20.388310 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.168) 0:01:12.097 ********** 2026-04-03 05:34:20.388321 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388332 | orchestrator | 2026-04-03 05:34:20.388343 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-03 05:34:20.388354 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.149) 0:01:12.246 ********** 2026-04-03 05:34:20.388364 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388375 | orchestrator | 2026-04-03 05:34:20.388386 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-03 05:34:20.388397 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.159) 0:01:12.405 ********** 2026-04-03 05:34:20.388408 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388419 | orchestrator | 2026-04-03 05:34:20.388430 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-03 05:34:20.388441 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.158) 0:01:12.564 ********** 2026-04-03 05:34:20.388452 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388463 | orchestrator | 2026-04-03 05:34:20.388474 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-03 05:34:20.388485 | orchestrator | Friday 03 April 2026 05:34:18 +0000 (0:00:00.142) 0:01:12.707 ********** 2026-04-03 05:34:20.388503 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388514 | orchestrator | 2026-04-03 05:34:20.388525 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-03 05:34:20.388536 | orchestrator | Friday 03 April 2026 05:34:19 +0000 (0:00:00.158) 0:01:12.865 ********** 2026-04-03 05:34:20.388547 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388558 | orchestrator | 2026-04-03 05:34:20.388569 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-03 05:34:20.388580 | orchestrator | Friday 03 April 2026 05:34:19 +0000 (0:00:00.372) 0:01:13.237 ********** 2026-04-03 05:34:20.388591 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388602 | orchestrator | 2026-04-03 05:34:20.388613 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-03 05:34:20.388624 | orchestrator | Friday 03 April 2026 05:34:19 +0000 (0:00:00.148) 0:01:13.386 ********** 2026-04-03 05:34:20.388635 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388646 | orchestrator | 2026-04-03 05:34:20.388657 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-03 05:34:20.388668 | orchestrator | Friday 03 April 2026 05:34:19 +0000 (0:00:00.149) 0:01:13.535 ********** 2026-04-03 05:34:20.388679 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388690 | orchestrator | 2026-04-03 05:34:20.388701 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-03 05:34:20.388711 | orchestrator | Friday 03 April 2026 05:34:19 +0000 (0:00:00.152) 0:01:13.688 ********** 2026-04-03 05:34:20.388723 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:20.388734 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:20.388745 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388756 | orchestrator | 2026-04-03 05:34:20.388767 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-03 05:34:20.388778 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.158) 0:01:13.847 ********** 2026-04-03 05:34:20.388789 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:20.388800 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:20.388811 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:20.388821 | orchestrator | 2026-04-03 05:34:20.388832 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-03 05:34:20.388843 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.163) 0:01:14.010 ********** 2026-04-03 05:34:20.388862 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587128 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587232 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587256 | orchestrator | 2026-04-03 05:34:23.587300 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-03 05:34:23.587322 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.174) 0:01:14.184 ********** 2026-04-03 05:34:23.587341 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587361 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587406 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587425 | orchestrator | 2026-04-03 05:34:23.587444 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-03 05:34:23.587464 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.179) 0:01:14.364 ********** 2026-04-03 05:34:23.587484 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587505 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587524 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587544 | orchestrator | 2026-04-03 05:34:23.587556 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-03 05:34:23.587567 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.173) 0:01:14.537 ********** 2026-04-03 05:34:23.587578 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587590 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587601 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587612 | orchestrator | 2026-04-03 05:34:23.587623 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-03 05:34:23.587634 | orchestrator | Friday 03 April 2026 05:34:20 +0000 (0:00:00.159) 0:01:14.697 ********** 2026-04-03 05:34:23.587645 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587657 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587670 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587682 | orchestrator | 2026-04-03 05:34:23.587695 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-03 05:34:23.587709 | orchestrator | Friday 03 April 2026 05:34:21 +0000 (0:00:00.184) 0:01:14.882 ********** 2026-04-03 05:34:23.587721 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.587734 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.587746 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.587759 | orchestrator | 2026-04-03 05:34:23.587771 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-03 05:34:23.587784 | orchestrator | Friday 03 April 2026 05:34:21 +0000 (0:00:00.168) 0:01:15.050 ********** 2026-04-03 05:34:23.587797 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:23.587810 | orchestrator | 2026-04-03 05:34:23.587822 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-03 05:34:23.587834 | orchestrator | Friday 03 April 2026 05:34:22 +0000 (0:00:00.755) 0:01:15.806 ********** 2026-04-03 05:34:23.587847 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:23.587859 | orchestrator | 2026-04-03 05:34:23.587872 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-03 05:34:23.587886 | orchestrator | Friday 03 April 2026 05:34:22 +0000 (0:00:00.506) 0:01:16.313 ********** 2026-04-03 05:34:23.587897 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:23.587936 | orchestrator | 2026-04-03 05:34:23.587947 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-03 05:34:23.587958 | orchestrator | Friday 03 April 2026 05:34:22 +0000 (0:00:00.159) 0:01:16.473 ********** 2026-04-03 05:34:23.587980 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'vg_name': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}) 2026-04-03 05:34:23.587992 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'vg_name': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}) 2026-04-03 05:34:23.588003 | orchestrator | 2026-04-03 05:34:23.588014 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-03 05:34:23.588026 | orchestrator | Friday 03 April 2026 05:34:22 +0000 (0:00:00.185) 0:01:16.658 ********** 2026-04-03 05:34:23.588058 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.588078 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.588090 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.588101 | orchestrator | 2026-04-03 05:34:23.588112 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-03 05:34:23.588124 | orchestrator | Friday 03 April 2026 05:34:23 +0000 (0:00:00.180) 0:01:16.839 ********** 2026-04-03 05:34:23.588135 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.588146 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.588157 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.588168 | orchestrator | 2026-04-03 05:34:23.588179 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-03 05:34:23.588191 | orchestrator | Friday 03 April 2026 05:34:23 +0000 (0:00:00.177) 0:01:17.016 ********** 2026-04-03 05:34:23.588202 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 05:34:23.588213 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 05:34:23.588224 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:23.588235 | orchestrator | 2026-04-03 05:34:23.588246 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-03 05:34:23.588258 | orchestrator | Friday 03 April 2026 05:34:23 +0000 (0:00:00.170) 0:01:17.187 ********** 2026-04-03 05:34:23.588268 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:34:23.588280 | orchestrator |  "lvm_report": { 2026-04-03 05:34:23.588291 | orchestrator |  "lv": [ 2026-04-03 05:34:23.588302 | orchestrator |  { 2026-04-03 05:34:23.588313 | orchestrator |  "lv_name": "osd-block-0168ecd7-dd70-56c3-8572-150117512a85", 2026-04-03 05:34:23.588325 | orchestrator |  "vg_name": "ceph-0168ecd7-dd70-56c3-8572-150117512a85" 2026-04-03 05:34:23.588336 | orchestrator |  }, 2026-04-03 05:34:23.588347 | orchestrator |  { 2026-04-03 05:34:23.588358 | orchestrator |  "lv_name": "osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29", 2026-04-03 05:34:23.588369 | orchestrator |  "vg_name": "ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29" 2026-04-03 05:34:23.588381 | orchestrator |  } 2026-04-03 05:34:23.588392 | orchestrator |  ], 2026-04-03 05:34:23.588403 | orchestrator |  "pv": [ 2026-04-03 05:34:23.588413 | orchestrator |  { 2026-04-03 05:34:23.588424 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-03 05:34:23.588436 | orchestrator |  "vg_name": "ceph-0168ecd7-dd70-56c3-8572-150117512a85" 2026-04-03 05:34:23.588447 | orchestrator |  }, 2026-04-03 05:34:23.588458 | orchestrator |  { 2026-04-03 05:34:23.588469 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-03 05:34:23.588491 | orchestrator |  "vg_name": "ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29" 2026-04-03 05:34:23.588502 | orchestrator |  } 2026-04-03 05:34:23.588513 | orchestrator |  ] 2026-04-03 05:34:23.588524 | orchestrator |  } 2026-04-03 05:34:23.588535 | orchestrator | } 2026-04-03 05:34:23.588546 | orchestrator | 2026-04-03 05:34:23.588557 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:34:23.588569 | orchestrator | testbed-node-3 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-03 05:34:23.588580 | orchestrator | testbed-node-4 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-03 05:34:23.588592 | orchestrator | testbed-node-5 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-03 05:34:23.588603 | orchestrator | 2026-04-03 05:34:23.588614 | orchestrator | 2026-04-03 05:34:23.588625 | orchestrator | 2026-04-03 05:34:23.588636 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:34:23.588647 | orchestrator | Friday 03 April 2026 05:34:23 +0000 (0:00:00.169) 0:01:17.357 ********** 2026-04-03 05:34:23.588659 | orchestrator | =============================================================================== 2026-04-03 05:34:23.588669 | orchestrator | Create block VGs -------------------------------------------------------- 6.68s 2026-04-03 05:34:23.588681 | orchestrator | Create block LVs -------------------------------------------------------- 4.04s 2026-04-03 05:34:23.588691 | orchestrator | Get list of Ceph LVs with associated VGs -------------------------------- 1.80s 2026-04-03 05:34:23.588702 | orchestrator | Gather DB VGs with total and available size in bytes -------------------- 1.77s 2026-04-03 05:34:23.588713 | orchestrator | Get list of Ceph PVs with associated VGs -------------------------------- 1.55s 2026-04-03 05:34:23.588724 | orchestrator | Gather WAL VGs with total and available size in bytes ------------------- 1.54s 2026-04-03 05:34:23.588735 | orchestrator | Gather DB+WAL VGs with total and available size in bytes ---------------- 1.53s 2026-04-03 05:34:23.588746 | orchestrator | Add known links to the list of available block devices ------------------ 1.40s 2026-04-03 05:34:23.588764 | orchestrator | Add known partitions to the list of available block devices ------------- 1.33s 2026-04-03 05:34:23.965844 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 1.26s 2026-04-03 05:34:23.965990 | orchestrator | Print LVM report data --------------------------------------------------- 1.03s 2026-04-03 05:34:23.966006 | orchestrator | Print 'Create block VGs' ------------------------------------------------ 0.94s 2026-04-03 05:34:23.966089 | orchestrator | Add known links to the list of available block devices ------------------ 0.93s 2026-04-03 05:34:23.966103 | orchestrator | Add known links to the list of available block devices ------------------ 0.89s 2026-04-03 05:34:23.966114 | orchestrator | Combine JSON from _db/wal/db_wal_vgs_cmd_output ------------------------- 0.88s 2026-04-03 05:34:23.966125 | orchestrator | Count OSDs put on ceph_db_devices defined in lvm_volumes ---------------- 0.76s 2026-04-03 05:34:23.966137 | orchestrator | Get initial list of available block devices ----------------------------- 0.73s 2026-04-03 05:34:23.966148 | orchestrator | Create WAL LVs for ceph_db_wal_devices ---------------------------------- 0.73s 2026-04-03 05:34:23.966159 | orchestrator | Count OSDs put on ceph_wal_devices defined in lvm_volumes --------------- 0.72s 2026-04-03 05:34:23.966170 | orchestrator | Add known partitions to the list of available block devices ------------- 0.72s 2026-04-03 05:34:36.331042 | orchestrator | 2026-04-03 05:34:36 | INFO  | Task 7857a5a6-89df-4c5d-be89-3ef36d63f10a (facts) was prepared for execution. 2026-04-03 05:34:36.331150 | orchestrator | 2026-04-03 05:34:36 | INFO  | It takes a moment until task 7857a5a6-89df-4c5d-be89-3ef36d63f10a (facts) has been started and output is visible here. 2026-04-03 05:34:49.385997 | orchestrator | 2026-04-03 05:34:49.386185 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-03 05:34:49.386232 | orchestrator | 2026-04-03 05:34:49.386245 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 05:34:49.386256 | orchestrator | Friday 03 April 2026 05:34:40 +0000 (0:00:00.294) 0:00:00.294 ********** 2026-04-03 05:34:49.386268 | orchestrator | ok: [testbed-manager] 2026-04-03 05:34:49.386280 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:34:49.386291 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:34:49.386302 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:34:49.386313 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:34:49.386324 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:34:49.386334 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:49.386345 | orchestrator | 2026-04-03 05:34:49.386356 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 05:34:49.386367 | orchestrator | Friday 03 April 2026 05:34:41 +0000 (0:00:01.138) 0:00:01.432 ********** 2026-04-03 05:34:49.386378 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:34:49.386390 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:34:49.386401 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:34:49.386412 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:34:49.386422 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:34:49.386433 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:34:49.386444 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:49.386455 | orchestrator | 2026-04-03 05:34:49.386465 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 05:34:49.386476 | orchestrator | 2026-04-03 05:34:49.386487 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 05:34:49.386499 | orchestrator | Friday 03 April 2026 05:34:43 +0000 (0:00:01.383) 0:00:02.815 ********** 2026-04-03 05:34:49.386511 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:34:49.386525 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:34:49.386537 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:34:49.386550 | orchestrator | ok: [testbed-manager] 2026-04-03 05:34:49.386562 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:34:49.386574 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:34:49.386586 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:34:49.386599 | orchestrator | 2026-04-03 05:34:49.386612 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 05:34:49.386625 | orchestrator | 2026-04-03 05:34:49.386636 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 05:34:49.386647 | orchestrator | Friday 03 April 2026 05:34:48 +0000 (0:00:05.093) 0:00:07.909 ********** 2026-04-03 05:34:49.386658 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:34:49.386668 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:34:49.386679 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:34:49.386690 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:34:49.386701 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:34:49.386711 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:34:49.386722 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:34:49.386733 | orchestrator | 2026-04-03 05:34:49.386744 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:34:49.386755 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386767 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386778 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386789 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386800 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386819 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386830 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:34:49.386841 | orchestrator | 2026-04-03 05:34:49.386851 | orchestrator | 2026-04-03 05:34:49.386862 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:34:49.386887 | orchestrator | Friday 03 April 2026 05:34:48 +0000 (0:00:00.578) 0:00:08.488 ********** 2026-04-03 05:34:49.386929 | orchestrator | =============================================================================== 2026-04-03 05:34:49.386941 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.09s 2026-04-03 05:34:49.386952 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.38s 2026-04-03 05:34:49.386963 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.14s 2026-04-03 05:34:49.386974 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.58s 2026-04-03 05:34:51.851113 | orchestrator | 2026-04-03 05:34:51 | INFO  | Task f4a68ab2-8787-4af4-9685-5bb39d9fd1f4 (ceph) was prepared for execution. 2026-04-03 05:34:51.851212 | orchestrator | 2026-04-03 05:34:51 | INFO  | It takes a moment until task f4a68ab2-8787-4af4-9685-5bb39d9fd1f4 (ceph) has been started and output is visible here. 2026-04-03 05:35:10.252341 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 05:35:10.252418 | orchestrator | 2.16.14 2026-04-03 05:35:10.252429 | orchestrator | 2026-04-03 05:35:10.252437 | orchestrator | PLAY [Prepare deployment of Ceph services] ************************************* 2026-04-03 05:35:10.252446 | orchestrator | 2026-04-03 05:35:10.252453 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 05:35:10.252461 | orchestrator | Friday 03 April 2026 05:34:56 +0000 (0:00:00.804) 0:00:00.804 ********** 2026-04-03 05:35:10.252469 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:35:10.252477 | orchestrator | 2026-04-03 05:35:10.252485 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 05:35:10.252492 | orchestrator | Friday 03 April 2026 05:34:58 +0000 (0:00:01.253) 0:00:02.058 ********** 2026-04-03 05:35:10.252499 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.252507 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.252514 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.252521 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.252528 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.252536 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.252543 | orchestrator | 2026-04-03 05:35:10.252551 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 05:35:10.252558 | orchestrator | Friday 03 April 2026 05:34:59 +0000 (0:00:01.296) 0:00:03.354 ********** 2026-04-03 05:35:10.252566 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.252573 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.252580 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.252587 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.252594 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.252603 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.252614 | orchestrator | 2026-04-03 05:35:10.252626 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 05:35:10.252636 | orchestrator | Friday 03 April 2026 05:35:00 +0000 (0:00:00.793) 0:00:04.147 ********** 2026-04-03 05:35:10.252646 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.252657 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.252668 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.252679 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.252711 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.252723 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.252747 | orchestrator | 2026-04-03 05:35:10.252769 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 05:35:10.252781 | orchestrator | Friday 03 April 2026 05:35:01 +0000 (0:00:00.944) 0:00:05.092 ********** 2026-04-03 05:35:10.252792 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.252804 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.252815 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.252827 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.252839 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.252850 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.252861 | orchestrator | 2026-04-03 05:35:10.252873 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 05:35:10.252944 | orchestrator | Friday 03 April 2026 05:35:02 +0000 (0:00:00.802) 0:00:05.894 ********** 2026-04-03 05:35:10.252961 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.252973 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.252986 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.252998 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.253011 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.253022 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.253034 | orchestrator | 2026-04-03 05:35:10.253046 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 05:35:10.253060 | orchestrator | Friday 03 April 2026 05:35:02 +0000 (0:00:00.600) 0:00:06.494 ********** 2026-04-03 05:35:10.253074 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.253087 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.253100 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.253114 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.253127 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.253140 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.253154 | orchestrator | 2026-04-03 05:35:10.253167 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 05:35:10.253182 | orchestrator | Friday 03 April 2026 05:35:03 +0000 (0:00:00.850) 0:00:07.345 ********** 2026-04-03 05:35:10.253195 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:10.253210 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:10.253222 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:10.253235 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:10.253249 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:10.253263 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:10.253276 | orchestrator | 2026-04-03 05:35:10.253289 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 05:35:10.253301 | orchestrator | Friday 03 April 2026 05:35:04 +0000 (0:00:00.642) 0:00:07.987 ********** 2026-04-03 05:35:10.253314 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.253326 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.253338 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.253350 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.253362 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.253386 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.253398 | orchestrator | 2026-04-03 05:35:10.253410 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 05:35:10.253421 | orchestrator | Friday 03 April 2026 05:35:04 +0000 (0:00:00.806) 0:00:08.794 ********** 2026-04-03 05:35:10.253433 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:35:10.253444 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:35:10.253455 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:35:10.253467 | orchestrator | 2026-04-03 05:35:10.253478 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 05:35:10.253490 | orchestrator | Friday 03 April 2026 05:35:05 +0000 (0:00:00.681) 0:00:09.476 ********** 2026-04-03 05:35:10.253512 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:10.253524 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:10.253535 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:10.253566 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:10.253579 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:10.253589 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:10.253601 | orchestrator | 2026-04-03 05:35:10.253612 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 05:35:10.253623 | orchestrator | Friday 03 April 2026 05:35:06 +0000 (0:00:00.731) 0:00:10.208 ********** 2026-04-03 05:35:10.253634 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:35:10.253645 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:35:10.253656 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:35:10.253668 | orchestrator | 2026-04-03 05:35:10.253675 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 05:35:10.253682 | orchestrator | Friday 03 April 2026 05:35:08 +0000 (0:00:02.482) 0:00:12.691 ********** 2026-04-03 05:35:10.253689 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 05:35:10.253696 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 05:35:10.253703 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 05:35:10.253709 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:10.253716 | orchestrator | 2026-04-03 05:35:10.253722 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 05:35:10.253729 | orchestrator | Friday 03 April 2026 05:35:09 +0000 (0:00:00.431) 0:00:13.122 ********** 2026-04-03 05:35:10.253737 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253746 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253753 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253760 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:10.253767 | orchestrator | 2026-04-03 05:35:10.253773 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 05:35:10.253780 | orchestrator | Friday 03 April 2026 05:35:09 +0000 (0:00:00.593) 0:00:13.716 ********** 2026-04-03 05:35:10.253788 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253797 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253804 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:10.253817 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:10.253824 | orchestrator | 2026-04-03 05:35:10.253836 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 05:35:10.253843 | orchestrator | Friday 03 April 2026 05:35:10 +0000 (0:00:00.170) 0:00:13.887 ********** 2026-04-03 05:35:10.253859 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 05:35:07.411027', 'end': '2026-04-03 05:35:07.453170', 'delta': '0:00:00.042143', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 05:35:19.835259 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 05:35:07.948326', 'end': '2026-04-03 05:35:07.988085', 'delta': '0:00:00.039759', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 05:35:19.835367 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 05:35:08.494276', 'end': '2026-04-03 05:35:08.526731', 'delta': '0:00:00.032455', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 05:35:19.835383 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.835396 | orchestrator | 2026-04-03 05:35:19.835407 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 05:35:19.835419 | orchestrator | Friday 03 April 2026 05:35:10 +0000 (0:00:00.167) 0:00:14.055 ********** 2026-04-03 05:35:19.835429 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:19.835439 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:19.835449 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:19.835459 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:19.835468 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:19.835478 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:19.835488 | orchestrator | 2026-04-03 05:35:19.835498 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 05:35:19.835508 | orchestrator | Friday 03 April 2026 05:35:10 +0000 (0:00:00.664) 0:00:14.719 ********** 2026-04-03 05:35:19.835518 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:35:19.835528 | orchestrator | 2026-04-03 05:35:19.835538 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 05:35:19.835548 | orchestrator | Friday 03 April 2026 05:35:11 +0000 (0:00:00.916) 0:00:15.636 ********** 2026-04-03 05:35:19.835585 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.835603 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.835623 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.835648 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.835665 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.835681 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.835697 | orchestrator | 2026-04-03 05:35:19.835716 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 05:35:19.835733 | orchestrator | Friday 03 April 2026 05:35:12 +0000 (0:00:00.613) 0:00:16.249 ********** 2026-04-03 05:35:19.835748 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.835758 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.835767 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.835777 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.835786 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.835796 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.835808 | orchestrator | 2026-04-03 05:35:19.835824 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 05:35:19.835840 | orchestrator | Friday 03 April 2026 05:35:13 +0000 (0:00:01.145) 0:00:17.395 ********** 2026-04-03 05:35:19.835856 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.835872 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.835918 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.835930 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.835941 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.835967 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.835977 | orchestrator | 2026-04-03 05:35:19.835987 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 05:35:19.835997 | orchestrator | Friday 03 April 2026 05:35:14 +0000 (0:00:00.630) 0:00:18.026 ********** 2026-04-03 05:35:19.836006 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836016 | orchestrator | 2026-04-03 05:35:19.836026 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 05:35:19.836035 | orchestrator | Friday 03 April 2026 05:35:14 +0000 (0:00:00.125) 0:00:18.152 ********** 2026-04-03 05:35:19.836045 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836054 | orchestrator | 2026-04-03 05:35:19.836064 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 05:35:19.836073 | orchestrator | Friday 03 April 2026 05:35:14 +0000 (0:00:00.225) 0:00:18.377 ********** 2026-04-03 05:35:19.836083 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836093 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836102 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836112 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836121 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836133 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836151 | orchestrator | 2026-04-03 05:35:19.836192 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 05:35:19.836211 | orchestrator | Friday 03 April 2026 05:35:15 +0000 (0:00:00.781) 0:00:19.159 ********** 2026-04-03 05:35:19.836227 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836245 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836263 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836282 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836300 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836320 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836331 | orchestrator | 2026-04-03 05:35:19.836342 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 05:35:19.836353 | orchestrator | Friday 03 April 2026 05:35:15 +0000 (0:00:00.625) 0:00:19.785 ********** 2026-04-03 05:35:19.836364 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836375 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836385 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836409 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836419 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836430 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836441 | orchestrator | 2026-04-03 05:35:19.836452 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 05:35:19.836463 | orchestrator | Friday 03 April 2026 05:35:16 +0000 (0:00:00.850) 0:00:20.635 ********** 2026-04-03 05:35:19.836473 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836484 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836495 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836505 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836516 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836527 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836543 | orchestrator | 2026-04-03 05:35:19.836561 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 05:35:19.836579 | orchestrator | Friday 03 April 2026 05:35:17 +0000 (0:00:00.625) 0:00:21.260 ********** 2026-04-03 05:35:19.836596 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836613 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836630 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836647 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836667 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836684 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836703 | orchestrator | 2026-04-03 05:35:19.836715 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 05:35:19.836726 | orchestrator | Friday 03 April 2026 05:35:18 +0000 (0:00:00.820) 0:00:22.081 ********** 2026-04-03 05:35:19.836737 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836747 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836758 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836769 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836779 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836790 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836801 | orchestrator | 2026-04-03 05:35:19.836811 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 05:35:19.836823 | orchestrator | Friday 03 April 2026 05:35:18 +0000 (0:00:00.618) 0:00:22.700 ********** 2026-04-03 05:35:19.836834 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:19.836845 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:19.836855 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:19.836866 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:19.836877 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:19.836916 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:19.836927 | orchestrator | 2026-04-03 05:35:19.836938 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 05:35:19.836949 | orchestrator | Friday 03 April 2026 05:35:19 +0000 (0:00:00.826) 0:00:23.526 ********** 2026-04-03 05:35:19.836962 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.836985 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.837017 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948520 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948606 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948618 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948627 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948635 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948643 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948652 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948696 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:19.948725 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:19.948736 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:19.948746 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:19.948765 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:19.948781 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217420 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-25-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.217535 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217555 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217569 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217581 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217592 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217641 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217654 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217666 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.217704 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.217721 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:20.217764 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.217792 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.217813 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.367510 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-22-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.367582 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367590 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367597 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367619 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367639 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367645 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367650 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367666 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367672 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367677 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.367687 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.367698 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:20.367705 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.367715 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.562370 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.562474 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-27-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.562515 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562530 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562557 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562569 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562580 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562621 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562653 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.562675 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-21-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.562688 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:20.562701 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.562731 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.854714 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.854842 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.854858 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.854870 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.854960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855005 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.855031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-28-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:20.855045 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:20.855058 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:20.855070 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855081 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855098 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855121 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855132 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855144 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:20.855162 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:35:21.293478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:21.293560 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-23-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:35:21.293572 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:21.293580 | orchestrator | 2026-04-03 05:35:21.293588 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 05:35:21.293595 | orchestrator | Friday 03 April 2026 05:35:20 +0000 (0:00:01.127) 0:00:24.654 ********** 2026-04-03 05:35:21.293605 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293642 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293650 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293658 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293669 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293676 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293683 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293699 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.293711 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314014 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314200 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314225 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314246 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314321 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314353 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314374 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314395 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314424 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.314455 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573048 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573185 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573217 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-25-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573273 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573296 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573315 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573385 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573431 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.573469 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.698768 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:21.698879 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.698950 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-22-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.698978 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.698986 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.698993 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699019 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699033 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699040 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699056 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699062 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699069 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699075 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.699082 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:21.699104 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800099 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800195 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800212 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800226 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-27-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800287 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800302 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800313 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800405 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800430 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800442 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800461 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.800483 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.949813 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.949981 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-21-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950071 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:21.950085 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950112 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950122 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950131 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950139 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950155 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950170 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950178 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:21.950195 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.172711 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-28-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.172837 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:22.172856 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:22.172870 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.172977 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173001 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173020 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173040 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173122 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173139 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173151 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173166 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:22.173203 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-23-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:35:34.091577 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.091682 | orchestrator | 2026-04-03 05:35:34.091696 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 05:35:34.091708 | orchestrator | Friday 03 April 2026 05:35:22 +0000 (0:00:01.318) 0:00:25.973 ********** 2026-04-03 05:35:34.091718 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:34.091729 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:34.091739 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:34.091749 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:34.091759 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:34.091768 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:34.091778 | orchestrator | 2026-04-03 05:35:34.091788 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 05:35:34.091798 | orchestrator | Friday 03 April 2026 05:35:23 +0000 (0:00:00.922) 0:00:26.896 ********** 2026-04-03 05:35:34.091808 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:34.091818 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:34.091828 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:34.091837 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:34.091847 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:34.091857 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:34.091866 | orchestrator | 2026-04-03 05:35:34.091959 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 05:35:34.091974 | orchestrator | Friday 03 April 2026 05:35:23 +0000 (0:00:00.852) 0:00:27.748 ********** 2026-04-03 05:35:34.091984 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.091994 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.092004 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.092013 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092023 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092032 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092042 | orchestrator | 2026-04-03 05:35:34.092052 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 05:35:34.092063 | orchestrator | Friday 03 April 2026 05:35:24 +0000 (0:00:00.630) 0:00:28.378 ********** 2026-04-03 05:35:34.092072 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.092082 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.092092 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.092101 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092111 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092122 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092134 | orchestrator | 2026-04-03 05:35:34.092146 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 05:35:34.092158 | orchestrator | Friday 03 April 2026 05:35:25 +0000 (0:00:00.827) 0:00:29.205 ********** 2026-04-03 05:35:34.092170 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.092181 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.092192 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.092229 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092241 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092252 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092263 | orchestrator | 2026-04-03 05:35:34.092275 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 05:35:34.092286 | orchestrator | Friday 03 April 2026 05:35:25 +0000 (0:00:00.608) 0:00:29.813 ********** 2026-04-03 05:35:34.092297 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.092308 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.092320 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.092331 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092342 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092354 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092364 | orchestrator | 2026-04-03 05:35:34.092376 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 05:35:34.092388 | orchestrator | Friday 03 April 2026 05:35:26 +0000 (0:00:00.885) 0:00:30.699 ********** 2026-04-03 05:35:34.092400 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 05:35:34.092411 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 05:35:34.092422 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 05:35:34.092434 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 05:35:34.092445 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 05:35:34.092456 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 05:35:34.092468 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 05:35:34.092479 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 05:35:34.092490 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 05:35:34.092500 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-03 05:35:34.092509 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 05:35:34.092519 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 05:35:34.092528 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-03 05:35:34.092538 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 05:35:34.092548 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-03 05:35:34.092557 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 05:35:34.092567 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-03 05:35:34.092590 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 05:35:34.092599 | orchestrator | 2026-04-03 05:35:34.092609 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 05:35:34.092619 | orchestrator | Friday 03 April 2026 05:35:29 +0000 (0:00:02.151) 0:00:32.851 ********** 2026-04-03 05:35:34.092629 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 05:35:34.092639 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 05:35:34.092649 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 05:35:34.092659 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.092668 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 05:35:34.092678 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 05:35:34.092688 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 05:35:34.092714 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.092724 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 05:35:34.092734 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 05:35:34.092744 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 05:35:34.092753 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.092763 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 05:35:34.092773 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 05:35:34.092790 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 05:35:34.092800 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092809 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 05:35:34.092819 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 05:35:34.092828 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 05:35:34.092838 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092848 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 05:35:34.092857 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 05:35:34.092867 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 05:35:34.092897 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092908 | orchestrator | 2026-04-03 05:35:34.092918 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 05:35:34.092928 | orchestrator | Friday 03 April 2026 05:35:29 +0000 (0:00:00.683) 0:00:33.535 ********** 2026-04-03 05:35:34.092937 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:34.092947 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:34.092957 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:34.092968 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:35:34.092977 | orchestrator | 2026-04-03 05:35:34.092988 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 05:35:34.092999 | orchestrator | Friday 03 April 2026 05:35:30 +0000 (0:00:01.055) 0:00:34.590 ********** 2026-04-03 05:35:34.093009 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093018 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.093028 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.093038 | orchestrator | 2026-04-03 05:35:34.093048 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 05:35:34.093057 | orchestrator | Friday 03 April 2026 05:35:31 +0000 (0:00:00.362) 0:00:34.953 ********** 2026-04-03 05:35:34.093067 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093077 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.093087 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.093096 | orchestrator | 2026-04-03 05:35:34.093106 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 05:35:34.093115 | orchestrator | Friday 03 April 2026 05:35:31 +0000 (0:00:00.342) 0:00:35.295 ********** 2026-04-03 05:35:34.093125 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093135 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:34.093144 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:34.093154 | orchestrator | 2026-04-03 05:35:34.093164 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 05:35:34.093173 | orchestrator | Friday 03 April 2026 05:35:32 +0000 (0:00:00.523) 0:00:35.819 ********** 2026-04-03 05:35:34.093183 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:34.093193 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:34.093202 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:34.093212 | orchestrator | 2026-04-03 05:35:34.093222 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 05:35:34.093232 | orchestrator | Friday 03 April 2026 05:35:32 +0000 (0:00:00.500) 0:00:36.319 ********** 2026-04-03 05:35:34.093241 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:35:34.093251 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:35:34.093261 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:35:34.093270 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093280 | orchestrator | 2026-04-03 05:35:34.093290 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 05:35:34.093306 | orchestrator | Friday 03 April 2026 05:35:32 +0000 (0:00:00.404) 0:00:36.724 ********** 2026-04-03 05:35:34.093316 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:35:34.093326 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:35:34.093335 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:35:34.093345 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093355 | orchestrator | 2026-04-03 05:35:34.093364 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 05:35:34.093374 | orchestrator | Friday 03 April 2026 05:35:33 +0000 (0:00:00.398) 0:00:37.123 ********** 2026-04-03 05:35:34.093388 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:35:34.093399 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:35:34.093408 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:35:34.093418 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:34.093427 | orchestrator | 2026-04-03 05:35:34.093437 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 05:35:34.093447 | orchestrator | Friday 03 April 2026 05:35:33 +0000 (0:00:00.418) 0:00:37.542 ********** 2026-04-03 05:35:34.093457 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:34.093467 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:34.093476 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:34.093486 | orchestrator | 2026-04-03 05:35:34.093496 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 05:35:34.093512 | orchestrator | Friday 03 April 2026 05:35:34 +0000 (0:00:00.345) 0:00:37.887 ********** 2026-04-03 05:35:53.610996 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 05:35:53.611108 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 05:35:53.611124 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 05:35:53.611137 | orchestrator | 2026-04-03 05:35:53.611150 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 05:35:53.611162 | orchestrator | Friday 03 April 2026 05:35:34 +0000 (0:00:00.876) 0:00:38.764 ********** 2026-04-03 05:35:53.611174 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:35:53.611186 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:35:53.611197 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:35:53.611208 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 05:35:53.611219 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 05:35:53.611230 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 05:35:53.611241 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 05:35:53.611251 | orchestrator | 2026-04-03 05:35:53.611263 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 05:35:53.611274 | orchestrator | Friday 03 April 2026 05:35:35 +0000 (0:00:00.849) 0:00:39.613 ********** 2026-04-03 05:35:53.611285 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:35:53.611295 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:35:53.611306 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:35:53.611317 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 05:35:53.611328 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 05:35:53.611339 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 05:35:53.611349 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 05:35:53.611360 | orchestrator | 2026-04-03 05:35:53.611371 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:35:53.611406 | orchestrator | Friday 03 April 2026 05:35:37 +0000 (0:00:01.934) 0:00:41.548 ********** 2026-04-03 05:35:53.611418 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:35:53.611430 | orchestrator | 2026-04-03 05:35:53.611441 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:35:53.611452 | orchestrator | Friday 03 April 2026 05:35:38 +0000 (0:00:01.261) 0:00:42.810 ********** 2026-04-03 05:35:53.611463 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:35:53.611476 | orchestrator | 2026-04-03 05:35:53.611488 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:35:53.611500 | orchestrator | Friday 03 April 2026 05:35:40 +0000 (0:00:01.258) 0:00:44.068 ********** 2026-04-03 05:35:53.611514 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.611527 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.611540 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.611553 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:53.611566 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:53.611578 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:53.611590 | orchestrator | 2026-04-03 05:35:53.611602 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:35:53.611615 | orchestrator | Friday 03 April 2026 05:35:41 +0000 (0:00:01.241) 0:00:45.310 ********** 2026-04-03 05:35:53.611627 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.611639 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.611651 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.611664 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.611677 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.611689 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.611702 | orchestrator | 2026-04-03 05:35:53.611714 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:35:53.611727 | orchestrator | Friday 03 April 2026 05:35:42 +0000 (0:00:00.698) 0:00:46.008 ********** 2026-04-03 05:35:53.611739 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.611751 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.611763 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.611775 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.611787 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.611800 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.611812 | orchestrator | 2026-04-03 05:35:53.611838 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:35:53.611850 | orchestrator | Friday 03 April 2026 05:35:43 +0000 (0:00:00.977) 0:00:46.985 ********** 2026-04-03 05:35:53.611861 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.611892 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.611904 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.611915 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.611925 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.611936 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.611947 | orchestrator | 2026-04-03 05:35:53.611958 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:35:53.611969 | orchestrator | Friday 03 April 2026 05:35:43 +0000 (0:00:00.676) 0:00:47.661 ********** 2026-04-03 05:35:53.611980 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.611991 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.612019 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.612031 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:53.612042 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:53.612053 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:53.612064 | orchestrator | 2026-04-03 05:35:53.612075 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:35:53.612095 | orchestrator | Friday 03 April 2026 05:35:45 +0000 (0:00:01.242) 0:00:48.904 ********** 2026-04-03 05:35:53.612106 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.612117 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.612128 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.612139 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612150 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612161 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612172 | orchestrator | 2026-04-03 05:35:53.612183 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:35:53.612194 | orchestrator | Friday 03 April 2026 05:35:45 +0000 (0:00:00.603) 0:00:49.507 ********** 2026-04-03 05:35:53.612205 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.612216 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.612227 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.612238 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612249 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612260 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612271 | orchestrator | 2026-04-03 05:35:53.612282 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:35:53.612293 | orchestrator | Friday 03 April 2026 05:35:46 +0000 (0:00:00.845) 0:00:50.352 ********** 2026-04-03 05:35:53.612304 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.612315 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.612326 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.612337 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:53.612348 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:53.612358 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:53.612369 | orchestrator | 2026-04-03 05:35:53.612380 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:35:53.612392 | orchestrator | Friday 03 April 2026 05:35:47 +0000 (0:00:00.977) 0:00:51.330 ********** 2026-04-03 05:35:53.612403 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.612413 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.612424 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.612435 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:53.612446 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:53.612457 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:53.612468 | orchestrator | 2026-04-03 05:35:53.612479 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:35:53.612490 | orchestrator | Friday 03 April 2026 05:35:48 +0000 (0:00:01.296) 0:00:52.627 ********** 2026-04-03 05:35:53.612501 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.612512 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.612523 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.612534 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612545 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612556 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612567 | orchestrator | 2026-04-03 05:35:53.612578 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:35:53.612589 | orchestrator | Friday 03 April 2026 05:35:49 +0000 (0:00:00.603) 0:00:53.230 ********** 2026-04-03 05:35:53.612600 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.612611 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.612622 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.612633 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:35:53.612644 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:35:53.612655 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:35:53.612666 | orchestrator | 2026-04-03 05:35:53.612677 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:35:53.612688 | orchestrator | Friday 03 April 2026 05:35:50 +0000 (0:00:00.892) 0:00:54.123 ********** 2026-04-03 05:35:53.612699 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.612710 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.612727 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.612738 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612749 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612760 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612771 | orchestrator | 2026-04-03 05:35:53.612782 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:35:53.612794 | orchestrator | Friday 03 April 2026 05:35:50 +0000 (0:00:00.608) 0:00:54.732 ********** 2026-04-03 05:35:53.612805 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.612816 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.612826 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.612837 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612848 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612859 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612870 | orchestrator | 2026-04-03 05:35:53.612900 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:35:53.612911 | orchestrator | Friday 03 April 2026 05:35:51 +0000 (0:00:00.890) 0:00:55.623 ********** 2026-04-03 05:35:53.612922 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:35:53.612933 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:35:53.612944 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:35:53.612954 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.612965 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.612981 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.612992 | orchestrator | 2026-04-03 05:35:53.613003 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:35:53.613014 | orchestrator | Friday 03 April 2026 05:35:52 +0000 (0:00:00.597) 0:00:56.221 ********** 2026-04-03 05:35:53.613025 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.613036 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:35:53.613047 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:35:53.613058 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:35:53.613068 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:35:53.613079 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:35:53.613090 | orchestrator | 2026-04-03 05:35:53.613101 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:35:53.613112 | orchestrator | Friday 03 April 2026 05:35:53 +0000 (0:00:00.924) 0:00:57.145 ********** 2026-04-03 05:35:53.613123 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:35:53.613140 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.094832 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.094984 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.094999 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.095009 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.095020 | orchestrator | 2026-04-03 05:37:11.095031 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:37:11.095044 | orchestrator | Friday 03 April 2026 05:35:54 +0000 (0:00:00.815) 0:00:57.961 ********** 2026-04-03 05:37:11.095054 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.095064 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.095074 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.095084 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:11.095094 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:11.095105 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:11.095115 | orchestrator | 2026-04-03 05:37:11.095126 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:37:11.095136 | orchestrator | Friday 03 April 2026 05:35:54 +0000 (0:00:00.656) 0:00:58.618 ********** 2026-04-03 05:37:11.095146 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:11.095157 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:11.095167 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:11.095177 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:11.095187 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:11.095197 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:11.095228 | orchestrator | 2026-04-03 05:37:11.095238 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:37:11.095249 | orchestrator | Friday 03 April 2026 05:35:55 +0000 (0:00:00.854) 0:00:59.472 ********** 2026-04-03 05:37:11.095259 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:11.095269 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:11.095279 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:11.095289 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:11.095299 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:11.095309 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:11.095320 | orchestrator | 2026-04-03 05:37:11.095330 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 05:37:11.095341 | orchestrator | Friday 03 April 2026 05:35:56 +0000 (0:00:01.266) 0:01:00.739 ********** 2026-04-03 05:37:11.095351 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:37:11.095361 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:37:11.095372 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:37:11.095383 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:37:11.095395 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:37:11.095406 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:37:11.095418 | orchestrator | 2026-04-03 05:37:11.095430 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 05:37:11.095442 | orchestrator | Friday 03 April 2026 05:35:58 +0000 (0:00:01.476) 0:01:02.215 ********** 2026-04-03 05:37:11.095454 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:37:11.095465 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:37:11.095477 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:37:11.095489 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:37:11.095500 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:37:11.095512 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:37:11.095525 | orchestrator | 2026-04-03 05:37:11.095536 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 05:37:11.095548 | orchestrator | Friday 03 April 2026 05:36:00 +0000 (0:00:02.215) 0:01:04.431 ********** 2026-04-03 05:37:11.095561 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:37:11.095574 | orchestrator | 2026-04-03 05:37:11.095586 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 05:37:11.095597 | orchestrator | Friday 03 April 2026 05:36:01 +0000 (0:00:01.235) 0:01:05.666 ********** 2026-04-03 05:37:11.095609 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.095621 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.095633 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.095644 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.095656 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.095667 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.095679 | orchestrator | 2026-04-03 05:37:11.095691 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 05:37:11.095703 | orchestrator | Friday 03 April 2026 05:36:02 +0000 (0:00:00.599) 0:01:06.265 ********** 2026-04-03 05:37:11.095715 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.095727 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.095739 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.095751 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.095761 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.095771 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.095781 | orchestrator | 2026-04-03 05:37:11.095792 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 05:37:11.095802 | orchestrator | Friday 03 April 2026 05:36:03 +0000 (0:00:00.803) 0:01:07.069 ********** 2026-04-03 05:37:11.095812 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095835 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095872 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095884 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095894 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095904 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095914 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095924 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 05:37:11.095934 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095958 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095969 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095979 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 05:37:11.095989 | orchestrator | 2026-04-03 05:37:11.095999 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 05:37:11.096008 | orchestrator | Friday 03 April 2026 05:36:04 +0000 (0:00:01.301) 0:01:08.370 ********** 2026-04-03 05:37:11.096018 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:37:11.096028 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:37:11.096037 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:37:11.096047 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:37:11.096057 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:37:11.096066 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:37:11.096076 | orchestrator | 2026-04-03 05:37:11.096086 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 05:37:11.096095 | orchestrator | Friday 03 April 2026 05:36:05 +0000 (0:00:01.232) 0:01:09.603 ********** 2026-04-03 05:37:11.096105 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.096115 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.096124 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.096134 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.096143 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.096153 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.096162 | orchestrator | 2026-04-03 05:37:11.096172 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 05:37:11.096182 | orchestrator | Friday 03 April 2026 05:36:06 +0000 (0:00:00.639) 0:01:10.242 ********** 2026-04-03 05:37:11.096191 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.096201 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.096211 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.096220 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.096230 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.096239 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.096249 | orchestrator | 2026-04-03 05:37:11.096258 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 05:37:11.096268 | orchestrator | Friday 03 April 2026 05:36:07 +0000 (0:00:00.818) 0:01:11.061 ********** 2026-04-03 05:37:11.096278 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.096288 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.096297 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.096307 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.096317 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:11.096326 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:11.096336 | orchestrator | 2026-04-03 05:37:11.096346 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 05:37:11.096356 | orchestrator | Friday 03 April 2026 05:36:07 +0000 (0:00:00.622) 0:01:11.683 ********** 2026-04-03 05:37:11.096372 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:37:11.096382 | orchestrator | 2026-04-03 05:37:11.096392 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 05:37:11.096401 | orchestrator | Friday 03 April 2026 05:36:09 +0000 (0:00:01.268) 0:01:12.952 ********** 2026-04-03 05:37:11.096411 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:11.096421 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:11.096430 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:11.096440 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:11.096450 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:11.096459 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:11.096469 | orchestrator | 2026-04-03 05:37:11.096479 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 05:37:11.096488 | orchestrator | Friday 03 April 2026 05:37:10 +0000 (0:01:01.239) 0:02:14.191 ********** 2026-04-03 05:37:11.096498 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:11.096508 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:11.096518 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:11.096527 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:11.096537 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:11.096547 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:11.096556 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:11.096566 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:11.096575 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:11.096585 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:11.096599 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:11.096610 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:11.096619 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:11.096629 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:11.096639 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:11.096648 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:11.096658 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:11.096667 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:11.096677 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:11.096692 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.542397 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 05:37:34.542508 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 05:37:34.542524 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 05:37:34.542538 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.542550 | orchestrator | 2026-04-03 05:37:34.542562 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 05:37:34.542573 | orchestrator | Friday 03 April 2026 05:37:11 +0000 (0:00:00.708) 0:02:14.900 ********** 2026-04-03 05:37:34.542584 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.542595 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.542607 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.542618 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.542629 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.542664 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.542675 | orchestrator | 2026-04-03 05:37:34.542687 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 05:37:34.542698 | orchestrator | Friday 03 April 2026 05:37:11 +0000 (0:00:00.898) 0:02:15.798 ********** 2026-04-03 05:37:34.542709 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.542720 | orchestrator | 2026-04-03 05:37:34.542731 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 05:37:34.542742 | orchestrator | Friday 03 April 2026 05:37:12 +0000 (0:00:00.181) 0:02:15.980 ********** 2026-04-03 05:37:34.542753 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.542764 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.542775 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.542785 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.542796 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.542808 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.542826 | orchestrator | 2026-04-03 05:37:34.542844 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 05:37:34.542895 | orchestrator | Friday 03 April 2026 05:37:12 +0000 (0:00:00.625) 0:02:16.606 ********** 2026-04-03 05:37:34.542913 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.542931 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.542948 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.542964 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.542979 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.542996 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543015 | orchestrator | 2026-04-03 05:37:34.543034 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 05:37:34.543053 | orchestrator | Friday 03 April 2026 05:37:13 +0000 (0:00:00.878) 0:02:17.485 ********** 2026-04-03 05:37:34.543073 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.543094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.543114 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.543132 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.543144 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.543155 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543166 | orchestrator | 2026-04-03 05:37:34.543177 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 05:37:34.543188 | orchestrator | Friday 03 April 2026 05:37:14 +0000 (0:00:00.608) 0:02:18.094 ********** 2026-04-03 05:37:34.543199 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:34.543211 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:34.543224 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:34.543244 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:34.543262 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:34.543280 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:34.543298 | orchestrator | 2026-04-03 05:37:34.543317 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 05:37:34.543337 | orchestrator | Friday 03 April 2026 05:37:17 +0000 (0:00:03.262) 0:02:21.356 ********** 2026-04-03 05:37:34.543357 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:34.543376 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:34.543394 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:34.543408 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:34.543419 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:34.543430 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:34.543441 | orchestrator | 2026-04-03 05:37:34.543452 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 05:37:34.543463 | orchestrator | Friday 03 April 2026 05:37:18 +0000 (0:00:00.623) 0:02:21.979 ********** 2026-04-03 05:37:34.543476 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:37:34.543488 | orchestrator | 2026-04-03 05:37:34.543500 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 05:37:34.543523 | orchestrator | Friday 03 April 2026 05:37:19 +0000 (0:00:01.376) 0:02:23.356 ********** 2026-04-03 05:37:34.543534 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.543545 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.543556 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.543567 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.543591 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.543603 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543614 | orchestrator | 2026-04-03 05:37:34.543625 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 05:37:34.543636 | orchestrator | Friday 03 April 2026 05:37:20 +0000 (0:00:00.867) 0:02:24.224 ********** 2026-04-03 05:37:34.543647 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.543658 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.543669 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.543679 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.543690 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.543701 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543712 | orchestrator | 2026-04-03 05:37:34.543723 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 05:37:34.543734 | orchestrator | Friday 03 April 2026 05:37:21 +0000 (0:00:00.649) 0:02:24.874 ********** 2026-04-03 05:37:34.543745 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.543776 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.543788 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.543799 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.543809 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.543820 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543831 | orchestrator | 2026-04-03 05:37:34.543842 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 05:37:34.543916 | orchestrator | Friday 03 April 2026 05:37:21 +0000 (0:00:00.919) 0:02:25.794 ********** 2026-04-03 05:37:34.543928 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.543940 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.543951 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.543961 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.543972 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.543983 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.543994 | orchestrator | 2026-04-03 05:37:34.544005 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 05:37:34.544016 | orchestrator | Friday 03 April 2026 05:37:22 +0000 (0:00:00.640) 0:02:26.434 ********** 2026-04-03 05:37:34.544027 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.544038 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.544048 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.544059 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.544070 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.544081 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.544092 | orchestrator | 2026-04-03 05:37:34.544103 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 05:37:34.544114 | orchestrator | Friday 03 April 2026 05:37:23 +0000 (0:00:00.896) 0:02:27.331 ********** 2026-04-03 05:37:34.544125 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.544136 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.544147 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.544157 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.544168 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.544179 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.544190 | orchestrator | 2026-04-03 05:37:34.544201 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 05:37:34.544212 | orchestrator | Friday 03 April 2026 05:37:24 +0000 (0:00:00.648) 0:02:27.979 ********** 2026-04-03 05:37:34.544232 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.544243 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.544254 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.544265 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.544276 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.544290 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.544309 | orchestrator | 2026-04-03 05:37:34.544328 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 05:37:34.544347 | orchestrator | Friday 03 April 2026 05:37:25 +0000 (0:00:00.873) 0:02:28.853 ********** 2026-04-03 05:37:34.544366 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:34.544384 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:34.544402 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:34.544419 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:34.544437 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:34.544456 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:34.544475 | orchestrator | 2026-04-03 05:37:34.544492 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 05:37:34.544512 | orchestrator | Friday 03 April 2026 05:37:25 +0000 (0:00:00.830) 0:02:29.684 ********** 2026-04-03 05:37:34.544532 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:34.544551 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:34.544569 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:34.544587 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:37:34.544606 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:37:34.544626 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:37:34.544644 | orchestrator | 2026-04-03 05:37:34.544664 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 05:37:34.544683 | orchestrator | Friday 03 April 2026 05:37:27 +0000 (0:00:01.287) 0:02:30.972 ********** 2026-04-03 05:37:34.544704 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:37:34.544720 | orchestrator | 2026-04-03 05:37:34.544731 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 05:37:34.544742 | orchestrator | Friday 03 April 2026 05:37:28 +0000 (0:00:01.276) 0:02:32.248 ********** 2026-04-03 05:37:34.544753 | orchestrator | changed: [testbed-node-3] => (item=/etc/ceph) 2026-04-03 05:37:34.544765 | orchestrator | changed: [testbed-node-4] => (item=/etc/ceph) 2026-04-03 05:37:34.544776 | orchestrator | changed: [testbed-node-5] => (item=/etc/ceph) 2026-04-03 05:37:34.544786 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544797 | orchestrator | changed: [testbed-node-0] => (item=/etc/ceph) 2026-04-03 05:37:34.544808 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544819 | orchestrator | changed: [testbed-node-1] => (item=/etc/ceph) 2026-04-03 05:37:34.544838 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544896 | orchestrator | changed: [testbed-node-2] => (item=/etc/ceph) 2026-04-03 05:37:34.544909 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:34.544920 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544931 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:34.544942 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544953 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:34.544964 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-03 05:37:34.544975 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:34.544987 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:34.545010 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:39.700273 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:39.700402 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:39.700418 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-03 05:37:39.700430 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700442 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700455 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:39.700467 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:39.700479 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700491 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700503 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-03 05:37:39.700515 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700527 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700539 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700551 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700562 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700576 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-03 05:37:39.700587 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700599 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700611 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700623 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700636 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700648 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-03 05:37:39.700659 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700671 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700683 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700695 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700707 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700719 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-03 05:37:39.700732 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700744 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700756 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700767 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700780 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-03 05:37:39.700792 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700804 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700818 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700831 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700873 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700888 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 05:37:39.700902 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.700916 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.700929 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.700943 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700964 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700978 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 05:37:39.700992 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701006 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701019 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701033 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.701061 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.701075 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 05:37:39.701089 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701102 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701116 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701129 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701143 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701157 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 05:37:39.701171 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701201 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701213 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701226 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701238 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701250 | orchestrator | changed: [testbed-node-4] => (item=/var/run/ceph) 2026-04-03 05:37:39.701262 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 05:37:39.701274 | orchestrator | changed: [testbed-node-3] => (item=/var/run/ceph) 2026-04-03 05:37:39.701286 | orchestrator | changed: [testbed-node-5] => (item=/var/run/ceph) 2026-04-03 05:37:39.701297 | orchestrator | changed: [testbed-node-4] => (item=/var/log/ceph) 2026-04-03 05:37:39.701310 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701322 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701334 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 05:37:39.701346 | orchestrator | changed: [testbed-node-3] => (item=/var/log/ceph) 2026-04-03 05:37:39.701358 | orchestrator | changed: [testbed-node-5] => (item=/var/log/ceph) 2026-04-03 05:37:39.701370 | orchestrator | changed: [testbed-node-2] => (item=/var/run/ceph) 2026-04-03 05:37:39.701382 | orchestrator | changed: [testbed-node-1] => (item=/var/run/ceph) 2026-04-03 05:37:39.701394 | orchestrator | changed: [testbed-node-0] => (item=/var/run/ceph) 2026-04-03 05:37:39.701406 | orchestrator | changed: [testbed-node-2] => (item=/var/log/ceph) 2026-04-03 05:37:39.701418 | orchestrator | changed: [testbed-node-1] => (item=/var/log/ceph) 2026-04-03 05:37:39.701430 | orchestrator | changed: [testbed-node-0] => (item=/var/log/ceph) 2026-04-03 05:37:39.701442 | orchestrator | 2026-04-03 05:37:39.701455 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 05:37:39.701467 | orchestrator | Friday 03 April 2026 05:37:34 +0000 (0:00:06.085) 0:02:38.334 ********** 2026-04-03 05:37:39.701479 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:39.701492 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:39.701504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:39.701517 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:37:39.701537 | orchestrator | 2026-04-03 05:37:39.701549 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 05:37:39.701561 | orchestrator | Friday 03 April 2026 05:37:35 +0000 (0:00:01.044) 0:02:39.379 ********** 2026-04-03 05:37:39.701574 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701586 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701598 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701610 | orchestrator | 2026-04-03 05:37:39.701622 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 05:37:39.701635 | orchestrator | Friday 03 April 2026 05:37:36 +0000 (0:00:00.690) 0:02:40.069 ********** 2026-04-03 05:37:39.701647 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701659 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701671 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:39.701683 | orchestrator | 2026-04-03 05:37:39.701695 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 05:37:39.701708 | orchestrator | Friday 03 April 2026 05:37:37 +0000 (0:00:01.142) 0:02:41.212 ********** 2026-04-03 05:37:39.701720 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:39.701732 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:39.701744 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:39.701756 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:39.701768 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:39.701780 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:39.701792 | orchestrator | 2026-04-03 05:37:39.701804 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 05:37:39.701821 | orchestrator | Friday 03 April 2026 05:37:38 +0000 (0:00:00.834) 0:02:42.046 ********** 2026-04-03 05:37:39.701832 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:39.701844 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:39.701888 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:39.701899 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:39.701910 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:39.701921 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:39.701932 | orchestrator | 2026-04-03 05:37:39.701943 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 05:37:39.701954 | orchestrator | Friday 03 April 2026 05:37:38 +0000 (0:00:00.607) 0:02:42.653 ********** 2026-04-03 05:37:39.701965 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:39.701976 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:39.701987 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:39.701998 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:39.702009 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:39.702085 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:39.702098 | orchestrator | 2026-04-03 05:37:39.702117 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 05:37:52.911339 | orchestrator | Friday 03 April 2026 05:37:39 +0000 (0:00:00.849) 0:02:43.502 ********** 2026-04-03 05:37:52.911454 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.911471 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.911483 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.911494 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.911505 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.911516 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.911551 | orchestrator | 2026-04-03 05:37:52.911564 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 05:37:52.911576 | orchestrator | Friday 03 April 2026 05:37:40 +0000 (0:00:00.612) 0:02:44.114 ********** 2026-04-03 05:37:52.911587 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.911598 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.911609 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.911620 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.911631 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.911641 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.911653 | orchestrator | 2026-04-03 05:37:52.911664 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 05:37:52.911676 | orchestrator | Friday 03 April 2026 05:37:41 +0000 (0:00:00.837) 0:02:44.951 ********** 2026-04-03 05:37:52.911687 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.911698 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.911709 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.911720 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.911731 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.911741 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.911752 | orchestrator | 2026-04-03 05:37:52.911764 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 05:37:52.911775 | orchestrator | Friday 03 April 2026 05:37:41 +0000 (0:00:00.604) 0:02:45.556 ********** 2026-04-03 05:37:52.911786 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.911797 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.911808 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.911819 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.911830 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.911841 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.911881 | orchestrator | 2026-04-03 05:37:52.911893 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 05:37:52.911904 | orchestrator | Friday 03 April 2026 05:37:42 +0000 (0:00:00.833) 0:02:46.390 ********** 2026-04-03 05:37:52.911915 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.911926 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.911937 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.911947 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.911958 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.911969 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.911981 | orchestrator | 2026-04-03 05:37:52.911992 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 05:37:52.912003 | orchestrator | Friday 03 April 2026 05:37:43 +0000 (0:00:00.607) 0:02:46.997 ********** 2026-04-03 05:37:52.912014 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912025 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912036 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912048 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:52.912059 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:52.912070 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:52.912081 | orchestrator | 2026-04-03 05:37:52.912092 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 05:37:52.912104 | orchestrator | Friday 03 April 2026 05:37:45 +0000 (0:00:02.798) 0:02:49.796 ********** 2026-04-03 05:37:52.912115 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:52.912126 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:52.912137 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:52.912148 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912159 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912169 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912180 | orchestrator | 2026-04-03 05:37:52.912191 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 05:37:52.912212 | orchestrator | Friday 03 April 2026 05:37:46 +0000 (0:00:00.614) 0:02:50.411 ********** 2026-04-03 05:37:52.912223 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:37:52.912234 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:37:52.912245 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:37:52.912256 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912267 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912278 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912289 | orchestrator | 2026-04-03 05:37:52.912301 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 05:37:52.912319 | orchestrator | Friday 03 April 2026 05:37:47 +0000 (0:00:00.961) 0:02:51.373 ********** 2026-04-03 05:37:52.912337 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.912356 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.912393 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.912411 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912429 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912447 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912465 | orchestrator | 2026-04-03 05:37:52.912484 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 05:37:52.912503 | orchestrator | Friday 03 April 2026 05:37:48 +0000 (0:00:00.845) 0:02:52.218 ********** 2026-04-03 05:37:52.912522 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:52.912542 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:52.912554 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 05:37:52.912565 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912595 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912606 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912617 | orchestrator | 2026-04-03 05:37:52.912628 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 05:37:52.912640 | orchestrator | Friday 03 April 2026 05:37:49 +0000 (0:00:00.679) 0:02:52.897 ********** 2026-04-03 05:37:52.912653 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}])  2026-04-03 05:37:52.912668 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}])  2026-04-03 05:37:52.912686 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.912711 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}])  2026-04-03 05:37:52.912736 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}])  2026-04-03 05:37:52.912754 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.912771 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}])  2026-04-03 05:37:52.912803 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}])  2026-04-03 05:37:52.912820 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.912838 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.912886 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.912905 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.912925 | orchestrator | 2026-04-03 05:37:52.912945 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 05:37:52.912964 | orchestrator | Friday 03 April 2026 05:37:49 +0000 (0:00:00.882) 0:02:53.780 ********** 2026-04-03 05:37:52.912982 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.912994 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.913005 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.913016 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.913027 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.913037 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.913048 | orchestrator | 2026-04-03 05:37:52.913059 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 05:37:52.913070 | orchestrator | Friday 03 April 2026 05:37:50 +0000 (0:00:00.637) 0:02:54.418 ********** 2026-04-03 05:37:52.913081 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.913092 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.913102 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.913113 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.913124 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.913134 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.913145 | orchestrator | 2026-04-03 05:37:52.913156 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 05:37:52.913167 | orchestrator | Friday 03 April 2026 05:37:51 +0000 (0:00:00.833) 0:02:55.251 ********** 2026-04-03 05:37:52.913191 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.913210 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.913222 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.913233 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.913244 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.913254 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.913265 | orchestrator | 2026-04-03 05:37:52.913276 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 05:37:52.913289 | orchestrator | Friday 03 April 2026 05:37:52 +0000 (0:00:00.646) 0:02:55.897 ********** 2026-04-03 05:37:52.913306 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:37:52.913331 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:37:52.913355 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:37:52.913371 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:37:52.913388 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:37:52.913405 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:37:52.913421 | orchestrator | 2026-04-03 05:37:52.913438 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 05:37:52.913468 | orchestrator | Friday 03 April 2026 05:37:52 +0000 (0:00:00.809) 0:02:56.707 ********** 2026-04-03 05:38:10.224895 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.225001 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:10.225015 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:10.225025 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.225035 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:10.225045 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:10.225078 | orchestrator | 2026-04-03 05:38:10.225089 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 05:38:10.225100 | orchestrator | Friday 03 April 2026 05:37:53 +0000 (0:00:00.689) 0:02:57.397 ********** 2026-04-03 05:38:10.225110 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:10.225121 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:10.225131 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:10.225141 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.225150 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:10.225160 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:10.225170 | orchestrator | 2026-04-03 05:38:10.225180 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 05:38:10.225190 | orchestrator | Friday 03 April 2026 05:37:54 +0000 (0:00:00.856) 0:02:58.253 ********** 2026-04-03 05:38:10.225200 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:10.225210 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:10.225220 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:10.225230 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.225240 | orchestrator | 2026-04-03 05:38:10.225250 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 05:38:10.225260 | orchestrator | Friday 03 April 2026 05:37:54 +0000 (0:00:00.428) 0:02:58.682 ********** 2026-04-03 05:38:10.225269 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:10.225279 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:10.225289 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:10.225298 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.225308 | orchestrator | 2026-04-03 05:38:10.225318 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 05:38:10.225327 | orchestrator | Friday 03 April 2026 05:37:55 +0000 (0:00:00.425) 0:02:59.108 ********** 2026-04-03 05:38:10.225337 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:10.225347 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:10.225356 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:10.225366 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.225376 | orchestrator | 2026-04-03 05:38:10.225385 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 05:38:10.225395 | orchestrator | Friday 03 April 2026 05:37:55 +0000 (0:00:00.407) 0:02:59.515 ********** 2026-04-03 05:38:10.225405 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:10.225415 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:10.225424 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:10.225434 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.225443 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:10.225453 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:10.225463 | orchestrator | 2026-04-03 05:38:10.225472 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 05:38:10.225482 | orchestrator | Friday 03 April 2026 05:37:56 +0000 (0:00:00.641) 0:03:00.157 ********** 2026-04-03 05:38:10.225492 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 05:38:10.225502 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 05:38:10.225511 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 05:38:10.225521 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-03 05:38:10.225531 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.225541 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-03 05:38:10.225550 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:10.225560 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-03 05:38:10.225570 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:10.225579 | orchestrator | 2026-04-03 05:38:10.225589 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 05:38:10.225605 | orchestrator | Friday 03 April 2026 05:37:58 +0000 (0:00:01.864) 0:03:02.022 ********** 2026-04-03 05:38:10.225615 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:38:10.225625 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:38:10.225635 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:38:10.225644 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:10.225654 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:10.225664 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:10.225673 | orchestrator | 2026-04-03 05:38:10.225683 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:38:10.225693 | orchestrator | Friday 03 April 2026 05:38:00 +0000 (0:00:02.704) 0:03:04.727 ********** 2026-04-03 05:38:10.225703 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:38:10.225726 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:38:10.225736 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:38:10.225745 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:10.225755 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:10.225765 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:10.225774 | orchestrator | 2026-04-03 05:38:10.225784 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-03 05:38:10.225794 | orchestrator | Friday 03 April 2026 05:38:01 +0000 (0:00:01.000) 0:03:05.728 ********** 2026-04-03 05:38:10.225804 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.225814 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:10.225823 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:10.225834 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:38:10.225871 | orchestrator | 2026-04-03 05:38:10.225882 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-03 05:38:10.225891 | orchestrator | Friday 03 April 2026 05:38:03 +0000 (0:00:01.101) 0:03:06.829 ********** 2026-04-03 05:38:10.225901 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:10.225926 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:10.225937 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:10.225947 | orchestrator | 2026-04-03 05:38:10.225956 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-03 05:38:10.225966 | orchestrator | Friday 03 April 2026 05:38:03 +0000 (0:00:00.565) 0:03:07.395 ********** 2026-04-03 05:38:10.225976 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:10.225986 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:10.225996 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:10.226005 | orchestrator | 2026-04-03 05:38:10.226070 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-03 05:38:10.226082 | orchestrator | Friday 03 April 2026 05:38:04 +0000 (0:00:01.249) 0:03:08.645 ********** 2026-04-03 05:38:10.226092 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 05:38:10.226102 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 05:38:10.226112 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 05:38:10.226121 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.226131 | orchestrator | 2026-04-03 05:38:10.226141 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-03 05:38:10.226151 | orchestrator | Friday 03 April 2026 05:38:05 +0000 (0:00:00.645) 0:03:09.291 ********** 2026-04-03 05:38:10.226160 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:10.226170 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:10.226180 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:10.226190 | orchestrator | 2026-04-03 05:38:10.226200 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-03 05:38:10.226210 | orchestrator | Friday 03 April 2026 05:38:05 +0000 (0:00:00.382) 0:03:09.673 ********** 2026-04-03 05:38:10.226219 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:10.226229 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:10.226239 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:10.226257 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:38:10.226267 | orchestrator | 2026-04-03 05:38:10.226277 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-03 05:38:10.226287 | orchestrator | Friday 03 April 2026 05:38:06 +0000 (0:00:01.083) 0:03:10.757 ********** 2026-04-03 05:38:10.226297 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:10.226306 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:10.226316 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:10.226326 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226335 | orchestrator | 2026-04-03 05:38:10.226345 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-03 05:38:10.226355 | orchestrator | Friday 03 April 2026 05:38:07 +0000 (0:00:00.416) 0:03:11.173 ********** 2026-04-03 05:38:10.226365 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226374 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:10.226384 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:10.226394 | orchestrator | 2026-04-03 05:38:10.226403 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-03 05:38:10.226413 | orchestrator | Friday 03 April 2026 05:38:07 +0000 (0:00:00.350) 0:03:11.524 ********** 2026-04-03 05:38:10.226423 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226433 | orchestrator | 2026-04-03 05:38:10.226442 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-03 05:38:10.226452 | orchestrator | Friday 03 April 2026 05:38:07 +0000 (0:00:00.236) 0:03:11.760 ********** 2026-04-03 05:38:10.226462 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226471 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:10.226481 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:10.226491 | orchestrator | 2026-04-03 05:38:10.226500 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-03 05:38:10.226510 | orchestrator | Friday 03 April 2026 05:38:08 +0000 (0:00:00.548) 0:03:12.309 ********** 2026-04-03 05:38:10.226520 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226530 | orchestrator | 2026-04-03 05:38:10.226539 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-03 05:38:10.226549 | orchestrator | Friday 03 April 2026 05:38:08 +0000 (0:00:00.248) 0:03:12.557 ********** 2026-04-03 05:38:10.226559 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226569 | orchestrator | 2026-04-03 05:38:10.226578 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-03 05:38:10.226588 | orchestrator | Friday 03 April 2026 05:38:08 +0000 (0:00:00.236) 0:03:12.794 ********** 2026-04-03 05:38:10.226598 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226608 | orchestrator | 2026-04-03 05:38:10.226617 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-03 05:38:10.226627 | orchestrator | Friday 03 April 2026 05:38:09 +0000 (0:00:00.146) 0:03:12.940 ********** 2026-04-03 05:38:10.226642 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226652 | orchestrator | 2026-04-03 05:38:10.226662 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-03 05:38:10.226672 | orchestrator | Friday 03 April 2026 05:38:09 +0000 (0:00:00.253) 0:03:13.194 ********** 2026-04-03 05:38:10.226682 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226692 | orchestrator | 2026-04-03 05:38:10.226702 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-03 05:38:10.226711 | orchestrator | Friday 03 April 2026 05:38:09 +0000 (0:00:00.231) 0:03:13.426 ********** 2026-04-03 05:38:10.226721 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:10.226731 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:10.226741 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:10.226756 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:10.226766 | orchestrator | 2026-04-03 05:38:10.226776 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-03 05:38:10.226786 | orchestrator | Friday 03 April 2026 05:38:10 +0000 (0:00:00.411) 0:03:13.838 ********** 2026-04-03 05:38:10.226803 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102100 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:29.102186 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:29.102196 | orchestrator | 2026-04-03 05:38:29.102204 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-03 05:38:29.102212 | orchestrator | Friday 03 April 2026 05:38:10 +0000 (0:00:00.334) 0:03:14.172 ********** 2026-04-03 05:38:29.102219 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102225 | orchestrator | 2026-04-03 05:38:29.102232 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-03 05:38:29.102238 | orchestrator | Friday 03 April 2026 05:38:10 +0000 (0:00:00.266) 0:03:14.439 ********** 2026-04-03 05:38:29.102245 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102251 | orchestrator | 2026-04-03 05:38:29.102257 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-03 05:38:29.102264 | orchestrator | Friday 03 April 2026 05:38:11 +0000 (0:00:00.760) 0:03:15.199 ********** 2026-04-03 05:38:29.102270 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.102276 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.102282 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.102290 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:38:29.102296 | orchestrator | 2026-04-03 05:38:29.102303 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-03 05:38:29.102309 | orchestrator | Friday 03 April 2026 05:38:12 +0000 (0:00:00.853) 0:03:16.052 ********** 2026-04-03 05:38:29.102315 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:29.102323 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:29.102330 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:29.102336 | orchestrator | 2026-04-03 05:38:29.102342 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-03 05:38:29.102348 | orchestrator | Friday 03 April 2026 05:38:12 +0000 (0:00:00.535) 0:03:16.587 ********** 2026-04-03 05:38:29.102355 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:38:29.102361 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:38:29.102367 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:38:29.102374 | orchestrator | 2026-04-03 05:38:29.102380 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-03 05:38:29.102386 | orchestrator | Friday 03 April 2026 05:38:13 +0000 (0:00:01.211) 0:03:17.799 ********** 2026-04-03 05:38:29.102393 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:29.102400 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:29.102406 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:29.102412 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102418 | orchestrator | 2026-04-03 05:38:29.102425 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-03 05:38:29.102431 | orchestrator | Friday 03 April 2026 05:38:14 +0000 (0:00:00.652) 0:03:18.451 ********** 2026-04-03 05:38:29.102437 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:29.102444 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:29.102450 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:29.102456 | orchestrator | 2026-04-03 05:38:29.102462 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-03 05:38:29.102469 | orchestrator | Friday 03 April 2026 05:38:14 +0000 (0:00:00.348) 0:03:18.800 ********** 2026-04-03 05:38:29.102475 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.102481 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.102487 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.102510 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:38:29.102517 | orchestrator | 2026-04-03 05:38:29.102523 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-03 05:38:29.102529 | orchestrator | Friday 03 April 2026 05:38:16 +0000 (0:00:01.102) 0:03:19.902 ********** 2026-04-03 05:38:29.102536 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:29.102542 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:29.102548 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:29.102554 | orchestrator | 2026-04-03 05:38:29.102560 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-03 05:38:29.102567 | orchestrator | Friday 03 April 2026 05:38:16 +0000 (0:00:00.360) 0:03:20.262 ********** 2026-04-03 05:38:29.102573 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:38:29.102579 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:38:29.102585 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:38:29.102591 | orchestrator | 2026-04-03 05:38:29.102598 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-03 05:38:29.102604 | orchestrator | Friday 03 April 2026 05:38:17 +0000 (0:00:01.147) 0:03:21.409 ********** 2026-04-03 05:38:29.102610 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:38:29.102617 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:38:29.102633 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:38:29.102641 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102648 | orchestrator | 2026-04-03 05:38:29.102655 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-03 05:38:29.102663 | orchestrator | Friday 03 April 2026 05:38:18 +0000 (0:00:01.096) 0:03:22.506 ********** 2026-04-03 05:38:29.102670 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:38:29.102677 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:38:29.102685 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:38:29.102692 | orchestrator | 2026-04-03 05:38:29.102699 | orchestrator | RUNNING HANDLER [ceph-handler : Rbdmirrors handler] **************************** 2026-04-03 05:38:29.102706 | orchestrator | Friday 03 April 2026 05:38:19 +0000 (0:00:00.344) 0:03:22.850 ********** 2026-04-03 05:38:29.102713 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102721 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:29.102728 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:29.102736 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.102743 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.102750 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.102757 | orchestrator | 2026-04-03 05:38:29.102776 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-03 05:38:29.102783 | orchestrator | Friday 03 April 2026 05:38:19 +0000 (0:00:00.606) 0:03:23.457 ********** 2026-04-03 05:38:29.102791 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:38:29.102798 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:38:29.102805 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:38:29.102812 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:38:29.102819 | orchestrator | 2026-04-03 05:38:29.102826 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-03 05:38:29.102833 | orchestrator | Friday 03 April 2026 05:38:20 +0000 (0:00:01.110) 0:03:24.568 ********** 2026-04-03 05:38:29.102864 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:29.102871 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:29.102878 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:29.102885 | orchestrator | 2026-04-03 05:38:29.102892 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-03 05:38:29.102900 | orchestrator | Friday 03 April 2026 05:38:21 +0000 (0:00:00.359) 0:03:24.927 ********** 2026-04-03 05:38:29.102906 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:29.102919 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:29.102926 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:29.102933 | orchestrator | 2026-04-03 05:38:29.102940 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-03 05:38:29.102947 | orchestrator | Friday 03 April 2026 05:38:22 +0000 (0:00:01.662) 0:03:26.590 ********** 2026-04-03 05:38:29.102954 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 05:38:29.102962 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 05:38:29.102969 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 05:38:29.102978 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.102989 | orchestrator | 2026-04-03 05:38:29.102999 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-03 05:38:29.103010 | orchestrator | Friday 03 April 2026 05:38:23 +0000 (0:00:00.668) 0:03:27.259 ********** 2026-04-03 05:38:29.103021 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:29.103028 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:29.103037 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:29.103046 | orchestrator | 2026-04-03 05:38:29.103053 | orchestrator | PLAY [Apply role ceph-mon] ***************************************************** 2026-04-03 05:38:29.103059 | orchestrator | 2026-04-03 05:38:29.103065 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:38:29.103071 | orchestrator | Friday 03 April 2026 05:38:24 +0000 (0:00:00.608) 0:03:27.867 ********** 2026-04-03 05:38:29.103078 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:38:29.103087 | orchestrator | 2026-04-03 05:38:29.103093 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:38:29.103099 | orchestrator | Friday 03 April 2026 05:38:24 +0000 (0:00:00.816) 0:03:28.684 ********** 2026-04-03 05:38:29.103105 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:38:29.103112 | orchestrator | 2026-04-03 05:38:29.103118 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:38:29.103124 | orchestrator | Friday 03 April 2026 05:38:25 +0000 (0:00:00.563) 0:03:29.247 ********** 2026-04-03 05:38:29.103130 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:29.103136 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:29.103142 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:29.103149 | orchestrator | 2026-04-03 05:38:29.103155 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:38:29.103161 | orchestrator | Friday 03 April 2026 05:38:26 +0000 (0:00:00.721) 0:03:29.969 ********** 2026-04-03 05:38:29.103167 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.103173 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.103180 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.103186 | orchestrator | 2026-04-03 05:38:29.103192 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:38:29.103198 | orchestrator | Friday 03 April 2026 05:38:26 +0000 (0:00:00.601) 0:03:30.570 ********** 2026-04-03 05:38:29.103204 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.103210 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.103216 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.103223 | orchestrator | 2026-04-03 05:38:29.103229 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:38:29.103235 | orchestrator | Friday 03 April 2026 05:38:27 +0000 (0:00:00.333) 0:03:30.903 ********** 2026-04-03 05:38:29.103241 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.103247 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.103258 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.103264 | orchestrator | 2026-04-03 05:38:29.103270 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:38:29.103276 | orchestrator | Friday 03 April 2026 05:38:27 +0000 (0:00:00.322) 0:03:31.225 ********** 2026-04-03 05:38:29.103287 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:29.103294 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:29.103300 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:29.103306 | orchestrator | 2026-04-03 05:38:29.103312 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:38:29.103318 | orchestrator | Friday 03 April 2026 05:38:28 +0000 (0:00:00.709) 0:03:31.935 ********** 2026-04-03 05:38:29.103325 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.103331 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.103337 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:29.103343 | orchestrator | 2026-04-03 05:38:29.103349 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:38:29.103356 | orchestrator | Friday 03 April 2026 05:38:28 +0000 (0:00:00.641) 0:03:32.577 ********** 2026-04-03 05:38:29.103362 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:29.103368 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:29.103379 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.424317 | orchestrator | 2026-04-03 05:38:50.424427 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:38:50.424446 | orchestrator | Friday 03 April 2026 05:38:29 +0000 (0:00:00.327) 0:03:32.905 ********** 2026-04-03 05:38:50.424458 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.424470 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.424482 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.424493 | orchestrator | 2026-04-03 05:38:50.424505 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:38:50.424516 | orchestrator | Friday 03 April 2026 05:38:29 +0000 (0:00:00.700) 0:03:33.606 ********** 2026-04-03 05:38:50.424528 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.424539 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.424550 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.424561 | orchestrator | 2026-04-03 05:38:50.424572 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:38:50.424584 | orchestrator | Friday 03 April 2026 05:38:30 +0000 (0:00:01.017) 0:03:34.623 ********** 2026-04-03 05:38:50.424595 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.424607 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.424618 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.424629 | orchestrator | 2026-04-03 05:38:50.424641 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:38:50.424652 | orchestrator | Friday 03 April 2026 05:38:31 +0000 (0:00:00.323) 0:03:34.946 ********** 2026-04-03 05:38:50.424663 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.424675 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.424687 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.424698 | orchestrator | 2026-04-03 05:38:50.424709 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:38:50.424721 | orchestrator | Friday 03 April 2026 05:38:31 +0000 (0:00:00.369) 0:03:35.316 ********** 2026-04-03 05:38:50.424732 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.424743 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.424754 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.424765 | orchestrator | 2026-04-03 05:38:50.424776 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:38:50.424787 | orchestrator | Friday 03 April 2026 05:38:31 +0000 (0:00:00.334) 0:03:35.651 ********** 2026-04-03 05:38:50.424798 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.424809 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.424821 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.424832 | orchestrator | 2026-04-03 05:38:50.424879 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:38:50.424894 | orchestrator | Friday 03 April 2026 05:38:32 +0000 (0:00:00.564) 0:03:36.215 ********** 2026-04-03 05:38:50.424906 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.424947 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.424967 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.424987 | orchestrator | 2026-04-03 05:38:50.425007 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:38:50.425028 | orchestrator | Friday 03 April 2026 05:38:32 +0000 (0:00:00.334) 0:03:36.550 ********** 2026-04-03 05:38:50.425041 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.425054 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.425066 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.425078 | orchestrator | 2026-04-03 05:38:50.425090 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:38:50.425103 | orchestrator | Friday 03 April 2026 05:38:33 +0000 (0:00:00.332) 0:03:36.882 ********** 2026-04-03 05:38:50.425115 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.425128 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:38:50.425140 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:38:50.425153 | orchestrator | 2026-04-03 05:38:50.425166 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:38:50.425179 | orchestrator | Friday 03 April 2026 05:38:33 +0000 (0:00:00.317) 0:03:37.200 ********** 2026-04-03 05:38:50.425193 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425205 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425218 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425229 | orchestrator | 2026-04-03 05:38:50.425243 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:38:50.425261 | orchestrator | Friday 03 April 2026 05:38:33 +0000 (0:00:00.615) 0:03:37.815 ********** 2026-04-03 05:38:50.425279 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425297 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425316 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425334 | orchestrator | 2026-04-03 05:38:50.425350 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:38:50.425361 | orchestrator | Friday 03 April 2026 05:38:34 +0000 (0:00:00.365) 0:03:38.180 ********** 2026-04-03 05:38:50.425372 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425383 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425393 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425404 | orchestrator | 2026-04-03 05:38:50.425430 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-03 05:38:50.425441 | orchestrator | Friday 03 April 2026 05:38:34 +0000 (0:00:00.553) 0:03:38.733 ********** 2026-04-03 05:38:50.425452 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425463 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425474 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425485 | orchestrator | 2026-04-03 05:38:50.425496 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-03 05:38:50.425507 | orchestrator | Friday 03 April 2026 05:38:35 +0000 (0:00:00.576) 0:03:39.310 ********** 2026-04-03 05:38:50.425518 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:38:50.425529 | orchestrator | 2026-04-03 05:38:50.425540 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-03 05:38:50.425550 | orchestrator | Friday 03 April 2026 05:38:36 +0000 (0:00:00.604) 0:03:39.914 ********** 2026-04-03 05:38:50.425561 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:38:50.425572 | orchestrator | 2026-04-03 05:38:50.425583 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-03 05:38:50.425612 | orchestrator | Friday 03 April 2026 05:38:36 +0000 (0:00:00.160) 0:03:40.074 ********** 2026-04-03 05:38:50.425625 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 05:38:50.425636 | orchestrator | 2026-04-03 05:38:50.425647 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-03 05:38:50.425657 | orchestrator | Friday 03 April 2026 05:38:37 +0000 (0:00:01.000) 0:03:41.075 ********** 2026-04-03 05:38:50.425678 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425689 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425700 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425711 | orchestrator | 2026-04-03 05:38:50.425722 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-03 05:38:50.425733 | orchestrator | Friday 03 April 2026 05:38:37 +0000 (0:00:00.602) 0:03:41.678 ********** 2026-04-03 05:38:50.425744 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.425755 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.425766 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.425777 | orchestrator | 2026-04-03 05:38:50.425788 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-03 05:38:50.425799 | orchestrator | Friday 03 April 2026 05:38:38 +0000 (0:00:00.362) 0:03:42.040 ********** 2026-04-03 05:38:50.425810 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.425821 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:50.425832 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:50.425877 | orchestrator | 2026-04-03 05:38:50.425889 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-03 05:38:50.425900 | orchestrator | Friday 03 April 2026 05:38:39 +0000 (0:00:01.131) 0:03:43.172 ********** 2026-04-03 05:38:50.425911 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.425922 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:50.425933 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:50.425944 | orchestrator | 2026-04-03 05:38:50.425955 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-03 05:38:50.425966 | orchestrator | Friday 03 April 2026 05:38:40 +0000 (0:00:00.830) 0:03:44.002 ********** 2026-04-03 05:38:50.425977 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.425987 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:50.425998 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:50.426009 | orchestrator | 2026-04-03 05:38:50.426079 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-03 05:38:50.426092 | orchestrator | Friday 03 April 2026 05:38:41 +0000 (0:00:00.930) 0:03:44.932 ********** 2026-04-03 05:38:50.426103 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.426114 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.426125 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.426136 | orchestrator | 2026-04-03 05:38:50.426147 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-03 05:38:50.426158 | orchestrator | Friday 03 April 2026 05:38:41 +0000 (0:00:00.693) 0:03:45.626 ********** 2026-04-03 05:38:50.426169 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.426180 | orchestrator | 2026-04-03 05:38:50.426191 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-03 05:38:50.426202 | orchestrator | Friday 03 April 2026 05:38:43 +0000 (0:00:01.269) 0:03:46.896 ********** 2026-04-03 05:38:50.426213 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.426224 | orchestrator | 2026-04-03 05:38:50.426235 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-03 05:38:50.426246 | orchestrator | Friday 03 April 2026 05:38:43 +0000 (0:00:00.720) 0:03:47.616 ********** 2026-04-03 05:38:50.426257 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 05:38:50.426268 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:38:50.426279 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:38:50.426290 | orchestrator | changed: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:38:50.426301 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-03 05:38:50.426312 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:38:50.426323 | orchestrator | changed: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:38:50.426334 | orchestrator | changed: [testbed-node-0 -> {{ item }}] 2026-04-03 05:38:50.426345 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:38:50.426364 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-03 05:38:50.426375 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-03 05:38:50.426386 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-03 05:38:50.426397 | orchestrator | 2026-04-03 05:38:50.426408 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-03 05:38:50.426419 | orchestrator | Friday 03 April 2026 05:38:46 +0000 (0:00:03.071) 0:03:50.688 ********** 2026-04-03 05:38:50.426430 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.426441 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:50.426457 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:50.426468 | orchestrator | 2026-04-03 05:38:50.426479 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-03 05:38:50.426490 | orchestrator | Friday 03 April 2026 05:38:47 +0000 (0:00:01.126) 0:03:51.815 ********** 2026-04-03 05:38:50.426501 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.426512 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.426523 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.426534 | orchestrator | 2026-04-03 05:38:50.426545 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-03 05:38:50.426556 | orchestrator | Friday 03 April 2026 05:38:48 +0000 (0:00:00.649) 0:03:52.464 ********** 2026-04-03 05:38:50.426567 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:38:50.426578 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:38:50.426589 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:38:50.426600 | orchestrator | 2026-04-03 05:38:50.426611 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-03 05:38:50.426622 | orchestrator | Friday 03 April 2026 05:38:49 +0000 (0:00:00.371) 0:03:52.836 ********** 2026-04-03 05:38:50.426633 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:38:50.426644 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:38:50.426655 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:38:50.426666 | orchestrator | 2026-04-03 05:38:50.426685 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-03 05:39:51.685414 | orchestrator | Friday 03 April 2026 05:38:50 +0000 (0:00:01.387) 0:03:54.223 ********** 2026-04-03 05:39:51.685549 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:39:51.685575 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:39:51.685593 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:39:51.685610 | orchestrator | 2026-04-03 05:39:51.685628 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-03 05:39:51.685644 | orchestrator | Friday 03 April 2026 05:38:51 +0000 (0:00:01.476) 0:03:55.700 ********** 2026-04-03 05:39:51.685662 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.685678 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.685695 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.685713 | orchestrator | 2026-04-03 05:39:51.685723 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-03 05:39:51.685733 | orchestrator | Friday 03 April 2026 05:38:52 +0000 (0:00:00.318) 0:03:56.018 ********** 2026-04-03 05:39:51.685744 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:39:51.685754 | orchestrator | 2026-04-03 05:39:51.685765 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-03 05:39:51.685776 | orchestrator | Friday 03 April 2026 05:38:52 +0000 (0:00:00.559) 0:03:56.578 ********** 2026-04-03 05:39:51.685786 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.685795 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.685805 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.685815 | orchestrator | 2026-04-03 05:39:51.685824 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-03 05:39:51.685871 | orchestrator | Friday 03 April 2026 05:38:53 +0000 (0:00:00.548) 0:03:57.127 ********** 2026-04-03 05:39:51.685882 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.685918 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.685929 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.685938 | orchestrator | 2026-04-03 05:39:51.685950 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-03 05:39:51.685962 | orchestrator | Friday 03 April 2026 05:38:53 +0000 (0:00:00.319) 0:03:57.447 ********** 2026-04-03 05:39:51.685973 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:39:51.685986 | orchestrator | 2026-04-03 05:39:51.685996 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-03 05:39:51.686007 | orchestrator | Friday 03 April 2026 05:38:54 +0000 (0:00:00.574) 0:03:58.021 ********** 2026-04-03 05:39:51.686074 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:39:51.686087 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:39:51.686098 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:39:51.686118 | orchestrator | 2026-04-03 05:39:51.686130 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-03 05:39:51.686142 | orchestrator | Friday 03 April 2026 05:38:56 +0000 (0:00:02.047) 0:04:00.069 ********** 2026-04-03 05:39:51.686154 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:39:51.686166 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:39:51.686177 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:39:51.686189 | orchestrator | 2026-04-03 05:39:51.686200 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-03 05:39:51.686210 | orchestrator | Friday 03 April 2026 05:38:57 +0000 (0:00:01.118) 0:04:01.187 ********** 2026-04-03 05:39:51.686222 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:39:51.686234 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:39:51.686245 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:39:51.686256 | orchestrator | 2026-04-03 05:39:51.686268 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-03 05:39:51.686279 | orchestrator | Friday 03 April 2026 05:38:59 +0000 (0:00:02.570) 0:04:03.757 ********** 2026-04-03 05:39:51.686290 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:39:51.686302 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:39:51.686313 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:39:51.686323 | orchestrator | 2026-04-03 05:39:51.686333 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-03 05:39:51.686343 | orchestrator | Friday 03 April 2026 05:39:01 +0000 (0:00:01.906) 0:04:05.664 ********** 2026-04-03 05:39:51.686353 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:39:51.686362 | orchestrator | 2026-04-03 05:39:51.686372 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-03 05:39:51.686382 | orchestrator | Friday 03 April 2026 05:39:02 +0000 (0:00:00.882) 0:04:06.547 ********** 2026-04-03 05:39:51.686404 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-03 05:39:51.686414 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:39:51.686425 | orchestrator | 2026-04-03 05:39:51.686435 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-03 05:39:51.686445 | orchestrator | Friday 03 April 2026 05:39:24 +0000 (0:00:21.835) 0:04:28.382 ********** 2026-04-03 05:39:51.686455 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:39:51.686465 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:39:51.686475 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:39:51.686484 | orchestrator | 2026-04-03 05:39:51.686494 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-03 05:39:51.686504 | orchestrator | Friday 03 April 2026 05:39:33 +0000 (0:00:08.474) 0:04:36.857 ********** 2026-04-03 05:39:51.686514 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.686524 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.686534 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.686554 | orchestrator | 2026-04-03 05:39:51.686564 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-03 05:39:51.686574 | orchestrator | Friday 03 April 2026 05:39:33 +0000 (0:00:00.342) 0:04:37.199 ********** 2026-04-03 05:39:51.686603 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-03 05:39:51.686617 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-03 05:39:51.686629 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-03 05:39:51.686640 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-03 05:39:51.686651 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-03 05:39:51.686662 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__53855dbb30864e75d15c6652271376936b70ed38'}])  2026-04-03 05:39:51.686673 | orchestrator | 2026-04-03 05:39:51.686684 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:39:51.686694 | orchestrator | Friday 03 April 2026 05:39:47 +0000 (0:00:14.556) 0:04:51.756 ********** 2026-04-03 05:39:51.686703 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.686713 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.686723 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.686733 | orchestrator | 2026-04-03 05:39:51.686742 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-03 05:39:51.686752 | orchestrator | Friday 03 April 2026 05:39:48 +0000 (0:00:00.379) 0:04:52.135 ********** 2026-04-03 05:39:51.686762 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:39:51.686772 | orchestrator | 2026-04-03 05:39:51.686781 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-03 05:39:51.686791 | orchestrator | Friday 03 April 2026 05:39:49 +0000 (0:00:00.815) 0:04:52.951 ********** 2026-04-03 05:39:51.686801 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:39:51.686811 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:39:51.686820 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:39:51.686854 | orchestrator | 2026-04-03 05:39:51.686872 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-03 05:39:51.686898 | orchestrator | Friday 03 April 2026 05:39:49 +0000 (0:00:00.343) 0:04:53.294 ********** 2026-04-03 05:39:51.686922 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.686933 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:39:51.686942 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:39:51.686952 | orchestrator | 2026-04-03 05:39:51.686962 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-03 05:39:51.686977 | orchestrator | Friday 03 April 2026 05:39:49 +0000 (0:00:00.402) 0:04:53.697 ********** 2026-04-03 05:39:51.686995 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 05:39:51.687012 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 05:39:51.687024 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 05:39:51.687057 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:39:51.687067 | orchestrator | 2026-04-03 05:39:51.687077 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-03 05:39:51.687087 | orchestrator | Friday 03 April 2026 05:39:50 +0000 (0:00:00.948) 0:04:54.645 ********** 2026-04-03 05:39:51.687097 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:39:51.687107 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:39:51.687116 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:39:51.687126 | orchestrator | 2026-04-03 05:39:51.687136 | orchestrator | PLAY [Apply role ceph-mgr] ***************************************************** 2026-04-03 05:39:51.687146 | orchestrator | 2026-04-03 05:39:51.687162 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:40:18.447236 | orchestrator | Friday 03 April 2026 05:39:51 +0000 (0:00:00.839) 0:04:55.485 ********** 2026-04-03 05:40:18.447327 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:40:18.447338 | orchestrator | 2026-04-03 05:40:18.447351 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:40:18.447364 | orchestrator | Friday 03 April 2026 05:39:52 +0000 (0:00:00.559) 0:04:56.044 ********** 2026-04-03 05:40:18.447382 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:40:18.447395 | orchestrator | 2026-04-03 05:40:18.447407 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:40:18.447419 | orchestrator | Friday 03 April 2026 05:39:53 +0000 (0:00:00.836) 0:04:56.880 ********** 2026-04-03 05:40:18.447431 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.447444 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.447455 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.447466 | orchestrator | 2026-04-03 05:40:18.447477 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:40:18.447489 | orchestrator | Friday 03 April 2026 05:39:53 +0000 (0:00:00.733) 0:04:57.613 ********** 2026-04-03 05:40:18.447501 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447514 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.447527 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.447539 | orchestrator | 2026-04-03 05:40:18.447551 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:40:18.447563 | orchestrator | Friday 03 April 2026 05:39:54 +0000 (0:00:00.354) 0:04:57.968 ********** 2026-04-03 05:40:18.447575 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447588 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.447599 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.447611 | orchestrator | 2026-04-03 05:40:18.447621 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:40:18.447629 | orchestrator | Friday 03 April 2026 05:39:54 +0000 (0:00:00.580) 0:04:58.548 ********** 2026-04-03 05:40:18.447637 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447644 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.447672 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.447680 | orchestrator | 2026-04-03 05:40:18.447687 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:40:18.447695 | orchestrator | Friday 03 April 2026 05:39:55 +0000 (0:00:00.330) 0:04:58.879 ********** 2026-04-03 05:40:18.447702 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.447710 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.447717 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.447724 | orchestrator | 2026-04-03 05:40:18.447732 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:40:18.447739 | orchestrator | Friday 03 April 2026 05:39:55 +0000 (0:00:00.735) 0:04:59.615 ********** 2026-04-03 05:40:18.447746 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447753 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.447761 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.447768 | orchestrator | 2026-04-03 05:40:18.447775 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:40:18.447783 | orchestrator | Friday 03 April 2026 05:39:56 +0000 (0:00:00.333) 0:04:59.948 ********** 2026-04-03 05:40:18.447790 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447799 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.447807 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.447816 | orchestrator | 2026-04-03 05:40:18.447825 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:40:18.447873 | orchestrator | Friday 03 April 2026 05:39:56 +0000 (0:00:00.643) 0:05:00.591 ********** 2026-04-03 05:40:18.447896 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.447906 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.447913 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.447920 | orchestrator | 2026-04-03 05:40:18.447928 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:40:18.447935 | orchestrator | Friday 03 April 2026 05:39:57 +0000 (0:00:00.730) 0:05:01.321 ********** 2026-04-03 05:40:18.447943 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.447950 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.447957 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.447965 | orchestrator | 2026-04-03 05:40:18.447972 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:40:18.447980 | orchestrator | Friday 03 April 2026 05:39:58 +0000 (0:00:00.720) 0:05:02.042 ********** 2026-04-03 05:40:18.447987 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.447995 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448013 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448021 | orchestrator | 2026-04-03 05:40:18.448028 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:40:18.448036 | orchestrator | Friday 03 April 2026 05:39:58 +0000 (0:00:00.609) 0:05:02.652 ********** 2026-04-03 05:40:18.448043 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.448050 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.448057 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.448064 | orchestrator | 2026-04-03 05:40:18.448072 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:40:18.448079 | orchestrator | Friday 03 April 2026 05:39:59 +0000 (0:00:00.355) 0:05:03.007 ********** 2026-04-03 05:40:18.448086 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448101 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448108 | orchestrator | 2026-04-03 05:40:18.448115 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:40:18.448122 | orchestrator | Friday 03 April 2026 05:39:59 +0000 (0:00:00.377) 0:05:03.385 ********** 2026-04-03 05:40:18.448130 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448137 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448144 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448152 | orchestrator | 2026-04-03 05:40:18.448180 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:40:18.448189 | orchestrator | Friday 03 April 2026 05:39:59 +0000 (0:00:00.343) 0:05:03.728 ********** 2026-04-03 05:40:18.448196 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448203 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448210 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448218 | orchestrator | 2026-04-03 05:40:18.448225 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:40:18.448232 | orchestrator | Friday 03 April 2026 05:40:00 +0000 (0:00:00.585) 0:05:04.314 ********** 2026-04-03 05:40:18.448239 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448246 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448254 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448261 | orchestrator | 2026-04-03 05:40:18.448268 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:40:18.448275 | orchestrator | Friday 03 April 2026 05:40:00 +0000 (0:00:00.356) 0:05:04.670 ********** 2026-04-03 05:40:18.448282 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448290 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448297 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448304 | orchestrator | 2026-04-03 05:40:18.448311 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:40:18.448318 | orchestrator | Friday 03 April 2026 05:40:01 +0000 (0:00:00.336) 0:05:05.007 ********** 2026-04-03 05:40:18.448325 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.448333 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.448340 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.448347 | orchestrator | 2026-04-03 05:40:18.448354 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:40:18.448361 | orchestrator | Friday 03 April 2026 05:40:01 +0000 (0:00:00.448) 0:05:05.455 ********** 2026-04-03 05:40:18.448369 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.448376 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.448383 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.448390 | orchestrator | 2026-04-03 05:40:18.448398 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:40:18.448405 | orchestrator | Friday 03 April 2026 05:40:02 +0000 (0:00:00.607) 0:05:06.063 ********** 2026-04-03 05:40:18.448414 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.448427 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.448439 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.448450 | orchestrator | 2026-04-03 05:40:18.448462 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 05:40:18.448475 | orchestrator | Friday 03 April 2026 05:40:02 +0000 (0:00:00.591) 0:05:06.654 ********** 2026-04-03 05:40:18.448487 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 05:40:18.448499 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:40:18.448512 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:40:18.448524 | orchestrator | 2026-04-03 05:40:18.448537 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 05:40:18.448549 | orchestrator | Friday 03 April 2026 05:40:03 +0000 (0:00:00.939) 0:05:07.594 ********** 2026-04-03 05:40:18.448562 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:40:18.448571 | orchestrator | 2026-04-03 05:40:18.448578 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-03 05:40:18.448585 | orchestrator | Friday 03 April 2026 05:40:04 +0000 (0:00:00.766) 0:05:08.360 ********** 2026-04-03 05:40:18.448592 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:40:18.448600 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:40:18.448607 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:40:18.448614 | orchestrator | 2026-04-03 05:40:18.448622 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-03 05:40:18.448665 | orchestrator | Friday 03 April 2026 05:40:05 +0000 (0:00:00.728) 0:05:09.088 ********** 2026-04-03 05:40:18.448673 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:40:18.448689 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:40:18.448697 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:40:18.448704 | orchestrator | 2026-04-03 05:40:18.448711 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-03 05:40:18.448719 | orchestrator | Friday 03 April 2026 05:40:05 +0000 (0:00:00.340) 0:05:09.428 ********** 2026-04-03 05:40:18.448726 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 05:40:18.448734 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 05:40:18.448741 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 05:40:18.448749 | orchestrator | changed: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-03 05:40:18.448756 | orchestrator | 2026-04-03 05:40:18.448768 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-03 05:40:18.448776 | orchestrator | Friday 03 April 2026 05:40:15 +0000 (0:00:10.109) 0:05:19.537 ********** 2026-04-03 05:40:18.448783 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:40:18.448791 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:40:18.448798 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:40:18.448805 | orchestrator | 2026-04-03 05:40:18.448813 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-03 05:40:18.448820 | orchestrator | Friday 03 April 2026 05:40:16 +0000 (0:00:00.633) 0:05:20.171 ********** 2026-04-03 05:40:18.448873 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 05:40:18.448888 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 05:40:18.448899 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 05:40:18.448906 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 05:40:18.448914 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:40:18.448921 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:40:18.448928 | orchestrator | 2026-04-03 05:40:18.448935 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-03 05:40:18.448949 | orchestrator | Friday 03 April 2026 05:40:18 +0000 (0:00:02.072) 0:05:22.244 ********** 2026-04-03 05:41:14.157680 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 05:41:14.157820 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 05:41:14.157940 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 05:41:14.157960 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-03 05:41:14.157976 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 05:41:14.157993 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-03 05:41:14.158010 | orchestrator | 2026-04-03 05:41:14.158103 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-03 05:41:14.158124 | orchestrator | Friday 03 April 2026 05:40:19 +0000 (0:00:01.132) 0:05:23.377 ********** 2026-04-03 05:41:14.158149 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:41:14.158167 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:41:14.158183 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:41:14.158200 | orchestrator | 2026-04-03 05:41:14.158218 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-03 05:41:14.158236 | orchestrator | Friday 03 April 2026 05:40:20 +0000 (0:00:00.678) 0:05:24.056 ********** 2026-04-03 05:41:14.158253 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.158272 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:41:14.158289 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:41:14.158307 | orchestrator | 2026-04-03 05:41:14.158324 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 05:41:14.158343 | orchestrator | Friday 03 April 2026 05:40:20 +0000 (0:00:00.590) 0:05:24.646 ********** 2026-04-03 05:41:14.158388 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.158408 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:41:14.158423 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:41:14.158439 | orchestrator | 2026-04-03 05:41:14.158454 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 05:41:14.158472 | orchestrator | Friday 03 April 2026 05:40:21 +0000 (0:00:00.330) 0:05:24.977 ********** 2026-04-03 05:41:14.158490 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:41:14.158508 | orchestrator | 2026-04-03 05:41:14.158525 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-03 05:41:14.158542 | orchestrator | Friday 03 April 2026 05:40:21 +0000 (0:00:00.553) 0:05:25.530 ********** 2026-04-03 05:41:14.158557 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.158573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:41:14.158589 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:41:14.158605 | orchestrator | 2026-04-03 05:41:14.158620 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-03 05:41:14.158636 | orchestrator | Friday 03 April 2026 05:40:22 +0000 (0:00:00.578) 0:05:26.109 ********** 2026-04-03 05:41:14.158652 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.158668 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:41:14.158683 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:41:14.158698 | orchestrator | 2026-04-03 05:41:14.158714 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-03 05:41:14.158731 | orchestrator | Friday 03 April 2026 05:40:22 +0000 (0:00:00.355) 0:05:26.464 ********** 2026-04-03 05:41:14.158745 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:41:14.158762 | orchestrator | 2026-04-03 05:41:14.158778 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-03 05:41:14.158794 | orchestrator | Friday 03 April 2026 05:40:23 +0000 (0:00:00.571) 0:05:27.036 ********** 2026-04-03 05:41:14.158811 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.158852 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.158871 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.158888 | orchestrator | 2026-04-03 05:41:14.158904 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-03 05:41:14.158923 | orchestrator | Friday 03 April 2026 05:40:24 +0000 (0:00:01.473) 0:05:28.509 ********** 2026-04-03 05:41:14.158940 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.158956 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.158973 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.158990 | orchestrator | 2026-04-03 05:41:14.159006 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-03 05:41:14.159022 | orchestrator | Friday 03 April 2026 05:40:25 +0000 (0:00:01.147) 0:05:29.657 ********** 2026-04-03 05:41:14.159039 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.159056 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.159074 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.159091 | orchestrator | 2026-04-03 05:41:14.159108 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-03 05:41:14.159145 | orchestrator | Friday 03 April 2026 05:40:27 +0000 (0:00:01.770) 0:05:31.428 ********** 2026-04-03 05:41:14.159162 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.159179 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.159196 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.159212 | orchestrator | 2026-04-03 05:41:14.159229 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 05:41:14.159246 | orchestrator | Friday 03 April 2026 05:40:29 +0000 (0:00:01.901) 0:05:33.330 ********** 2026-04-03 05:41:14.159262 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.159278 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:41:14.159295 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-03 05:41:14.159326 | orchestrator | 2026-04-03 05:41:14.159341 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-03 05:41:14.159358 | orchestrator | Friday 03 April 2026 05:40:30 +0000 (0:00:00.711) 0:05:34.041 ********** 2026-04-03 05:41:14.159374 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (30 retries left). 2026-04-03 05:41:14.159391 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (29 retries left). 2026-04-03 05:41:14.159433 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (28 retries left). 2026-04-03 05:41:14.159451 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (27 retries left). 2026-04-03 05:41:14.159467 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:41:14.159484 | orchestrator | 2026-04-03 05:41:14.159499 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-03 05:41:14.159515 | orchestrator | Friday 03 April 2026 05:40:54 +0000 (0:00:24.203) 0:05:58.244 ********** 2026-04-03 05:41:14.159531 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:41:14.159546 | orchestrator | 2026-04-03 05:41:14.159561 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-03 05:41:14.159576 | orchestrator | Friday 03 April 2026 05:40:55 +0000 (0:00:01.247) 0:05:59.492 ********** 2026-04-03 05:41:14.159591 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:41:14.159608 | orchestrator | 2026-04-03 05:41:14.159626 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-03 05:41:14.159642 | orchestrator | Friday 03 April 2026 05:40:56 +0000 (0:00:00.329) 0:05:59.821 ********** 2026-04-03 05:41:14.159660 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:41:14.159676 | orchestrator | 2026-04-03 05:41:14.159692 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-03 05:41:14.159708 | orchestrator | Friday 03 April 2026 05:40:56 +0000 (0:00:00.170) 0:05:59.992 ********** 2026-04-03 05:41:14.159724 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=iostat) 2026-04-03 05:41:14.159742 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=nfs) 2026-04-03 05:41:14.159760 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=restful) 2026-04-03 05:41:14.159777 | orchestrator | 2026-04-03 05:41:14.159793 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-03 05:41:14.159810 | orchestrator | Friday 03 April 2026 05:41:02 +0000 (0:00:06.444) 0:06:06.436 ********** 2026-04-03 05:41:14.159851 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-03 05:41:14.159869 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=dashboard) 2026-04-03 05:41:14.159885 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=prometheus) 2026-04-03 05:41:14.159902 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-03 05:41:14.159918 | orchestrator | 2026-04-03 05:41:14.159935 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:41:14.159952 | orchestrator | Friday 03 April 2026 05:41:07 +0000 (0:00:05.333) 0:06:11.769 ********** 2026-04-03 05:41:14.159968 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.159985 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.160003 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.160018 | orchestrator | 2026-04-03 05:41:14.160033 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-03 05:41:14.160049 | orchestrator | Friday 03 April 2026 05:41:08 +0000 (0:00:00.688) 0:06:12.457 ********** 2026-04-03 05:41:14.160067 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:41:14.160084 | orchestrator | 2026-04-03 05:41:14.160112 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-03 05:41:14.160129 | orchestrator | Friday 03 April 2026 05:41:09 +0000 (0:00:00.808) 0:06:13.266 ********** 2026-04-03 05:41:14.160145 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:41:14.160161 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:41:14.160176 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:41:14.160192 | orchestrator | 2026-04-03 05:41:14.160209 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-03 05:41:14.160226 | orchestrator | Friday 03 April 2026 05:41:09 +0000 (0:00:00.405) 0:06:13.672 ********** 2026-04-03 05:41:14.160241 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:41:14.160258 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:41:14.160273 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:41:14.160290 | orchestrator | 2026-04-03 05:41:14.160306 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-03 05:41:14.160323 | orchestrator | Friday 03 April 2026 05:41:11 +0000 (0:00:01.180) 0:06:14.852 ********** 2026-04-03 05:41:14.160368 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 05:41:14.160385 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 05:41:14.160411 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 05:41:14.160426 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:41:14.160442 | orchestrator | 2026-04-03 05:41:14.160457 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-03 05:41:14.160474 | orchestrator | Friday 03 April 2026 05:41:11 +0000 (0:00:00.908) 0:06:15.761 ********** 2026-04-03 05:41:14.160489 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:41:14.160506 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:41:14.160522 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:41:14.160540 | orchestrator | 2026-04-03 05:41:14.160557 | orchestrator | PLAY [Apply role ceph-osd] ***************************************************** 2026-04-03 05:41:14.160572 | orchestrator | 2026-04-03 05:41:14.160589 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:41:14.160605 | orchestrator | Friday 03 April 2026 05:41:12 +0000 (0:00:00.858) 0:06:16.620 ********** 2026-04-03 05:41:14.160621 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:41:14.160640 | orchestrator | 2026-04-03 05:41:14.160656 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:41:14.160672 | orchestrator | Friday 03 April 2026 05:41:13 +0000 (0:00:00.574) 0:06:17.194 ********** 2026-04-03 05:41:14.160702 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:41:29.862705 | orchestrator | 2026-04-03 05:41:29.862812 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:41:29.862872 | orchestrator | Friday 03 April 2026 05:41:14 +0000 (0:00:00.760) 0:06:17.955 ********** 2026-04-03 05:41:29.862885 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.862897 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.862908 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.862919 | orchestrator | 2026-04-03 05:41:29.862931 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:41:29.862942 | orchestrator | Friday 03 April 2026 05:41:14 +0000 (0:00:00.332) 0:06:18.287 ********** 2026-04-03 05:41:29.862953 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.862965 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.862976 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.862987 | orchestrator | 2026-04-03 05:41:29.862998 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:41:29.863009 | orchestrator | Friday 03 April 2026 05:41:15 +0000 (0:00:00.672) 0:06:18.960 ********** 2026-04-03 05:41:29.863020 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863031 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863068 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863079 | orchestrator | 2026-04-03 05:41:29.863090 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:41:29.863102 | orchestrator | Friday 03 April 2026 05:41:15 +0000 (0:00:00.687) 0:06:19.647 ********** 2026-04-03 05:41:29.863112 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863123 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863134 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863145 | orchestrator | 2026-04-03 05:41:29.863156 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:41:29.863167 | orchestrator | Friday 03 April 2026 05:41:16 +0000 (0:00:00.980) 0:06:20.628 ********** 2026-04-03 05:41:29.863178 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863189 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863199 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863210 | orchestrator | 2026-04-03 05:41:29.863221 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:41:29.863232 | orchestrator | Friday 03 April 2026 05:41:17 +0000 (0:00:00.316) 0:06:20.944 ********** 2026-04-03 05:41:29.863243 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863254 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863265 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863276 | orchestrator | 2026-04-03 05:41:29.863287 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:41:29.863298 | orchestrator | Friday 03 April 2026 05:41:17 +0000 (0:00:00.322) 0:06:21.266 ********** 2026-04-03 05:41:29.863309 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863319 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863330 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863341 | orchestrator | 2026-04-03 05:41:29.863352 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:41:29.863363 | orchestrator | Friday 03 April 2026 05:41:17 +0000 (0:00:00.324) 0:06:21.591 ********** 2026-04-03 05:41:29.863375 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863386 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863397 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863408 | orchestrator | 2026-04-03 05:41:29.863419 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:41:29.863430 | orchestrator | Friday 03 April 2026 05:41:18 +0000 (0:00:01.017) 0:06:22.609 ********** 2026-04-03 05:41:29.863441 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863452 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863462 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863473 | orchestrator | 2026-04-03 05:41:29.863484 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:41:29.863495 | orchestrator | Friday 03 April 2026 05:41:19 +0000 (0:00:00.731) 0:06:23.340 ********** 2026-04-03 05:41:29.863506 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863517 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863528 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863539 | orchestrator | 2026-04-03 05:41:29.863550 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:41:29.863561 | orchestrator | Friday 03 April 2026 05:41:19 +0000 (0:00:00.326) 0:06:23.667 ********** 2026-04-03 05:41:29.863572 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863582 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863593 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863604 | orchestrator | 2026-04-03 05:41:29.863615 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:41:29.863640 | orchestrator | Friday 03 April 2026 05:41:20 +0000 (0:00:00.320) 0:06:23.988 ********** 2026-04-03 05:41:29.863652 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863663 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863673 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863684 | orchestrator | 2026-04-03 05:41:29.863702 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:41:29.863713 | orchestrator | Friday 03 April 2026 05:41:20 +0000 (0:00:00.630) 0:06:24.619 ********** 2026-04-03 05:41:29.863724 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863735 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863746 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863757 | orchestrator | 2026-04-03 05:41:29.863768 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:41:29.863779 | orchestrator | Friday 03 April 2026 05:41:21 +0000 (0:00:00.347) 0:06:24.966 ********** 2026-04-03 05:41:29.863790 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.863800 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.863811 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.863822 | orchestrator | 2026-04-03 05:41:29.863910 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:41:29.863922 | orchestrator | Friday 03 April 2026 05:41:21 +0000 (0:00:00.339) 0:06:25.305 ********** 2026-04-03 05:41:29.863933 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.863944 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.863955 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.863966 | orchestrator | 2026-04-03 05:41:29.863977 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:41:29.864006 | orchestrator | Friday 03 April 2026 05:41:22 +0000 (0:00:00.617) 0:06:25.923 ********** 2026-04-03 05:41:29.864017 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.864028 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.864039 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.864050 | orchestrator | 2026-04-03 05:41:29.864061 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:41:29.864072 | orchestrator | Friday 03 April 2026 05:41:22 +0000 (0:00:00.329) 0:06:26.253 ********** 2026-04-03 05:41:29.864083 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.864094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.864105 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.864116 | orchestrator | 2026-04-03 05:41:29.864126 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:41:29.864138 | orchestrator | Friday 03 April 2026 05:41:22 +0000 (0:00:00.321) 0:06:26.574 ********** 2026-04-03 05:41:29.864148 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.864159 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.864170 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.864181 | orchestrator | 2026-04-03 05:41:29.864192 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:41:29.864203 | orchestrator | Friday 03 April 2026 05:41:23 +0000 (0:00:00.365) 0:06:26.940 ********** 2026-04-03 05:41:29.864214 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.864225 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.864236 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.864247 | orchestrator | 2026-04-03 05:41:29.864258 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-03 05:41:29.864269 | orchestrator | Friday 03 April 2026 05:41:23 +0000 (0:00:00.815) 0:06:27.755 ********** 2026-04-03 05:41:29.864279 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.864290 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.864301 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.864312 | orchestrator | 2026-04-03 05:41:29.864323 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-03 05:41:29.864334 | orchestrator | Friday 03 April 2026 05:41:24 +0000 (0:00:00.353) 0:06:28.109 ********** 2026-04-03 05:41:29.864346 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:41:29.864357 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:41:29.864368 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:41:29.864387 | orchestrator | 2026-04-03 05:41:29.864398 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-03 05:41:29.864409 | orchestrator | Friday 03 April 2026 05:41:25 +0000 (0:00:00.913) 0:06:29.023 ********** 2026-04-03 05:41:29.864420 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:41:29.864431 | orchestrator | 2026-04-03 05:41:29.864442 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-03 05:41:29.864453 | orchestrator | Friday 03 April 2026 05:41:25 +0000 (0:00:00.780) 0:06:29.803 ********** 2026-04-03 05:41:29.864464 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.864475 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.864486 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.864497 | orchestrator | 2026-04-03 05:41:29.864508 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-03 05:41:29.864518 | orchestrator | Friday 03 April 2026 05:41:26 +0000 (0:00:00.357) 0:06:30.160 ********** 2026-04-03 05:41:29.864529 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:41:29.864540 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:41:29.864551 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:41:29.864562 | orchestrator | 2026-04-03 05:41:29.864573 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-03 05:41:29.864584 | orchestrator | Friday 03 April 2026 05:41:26 +0000 (0:00:00.342) 0:06:30.503 ********** 2026-04-03 05:41:29.864595 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.864606 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.864617 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.864628 | orchestrator | 2026-04-03 05:41:29.864639 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-03 05:41:29.864650 | orchestrator | Friday 03 April 2026 05:41:27 +0000 (0:00:00.607) 0:06:31.110 ********** 2026-04-03 05:41:29.864660 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:41:29.864671 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:41:29.864682 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:41:29.864693 | orchestrator | 2026-04-03 05:41:29.864710 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-03 05:41:29.864721 | orchestrator | Friday 03 April 2026 05:41:27 +0000 (0:00:00.638) 0:06:31.749 ********** 2026-04-03 05:41:29.864732 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 05:41:29.864744 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 05:41:29.864755 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 05:41:29.864766 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 05:41:29.864777 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 05:41:29.864788 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 05:41:29.864798 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 05:41:29.864809 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 05:41:29.864821 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 05:41:29.864856 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 05:42:33.668395 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 05:42:33.668513 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 05:42:33.668531 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 05:42:33.668544 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 05:42:33.668578 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 05:42:33.668590 | orchestrator | 2026-04-03 05:42:33.668602 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-03 05:42:33.668613 | orchestrator | Friday 03 April 2026 05:41:29 +0000 (0:00:01.912) 0:06:33.662 ********** 2026-04-03 05:42:33.668624 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:42:33.668636 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:42:33.668647 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:42:33.668658 | orchestrator | 2026-04-03 05:42:33.668669 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-03 05:42:33.668680 | orchestrator | Friday 03 April 2026 05:41:30 +0000 (0:00:00.307) 0:06:33.969 ********** 2026-04-03 05:42:33.668691 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:42:33.668703 | orchestrator | 2026-04-03 05:42:33.668714 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-03 05:42:33.668724 | orchestrator | Friday 03 April 2026 05:41:30 +0000 (0:00:00.810) 0:06:34.779 ********** 2026-04-03 05:42:33.668735 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 05:42:33.668747 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 05:42:33.668759 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 05:42:33.668780 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-03 05:42:33.668799 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-03 05:42:33.668815 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-03 05:42:33.668826 | orchestrator | 2026-04-03 05:42:33.668877 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-03 05:42:33.668889 | orchestrator | Friday 03 April 2026 05:41:31 +0000 (0:00:00.957) 0:06:35.736 ********** 2026-04-03 05:42:33.668899 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:42:33.668910 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:42:33.668921 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:42:33.668941 | orchestrator | 2026-04-03 05:42:33.668961 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-03 05:42:33.668980 | orchestrator | Friday 03 April 2026 05:41:33 +0000 (0:00:01.873) 0:06:37.610 ********** 2026-04-03 05:42:33.669000 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 05:42:33.669020 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:42:33.669039 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:42:33.669060 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 05:42:33.669081 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 05:42:33.669100 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:42:33.669117 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 05:42:33.669136 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 05:42:33.669155 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:42:33.669174 | orchestrator | 2026-04-03 05:42:33.669187 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-03 05:42:33.669198 | orchestrator | Friday 03 April 2026 05:41:34 +0000 (0:00:01.146) 0:06:38.757 ********** 2026-04-03 05:42:33.669208 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:42:33.669219 | orchestrator | 2026-04-03 05:42:33.669230 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-03 05:42:33.669241 | orchestrator | Friday 03 April 2026 05:41:36 +0000 (0:00:01.898) 0:06:40.656 ********** 2026-04-03 05:42:33.669270 | orchestrator | included: /ansible/roles/ceph-osd/tasks/scenarios/lvm.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:42:33.669290 | orchestrator | 2026-04-03 05:42:33.669323 | orchestrator | TASK [ceph-osd : Use ceph-volume to create osds] ******************************* 2026-04-03 05:42:33.669339 | orchestrator | Friday 03 April 2026 05:41:37 +0000 (0:00:00.847) 0:06:41.503 ********** 2026-04-03 05:42:33.669351 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}) 2026-04-03 05:42:33.669363 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}) 2026-04-03 05:42:33.669374 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}) 2026-04-03 05:42:33.669385 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}) 2026-04-03 05:42:33.669396 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}) 2026-04-03 05:42:33.669426 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}) 2026-04-03 05:42:33.669438 | orchestrator | 2026-04-03 05:42:33.669449 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-03 05:42:33.669459 | orchestrator | Friday 03 April 2026 05:42:16 +0000 (0:00:39.106) 0:07:20.610 ********** 2026-04-03 05:42:33.669470 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:42:33.669481 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:42:33.669492 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:42:33.669505 | orchestrator | 2026-04-03 05:42:33.669523 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-03 05:42:33.669541 | orchestrator | Friday 03 April 2026 05:42:17 +0000 (0:00:00.329) 0:07:20.940 ********** 2026-04-03 05:42:33.669559 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:42:33.669576 | orchestrator | 2026-04-03 05:42:33.669592 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-03 05:42:33.669603 | orchestrator | Friday 03 April 2026 05:42:17 +0000 (0:00:00.819) 0:07:21.760 ********** 2026-04-03 05:42:33.669613 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:42:33.669624 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:42:33.669635 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:42:33.669646 | orchestrator | 2026-04-03 05:42:33.669657 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-03 05:42:33.669668 | orchestrator | Friday 03 April 2026 05:42:18 +0000 (0:00:00.637) 0:07:22.397 ********** 2026-04-03 05:42:33.669679 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:42:33.669690 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:42:33.669701 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:42:33.669712 | orchestrator | 2026-04-03 05:42:33.669722 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-03 05:42:33.669734 | orchestrator | Friday 03 April 2026 05:42:21 +0000 (0:00:02.437) 0:07:24.834 ********** 2026-04-03 05:42:33.669744 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:42:33.669756 | orchestrator | 2026-04-03 05:42:33.669767 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-03 05:42:33.669777 | orchestrator | Friday 03 April 2026 05:42:21 +0000 (0:00:00.904) 0:07:25.738 ********** 2026-04-03 05:42:33.669788 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:42:33.669799 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:42:33.669810 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:42:33.669821 | orchestrator | 2026-04-03 05:42:33.669875 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-03 05:42:33.669888 | orchestrator | Friday 03 April 2026 05:42:23 +0000 (0:00:01.192) 0:07:26.930 ********** 2026-04-03 05:42:33.669911 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:42:33.669930 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:42:33.669954 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:42:33.669978 | orchestrator | 2026-04-03 05:42:33.669996 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-03 05:42:33.670013 | orchestrator | Friday 03 April 2026 05:42:24 +0000 (0:00:01.138) 0:07:28.069 ********** 2026-04-03 05:42:33.670106 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:42:33.670127 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:42:33.670145 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:42:33.670164 | orchestrator | 2026-04-03 05:42:33.670176 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-03 05:42:33.670187 | orchestrator | Friday 03 April 2026 05:42:26 +0000 (0:00:01.983) 0:07:30.053 ********** 2026-04-03 05:42:33.670198 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:42:33.670208 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:42:33.670219 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:42:33.670230 | orchestrator | 2026-04-03 05:42:33.670240 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-03 05:42:33.670251 | orchestrator | Friday 03 April 2026 05:42:26 +0000 (0:00:00.368) 0:07:30.421 ********** 2026-04-03 05:42:33.670262 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:42:33.670272 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:42:33.670283 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:42:33.670294 | orchestrator | 2026-04-03 05:42:33.670304 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-03 05:42:33.670315 | orchestrator | Friday 03 April 2026 05:42:26 +0000 (0:00:00.335) 0:07:30.757 ********** 2026-04-03 05:42:33.670326 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-03 05:42:33.670345 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-03 05:42:33.670356 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-03 05:42:33.670367 | orchestrator | ok: [testbed-node-3] => (item=1) 2026-04-03 05:42:33.670378 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 05:42:33.670388 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-03 05:42:33.670399 | orchestrator | 2026-04-03 05:42:33.670410 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-03 05:42:33.670421 | orchestrator | Friday 03 April 2026 05:42:27 +0000 (0:00:01.011) 0:07:31.768 ********** 2026-04-03 05:42:33.670431 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-03 05:42:33.670442 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-03 05:42:33.670453 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-03 05:42:33.670464 | orchestrator | changed: [testbed-node-3] => (item=1) 2026-04-03 05:42:33.670474 | orchestrator | changed: [testbed-node-4] => (item=0) 2026-04-03 05:42:33.670485 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-03 05:42:33.670496 | orchestrator | 2026-04-03 05:42:33.670507 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-03 05:42:33.670517 | orchestrator | Friday 03 April 2026 05:42:30 +0000 (0:00:02.440) 0:07:34.209 ********** 2026-04-03 05:42:33.670528 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-03 05:42:33.670539 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-03 05:42:33.670549 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-03 05:42:33.670560 | orchestrator | changed: [testbed-node-4] => (item=0) 2026-04-03 05:42:33.670582 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-03 05:43:04.768636 | orchestrator | changed: [testbed-node-3] => (item=1) 2026-04-03 05:43:04.768778 | orchestrator | 2026-04-03 05:43:04.768793 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-03 05:43:04.768806 | orchestrator | Friday 03 April 2026 05:42:33 +0000 (0:00:03.256) 0:07:37.465 ********** 2026-04-03 05:43:04.768817 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.768867 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.768902 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:43:04.768913 | orchestrator | 2026-04-03 05:43:04.768923 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-03 05:43:04.768933 | orchestrator | Friday 03 April 2026 05:42:35 +0000 (0:00:02.148) 0:07:39.613 ********** 2026-04-03 05:43:04.768943 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.768953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.768963 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-03 05:43:04.768975 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:43:04.768985 | orchestrator | 2026-04-03 05:43:04.768995 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-03 05:43:04.769005 | orchestrator | Friday 03 April 2026 05:42:48 +0000 (0:00:13.002) 0:07:52.616 ********** 2026-04-03 05:43:04.769015 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769025 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.769034 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.769044 | orchestrator | 2026-04-03 05:43:04.769055 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:43:04.769064 | orchestrator | Friday 03 April 2026 05:42:49 +0000 (0:00:00.885) 0:07:53.501 ********** 2026-04-03 05:43:04.769074 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769084 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.769094 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.769103 | orchestrator | 2026-04-03 05:43:04.769113 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-03 05:43:04.769123 | orchestrator | Friday 03 April 2026 05:42:50 +0000 (0:00:00.625) 0:07:54.127 ********** 2026-04-03 05:43:04.769133 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:43:04.769143 | orchestrator | 2026-04-03 05:43:04.769153 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-03 05:43:04.769163 | orchestrator | Friday 03 April 2026 05:42:50 +0000 (0:00:00.568) 0:07:54.695 ********** 2026-04-03 05:43:04.769173 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:43:04.769185 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:43:04.769197 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:43:04.769209 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769221 | orchestrator | 2026-04-03 05:43:04.769232 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-03 05:43:04.769244 | orchestrator | Friday 03 April 2026 05:42:51 +0000 (0:00:00.421) 0:07:55.116 ********** 2026-04-03 05:43:04.769256 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769267 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.769279 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.769290 | orchestrator | 2026-04-03 05:43:04.769302 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-03 05:43:04.769314 | orchestrator | Friday 03 April 2026 05:42:51 +0000 (0:00:00.313) 0:07:55.430 ********** 2026-04-03 05:43:04.769325 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769337 | orchestrator | 2026-04-03 05:43:04.769348 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-03 05:43:04.769360 | orchestrator | Friday 03 April 2026 05:42:51 +0000 (0:00:00.237) 0:07:55.667 ********** 2026-04-03 05:43:04.769371 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769382 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.769393 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.769405 | orchestrator | 2026-04-03 05:43:04.769417 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-03 05:43:04.769427 | orchestrator | Friday 03 April 2026 05:42:52 +0000 (0:00:00.630) 0:07:56.298 ********** 2026-04-03 05:43:04.769447 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769458 | orchestrator | 2026-04-03 05:43:04.769483 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-03 05:43:04.769495 | orchestrator | Friday 03 April 2026 05:42:52 +0000 (0:00:00.255) 0:07:56.553 ********** 2026-04-03 05:43:04.769506 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769518 | orchestrator | 2026-04-03 05:43:04.769529 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-03 05:43:04.769545 | orchestrator | Friday 03 April 2026 05:42:52 +0000 (0:00:00.243) 0:07:56.797 ********** 2026-04-03 05:43:04.769560 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769577 | orchestrator | 2026-04-03 05:43:04.769594 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-03 05:43:04.769610 | orchestrator | Friday 03 April 2026 05:42:53 +0000 (0:00:00.141) 0:07:56.938 ********** 2026-04-03 05:43:04.769625 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769641 | orchestrator | 2026-04-03 05:43:04.769657 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-03 05:43:04.769672 | orchestrator | Friday 03 April 2026 05:42:53 +0000 (0:00:00.227) 0:07:57.165 ********** 2026-04-03 05:43:04.769685 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769701 | orchestrator | 2026-04-03 05:43:04.769718 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-03 05:43:04.769734 | orchestrator | Friday 03 April 2026 05:42:53 +0000 (0:00:00.243) 0:07:57.409 ********** 2026-04-03 05:43:04.769751 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:43:04.769762 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:43:04.769790 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:43:04.769801 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769811 | orchestrator | 2026-04-03 05:43:04.769820 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-03 05:43:04.769858 | orchestrator | Friday 03 April 2026 05:42:54 +0000 (0:00:00.442) 0:07:57.851 ********** 2026-04-03 05:43:04.769874 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769884 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.769893 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.769903 | orchestrator | 2026-04-03 05:43:04.769913 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-03 05:43:04.769923 | orchestrator | Friday 03 April 2026 05:42:54 +0000 (0:00:00.676) 0:07:58.527 ********** 2026-04-03 05:43:04.769932 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769942 | orchestrator | 2026-04-03 05:43:04.769952 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-03 05:43:04.769962 | orchestrator | Friday 03 April 2026 05:42:54 +0000 (0:00:00.239) 0:07:58.766 ********** 2026-04-03 05:43:04.769972 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.769981 | orchestrator | 2026-04-03 05:43:04.769991 | orchestrator | PLAY [Apply role ceph-crash] *************************************************** 2026-04-03 05:43:04.770001 | orchestrator | 2026-04-03 05:43:04.770010 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:43:04.770076 | orchestrator | Friday 03 April 2026 05:42:55 +0000 (0:00:00.694) 0:07:59.461 ********** 2026-04-03 05:43:04.770093 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:43:04.770109 | orchestrator | 2026-04-03 05:43:04.770124 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:43:04.770139 | orchestrator | Friday 03 April 2026 05:42:56 +0000 (0:00:01.337) 0:08:00.798 ********** 2026-04-03 05:43:04.770156 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:43:04.770186 | orchestrator | 2026-04-03 05:43:04.770205 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:43:04.770222 | orchestrator | Friday 03 April 2026 05:42:58 +0000 (0:00:01.283) 0:08:02.082 ********** 2026-04-03 05:43:04.770236 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.770246 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.770256 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.770266 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:04.770276 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:04.770286 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:04.770295 | orchestrator | 2026-04-03 05:43:04.770305 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:43:04.770315 | orchestrator | Friday 03 April 2026 05:42:59 +0000 (0:00:01.255) 0:08:03.337 ********** 2026-04-03 05:43:04.770325 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:04.770335 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:04.770344 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:04.770354 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:04.770363 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:04.770373 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:04.770387 | orchestrator | 2026-04-03 05:43:04.770403 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:43:04.770418 | orchestrator | Friday 03 April 2026 05:43:00 +0000 (0:00:00.709) 0:08:04.047 ********** 2026-04-03 05:43:04.770433 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:04.770447 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:04.770462 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:04.770476 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:04.770491 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:04.770508 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:04.770525 | orchestrator | 2026-04-03 05:43:04.770535 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:43:04.770545 | orchestrator | Friday 03 April 2026 05:43:01 +0000 (0:00:00.932) 0:08:04.979 ********** 2026-04-03 05:43:04.770555 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:04.770564 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:04.770574 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:04.770583 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:04.770593 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:04.770602 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:04.770612 | orchestrator | 2026-04-03 05:43:04.770632 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:43:04.770649 | orchestrator | Friday 03 April 2026 05:43:01 +0000 (0:00:00.731) 0:08:05.711 ********** 2026-04-03 05:43:04.770666 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.770684 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.770701 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.770717 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:04.770728 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:04.770738 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:04.770750 | orchestrator | 2026-04-03 05:43:04.770767 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:43:04.770783 | orchestrator | Friday 03 April 2026 05:43:03 +0000 (0:00:01.320) 0:08:07.032 ********** 2026-04-03 05:43:04.770799 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.770815 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.770867 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.770885 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:04.770901 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:04.770919 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:04.770933 | orchestrator | 2026-04-03 05:43:04.770951 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:43:04.770966 | orchestrator | Friday 03 April 2026 05:43:03 +0000 (0:00:00.664) 0:08:07.696 ********** 2026-04-03 05:43:04.770981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:04.771010 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:04.771029 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:04.771046 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:04.771077 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.591977 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592064 | orchestrator | 2026-04-03 05:43:36.592076 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:43:36.592085 | orchestrator | Friday 03 April 2026 05:43:04 +0000 (0:00:00.873) 0:08:08.570 ********** 2026-04-03 05:43:36.592092 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592100 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592106 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592113 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592120 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592127 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592134 | orchestrator | 2026-04-03 05:43:36.592141 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:43:36.592148 | orchestrator | Friday 03 April 2026 05:43:05 +0000 (0:00:01.053) 0:08:09.623 ********** 2026-04-03 05:43:36.592154 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592161 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592168 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592174 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592181 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592187 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592194 | orchestrator | 2026-04-03 05:43:36.592200 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:43:36.592207 | orchestrator | Friday 03 April 2026 05:43:07 +0000 (0:00:01.340) 0:08:10.964 ********** 2026-04-03 05:43:36.592214 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:36.592221 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:36.592228 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:36.592235 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592242 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592248 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592255 | orchestrator | 2026-04-03 05:43:36.592261 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:43:36.592268 | orchestrator | Friday 03 April 2026 05:43:07 +0000 (0:00:00.622) 0:08:11.586 ********** 2026-04-03 05:43:36.592275 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:36.592281 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:36.592288 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:36.592295 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592301 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592308 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592314 | orchestrator | 2026-04-03 05:43:36.592321 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:43:36.592328 | orchestrator | Friday 03 April 2026 05:43:08 +0000 (0:00:00.878) 0:08:12.464 ********** 2026-04-03 05:43:36.592335 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592341 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592348 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592354 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592361 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592368 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592374 | orchestrator | 2026-04-03 05:43:36.592381 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:43:36.592388 | orchestrator | Friday 03 April 2026 05:43:09 +0000 (0:00:00.621) 0:08:13.086 ********** 2026-04-03 05:43:36.592394 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592401 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592408 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592414 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592421 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592445 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592452 | orchestrator | 2026-04-03 05:43:36.592459 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:43:36.592465 | orchestrator | Friday 03 April 2026 05:43:10 +0000 (0:00:00.941) 0:08:14.028 ********** 2026-04-03 05:43:36.592472 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592478 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592485 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592492 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592498 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592505 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592511 | orchestrator | 2026-04-03 05:43:36.592518 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:43:36.592525 | orchestrator | Friday 03 April 2026 05:43:10 +0000 (0:00:00.619) 0:08:14.647 ********** 2026-04-03 05:43:36.592531 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:36.592538 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:36.592544 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:36.592551 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592558 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592564 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592571 | orchestrator | 2026-04-03 05:43:36.592578 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:43:36.592584 | orchestrator | Friday 03 April 2026 05:43:11 +0000 (0:00:00.870) 0:08:15.518 ********** 2026-04-03 05:43:36.592591 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:36.592598 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:36.592604 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:36.592611 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:43:36.592617 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:43:36.592624 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:43:36.592630 | orchestrator | 2026-04-03 05:43:36.592637 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:43:36.592644 | orchestrator | Friday 03 April 2026 05:43:12 +0000 (0:00:00.617) 0:08:16.136 ********** 2026-04-03 05:43:36.592650 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:43:36.592657 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:43:36.592663 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:43:36.592670 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592676 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592683 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592690 | orchestrator | 2026-04-03 05:43:36.592696 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:43:36.592703 | orchestrator | Friday 03 April 2026 05:43:13 +0000 (0:00:00.903) 0:08:17.039 ********** 2026-04-03 05:43:36.592710 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592716 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592723 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592729 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592748 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592755 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592762 | orchestrator | 2026-04-03 05:43:36.592769 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:43:36.592775 | orchestrator | Friday 03 April 2026 05:43:13 +0000 (0:00:00.637) 0:08:17.677 ********** 2026-04-03 05:43:36.592782 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.592789 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.592795 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.592892 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.592911 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.592921 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.592928 | orchestrator | 2026-04-03 05:43:36.592935 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-03 05:43:36.592942 | orchestrator | Friday 03 April 2026 05:43:15 +0000 (0:00:01.345) 0:08:19.023 ********** 2026-04-03 05:43:36.592955 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:43:36.592962 | orchestrator | 2026-04-03 05:43:36.592969 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-03 05:43:36.592975 | orchestrator | Friday 03 April 2026 05:43:19 +0000 (0:00:04.288) 0:08:23.311 ********** 2026-04-03 05:43:36.592982 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:43:36.592989 | orchestrator | 2026-04-03 05:43:36.592995 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-03 05:43:36.593002 | orchestrator | Friday 03 April 2026 05:43:21 +0000 (0:00:01.890) 0:08:25.202 ********** 2026-04-03 05:43:36.593009 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:43:36.593015 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:43:36.593022 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:43:36.593029 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.593035 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:43:36.593042 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:43:36.593048 | orchestrator | 2026-04-03 05:43:36.593055 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-03 05:43:36.593062 | orchestrator | Friday 03 April 2026 05:43:22 +0000 (0:00:01.461) 0:08:26.663 ********** 2026-04-03 05:43:36.593068 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:43:36.593075 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:43:36.593081 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:43:36.593088 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:43:36.593094 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:43:36.593101 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:43:36.593108 | orchestrator | 2026-04-03 05:43:36.593114 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-03 05:43:36.593121 | orchestrator | Friday 03 April 2026 05:43:24 +0000 (0:00:01.279) 0:08:27.942 ********** 2026-04-03 05:43:36.593129 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:43:36.593137 | orchestrator | 2026-04-03 05:43:36.593144 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-03 05:43:36.593151 | orchestrator | Friday 03 April 2026 05:43:25 +0000 (0:00:01.341) 0:08:29.284 ********** 2026-04-03 05:43:36.593158 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:43:36.593164 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:43:36.593171 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:43:36.593177 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:43:36.593184 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:43:36.593190 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:43:36.593197 | orchestrator | 2026-04-03 05:43:36.593204 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-03 05:43:36.593210 | orchestrator | Friday 03 April 2026 05:43:27 +0000 (0:00:01.536) 0:08:30.820 ********** 2026-04-03 05:43:36.593217 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:43:36.593224 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:43:36.593230 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:43:36.593237 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:43:36.593243 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:43:36.593250 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:43:36.593256 | orchestrator | 2026-04-03 05:43:36.593263 | orchestrator | RUNNING HANDLER [ceph-handler : Ceph crash handler] **************************** 2026-04-03 05:43:36.593270 | orchestrator | Friday 03 April 2026 05:43:30 +0000 (0:00:03.714) 0:08:34.534 ********** 2026-04-03 05:43:36.593280 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_crash.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:43:36.593287 | orchestrator | 2026-04-03 05:43:36.593294 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called before restart] ****** 2026-04-03 05:43:36.593306 | orchestrator | Friday 03 April 2026 05:43:32 +0000 (0:00:01.365) 0:08:35.899 ********** 2026-04-03 05:43:36.593312 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.593319 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.593326 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.593332 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.593339 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:43:36.593345 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:43:36.593352 | orchestrator | 2026-04-03 05:43:36.593359 | orchestrator | RUNNING HANDLER [ceph-handler : Restart the ceph-crash service] **************** 2026-04-03 05:43:36.593365 | orchestrator | Friday 03 April 2026 05:43:32 +0000 (0:00:00.685) 0:08:36.585 ********** 2026-04-03 05:43:36.593372 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:43:36.593378 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:43:36.593385 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:43:36.593392 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:43:36.593398 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:43:36.593405 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:43:36.593411 | orchestrator | 2026-04-03 05:43:36.593418 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called after restart] ******* 2026-04-03 05:43:36.593425 | orchestrator | Friday 03 April 2026 05:43:35 +0000 (0:00:02.605) 0:08:39.191 ********** 2026-04-03 05:43:36.593431 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:43:36.593438 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:43:36.593444 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:43:36.593451 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:43:36.593464 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:44:03.845660 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:44:03.845759 | orchestrator | 2026-04-03 05:44:03.845772 | orchestrator | PLAY [Apply role ceph-mds] ***************************************************** 2026-04-03 05:44:03.845781 | orchestrator | 2026-04-03 05:44:03.845789 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:44:03.845797 | orchestrator | Friday 03 April 2026 05:43:36 +0000 (0:00:01.201) 0:08:40.392 ********** 2026-04-03 05:44:03.845805 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:03.845813 | orchestrator | 2026-04-03 05:44:03.845820 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:44:03.845828 | orchestrator | Friday 03 April 2026 05:43:37 +0000 (0:00:00.536) 0:08:40.929 ********** 2026-04-03 05:44:03.845863 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:03.845870 | orchestrator | 2026-04-03 05:44:03.845877 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:44:03.845884 | orchestrator | Friday 03 April 2026 05:43:37 +0000 (0:00:00.779) 0:08:41.708 ********** 2026-04-03 05:44:03.845891 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.845898 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.845904 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.845910 | orchestrator | 2026-04-03 05:44:03.845917 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:44:03.845923 | orchestrator | Friday 03 April 2026 05:43:38 +0000 (0:00:00.331) 0:08:42.040 ********** 2026-04-03 05:44:03.845929 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.845936 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.845942 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.845948 | orchestrator | 2026-04-03 05:44:03.845955 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:44:03.845962 | orchestrator | Friday 03 April 2026 05:43:38 +0000 (0:00:00.713) 0:08:42.753 ********** 2026-04-03 05:44:03.845969 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.845974 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.845980 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.845985 | orchestrator | 2026-04-03 05:44:03.845990 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:44:03.846061 | orchestrator | Friday 03 April 2026 05:43:39 +0000 (0:00:00.714) 0:08:43.468 ********** 2026-04-03 05:44:03.846071 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846076 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846083 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846088 | orchestrator | 2026-04-03 05:44:03.846095 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:44:03.846101 | orchestrator | Friday 03 April 2026 05:43:40 +0000 (0:00:01.049) 0:08:44.518 ********** 2026-04-03 05:44:03.846106 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846113 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846118 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846124 | orchestrator | 2026-04-03 05:44:03.846131 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:44:03.846137 | orchestrator | Friday 03 April 2026 05:43:41 +0000 (0:00:00.344) 0:08:44.863 ********** 2026-04-03 05:44:03.846143 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846150 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846154 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846158 | orchestrator | 2026-04-03 05:44:03.846162 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:44:03.846166 | orchestrator | Friday 03 April 2026 05:43:41 +0000 (0:00:00.325) 0:08:45.188 ********** 2026-04-03 05:44:03.846170 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846174 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846178 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846182 | orchestrator | 2026-04-03 05:44:03.846186 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:44:03.846190 | orchestrator | Friday 03 April 2026 05:43:41 +0000 (0:00:00.310) 0:08:45.498 ********** 2026-04-03 05:44:03.846194 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846198 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846202 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846205 | orchestrator | 2026-04-03 05:44:03.846209 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:44:03.846224 | orchestrator | Friday 03 April 2026 05:43:42 +0000 (0:00:01.054) 0:08:46.552 ********** 2026-04-03 05:44:03.846229 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846233 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846238 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846242 | orchestrator | 2026-04-03 05:44:03.846246 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:44:03.846251 | orchestrator | Friday 03 April 2026 05:43:43 +0000 (0:00:00.721) 0:08:47.274 ********** 2026-04-03 05:44:03.846255 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846260 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846264 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846268 | orchestrator | 2026-04-03 05:44:03.846273 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:44:03.846277 | orchestrator | Friday 03 April 2026 05:43:43 +0000 (0:00:00.318) 0:08:47.592 ********** 2026-04-03 05:44:03.846282 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846286 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846291 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846295 | orchestrator | 2026-04-03 05:44:03.846300 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:44:03.846306 | orchestrator | Friday 03 April 2026 05:43:44 +0000 (0:00:00.334) 0:08:47.927 ********** 2026-04-03 05:44:03.846312 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846318 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846324 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846331 | orchestrator | 2026-04-03 05:44:03.846337 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:44:03.846344 | orchestrator | Friday 03 April 2026 05:43:44 +0000 (0:00:00.657) 0:08:48.584 ********** 2026-04-03 05:44:03.846376 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846384 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846391 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846397 | orchestrator | 2026-04-03 05:44:03.846403 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:44:03.846407 | orchestrator | Friday 03 April 2026 05:43:45 +0000 (0:00:00.340) 0:08:48.925 ********** 2026-04-03 05:44:03.846411 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846414 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846418 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846422 | orchestrator | 2026-04-03 05:44:03.846425 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:44:03.846429 | orchestrator | Friday 03 April 2026 05:43:45 +0000 (0:00:00.334) 0:08:49.259 ********** 2026-04-03 05:44:03.846433 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846437 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846440 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846444 | orchestrator | 2026-04-03 05:44:03.846448 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:44:03.846452 | orchestrator | Friday 03 April 2026 05:43:45 +0000 (0:00:00.334) 0:08:49.594 ********** 2026-04-03 05:44:03.846455 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846459 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846463 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846467 | orchestrator | 2026-04-03 05:44:03.846470 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:44:03.846474 | orchestrator | Friday 03 April 2026 05:43:46 +0000 (0:00:00.616) 0:08:50.210 ********** 2026-04-03 05:44:03.846478 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846482 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846485 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846490 | orchestrator | 2026-04-03 05:44:03.846496 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:44:03.846502 | orchestrator | Friday 03 April 2026 05:43:46 +0000 (0:00:00.325) 0:08:50.536 ********** 2026-04-03 05:44:03.846508 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846515 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846521 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846528 | orchestrator | 2026-04-03 05:44:03.846534 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:44:03.846541 | orchestrator | Friday 03 April 2026 05:43:47 +0000 (0:00:00.360) 0:08:50.896 ********** 2026-04-03 05:44:03.846547 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:03.846551 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:03.846554 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:03.846558 | orchestrator | 2026-04-03 05:44:03.846562 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-03 05:44:03.846566 | orchestrator | Friday 03 April 2026 05:43:47 +0000 (0:00:00.855) 0:08:51.752 ********** 2026-04-03 05:44:03.846569 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:03.846573 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:03.846577 | orchestrator | included: /ansible/roles/ceph-mds/tasks/create_mds_filesystems.yml for testbed-node-3 2026-04-03 05:44:03.846582 | orchestrator | 2026-04-03 05:44:03.846586 | orchestrator | TASK [ceph-facts : Get current default crush rule details] ********************* 2026-04-03 05:44:03.846590 | orchestrator | Friday 03 April 2026 05:43:48 +0000 (0:00:00.489) 0:08:52.241 ********** 2026-04-03 05:44:03.846594 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:44:03.846598 | orchestrator | 2026-04-03 05:44:03.846602 | orchestrator | TASK [ceph-facts : Get current default crush rule name] ************************ 2026-04-03 05:44:03.846605 | orchestrator | Friday 03 April 2026 05:43:50 +0000 (0:00:01.990) 0:08:54.232 ********** 2026-04-03 05:44:03.846611 | orchestrator | skipping: [testbed-node-3] => (item={'rule_id': 0, 'rule_name': 'replicated_rule', 'type': 1, 'steps': [{'op': 'take', 'item': -1, 'item_name': 'default'}, {'op': 'chooseleaf_firstn', 'num': 0, 'type': 'host'}, {'op': 'emit'}]})  2026-04-03 05:44:03.846622 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:03.846626 | orchestrator | 2026-04-03 05:44:03.846629 | orchestrator | TASK [ceph-mds : Create filesystem pools] ************************************** 2026-04-03 05:44:03.846634 | orchestrator | Friday 03 April 2026 05:43:50 +0000 (0:00:00.244) 0:08:54.477 ********** 2026-04-03 05:44:03.846647 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_data', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:44:03.846660 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_metadata', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:44:03.846667 | orchestrator | 2026-04-03 05:44:03.846674 | orchestrator | TASK [ceph-mds : Create ceph filesystem] *************************************** 2026-04-03 05:44:03.846681 | orchestrator | Friday 03 April 2026 05:43:58 +0000 (0:00:07.545) 0:09:02.023 ********** 2026-04-03 05:44:03.846687 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 05:44:03.846693 | orchestrator | 2026-04-03 05:44:03.846700 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-03 05:44:03.846706 | orchestrator | Friday 03 April 2026 05:44:02 +0000 (0:00:04.023) 0:09:06.047 ********** 2026-04-03 05:44:03.846712 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:03.846719 | orchestrator | 2026-04-03 05:44:03.846725 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-03 05:44:03.846732 | orchestrator | Friday 03 April 2026 05:44:02 +0000 (0:00:00.568) 0:09:06.616 ********** 2026-04-03 05:44:03.846742 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 05:44:30.007463 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 05:44:30.007564 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 05:44:30.007575 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-03 05:44:30.007584 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-03 05:44:30.007591 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-03 05:44:30.007598 | orchestrator | 2026-04-03 05:44:30.007606 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-03 05:44:30.007614 | orchestrator | Friday 03 April 2026 05:44:03 +0000 (0:00:01.032) 0:09:07.649 ********** 2026-04-03 05:44:30.007621 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:30.007628 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:44:30.007635 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:44:30.007641 | orchestrator | 2026-04-03 05:44:30.007647 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-03 05:44:30.007653 | orchestrator | Friday 03 April 2026 05:44:05 +0000 (0:00:02.040) 0:09:09.689 ********** 2026-04-03 05:44:30.007661 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 05:44:30.007669 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:44:30.007677 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.007684 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 05:44:30.007691 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 05:44:30.007698 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.007704 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 05:44:30.007710 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 05:44:30.007737 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.007744 | orchestrator | 2026-04-03 05:44:30.007751 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-03 05:44:30.007757 | orchestrator | Friday 03 April 2026 05:44:07 +0000 (0:00:01.519) 0:09:11.208 ********** 2026-04-03 05:44:30.007763 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.007769 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.007776 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.007782 | orchestrator | 2026-04-03 05:44:30.007789 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-03 05:44:30.007796 | orchestrator | Friday 03 April 2026 05:44:10 +0000 (0:00:02.637) 0:09:13.846 ********** 2026-04-03 05:44:30.007803 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.007808 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:30.007814 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:30.007821 | orchestrator | 2026-04-03 05:44:30.007828 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-03 05:44:30.007902 | orchestrator | Friday 03 April 2026 05:44:10 +0000 (0:00:00.307) 0:09:14.153 ********** 2026-04-03 05:44:30.007911 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:30.007917 | orchestrator | 2026-04-03 05:44:30.007923 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-03 05:44:30.007930 | orchestrator | Friday 03 April 2026 05:44:11 +0000 (0:00:00.864) 0:09:15.018 ********** 2026-04-03 05:44:30.007936 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:30.007944 | orchestrator | 2026-04-03 05:44:30.007950 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-03 05:44:30.007957 | orchestrator | Friday 03 April 2026 05:44:11 +0000 (0:00:00.563) 0:09:15.582 ********** 2026-04-03 05:44:30.007964 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.007971 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.007977 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.007983 | orchestrator | 2026-04-03 05:44:30.007990 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-03 05:44:30.008013 | orchestrator | Friday 03 April 2026 05:44:13 +0000 (0:00:01.250) 0:09:16.832 ********** 2026-04-03 05:44:30.008020 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.008028 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.008035 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.008042 | orchestrator | 2026-04-03 05:44:30.008049 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-03 05:44:30.008056 | orchestrator | Friday 03 April 2026 05:44:14 +0000 (0:00:01.478) 0:09:18.311 ********** 2026-04-03 05:44:30.008063 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.008071 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.008078 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.008085 | orchestrator | 2026-04-03 05:44:30.008092 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-03 05:44:30.008099 | orchestrator | Friday 03 April 2026 05:44:16 +0000 (0:00:01.675) 0:09:19.986 ********** 2026-04-03 05:44:30.008107 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.008114 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.008121 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.008128 | orchestrator | 2026-04-03 05:44:30.008136 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-03 05:44:30.008143 | orchestrator | Friday 03 April 2026 05:44:18 +0000 (0:00:01.859) 0:09:21.845 ********** 2026-04-03 05:44:30.008150 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008158 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008166 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008173 | orchestrator | 2026-04-03 05:44:30.008180 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:44:30.008195 | orchestrator | Friday 03 April 2026 05:44:19 +0000 (0:00:01.582) 0:09:23.428 ********** 2026-04-03 05:44:30.008203 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.008211 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.008235 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.008243 | orchestrator | 2026-04-03 05:44:30.008250 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-03 05:44:30.008258 | orchestrator | Friday 03 April 2026 05:44:20 +0000 (0:00:00.689) 0:09:24.117 ********** 2026-04-03 05:44:30.008264 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:30.008271 | orchestrator | 2026-04-03 05:44:30.008278 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-03 05:44:30.008285 | orchestrator | Friday 03 April 2026 05:44:21 +0000 (0:00:00.823) 0:09:24.941 ********** 2026-04-03 05:44:30.008293 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008301 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008308 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008314 | orchestrator | 2026-04-03 05:44:30.008322 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-03 05:44:30.008329 | orchestrator | Friday 03 April 2026 05:44:21 +0000 (0:00:00.353) 0:09:25.294 ********** 2026-04-03 05:44:30.008337 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:30.008344 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:30.008351 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:30.008359 | orchestrator | 2026-04-03 05:44:30.008367 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-03 05:44:30.008374 | orchestrator | Friday 03 April 2026 05:44:22 +0000 (0:00:01.219) 0:09:26.514 ********** 2026-04-03 05:44:30.008381 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:44:30.008387 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:44:30.008394 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:44:30.008400 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.008407 | orchestrator | 2026-04-03 05:44:30.008414 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-03 05:44:30.008419 | orchestrator | Friday 03 April 2026 05:44:23 +0000 (0:00:00.897) 0:09:27.411 ********** 2026-04-03 05:44:30.008425 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008431 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008437 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008442 | orchestrator | 2026-04-03 05:44:30.008448 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-03 05:44:30.008454 | orchestrator | 2026-04-03 05:44:30.008461 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 05:44:30.008467 | orchestrator | Friday 03 April 2026 05:44:24 +0000 (0:00:00.873) 0:09:28.285 ********** 2026-04-03 05:44:30.008475 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:30.008483 | orchestrator | 2026-04-03 05:44:30.008489 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 05:44:30.008496 | orchestrator | Friday 03 April 2026 05:44:25 +0000 (0:00:00.549) 0:09:28.834 ********** 2026-04-03 05:44:30.008503 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:30.008510 | orchestrator | 2026-04-03 05:44:30.008516 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 05:44:30.008522 | orchestrator | Friday 03 April 2026 05:44:25 +0000 (0:00:00.803) 0:09:29.638 ********** 2026-04-03 05:44:30.008528 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.008535 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:30.008542 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:30.008557 | orchestrator | 2026-04-03 05:44:30.008564 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 05:44:30.008571 | orchestrator | Friday 03 April 2026 05:44:26 +0000 (0:00:00.332) 0:09:29.971 ********** 2026-04-03 05:44:30.008578 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008584 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008591 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008598 | orchestrator | 2026-04-03 05:44:30.008604 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 05:44:30.008610 | orchestrator | Friday 03 April 2026 05:44:26 +0000 (0:00:00.705) 0:09:30.676 ********** 2026-04-03 05:44:30.008616 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008629 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008635 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008642 | orchestrator | 2026-04-03 05:44:30.008648 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 05:44:30.008655 | orchestrator | Friday 03 April 2026 05:44:27 +0000 (0:00:01.043) 0:09:31.719 ********** 2026-04-03 05:44:30.008661 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:30.008668 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:30.008675 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:30.008681 | orchestrator | 2026-04-03 05:44:30.008688 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 05:44:30.008695 | orchestrator | Friday 03 April 2026 05:44:28 +0000 (0:00:00.753) 0:09:32.473 ********** 2026-04-03 05:44:30.008702 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.008708 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:30.008714 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:30.008720 | orchestrator | 2026-04-03 05:44:30.008727 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 05:44:30.008733 | orchestrator | Friday 03 April 2026 05:44:29 +0000 (0:00:00.345) 0:09:32.818 ********** 2026-04-03 05:44:30.008740 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.008746 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:30.008753 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:30.008759 | orchestrator | 2026-04-03 05:44:30.008765 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 05:44:30.008771 | orchestrator | Friday 03 April 2026 05:44:29 +0000 (0:00:00.344) 0:09:33.162 ********** 2026-04-03 05:44:30.008778 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:30.008784 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:30.008791 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:30.008797 | orchestrator | 2026-04-03 05:44:30.008811 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 05:44:51.068482 | orchestrator | Friday 03 April 2026 05:44:29 +0000 (0:00:00.648) 0:09:33.811 ********** 2026-04-03 05:44:51.068596 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.068612 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.068641 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.068664 | orchestrator | 2026-04-03 05:44:51.068677 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 05:44:51.068689 | orchestrator | Friday 03 April 2026 05:44:30 +0000 (0:00:00.742) 0:09:34.554 ********** 2026-04-03 05:44:51.068700 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.068711 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.068722 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.068733 | orchestrator | 2026-04-03 05:44:51.068745 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 05:44:51.068759 | orchestrator | Friday 03 April 2026 05:44:31 +0000 (0:00:00.746) 0:09:35.301 ********** 2026-04-03 05:44:51.068778 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.068796 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.068807 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.068818 | orchestrator | 2026-04-03 05:44:51.068829 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 05:44:51.068908 | orchestrator | Friday 03 April 2026 05:44:31 +0000 (0:00:00.324) 0:09:35.626 ********** 2026-04-03 05:44:51.068921 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.068932 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.068944 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.068955 | orchestrator | 2026-04-03 05:44:51.068966 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 05:44:51.068977 | orchestrator | Friday 03 April 2026 05:44:32 +0000 (0:00:00.598) 0:09:36.224 ********** 2026-04-03 05:44:51.068988 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.068999 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.069010 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.069021 | orchestrator | 2026-04-03 05:44:51.069034 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 05:44:51.069047 | orchestrator | Friday 03 April 2026 05:44:32 +0000 (0:00:00.348) 0:09:36.572 ********** 2026-04-03 05:44:51.069060 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.069072 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.069085 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.069097 | orchestrator | 2026-04-03 05:44:51.069110 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 05:44:51.069123 | orchestrator | Friday 03 April 2026 05:44:33 +0000 (0:00:00.361) 0:09:36.934 ********** 2026-04-03 05:44:51.069136 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.069149 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.069163 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.069175 | orchestrator | 2026-04-03 05:44:51.069189 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 05:44:51.069202 | orchestrator | Friday 03 April 2026 05:44:33 +0000 (0:00:00.364) 0:09:37.298 ********** 2026-04-03 05:44:51.069215 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.069227 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.069240 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.069253 | orchestrator | 2026-04-03 05:44:51.069265 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 05:44:51.069278 | orchestrator | Friday 03 April 2026 05:44:34 +0000 (0:00:00.618) 0:09:37.917 ********** 2026-04-03 05:44:51.069291 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.069303 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.069315 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.069325 | orchestrator | 2026-04-03 05:44:51.069336 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 05:44:51.069347 | orchestrator | Friday 03 April 2026 05:44:34 +0000 (0:00:00.331) 0:09:38.249 ********** 2026-04-03 05:44:51.069358 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.069369 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.069380 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.069391 | orchestrator | 2026-04-03 05:44:51.069402 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 05:44:51.069413 | orchestrator | Friday 03 April 2026 05:44:34 +0000 (0:00:00.336) 0:09:38.585 ********** 2026-04-03 05:44:51.069424 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.069435 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.069446 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.069457 | orchestrator | 2026-04-03 05:44:51.069483 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 05:44:51.069494 | orchestrator | Friday 03 April 2026 05:44:35 +0000 (0:00:00.340) 0:09:38.926 ********** 2026-04-03 05:44:51.069505 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:44:51.069516 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:44:51.069527 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:44:51.069538 | orchestrator | 2026-04-03 05:44:51.069549 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-03 05:44:51.069560 | orchestrator | Friday 03 April 2026 05:44:36 +0000 (0:00:00.919) 0:09:39.845 ********** 2026-04-03 05:44:51.069580 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:51.069592 | orchestrator | 2026-04-03 05:44:51.069603 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 05:44:51.069614 | orchestrator | Friday 03 April 2026 05:44:36 +0000 (0:00:00.827) 0:09:40.672 ********** 2026-04-03 05:44:51.069625 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.069636 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:44:51.069648 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:44:51.069659 | orchestrator | 2026-04-03 05:44:51.069670 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 05:44:51.069681 | orchestrator | Friday 03 April 2026 05:44:38 +0000 (0:00:02.125) 0:09:42.798 ********** 2026-04-03 05:44:51.069692 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 05:44:51.069703 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 05:44:51.069714 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:51.069743 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 05:44:51.069755 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 05:44:51.069766 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:51.069777 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 05:44:51.069788 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 05:44:51.069799 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:51.069810 | orchestrator | 2026-04-03 05:44:51.069821 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-03 05:44:51.069832 | orchestrator | Friday 03 April 2026 05:44:40 +0000 (0:00:01.222) 0:09:44.021 ********** 2026-04-03 05:44:51.069862 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:44:51.069873 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:44:51.069884 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:44:51.069895 | orchestrator | 2026-04-03 05:44:51.069906 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-03 05:44:51.069917 | orchestrator | Friday 03 April 2026 05:44:40 +0000 (0:00:00.335) 0:09:44.356 ********** 2026-04-03 05:44:51.069928 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:44:51.069940 | orchestrator | 2026-04-03 05:44:51.069951 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-03 05:44:51.069962 | orchestrator | Friday 03 April 2026 05:44:41 +0000 (0:00:00.835) 0:09:45.192 ********** 2026-04-03 05:44:51.069974 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 05:44:51.069988 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 05:44:51.069999 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 05:44:51.070010 | orchestrator | 2026-04-03 05:44:51.070086 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-03 05:44:51.070098 | orchestrator | Friday 03 April 2026 05:44:42 +0000 (0:00:00.858) 0:09:46.050 ********** 2026-04-03 05:44:51.070109 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070120 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 05:44:51.070131 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070142 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 05:44:51.070196 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070209 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 05:44:51.070221 | orchestrator | 2026-04-03 05:44:51.070231 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 05:44:51.070242 | orchestrator | Friday 03 April 2026 05:44:46 +0000 (0:00:04.227) 0:09:50.278 ********** 2026-04-03 05:44:51.070253 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070264 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:44:51.070275 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070286 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:44:51.070297 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:44:51.070314 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:44:51.070325 | orchestrator | 2026-04-03 05:44:51.070336 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 05:44:51.070347 | orchestrator | Friday 03 April 2026 05:44:48 +0000 (0:00:02.117) 0:09:52.396 ********** 2026-04-03 05:44:51.070358 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 05:44:51.070369 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:44:51.070380 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 05:44:51.070391 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:44:51.070401 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 05:44:51.070412 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:44:51.070423 | orchestrator | 2026-04-03 05:44:51.070434 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-03 05:44:51.070445 | orchestrator | Friday 03 April 2026 05:44:50 +0000 (0:00:01.581) 0:09:53.978 ********** 2026-04-03 05:44:51.070456 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-03 05:44:51.070467 | orchestrator | 2026-04-03 05:44:51.070478 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-03 05:44:51.070489 | orchestrator | Friday 03 April 2026 05:44:50 +0000 (0:00:00.254) 0:09:54.232 ********** 2026-04-03 05:44:51.070500 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:44:51.070512 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:44:51.070531 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460447 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460567 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460585 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.460599 | orchestrator | 2026-04-03 05:45:33.460611 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-03 05:45:33.460624 | orchestrator | Friday 03 April 2026 05:44:51 +0000 (0:00:00.635) 0:09:54.868 ********** 2026-04-03 05:45:33.460636 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460647 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460658 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460692 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460704 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 05:45:33.460715 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.460726 | orchestrator | 2026-04-03 05:45:33.460738 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-03 05:45:33.460749 | orchestrator | Friday 03 April 2026 05:44:51 +0000 (0:00:00.656) 0:09:55.524 ********** 2026-04-03 05:45:33.460760 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 05:45:33.460773 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 05:45:33.460784 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 05:45:33.460795 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 05:45:33.460805 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 05:45:33.460816 | orchestrator | 2026-04-03 05:45:33.460827 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-03 05:45:33.460838 | orchestrator | Friday 03 April 2026 05:45:20 +0000 (0:00:28.618) 0:10:24.142 ********** 2026-04-03 05:45:33.460889 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.460900 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:33.460911 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:33.460922 | orchestrator | 2026-04-03 05:45:33.460933 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-03 05:45:33.460944 | orchestrator | Friday 03 April 2026 05:45:20 +0000 (0:00:00.323) 0:10:24.466 ********** 2026-04-03 05:45:33.460955 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.460966 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:33.460977 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:33.460989 | orchestrator | 2026-04-03 05:45:33.461017 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-03 05:45:33.461030 | orchestrator | Friday 03 April 2026 05:45:21 +0000 (0:00:00.593) 0:10:25.060 ********** 2026-04-03 05:45:33.461043 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:45:33.461056 | orchestrator | 2026-04-03 05:45:33.461069 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-03 05:45:33.461081 | orchestrator | Friday 03 April 2026 05:45:21 +0000 (0:00:00.575) 0:10:25.635 ********** 2026-04-03 05:45:33.461093 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:45:33.461106 | orchestrator | 2026-04-03 05:45:33.461118 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-03 05:45:33.461130 | orchestrator | Friday 03 April 2026 05:45:22 +0000 (0:00:00.794) 0:10:26.430 ********** 2026-04-03 05:45:33.461142 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:45:33.461155 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:45:33.461168 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:45:33.461180 | orchestrator | 2026-04-03 05:45:33.461192 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-03 05:45:33.461204 | orchestrator | Friday 03 April 2026 05:45:23 +0000 (0:00:01.287) 0:10:27.718 ********** 2026-04-03 05:45:33.461225 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:45:33.461237 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:45:33.461249 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:45:33.461262 | orchestrator | 2026-04-03 05:45:33.461274 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-03 05:45:33.461286 | orchestrator | Friday 03 April 2026 05:45:25 +0000 (0:00:01.179) 0:10:28.897 ********** 2026-04-03 05:45:33.461299 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:45:33.461329 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:45:33.461342 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:45:33.461355 | orchestrator | 2026-04-03 05:45:33.461366 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-03 05:45:33.461377 | orchestrator | Friday 03 April 2026 05:45:26 +0000 (0:00:01.702) 0:10:30.600 ********** 2026-04-03 05:45:33.461388 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 05:45:33.461399 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 05:45:33.461424 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 05:45:33.461436 | orchestrator | 2026-04-03 05:45:33.461457 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-03 05:45:33.461468 | orchestrator | Friday 03 April 2026 05:45:30 +0000 (0:00:03.239) 0:10:33.840 ********** 2026-04-03 05:45:33.461479 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.461490 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:33.461501 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:33.461512 | orchestrator | 2026-04-03 05:45:33.461523 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-03 05:45:33.461534 | orchestrator | Friday 03 April 2026 05:45:30 +0000 (0:00:00.353) 0:10:34.193 ********** 2026-04-03 05:45:33.461545 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:45:33.461556 | orchestrator | 2026-04-03 05:45:33.461566 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-03 05:45:33.461577 | orchestrator | Friday 03 April 2026 05:45:31 +0000 (0:00:00.851) 0:10:35.045 ********** 2026-04-03 05:45:33.461588 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:33.461600 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:33.461611 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:33.461622 | orchestrator | 2026-04-03 05:45:33.461633 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-03 05:45:33.461644 | orchestrator | Friday 03 April 2026 05:45:31 +0000 (0:00:00.360) 0:10:35.405 ********** 2026-04-03 05:45:33.461654 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.461665 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:33.461676 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:33.461686 | orchestrator | 2026-04-03 05:45:33.461697 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-03 05:45:33.461708 | orchestrator | Friday 03 April 2026 05:45:31 +0000 (0:00:00.354) 0:10:35.760 ********** 2026-04-03 05:45:33.461719 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:45:33.461731 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:45:33.461741 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:45:33.461752 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:33.461763 | orchestrator | 2026-04-03 05:45:33.461774 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-03 05:45:33.461785 | orchestrator | Friday 03 April 2026 05:45:33 +0000 (0:00:01.232) 0:10:36.992 ********** 2026-04-03 05:45:33.461796 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:33.461807 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:33.461825 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:33.461836 | orchestrator | 2026-04-03 05:45:33.461866 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:45:33.461877 | orchestrator | testbed-node-0 : ok=134  changed=35  unreachable=0 failed=0 skipped=125  rescued=0 ignored=0 2026-04-03 05:45:33.461894 | orchestrator | testbed-node-1 : ok=127  changed=31  unreachable=0 failed=0 skipped=120  rescued=0 ignored=0 2026-04-03 05:45:33.461905 | orchestrator | testbed-node-2 : ok=134  changed=33  unreachable=0 failed=0 skipped=119  rescued=0 ignored=0 2026-04-03 05:45:33.461916 | orchestrator | testbed-node-3 : ok=193  changed=45  unreachable=0 failed=0 skipped=162  rescued=0 ignored=0 2026-04-03 05:45:33.461927 | orchestrator | testbed-node-4 : ok=175  changed=40  unreachable=0 failed=0 skipped=123  rescued=0 ignored=0 2026-04-03 05:45:33.461938 | orchestrator | testbed-node-5 : ok=177  changed=41  unreachable=0 failed=0 skipped=121  rescued=0 ignored=0 2026-04-03 05:45:33.461949 | orchestrator | 2026-04-03 05:45:33.461960 | orchestrator | 2026-04-03 05:45:33.461971 | orchestrator | 2026-04-03 05:45:33.461982 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:45:33.461993 | orchestrator | Friday 03 April 2026 05:45:33 +0000 (0:00:00.254) 0:10:37.247 ********** 2026-04-03 05:45:33.462004 | orchestrator | =============================================================================== 2026-04-03 05:45:33.462074 | orchestrator | ceph-container-common : Pulling Ceph container image ------------------- 61.24s 2026-04-03 05:45:33.462087 | orchestrator | ceph-osd : Use ceph-volume to create osds ------------------------------ 39.11s 2026-04-03 05:45:33.462098 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 28.62s 2026-04-03 05:45:33.462109 | orchestrator | ceph-mgr : Wait for all mgr to be up ----------------------------------- 24.20s 2026-04-03 05:45:33.462120 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 21.84s 2026-04-03 05:45:33.462138 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 14.56s 2026-04-03 05:45:33.952446 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 13.00s 2026-04-03 05:45:33.952557 | orchestrator | ceph-mgr : Create ceph mgr keyring(s) on a mon node -------------------- 10.11s 2026-04-03 05:45:33.952575 | orchestrator | ceph-mon : Fetch ceph initial keys -------------------------------------- 8.47s 2026-04-03 05:45:33.952591 | orchestrator | ceph-mds : Create filesystem pools -------------------------------------- 7.55s 2026-04-03 05:45:33.952607 | orchestrator | ceph-mgr : Disable ceph mgr enabled modules ----------------------------- 6.44s 2026-04-03 05:45:33.952623 | orchestrator | ceph-config : Create ceph initial directories --------------------------- 6.09s 2026-04-03 05:45:33.952635 | orchestrator | ceph-mgr : Add modules to ceph-mgr -------------------------------------- 5.33s 2026-04-03 05:45:33.952644 | orchestrator | ceph-crash : Create client.crash keyring -------------------------------- 4.29s 2026-04-03 05:45:33.952653 | orchestrator | ceph-rgw : Create rgw keyrings ------------------------------------------ 4.23s 2026-04-03 05:45:33.952663 | orchestrator | ceph-mds : Create ceph filesystem --------------------------------------- 4.02s 2026-04-03 05:45:33.952672 | orchestrator | ceph-crash : Start the ceph-crash service ------------------------------- 3.71s 2026-04-03 05:45:33.952681 | orchestrator | ceph-container-common : Get ceph version -------------------------------- 3.26s 2026-04-03 05:45:33.952690 | orchestrator | ceph-osd : Systemd start osd -------------------------------------------- 3.26s 2026-04-03 05:45:33.952699 | orchestrator | ceph-rgw : Systemd start rgw container ---------------------------------- 3.24s 2026-04-03 05:45:36.370645 | orchestrator | 2026-04-03 05:45:36 | INFO  | Task bf7d93d8-668d-4cac-9a59-6d261384cbae (ceph-pools) was prepared for execution. 2026-04-03 05:45:36.370770 | orchestrator | 2026-04-03 05:45:36 | INFO  | It takes a moment until task bf7d93d8-668d-4cac-9a59-6d261384cbae (ceph-pools) has been started and output is visible here. 2026-04-03 05:45:50.809314 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 05:45:50.809430 | orchestrator | 2.16.14 2026-04-03 05:45:50.809446 | orchestrator | 2026-04-03 05:45:50.809459 | orchestrator | PLAY [Create ceph pools] ******************************************************* 2026-04-03 05:45:50.809472 | orchestrator | 2026-04-03 05:45:50.809483 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 05:45:50.809495 | orchestrator | Friday 03 April 2026 05:45:40 +0000 (0:00:00.614) 0:00:00.614 ********** 2026-04-03 05:45:50.809507 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:45:50.809519 | orchestrator | 2026-04-03 05:45:50.809530 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 05:45:50.809541 | orchestrator | Friday 03 April 2026 05:45:41 +0000 (0:00:00.666) 0:00:01.280 ********** 2026-04-03 05:45:50.809552 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809564 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809575 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809586 | orchestrator | 2026-04-03 05:45:50.809597 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 05:45:50.809608 | orchestrator | Friday 03 April 2026 05:45:42 +0000 (0:00:00.685) 0:00:01.966 ********** 2026-04-03 05:45:50.809619 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809630 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809641 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809652 | orchestrator | 2026-04-03 05:45:50.809663 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 05:45:50.809674 | orchestrator | Friday 03 April 2026 05:45:42 +0000 (0:00:00.294) 0:00:02.261 ********** 2026-04-03 05:45:50.809685 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809696 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809707 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809718 | orchestrator | 2026-04-03 05:45:50.809747 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 05:45:50.809759 | orchestrator | Friday 03 April 2026 05:45:43 +0000 (0:00:00.825) 0:00:03.086 ********** 2026-04-03 05:45:50.809769 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809780 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809791 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809802 | orchestrator | 2026-04-03 05:45:50.809813 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 05:45:50.809825 | orchestrator | Friday 03 April 2026 05:45:43 +0000 (0:00:00.334) 0:00:03.420 ********** 2026-04-03 05:45:50.809835 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809873 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809887 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809899 | orchestrator | 2026-04-03 05:45:50.809912 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 05:45:50.809925 | orchestrator | Friday 03 April 2026 05:45:44 +0000 (0:00:00.310) 0:00:03.731 ********** 2026-04-03 05:45:50.809937 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.809950 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.809963 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.809976 | orchestrator | 2026-04-03 05:45:50.809990 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 05:45:50.810003 | orchestrator | Friday 03 April 2026 05:45:44 +0000 (0:00:00.336) 0:00:04.068 ********** 2026-04-03 05:45:50.810066 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:50.810080 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:50.810091 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:50.810102 | orchestrator | 2026-04-03 05:45:50.810113 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 05:45:50.810148 | orchestrator | Friday 03 April 2026 05:45:44 +0000 (0:00:00.561) 0:00:04.630 ********** 2026-04-03 05:45:50.810159 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.810170 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.810215 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.810228 | orchestrator | 2026-04-03 05:45:50.810239 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 05:45:50.810250 | orchestrator | Friday 03 April 2026 05:45:45 +0000 (0:00:00.299) 0:00:04.929 ********** 2026-04-03 05:45:50.810261 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:45:50.810272 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:45:50.810283 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:45:50.810294 | orchestrator | 2026-04-03 05:45:50.810305 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 05:45:50.810316 | orchestrator | Friday 03 April 2026 05:45:45 +0000 (0:00:00.677) 0:00:05.607 ********** 2026-04-03 05:45:50.810327 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:50.810338 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:50.810348 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:50.810359 | orchestrator | 2026-04-03 05:45:50.810370 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 05:45:50.810381 | orchestrator | Friday 03 April 2026 05:45:46 +0000 (0:00:00.478) 0:00:06.086 ********** 2026-04-03 05:45:50.810392 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:45:50.810403 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:45:50.810414 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:45:50.810424 | orchestrator | 2026-04-03 05:45:50.810435 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 05:45:50.810446 | orchestrator | Friday 03 April 2026 05:45:48 +0000 (0:00:02.143) 0:00:08.229 ********** 2026-04-03 05:45:50.810458 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 05:45:50.810469 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 05:45:50.810481 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 05:45:50.810492 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:50.810503 | orchestrator | 2026-04-03 05:45:50.810532 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 05:45:50.810544 | orchestrator | Friday 03 April 2026 05:45:49 +0000 (0:00:00.681) 0:00:08.910 ********** 2026-04-03 05:45:50.810557 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810572 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810583 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810594 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:50.810606 | orchestrator | 2026-04-03 05:45:50.810617 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 05:45:50.810628 | orchestrator | Friday 03 April 2026 05:45:50 +0000 (0:00:01.157) 0:00:10.068 ********** 2026-04-03 05:45:50.810648 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810670 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810683 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:50.810694 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:50.810706 | orchestrator | 2026-04-03 05:45:50.810717 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 05:45:50.810728 | orchestrator | Friday 03 April 2026 05:45:50 +0000 (0:00:00.176) 0:00:10.244 ********** 2026-04-03 05:45:50.810742 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '190174266bca', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 05:45:47.291575', 'end': '2026-04-03 05:45:47.332428', 'delta': '0:00:00.040853', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['190174266bca'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 05:45:50.810758 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'a19b2cd80470', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 05:45:47.846812', 'end': '2026-04-03 05:45:47.894801', 'delta': '0:00:00.047989', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a19b2cd80470'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 05:45:50.810778 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '998d77407386', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 05:45:48.374951', 'end': '2026-04-03 05:45:48.419755', 'delta': '0:00:00.044804', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['998d77407386'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 05:45:57.576271 | orchestrator | 2026-04-03 05:45:57.576410 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 05:45:57.576431 | orchestrator | Friday 03 April 2026 05:45:50 +0000 (0:00:00.212) 0:00:10.457 ********** 2026-04-03 05:45:57.576467 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:57.576480 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:45:57.576491 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:45:57.576502 | orchestrator | 2026-04-03 05:45:57.576513 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 05:45:57.576525 | orchestrator | Friday 03 April 2026 05:45:51 +0000 (0:00:00.466) 0:00:10.924 ********** 2026-04-03 05:45:57.576536 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-03 05:45:57.576547 | orchestrator | 2026-04-03 05:45:57.576572 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 05:45:57.576584 | orchestrator | Friday 03 April 2026 05:45:52 +0000 (0:00:01.647) 0:00:12.571 ********** 2026-04-03 05:45:57.576595 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.576606 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.576617 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.576628 | orchestrator | 2026-04-03 05:45:57.576639 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 05:45:57.576650 | orchestrator | Friday 03 April 2026 05:45:53 +0000 (0:00:00.316) 0:00:12.887 ********** 2026-04-03 05:45:57.576661 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.576672 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.576683 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.576694 | orchestrator | 2026-04-03 05:45:57.576705 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 05:45:57.576715 | orchestrator | Friday 03 April 2026 05:45:53 +0000 (0:00:00.711) 0:00:13.599 ********** 2026-04-03 05:45:57.576727 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.576737 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.576748 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.576760 | orchestrator | 2026-04-03 05:45:57.576771 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 05:45:57.576782 | orchestrator | Friday 03 April 2026 05:45:54 +0000 (0:00:00.325) 0:00:13.924 ********** 2026-04-03 05:45:57.576793 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:45:57.576805 | orchestrator | 2026-04-03 05:45:57.576818 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 05:45:57.576831 | orchestrator | Friday 03 April 2026 05:45:54 +0000 (0:00:00.142) 0:00:14.066 ********** 2026-04-03 05:45:57.576879 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.576902 | orchestrator | 2026-04-03 05:45:57.576922 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 05:45:57.576942 | orchestrator | Friday 03 April 2026 05:45:54 +0000 (0:00:00.250) 0:00:14.317 ********** 2026-04-03 05:45:57.576962 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.576976 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.576989 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577001 | orchestrator | 2026-04-03 05:45:57.577013 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 05:45:57.577026 | orchestrator | Friday 03 April 2026 05:45:54 +0000 (0:00:00.316) 0:00:14.633 ********** 2026-04-03 05:45:57.577038 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577050 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577064 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577075 | orchestrator | 2026-04-03 05:45:57.577089 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 05:45:57.577102 | orchestrator | Friday 03 April 2026 05:45:55 +0000 (0:00:00.530) 0:00:15.163 ********** 2026-04-03 05:45:57.577113 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577124 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577135 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577146 | orchestrator | 2026-04-03 05:45:57.577157 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 05:45:57.577168 | orchestrator | Friday 03 April 2026 05:45:55 +0000 (0:00:00.343) 0:00:15.507 ********** 2026-04-03 05:45:57.577191 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577202 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577213 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577225 | orchestrator | 2026-04-03 05:45:57.577236 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 05:45:57.577247 | orchestrator | Friday 03 April 2026 05:45:56 +0000 (0:00:00.339) 0:00:15.847 ********** 2026-04-03 05:45:57.577258 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577269 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577280 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577291 | orchestrator | 2026-04-03 05:45:57.577302 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 05:45:57.577313 | orchestrator | Friday 03 April 2026 05:45:56 +0000 (0:00:00.328) 0:00:16.175 ********** 2026-04-03 05:45:57.577323 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577334 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577345 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577356 | orchestrator | 2026-04-03 05:45:57.577367 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 05:45:57.577378 | orchestrator | Friday 03 April 2026 05:45:57 +0000 (0:00:00.510) 0:00:16.685 ********** 2026-04-03 05:45:57.577389 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.577400 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.577411 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:57.577422 | orchestrator | 2026-04-03 05:45:57.577433 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 05:45:57.577444 | orchestrator | Friday 03 April 2026 05:45:57 +0000 (0:00:00.334) 0:00:17.020 ********** 2026-04-03 05:45:57.577478 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577501 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577514 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577528 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577540 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577559 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577570 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577582 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577593 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.577613 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660381 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660482 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.660521 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660550 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.660571 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660586 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.660605 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660618 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.660629 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660642 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-25-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.660653 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.660672 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.890673 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.890770 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.890784 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.890823 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.890928 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.890952 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.890966 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.890987 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-22-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:57.891000 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:57.891013 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:57.891025 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.891039 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.891051 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:57.891070 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102092 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102195 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102239 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102252 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102263 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102275 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-03 05:45:58.102319 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:58.102343 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:58.102357 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:58.102370 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:58.102382 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-27-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-03 05:45:58.102396 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:45:58.102409 | orchestrator | 2026-04-03 05:45:58.102420 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 05:45:58.102432 | orchestrator | Friday 03 April 2026 05:45:57 +0000 (0:00:00.639) 0:00:17.660 ********** 2026-04-03 05:45:58.102453 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211370 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211469 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211487 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211499 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211510 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211522 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211578 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211592 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211603 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211615 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.211645 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336007 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336145 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336173 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336195 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336265 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336302 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336315 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336328 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-25-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336342 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:45:58.336356 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336368 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336393 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.336415 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450359 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450458 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450512 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450543 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450557 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450569 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450598 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450615 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.450635 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-22-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.610962 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:45:58.611042 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611052 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611058 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611080 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611098 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611104 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611122 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611131 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611147 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:45:58.611159 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:46:08.889665 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:46:08.889802 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-03-04-26-27-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-03 05:46:08.889921 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.889941 | orchestrator | 2026-04-03 05:46:08.889953 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 05:46:08.889967 | orchestrator | Friday 03 April 2026 05:45:58 +0000 (0:00:00.605) 0:00:18.265 ********** 2026-04-03 05:46:08.889978 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:46:08.889989 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:46:08.890000 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:46:08.890011 | orchestrator | 2026-04-03 05:46:08.890087 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 05:46:08.890099 | orchestrator | Friday 03 April 2026 05:45:59 +0000 (0:00:00.947) 0:00:19.213 ********** 2026-04-03 05:46:08.890110 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:46:08.890121 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:46:08.890132 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:46:08.890143 | orchestrator | 2026-04-03 05:46:08.890154 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 05:46:08.890165 | orchestrator | Friday 03 April 2026 05:45:59 +0000 (0:00:00.368) 0:00:19.581 ********** 2026-04-03 05:46:08.890176 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:46:08.890190 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:46:08.890202 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:46:08.890215 | orchestrator | 2026-04-03 05:46:08.890251 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 05:46:08.890270 | orchestrator | Friday 03 April 2026 05:46:00 +0000 (0:00:00.634) 0:00:20.216 ********** 2026-04-03 05:46:08.890290 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.890308 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.890328 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.890345 | orchestrator | 2026-04-03 05:46:08.890364 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 05:46:08.890382 | orchestrator | Friday 03 April 2026 05:46:00 +0000 (0:00:00.291) 0:00:20.507 ********** 2026-04-03 05:46:08.890401 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.890420 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.890439 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.890457 | orchestrator | 2026-04-03 05:46:08.890476 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 05:46:08.890494 | orchestrator | Friday 03 April 2026 05:46:01 +0000 (0:00:00.693) 0:00:21.201 ********** 2026-04-03 05:46:08.890513 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.890532 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.890550 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.890570 | orchestrator | 2026-04-03 05:46:08.890588 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 05:46:08.890608 | orchestrator | Friday 03 April 2026 05:46:01 +0000 (0:00:00.347) 0:00:21.548 ********** 2026-04-03 05:46:08.890626 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 05:46:08.890645 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 05:46:08.890663 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 05:46:08.890682 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 05:46:08.890702 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 05:46:08.890721 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 05:46:08.890740 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 05:46:08.890774 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 05:46:08.890793 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 05:46:08.890814 | orchestrator | 2026-04-03 05:46:08.890831 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 05:46:08.890900 | orchestrator | Friday 03 April 2026 05:46:02 +0000 (0:00:01.075) 0:00:22.624 ********** 2026-04-03 05:46:08.890945 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 05:46:08.890959 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 05:46:08.890970 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 05:46:08.890981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.890991 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 05:46:08.891002 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 05:46:08.891013 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 05:46:08.891024 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.891035 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 05:46:08.891045 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 05:46:08.891056 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 05:46:08.891067 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.891078 | orchestrator | 2026-04-03 05:46:08.891089 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 05:46:08.891100 | orchestrator | Friday 03 April 2026 05:46:03 +0000 (0:00:00.376) 0:00:23.001 ********** 2026-04-03 05:46:08.891111 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:46:08.891122 | orchestrator | 2026-04-03 05:46:08.891133 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 05:46:08.891146 | orchestrator | Friday 03 April 2026 05:46:04 +0000 (0:00:00.789) 0:00:23.790 ********** 2026-04-03 05:46:08.891157 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891168 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.891179 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.891190 | orchestrator | 2026-04-03 05:46:08.891201 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 05:46:08.891211 | orchestrator | Friday 03 April 2026 05:46:04 +0000 (0:00:00.342) 0:00:24.132 ********** 2026-04-03 05:46:08.891222 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891233 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.891244 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.891254 | orchestrator | 2026-04-03 05:46:08.891265 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 05:46:08.891276 | orchestrator | Friday 03 April 2026 05:46:04 +0000 (0:00:00.335) 0:00:24.468 ********** 2026-04-03 05:46:08.891287 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891298 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:46:08.891309 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:46:08.891320 | orchestrator | 2026-04-03 05:46:08.891330 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 05:46:08.891341 | orchestrator | Friday 03 April 2026 05:46:05 +0000 (0:00:00.517) 0:00:24.986 ********** 2026-04-03 05:46:08.891352 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:46:08.891364 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:46:08.891375 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:46:08.891386 | orchestrator | 2026-04-03 05:46:08.891397 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 05:46:08.891408 | orchestrator | Friday 03 April 2026 05:46:05 +0000 (0:00:00.418) 0:00:25.404 ********** 2026-04-03 05:46:08.891419 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:46:08.891440 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:46:08.891459 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:46:08.891471 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891489 | orchestrator | 2026-04-03 05:46:08.891506 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 05:46:08.891523 | orchestrator | Friday 03 April 2026 05:46:06 +0000 (0:00:00.375) 0:00:25.779 ********** 2026-04-03 05:46:08.891543 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:46:08.891559 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:46:08.891570 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:46:08.891581 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891591 | orchestrator | 2026-04-03 05:46:08.891602 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 05:46:08.891613 | orchestrator | Friday 03 April 2026 05:46:06 +0000 (0:00:00.400) 0:00:26.180 ********** 2026-04-03 05:46:08.891624 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 05:46:08.891635 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 05:46:08.891646 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 05:46:08.891657 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:46:08.891667 | orchestrator | 2026-04-03 05:46:08.891678 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 05:46:08.891689 | orchestrator | Friday 03 April 2026 05:46:06 +0000 (0:00:00.399) 0:00:26.579 ********** 2026-04-03 05:46:08.891700 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:46:08.891711 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:46:08.891722 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:46:08.891732 | orchestrator | 2026-04-03 05:46:08.891743 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 05:46:08.891754 | orchestrator | Friday 03 April 2026 05:46:07 +0000 (0:00:00.331) 0:00:26.910 ********** 2026-04-03 05:46:08.891765 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 05:46:08.891776 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 05:46:08.891787 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 05:46:08.891798 | orchestrator | 2026-04-03 05:46:08.891808 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 05:46:08.891819 | orchestrator | Friday 03 April 2026 05:46:08 +0000 (0:00:00.787) 0:00:27.698 ********** 2026-04-03 05:46:08.891830 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:46:08.891878 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:47:44.859522 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:47:44.859624 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 05:47:44.859636 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 05:47:44.859644 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 05:47:44.859652 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 05:47:44.859658 | orchestrator | 2026-04-03 05:47:44.859664 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 05:47:44.859671 | orchestrator | Friday 03 April 2026 05:46:08 +0000 (0:00:00.843) 0:00:28.541 ********** 2026-04-03 05:47:44.859677 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 05:47:44.859683 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 05:47:44.859689 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 05:47:44.859694 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 05:47:44.859721 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 05:47:44.859728 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 05:47:44.859734 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 05:47:44.859740 | orchestrator | 2026-04-03 05:47:44.859746 | orchestrator | TASK [Include tasks from the ceph-osd role] ************************************ 2026-04-03 05:47:44.859752 | orchestrator | Friday 03 April 2026 05:46:10 +0000 (0:00:01.714) 0:00:30.255 ********** 2026-04-03 05:47:44.859758 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:47:44.859765 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:47:44.859771 | orchestrator | included: /ansible/tasks/openstack_config.yml for testbed-node-5 2026-04-03 05:47:44.859777 | orchestrator | 2026-04-03 05:47:44.859784 | orchestrator | TASK [create openstack pool(s)] ************************************************ 2026-04-03 05:47:44.859790 | orchestrator | Friday 03 April 2026 05:46:11 +0000 (0:00:00.565) 0:00:30.821 ********** 2026-04-03 05:47:44.859800 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'backups', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:47:44.859810 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'volumes', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:47:44.859830 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'images', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:47:44.859838 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'metrics', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:47:44.859844 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'vms', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-03 05:47:44.859850 | orchestrator | 2026-04-03 05:47:44.859857 | orchestrator | TASK [generate keys] *********************************************************** 2026-04-03 05:47:44.859926 | orchestrator | Friday 03 April 2026 05:46:54 +0000 (0:00:43.544) 0:01:14.365 ********** 2026-04-03 05:47:44.859932 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859939 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859945 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859950 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859956 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859961 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.859967 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] }}] 2026-04-03 05:47:44.859974 | orchestrator | 2026-04-03 05:47:44.859980 | orchestrator | TASK [get keys from monitors] ************************************************** 2026-04-03 05:47:44.859986 | orchestrator | Friday 03 April 2026 05:47:17 +0000 (0:00:22.371) 0:01:36.737 ********** 2026-04-03 05:47:44.860011 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860027 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860033 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860039 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860045 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860052 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860057 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 05:47:44.860063 | orchestrator | 2026-04-03 05:47:44.860068 | orchestrator | TASK [copy ceph key(s) if needed] ********************************************** 2026-04-03 05:47:44.860074 | orchestrator | Friday 03 April 2026 05:47:28 +0000 (0:00:10.975) 0:01:47.713 ********** 2026-04-03 05:47:44.860080 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860086 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860092 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860097 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860103 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860109 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860114 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860120 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860127 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860133 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860139 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860144 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860150 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860156 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860162 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860167 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 05:47:44.860173 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 05:47:44.860179 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 05:47:44.860186 | orchestrator | changed: [testbed-node-5 -> {{ item.1 }}] 2026-04-03 05:47:44.860192 | orchestrator | 2026-04-03 05:47:44.860198 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:47:44.860210 | orchestrator | testbed-node-3 : ok=25  changed=0 unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-03 05:47:44.860218 | orchestrator | testbed-node-4 : ok=18  changed=0 unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-03 05:47:44.860226 | orchestrator | testbed-node-5 : ok=23  changed=3  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-03 05:47:44.860232 | orchestrator | 2026-04-03 05:47:44.860239 | orchestrator | 2026-04-03 05:47:44.860246 | orchestrator | 2026-04-03 05:47:44.860253 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:47:44.860261 | orchestrator | Friday 03 April 2026 05:47:44 +0000 (0:00:16.771) 0:02:04.484 ********** 2026-04-03 05:47:44.860268 | orchestrator | =============================================================================== 2026-04-03 05:47:44.860282 | orchestrator | create openstack pool(s) ----------------------------------------------- 43.54s 2026-04-03 05:47:44.860289 | orchestrator | generate keys ---------------------------------------------------------- 22.37s 2026-04-03 05:47:44.860296 | orchestrator | copy ceph key(s) if needed --------------------------------------------- 16.77s 2026-04-03 05:47:44.860304 | orchestrator | get keys from monitors ------------------------------------------------- 10.98s 2026-04-03 05:47:44.860311 | orchestrator | ceph-facts : Find a running mon container ------------------------------- 2.14s 2026-04-03 05:47:44.860317 | orchestrator | ceph-facts : Set_fact ceph_admin_command -------------------------------- 1.71s 2026-04-03 05:47:44.860324 | orchestrator | ceph-facts : Get current fsid if cluster is already running ------------- 1.65s 2026-04-03 05:47:44.860330 | orchestrator | ceph-facts : Check if the ceph mon socket is in-use --------------------- 1.16s 2026-04-03 05:47:44.860336 | orchestrator | ceph-facts : Set_fact _monitor_addresses - ipv4 ------------------------- 1.08s 2026-04-03 05:47:44.860342 | orchestrator | ceph-facts : Check if the ceph conf exists ------------------------------ 0.95s 2026-04-03 05:47:44.860348 | orchestrator | ceph-facts : Set_fact ceph_run_cmd -------------------------------------- 0.84s 2026-04-03 05:47:44.860354 | orchestrator | ceph-facts : Check if podman binary is present -------------------------- 0.83s 2026-04-03 05:47:44.860360 | orchestrator | ceph-facts : Import_tasks set_radosgw_address.yml ----------------------- 0.79s 2026-04-03 05:47:44.860375 | orchestrator | ceph-facts : Set_fact rgw_instances ------------------------------------- 0.79s 2026-04-03 05:47:45.197605 | orchestrator | ceph-facts : Get current fsid ------------------------------------------- 0.71s 2026-04-03 05:47:45.197713 | orchestrator | ceph-facts : Read osd pool default crush rule --------------------------- 0.69s 2026-04-03 05:47:45.197727 | orchestrator | ceph-facts : Check if it is atomic host --------------------------------- 0.69s 2026-04-03 05:47:45.197740 | orchestrator | ceph-facts : Check for a ceph mon socket -------------------------------- 0.68s 2026-04-03 05:47:45.197751 | orchestrator | ceph-facts : Set_fact monitor_name ansible_facts['hostname'] ------------ 0.68s 2026-04-03 05:47:45.197762 | orchestrator | ceph-facts : Include facts.yml ------------------------------------------ 0.67s 2026-04-03 05:47:47.534562 | orchestrator | 2026-04-03 05:47:47 | INFO  | Task 3e067da3-fd21-4410-99e9-fa7de7252f28 (copy-ceph-keys) was prepared for execution. 2026-04-03 05:47:47.534637 | orchestrator | 2026-04-03 05:47:47 | INFO  | It takes a moment until task 3e067da3-fd21-4410-99e9-fa7de7252f28 (copy-ceph-keys) has been started and output is visible here. 2026-04-03 05:48:25.522739 | orchestrator | 2026-04-03 05:48:25.522838 | orchestrator | PLAY [Copy ceph keys to the configuration repository] ************************** 2026-04-03 05:48:25.522853 | orchestrator | 2026-04-03 05:48:25.522863 | orchestrator | TASK [Check if ceph keys exist] ************************************************ 2026-04-03 05:48:25.522917 | orchestrator | Friday 03 April 2026 05:47:51 +0000 (0:00:00.130) 0:00:00.130 ********** 2026-04-03 05:48:25.522926 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-03 05:48:25.522937 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.522946 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.522955 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 05:48:25.522964 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.522972 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-03 05:48:25.522981 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-03 05:48:25.522990 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-03 05:48:25.523019 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-03 05:48:25.523028 | orchestrator | 2026-04-03 05:48:25.523037 | orchestrator | TASK [Fetch all ceph keys] ***************************************************** 2026-04-03 05:48:25.523046 | orchestrator | Friday 03 April 2026 05:47:56 +0000 (0:00:04.354) 0:00:04.485 ********** 2026-04-03 05:48:25.523055 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-03 05:48:25.523077 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523086 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523094 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 05:48:25.523103 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523112 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-03 05:48:25.523120 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-03 05:48:25.523129 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-03 05:48:25.523138 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-03 05:48:25.523146 | orchestrator | 2026-04-03 05:48:25.523155 | orchestrator | TASK [Create share directory] ************************************************** 2026-04-03 05:48:25.523164 | orchestrator | Friday 03 April 2026 05:48:00 +0000 (0:00:04.149) 0:00:08.634 ********** 2026-04-03 05:48:25.523173 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-03 05:48:25.523183 | orchestrator | 2026-04-03 05:48:25.523191 | orchestrator | TASK [Write ceph keys to the share directory] ********************************** 2026-04-03 05:48:25.523200 | orchestrator | Friday 03 April 2026 05:48:01 +0000 (0:00:01.034) 0:00:09.669 ********** 2026-04-03 05:48:25.523209 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.admin.keyring) 2026-04-03 05:48:25.523218 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523227 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523236 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 05:48:25.523244 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523253 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.nova.keyring) 2026-04-03 05:48:25.523262 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.glance.keyring) 2026-04-03 05:48:25.523270 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.gnocchi.keyring) 2026-04-03 05:48:25.523279 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.manila.keyring) 2026-04-03 05:48:25.523288 | orchestrator | 2026-04-03 05:48:25.523298 | orchestrator | TASK [Check if target directories exist] *************************************** 2026-04-03 05:48:25.523308 | orchestrator | Friday 03 April 2026 05:48:14 +0000 (0:00:13.386) 0:00:23.055 ********** 2026-04-03 05:48:25.523318 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/infrastructure/files/ceph) 2026-04-03 05:48:25.523328 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-volume) 2026-04-03 05:48:25.523338 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-03 05:48:25.523348 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-03 05:48:25.523372 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-03 05:48:25.523390 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-03 05:48:25.523401 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/glance) 2026-04-03 05:48:25.523411 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/gnocchi) 2026-04-03 05:48:25.523421 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/manila) 2026-04-03 05:48:25.523430 | orchestrator | 2026-04-03 05:48:25.523440 | orchestrator | TASK [Write ceph keys to the configuration directory] ************************** 2026-04-03 05:48:25.523450 | orchestrator | Friday 03 April 2026 05:48:17 +0000 (0:00:03.158) 0:00:26.214 ********** 2026-04-03 05:48:25.523461 | orchestrator | changed: [testbed-manager] => (item=ceph.client.admin.keyring) 2026-04-03 05:48:25.523472 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523481 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523492 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 05:48:25.523501 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-03 05:48:25.523511 | orchestrator | changed: [testbed-manager] => (item=ceph.client.nova.keyring) 2026-04-03 05:48:25.523521 | orchestrator | changed: [testbed-manager] => (item=ceph.client.glance.keyring) 2026-04-03 05:48:25.523531 | orchestrator | changed: [testbed-manager] => (item=ceph.client.gnocchi.keyring) 2026-04-03 05:48:25.523541 | orchestrator | changed: [testbed-manager] => (item=ceph.client.manila.keyring) 2026-04-03 05:48:25.523551 | orchestrator | 2026-04-03 05:48:25.523562 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:48:25.523577 | orchestrator | testbed-manager : ok=6  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:48:25.523588 | orchestrator | 2026-04-03 05:48:25.523598 | orchestrator | 2026-04-03 05:48:25.523608 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:48:25.523617 | orchestrator | Friday 03 April 2026 05:48:25 +0000 (0:00:07.340) 0:00:33.554 ********** 2026-04-03 05:48:25.523628 | orchestrator | =============================================================================== 2026-04-03 05:48:25.523638 | orchestrator | Write ceph keys to the share directory --------------------------------- 13.39s 2026-04-03 05:48:25.523648 | orchestrator | Write ceph keys to the configuration directory -------------------------- 7.34s 2026-04-03 05:48:25.523657 | orchestrator | Check if ceph keys exist ------------------------------------------------ 4.35s 2026-04-03 05:48:25.523666 | orchestrator | Fetch all ceph keys ----------------------------------------------------- 4.15s 2026-04-03 05:48:25.523674 | orchestrator | Check if target directories exist --------------------------------------- 3.16s 2026-04-03 05:48:25.523683 | orchestrator | Create share directory -------------------------------------------------- 1.03s 2026-04-03 05:48:37.881279 | orchestrator | 2026-04-03 05:48:37 | INFO  | Task 58102cf4-ecfc-49d8-a42e-639ffc210c95 (cephclient) was prepared for execution. 2026-04-03 05:48:37.881390 | orchestrator | 2026-04-03 05:48:37 | INFO  | It takes a moment until task 58102cf4-ecfc-49d8-a42e-639ffc210c95 (cephclient) has been started and output is visible here. 2026-04-03 05:49:40.642109 | orchestrator | 2026-04-03 05:49:40.642227 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-03 05:49:40.642243 | orchestrator | 2026-04-03 05:49:40.642255 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-03 05:49:40.642267 | orchestrator | Friday 03 April 2026 05:48:42 +0000 (0:00:00.232) 0:00:00.232 ********** 2026-04-03 05:49:40.642279 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-03 05:49:40.642314 | orchestrator | 2026-04-03 05:49:40.642327 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-03 05:49:40.642338 | orchestrator | Friday 03 April 2026 05:48:42 +0000 (0:00:00.236) 0:00:00.469 ********** 2026-04-03 05:49:40.642350 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-03 05:49:40.642362 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-03 05:49:40.642374 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-03 05:49:40.642385 | orchestrator | 2026-04-03 05:49:40.642397 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-03 05:49:40.642408 | orchestrator | Friday 03 April 2026 05:48:43 +0000 (0:00:01.261) 0:00:01.731 ********** 2026-04-03 05:49:40.642419 | orchestrator | changed: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-03 05:49:40.642431 | orchestrator | 2026-04-03 05:49:40.642442 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-03 05:49:40.642453 | orchestrator | Friday 03 April 2026 05:48:45 +0000 (0:00:01.476) 0:00:03.207 ********** 2026-04-03 05:49:40.642464 | orchestrator | changed: [testbed-manager] 2026-04-03 05:49:40.642476 | orchestrator | 2026-04-03 05:49:40.642487 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-03 05:49:40.642498 | orchestrator | Friday 03 April 2026 05:48:46 +0000 (0:00:00.907) 0:00:04.115 ********** 2026-04-03 05:49:40.642509 | orchestrator | changed: [testbed-manager] 2026-04-03 05:49:40.642520 | orchestrator | 2026-04-03 05:49:40.642531 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-03 05:49:40.642542 | orchestrator | Friday 03 April 2026 05:48:47 +0000 (0:00:00.925) 0:00:05.041 ********** 2026-04-03 05:49:40.642554 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage cephclient service (10 retries left). 2026-04-03 05:49:40.642565 | orchestrator | ok: [testbed-manager] 2026-04-03 05:49:40.642576 | orchestrator | 2026-04-03 05:49:40.642587 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-03 05:49:40.642600 | orchestrator | Friday 03 April 2026 05:49:30 +0000 (0:00:43.415) 0:00:48.456 ********** 2026-04-03 05:49:40.642613 | orchestrator | changed: [testbed-manager] => (item=ceph) 2026-04-03 05:49:40.642627 | orchestrator | changed: [testbed-manager] => (item=ceph-authtool) 2026-04-03 05:49:40.642639 | orchestrator | changed: [testbed-manager] => (item=rados) 2026-04-03 05:49:40.642652 | orchestrator | changed: [testbed-manager] => (item=radosgw-admin) 2026-04-03 05:49:40.642664 | orchestrator | changed: [testbed-manager] => (item=rbd) 2026-04-03 05:49:40.642677 | orchestrator | 2026-04-03 05:49:40.642690 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-03 05:49:40.642703 | orchestrator | Friday 03 April 2026 05:49:34 +0000 (0:00:04.299) 0:00:52.756 ********** 2026-04-03 05:49:40.642715 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-03 05:49:40.642728 | orchestrator | 2026-04-03 05:49:40.642741 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-03 05:49:40.642753 | orchestrator | Friday 03 April 2026 05:49:35 +0000 (0:00:00.474) 0:00:53.231 ********** 2026-04-03 05:49:40.642766 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:49:40.642779 | orchestrator | 2026-04-03 05:49:40.642791 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-03 05:49:40.642804 | orchestrator | Friday 03 April 2026 05:49:35 +0000 (0:00:00.132) 0:00:53.363 ********** 2026-04-03 05:49:40.642816 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:49:40.642829 | orchestrator | 2026-04-03 05:49:40.642841 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Restart cephclient service] ******* 2026-04-03 05:49:40.642854 | orchestrator | Friday 03 April 2026 05:49:35 +0000 (0:00:00.547) 0:00:53.910 ********** 2026-04-03 05:49:40.642906 | orchestrator | changed: [testbed-manager] 2026-04-03 05:49:40.642920 | orchestrator | 2026-04-03 05:49:40.642933 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Ensure that all containers are up] *** 2026-04-03 05:49:40.642957 | orchestrator | Friday 03 April 2026 05:49:37 +0000 (0:00:01.499) 0:00:55.410 ********** 2026-04-03 05:49:40.642968 | orchestrator | changed: [testbed-manager] 2026-04-03 05:49:40.642980 | orchestrator | 2026-04-03 05:49:40.642991 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Wait for an healthy service] ****** 2026-04-03 05:49:40.643002 | orchestrator | Friday 03 April 2026 05:49:38 +0000 (0:00:00.713) 0:00:56.124 ********** 2026-04-03 05:49:40.643013 | orchestrator | changed: [testbed-manager] 2026-04-03 05:49:40.643024 | orchestrator | 2026-04-03 05:49:40.643035 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Copy bash completion scripts] ***** 2026-04-03 05:49:40.643047 | orchestrator | Friday 03 April 2026 05:49:38 +0000 (0:00:00.644) 0:00:56.769 ********** 2026-04-03 05:49:40.643058 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-03 05:49:40.643069 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-03 05:49:40.643081 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-03 05:49:40.643092 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-03 05:49:40.643103 | orchestrator | 2026-04-03 05:49:40.643114 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:49:40.643126 | orchestrator | testbed-manager : ok=12  changed=8  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 05:49:40.643138 | orchestrator | 2026-04-03 05:49:40.643149 | orchestrator | 2026-04-03 05:49:40.643179 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:49:40.643191 | orchestrator | Friday 03 April 2026 05:49:40 +0000 (0:00:01.509) 0:00:58.279 ********** 2026-04-03 05:49:40.643202 | orchestrator | =============================================================================== 2026-04-03 05:49:40.643213 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------ 43.42s 2026-04-03 05:49:40.643225 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 4.30s 2026-04-03 05:49:40.643236 | orchestrator | osism.services.cephclient : Copy bash completion scripts ---------------- 1.51s 2026-04-03 05:49:40.643247 | orchestrator | osism.services.cephclient : Restart cephclient service ------------------ 1.50s 2026-04-03 05:49:40.643258 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 1.48s 2026-04-03 05:49:40.643269 | orchestrator | osism.services.cephclient : Create required directories ----------------- 1.26s 2026-04-03 05:49:40.643280 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 0.93s 2026-04-03 05:49:40.643291 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 0.91s 2026-04-03 05:49:40.643302 | orchestrator | osism.services.cephclient : Ensure that all containers are up ----------- 0.71s 2026-04-03 05:49:40.643313 | orchestrator | osism.services.cephclient : Wait for an healthy service ----------------- 0.64s 2026-04-03 05:49:40.643324 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 0.55s 2026-04-03 05:49:40.643335 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 0.48s 2026-04-03 05:49:40.643346 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 0.24s 2026-04-03 05:49:40.643358 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 0.13s 2026-04-03 05:49:42.971373 | orchestrator | 2026-04-03 05:49:42 | INFO  | Task 1cc7df5e-f8db-41e9-a60f-5b86878e17e3 (ceph-bootstrap-dashboard) was prepared for execution. 2026-04-03 05:49:42.971479 | orchestrator | 2026-04-03 05:49:42 | INFO  | It takes a moment until task 1cc7df5e-f8db-41e9-a60f-5b86878e17e3 (ceph-bootstrap-dashboard) has been started and output is visible here. 2026-04-03 05:50:58.720847 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 05:50:58.721018 | orchestrator | 2.16.14 2026-04-03 05:50:58.721045 | orchestrator | 2026-04-03 05:50:58.721065 | orchestrator | PLAY [Bootstraph ceph dashboard] *********************************************** 2026-04-03 05:50:58.721083 | orchestrator | 2026-04-03 05:50:58.721100 | orchestrator | TASK [Disable the ceph dashboard] ********************************************** 2026-04-03 05:50:58.721147 | orchestrator | Friday 03 April 2026 05:49:47 +0000 (0:00:00.283) 0:00:00.283 ********** 2026-04-03 05:50:58.721165 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721183 | orchestrator | 2026-04-03 05:50:58.721199 | orchestrator | TASK [Set mgr/dashboard/ssl to false] ****************************************** 2026-04-03 05:50:58.721216 | orchestrator | Friday 03 April 2026 05:49:48 +0000 (0:00:01.373) 0:00:01.657 ********** 2026-04-03 05:50:58.721233 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721250 | orchestrator | 2026-04-03 05:50:58.721267 | orchestrator | TASK [Set mgr/dashboard/server_port to 7000] *********************************** 2026-04-03 05:50:58.721285 | orchestrator | Friday 03 April 2026 05:49:49 +0000 (0:00:01.124) 0:00:02.781 ********** 2026-04-03 05:50:58.721302 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721318 | orchestrator | 2026-04-03 05:50:58.721335 | orchestrator | TASK [Set mgr/dashboard/server_addr to 0.0.0.0] ******************************** 2026-04-03 05:50:58.721353 | orchestrator | Friday 03 April 2026 05:49:50 +0000 (0:00:01.067) 0:00:03.848 ********** 2026-04-03 05:50:58.721371 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721389 | orchestrator | 2026-04-03 05:50:58.721406 | orchestrator | TASK [Set mgr/dashboard/standby_behaviour to error] **************************** 2026-04-03 05:50:58.721422 | orchestrator | Friday 03 April 2026 05:49:52 +0000 (0:00:01.236) 0:00:05.085 ********** 2026-04-03 05:50:58.721439 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721457 | orchestrator | 2026-04-03 05:50:58.721475 | orchestrator | TASK [Set mgr/dashboard/standby_error_status_code to 404] ********************** 2026-04-03 05:50:58.721494 | orchestrator | Friday 03 April 2026 05:49:53 +0000 (0:00:01.049) 0:00:06.134 ********** 2026-04-03 05:50:58.721529 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721547 | orchestrator | 2026-04-03 05:50:58.721566 | orchestrator | TASK [Enable the ceph dashboard] *********************************************** 2026-04-03 05:50:58.721584 | orchestrator | Friday 03 April 2026 05:49:54 +0000 (0:00:01.078) 0:00:07.213 ********** 2026-04-03 05:50:58.721602 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721620 | orchestrator | 2026-04-03 05:50:58.721637 | orchestrator | TASK [Write ceph_dashboard_password to temporary file] ************************* 2026-04-03 05:50:58.721654 | orchestrator | Friday 03 April 2026 05:49:56 +0000 (0:00:02.081) 0:00:09.294 ********** 2026-04-03 05:50:58.721672 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721689 | orchestrator | 2026-04-03 05:50:58.721706 | orchestrator | TASK [Create admin user] ******************************************************* 2026-04-03 05:50:58.721723 | orchestrator | Friday 03 April 2026 05:49:57 +0000 (0:00:01.205) 0:00:10.499 ********** 2026-04-03 05:50:58.721740 | orchestrator | changed: [testbed-manager] 2026-04-03 05:50:58.721757 | orchestrator | 2026-04-03 05:50:58.721774 | orchestrator | TASK [Remove temporary file for ceph_dashboard_password] *********************** 2026-04-03 05:50:58.721791 | orchestrator | Friday 03 April 2026 05:50:33 +0000 (0:00:36.459) 0:00:46.959 ********** 2026-04-03 05:50:58.721807 | orchestrator | skipping: [testbed-manager] 2026-04-03 05:50:58.721822 | orchestrator | 2026-04-03 05:50:58.721838 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-03 05:50:58.721855 | orchestrator | 2026-04-03 05:50:58.721953 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-03 05:50:58.721971 | orchestrator | Friday 03 April 2026 05:50:34 +0000 (0:00:00.156) 0:00:47.115 ********** 2026-04-03 05:50:58.721988 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:50:58.722005 | orchestrator | 2026-04-03 05:50:58.722093 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-03 05:50:58.722111 | orchestrator | 2026-04-03 05:50:58.722128 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-03 05:50:58.722154 | orchestrator | Friday 03 April 2026 05:50:45 +0000 (0:00:11.745) 0:00:58.860 ********** 2026-04-03 05:50:58.722171 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:50:58.722187 | orchestrator | 2026-04-03 05:50:58.722203 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-03 05:50:58.722236 | orchestrator | 2026-04-03 05:50:58.722253 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-03 05:50:58.722269 | orchestrator | Friday 03 April 2026 05:50:57 +0000 (0:00:11.149) 0:01:10.010 ********** 2026-04-03 05:50:58.722286 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:50:58.722302 | orchestrator | 2026-04-03 05:50:58.722318 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:50:58.722336 | orchestrator | testbed-manager : ok=9  changed=9  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 05:50:58.722354 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:50:58.722372 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:50:58.722388 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 05:50:58.722404 | orchestrator | 2026-04-03 05:50:58.722421 | orchestrator | 2026-04-03 05:50:58.722437 | orchestrator | 2026-04-03 05:50:58.722453 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:50:58.722470 | orchestrator | Friday 03 April 2026 05:50:58 +0000 (0:00:01.309) 0:01:11.320 ********** 2026-04-03 05:50:58.722486 | orchestrator | =============================================================================== 2026-04-03 05:50:58.722502 | orchestrator | Create admin user ------------------------------------------------------ 36.46s 2026-04-03 05:50:58.722543 | orchestrator | Restart ceph manager service ------------------------------------------- 24.21s 2026-04-03 05:50:58.722561 | orchestrator | Enable the ceph dashboard ----------------------------------------------- 2.08s 2026-04-03 05:50:58.722577 | orchestrator | Disable the ceph dashboard ---------------------------------------------- 1.37s 2026-04-03 05:50:58.722593 | orchestrator | Set mgr/dashboard/server_addr to 0.0.0.0 -------------------------------- 1.24s 2026-04-03 05:50:58.722609 | orchestrator | Write ceph_dashboard_password to temporary file ------------------------- 1.21s 2026-04-03 05:50:58.722626 | orchestrator | Set mgr/dashboard/ssl to false ------------------------------------------ 1.12s 2026-04-03 05:50:58.722641 | orchestrator | Set mgr/dashboard/standby_error_status_code to 404 ---------------------- 1.08s 2026-04-03 05:50:58.722657 | orchestrator | Set mgr/dashboard/server_port to 7000 ----------------------------------- 1.07s 2026-04-03 05:50:58.722673 | orchestrator | Set mgr/dashboard/standby_behaviour to error ---------------------------- 1.05s 2026-04-03 05:50:58.722689 | orchestrator | Remove temporary file for ceph_dashboard_password ----------------------- 0.16s 2026-04-03 05:50:59.045568 | orchestrator | + sh -c /opt/configuration/scripts/deploy/300-openstack.sh 2026-04-03 05:51:01.066742 | orchestrator | 2026-04-03 05:51:01 | INFO  | Task 30d19351-772c-4128-bb45-7405d49d572a (keystone) was prepared for execution. 2026-04-03 05:51:01.067002 | orchestrator | 2026-04-03 05:51:01 | INFO  | It takes a moment until task 30d19351-772c-4128-bb45-7405d49d572a (keystone) has been started and output is visible here. 2026-04-03 05:51:08.233214 | orchestrator | 2026-04-03 05:51:08.233302 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:51:08.233313 | orchestrator | 2026-04-03 05:51:08.233321 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:51:08.233343 | orchestrator | Friday 03 April 2026 05:51:05 +0000 (0:00:00.274) 0:00:00.274 ********** 2026-04-03 05:51:08.233351 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:51:08.233359 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:51:08.233367 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:51:08.233374 | orchestrator | 2026-04-03 05:51:08.233381 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:51:08.233389 | orchestrator | Friday 03 April 2026 05:51:05 +0000 (0:00:00.333) 0:00:00.608 ********** 2026-04-03 05:51:08.233416 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-03 05:51:08.233424 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-03 05:51:08.233432 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-03 05:51:08.233439 | orchestrator | 2026-04-03 05:51:08.233446 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-03 05:51:08.233453 | orchestrator | 2026-04-03 05:51:08.233461 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:51:08.233468 | orchestrator | Friday 03 April 2026 05:51:06 +0000 (0:00:00.423) 0:00:01.031 ********** 2026-04-03 05:51:08.233476 | orchestrator | included: /ansible/roles/keystone/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:51:08.233484 | orchestrator | 2026-04-03 05:51:08.233491 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-03 05:51:08.233498 | orchestrator | Friday 03 April 2026 05:51:06 +0000 (0:00:00.542) 0:00:01.574 ********** 2026-04-03 05:51:08.233511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:08.233522 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:08.233550 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:08.233566 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233576 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233583 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233591 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233599 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233607 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:08.233620 | orchestrator | 2026-04-03 05:51:08.233628 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-03 05:51:08.233640 | orchestrator | Friday 03 April 2026 05:51:08 +0000 (0:00:01.614) 0:00:03.189 ********** 2026-04-03 05:51:13.915379 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:13.915484 | orchestrator | 2026-04-03 05:51:13.915499 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-03 05:51:13.915527 | orchestrator | Friday 03 April 2026 05:51:08 +0000 (0:00:00.290) 0:00:03.479 ********** 2026-04-03 05:51:13.915538 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:13.915548 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:13.915558 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:13.915568 | orchestrator | 2026-04-03 05:51:13.915578 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-03 05:51:13.915588 | orchestrator | Friday 03 April 2026 05:51:08 +0000 (0:00:00.324) 0:00:03.804 ********** 2026-04-03 05:51:13.915597 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:51:13.915607 | orchestrator | 2026-04-03 05:51:13.915617 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:51:13.915627 | orchestrator | Friday 03 April 2026 05:51:09 +0000 (0:00:00.861) 0:00:04.665 ********** 2026-04-03 05:51:13.915637 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:51:13.915647 | orchestrator | 2026-04-03 05:51:13.915657 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-03 05:51:13.915667 | orchestrator | Friday 03 April 2026 05:51:10 +0000 (0:00:00.538) 0:00:05.203 ********** 2026-04-03 05:51:13.915683 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:13.915698 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:13.915710 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:13.915764 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915778 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915789 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915800 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915810 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915826 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:13.915836 | orchestrator | 2026-04-03 05:51:13.915847 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-03 05:51:13.915857 | orchestrator | Friday 03 April 2026 05:51:13 +0000 (0:00:03.025) 0:00:08.229 ********** 2026-04-03 05:51:13.915929 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:14.750728 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:14.750910 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:14.750933 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:14.750950 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:14.750986 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:14.751005 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:14.751017 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:14.751049 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:14.751062 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:14.751074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:14.751092 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:14.751104 | orchestrator | 2026-04-03 05:51:14.751116 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-03 05:51:14.751129 | orchestrator | Friday 03 April 2026 05:51:13 +0000 (0:00:00.649) 0:00:08.879 ********** 2026-04-03 05:51:14.751141 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:14.751158 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:14.751179 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:17.859294 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:17.859398 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:17.859420 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:17.859463 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:17.859477 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:17.859503 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:17.859516 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:17.859545 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:17.859558 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:17.859570 | orchestrator | 2026-04-03 05:51:17.859582 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-03 05:51:17.859595 | orchestrator | Friday 03 April 2026 05:51:14 +0000 (0:00:00.832) 0:00:09.712 ********** 2026-04-03 05:51:17.859607 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:17.859628 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:17.859648 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:17.859669 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:22.458941 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:22.459091 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:51:22.459112 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:22.459127 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:22.459156 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:22.459172 | orchestrator | 2026-04-03 05:51:22.459188 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-03 05:51:22.459203 | orchestrator | Friday 03 April 2026 05:51:17 +0000 (0:00:03.111) 0:00:12.823 ********** 2026-04-03 05:51:22.459239 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:22.459256 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:22.459282 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:22.459298 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:22.459317 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:22.459340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:25.928575 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:25.928708 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:25.928726 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:51:25.928740 | orchestrator | 2026-04-03 05:51:25.928753 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-03 05:51:25.928766 | orchestrator | Friday 03 April 2026 05:51:22 +0000 (0:00:04.598) 0:00:17.422 ********** 2026-04-03 05:51:25.928777 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:51:25.928789 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:51:25.928800 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:51:25.928811 | orchestrator | 2026-04-03 05:51:25.928822 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-03 05:51:25.928833 | orchestrator | Friday 03 April 2026 05:51:23 +0000 (0:00:01.307) 0:00:18.729 ********** 2026-04-03 05:51:25.928844 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:25.928855 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:25.928935 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:25.928949 | orchestrator | 2026-04-03 05:51:25.928960 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-03 05:51:25.928971 | orchestrator | Friday 03 April 2026 05:51:24 +0000 (0:00:00.770) 0:00:19.500 ********** 2026-04-03 05:51:25.928982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:25.928993 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:25.929003 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:25.929014 | orchestrator | 2026-04-03 05:51:25.929039 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-03 05:51:25.929050 | orchestrator | Friday 03 April 2026 05:51:25 +0000 (0:00:00.511) 0:00:20.011 ********** 2026-04-03 05:51:25.929061 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:25.929072 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:25.929083 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:25.929094 | orchestrator | 2026-04-03 05:51:25.929106 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-03 05:51:25.929119 | orchestrator | Friday 03 April 2026 05:51:25 +0000 (0:00:00.313) 0:00:20.325 ********** 2026-04-03 05:51:25.929154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:25.929180 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:25.929195 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:25.929209 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:25.929223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:25.929241 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:25.929253 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:25.929274 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:25.929295 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-03 05:51:44.198465 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 05:51:44.198582 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 05:51:44.198610 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:44.198630 | orchestrator | 2026-04-03 05:51:44.198651 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:51:44.198674 | orchestrator | Friday 03 April 2026 05:51:25 +0000 (0:00:00.565) 0:00:20.890 ********** 2026-04-03 05:51:44.198694 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:44.198713 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:44.198729 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:44.198741 | orchestrator | 2026-04-03 05:51:44.198753 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-03 05:51:44.198764 | orchestrator | Friday 03 April 2026 05:51:26 +0000 (0:00:00.320) 0:00:21.211 ********** 2026-04-03 05:51:44.198776 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 05:51:44.198788 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 05:51:44.198821 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 05:51:44.198833 | orchestrator | 2026-04-03 05:51:44.198859 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-03 05:51:44.198915 | orchestrator | Friday 03 April 2026 05:51:28 +0000 (0:00:01.815) 0:00:23.026 ********** 2026-04-03 05:51:44.198927 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:51:44.198938 | orchestrator | 2026-04-03 05:51:44.198949 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-03 05:51:44.198959 | orchestrator | Friday 03 April 2026 05:51:28 +0000 (0:00:00.889) 0:00:23.915 ********** 2026-04-03 05:51:44.198973 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:51:44.198986 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:51:44.198999 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:51:44.199011 | orchestrator | 2026-04-03 05:51:44.199024 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-03 05:51:44.199037 | orchestrator | Friday 03 April 2026 05:51:29 +0000 (0:00:00.557) 0:00:24.473 ********** 2026-04-03 05:51:44.199049 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 05:51:44.199061 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:51:44.199074 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 05:51:44.199086 | orchestrator | 2026-04-03 05:51:44.199099 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-03 05:51:44.199112 | orchestrator | Friday 03 April 2026 05:51:30 +0000 (0:00:01.003) 0:00:25.477 ********** 2026-04-03 05:51:44.199124 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:51:44.199138 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:51:44.199149 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:51:44.199162 | orchestrator | 2026-04-03 05:51:44.199174 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-03 05:51:44.199187 | orchestrator | Friday 03 April 2026 05:51:31 +0000 (0:00:00.542) 0:00:26.020 ********** 2026-04-03 05:51:44.199199 | orchestrator | changed: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 05:51:44.199212 | orchestrator | changed: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 05:51:44.199226 | orchestrator | changed: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 05:51:44.199238 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 05:51:44.199251 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 05:51:44.199263 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 05:51:44.199276 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 05:51:44.199289 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 05:51:44.199320 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 05:51:44.199334 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 05:51:44.199345 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 05:51:44.199356 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 05:51:44.199367 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 05:51:44.199378 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 05:51:44.199389 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 05:51:44.199400 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 05:51:44.199419 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 05:51:44.199430 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 05:51:44.199441 | orchestrator | changed: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 05:51:44.199452 | orchestrator | changed: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 05:51:44.199463 | orchestrator | changed: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 05:51:44.199474 | orchestrator | 2026-04-03 05:51:44.199484 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-03 05:51:44.199495 | orchestrator | Friday 03 April 2026 05:51:39 +0000 (0:00:08.438) 0:00:34.458 ********** 2026-04-03 05:51:44.199506 | orchestrator | changed: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 05:51:44.199517 | orchestrator | changed: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 05:51:44.199528 | orchestrator | changed: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 05:51:44.199538 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 05:51:44.199549 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 05:51:44.199560 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 05:51:44.199571 | orchestrator | 2026-04-03 05:51:44.199582 | orchestrator | TASK [keystone : Check keystone containers] ************************************ 2026-04-03 05:51:44.199598 | orchestrator | Friday 03 April 2026 05:51:42 +0000 (0:00:02.551) 0:00:37.009 ********** 2026-04-03 05:51:44.199614 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:51:44.199642 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:53:19.873825 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-03 05:53:19.874096 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874138 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874152 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874164 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874194 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874216 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 05:53:19.874229 | orchestrator | 2026-04-03 05:53:19.874242 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:53:19.874255 | orchestrator | Friday 03 April 2026 05:51:44 +0000 (0:00:02.146) 0:00:39.156 ********** 2026-04-03 05:53:19.874266 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:53:19.874278 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:53:19.874289 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:53:19.874300 | orchestrator | 2026-04-03 05:53:19.874311 | orchestrator | TASK [keystone : Creating keystone database] *********************************** 2026-04-03 05:53:19.874322 | orchestrator | Friday 03 April 2026 05:51:44 +0000 (0:00:00.496) 0:00:39.653 ********** 2026-04-03 05:53:19.874333 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.874343 | orchestrator | 2026-04-03 05:53:19.874355 | orchestrator | TASK [keystone : Creating Keystone database user and setting permissions] ****** 2026-04-03 05:53:19.874368 | orchestrator | Friday 03 April 2026 05:51:46 +0000 (0:00:02.273) 0:00:41.927 ********** 2026-04-03 05:53:19.874381 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.874393 | orchestrator | 2026-04-03 05:53:19.874406 | orchestrator | TASK [keystone : Checking for any running keystone_fernet containers] ********** 2026-04-03 05:53:19.874419 | orchestrator | Friday 03 April 2026 05:51:49 +0000 (0:00:02.098) 0:00:44.026 ********** 2026-04-03 05:53:19.874432 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:53:19.874446 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:53:19.874457 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:53:19.874467 | orchestrator | 2026-04-03 05:53:19.874478 | orchestrator | TASK [keystone : Group nodes where keystone_fernet is running] ***************** 2026-04-03 05:53:19.874489 | orchestrator | Friday 03 April 2026 05:51:49 +0000 (0:00:00.812) 0:00:44.838 ********** 2026-04-03 05:53:19.874500 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:53:19.874511 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:53:19.874522 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:53:19.874532 | orchestrator | 2026-04-03 05:53:19.874544 | orchestrator | TASK [keystone : Fail if any hosts need bootstrapping and not all hosts targeted] *** 2026-04-03 05:53:19.874560 | orchestrator | Friday 03 April 2026 05:51:50 +0000 (0:00:00.328) 0:00:45.167 ********** 2026-04-03 05:53:19.874572 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:53:19.874583 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:53:19.874593 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:53:19.874604 | orchestrator | 2026-04-03 05:53:19.874615 | orchestrator | TASK [keystone : Running Keystone bootstrap container] ************************* 2026-04-03 05:53:19.874626 | orchestrator | Friday 03 April 2026 05:51:50 +0000 (0:00:00.553) 0:00:45.721 ********** 2026-04-03 05:53:19.874636 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.874647 | orchestrator | 2026-04-03 05:53:19.874658 | orchestrator | TASK [keystone : Running Keystone fernet bootstrap container] ****************** 2026-04-03 05:53:19.874669 | orchestrator | Friday 03 April 2026 05:52:04 +0000 (0:00:13.343) 0:00:59.064 ********** 2026-04-03 05:53:19.874679 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.874690 | orchestrator | 2026-04-03 05:53:19.874701 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 05:53:19.874712 | orchestrator | Friday 03 April 2026 05:52:14 +0000 (0:00:09.936) 0:01:09.001 ********** 2026-04-03 05:53:19.874730 | orchestrator | 2026-04-03 05:53:19.874741 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 05:53:19.874752 | orchestrator | Friday 03 April 2026 05:52:14 +0000 (0:00:00.067) 0:01:09.068 ********** 2026-04-03 05:53:19.874762 | orchestrator | 2026-04-03 05:53:19.874773 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 05:53:19.874784 | orchestrator | Friday 03 April 2026 05:52:14 +0000 (0:00:00.071) 0:01:09.140 ********** 2026-04-03 05:53:19.874795 | orchestrator | 2026-04-03 05:53:19.874805 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-03 05:53:19.874820 | orchestrator | Friday 03 April 2026 05:52:14 +0000 (0:00:00.073) 0:01:09.213 ********** 2026-04-03 05:53:19.874839 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.874858 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:53:19.874904 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:53:19.874921 | orchestrator | 2026-04-03 05:53:19.874939 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-03 05:53:19.874957 | orchestrator | Friday 03 April 2026 05:53:02 +0000 (0:00:48.605) 0:01:57.818 ********** 2026-04-03 05:53:19.874972 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:53:19.874989 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.875008 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:53:19.875026 | orchestrator | 2026-04-03 05:53:19.875044 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-03 05:53:19.875063 | orchestrator | Friday 03 April 2026 05:53:12 +0000 (0:00:09.897) 0:02:07.716 ********** 2026-04-03 05:53:19.875083 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:53:19.875101 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:53:19.875115 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:53:19.875126 | orchestrator | 2026-04-03 05:53:19.875137 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:53:19.875147 | orchestrator | Friday 03 April 2026 05:53:19 +0000 (0:00:06.487) 0:02:14.204 ********** 2026-04-03 05:53:19.875168 | orchestrator | included: /ansible/roles/keystone/tasks/distribute_fernet.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:54:04.636942 | orchestrator | 2026-04-03 05:54:04.637057 | orchestrator | TASK [keystone : Waiting for Keystone SSH port to be UP] *********************** 2026-04-03 05:54:04.637074 | orchestrator | Friday 03 April 2026 05:53:19 +0000 (0:00:00.629) 0:02:14.833 ********** 2026-04-03 05:54:04.637086 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:54:04.637100 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:54:04.637111 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:54:04.637122 | orchestrator | 2026-04-03 05:54:04.637134 | orchestrator | TASK [keystone : Run key distribution] ***************************************** 2026-04-03 05:54:04.637145 | orchestrator | Friday 03 April 2026 05:53:20 +0000 (0:00:01.141) 0:02:15.975 ********** 2026-04-03 05:54:04.637157 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:54:04.637169 | orchestrator | 2026-04-03 05:54:04.637180 | orchestrator | TASK [keystone : Creating admin project, user, role, service, and endpoint] **** 2026-04-03 05:54:04.637191 | orchestrator | Friday 03 April 2026 05:53:22 +0000 (0:00:01.673) 0:02:17.648 ********** 2026-04-03 05:54:04.637202 | orchestrator | changed: [testbed-node-0] => (item=RegionOne) 2026-04-03 05:54:04.637213 | orchestrator | 2026-04-03 05:54:04.637225 | orchestrator | TASK [service-ks-register : keystone | Creating services] ********************** 2026-04-03 05:54:04.637235 | orchestrator | Friday 03 April 2026 05:53:32 +0000 (0:00:10.047) 0:02:27.696 ********** 2026-04-03 05:54:04.637246 | orchestrator | changed: [testbed-node-0] => (item=keystone (identity)) 2026-04-03 05:54:04.637257 | orchestrator | 2026-04-03 05:54:04.637268 | orchestrator | TASK [service-ks-register : keystone | Creating endpoints] ********************* 2026-04-03 05:54:04.637280 | orchestrator | Friday 03 April 2026 05:53:53 +0000 (0:00:21.217) 0:02:48.914 ********** 2026-04-03 05:54:04.637291 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api-int.testbed.osism.xyz:5000 -> internal) 2026-04-03 05:54:04.637328 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api.testbed.osism.xyz:5000 -> public) 2026-04-03 05:54:04.637340 | orchestrator | 2026-04-03 05:54:04.637351 | orchestrator | TASK [service-ks-register : keystone | Creating projects] ********************** 2026-04-03 05:54:04.637362 | orchestrator | Friday 03 April 2026 05:53:59 +0000 (0:00:05.917) 0:02:54.831 ********** 2026-04-03 05:54:04.637373 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:04.637384 | orchestrator | 2026-04-03 05:54:04.637395 | orchestrator | TASK [service-ks-register : keystone | Creating users] ************************* 2026-04-03 05:54:04.637406 | orchestrator | Friday 03 April 2026 05:53:59 +0000 (0:00:00.142) 0:02:54.974 ********** 2026-04-03 05:54:04.637417 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:04.637428 | orchestrator | 2026-04-03 05:54:04.637439 | orchestrator | TASK [service-ks-register : keystone | Creating roles] ************************* 2026-04-03 05:54:04.637453 | orchestrator | Friday 03 April 2026 05:54:00 +0000 (0:00:00.132) 0:02:55.106 ********** 2026-04-03 05:54:04.637466 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:04.637480 | orchestrator | 2026-04-03 05:54:04.637507 | orchestrator | TASK [service-ks-register : keystone | Granting user roles] ******************** 2026-04-03 05:54:04.637520 | orchestrator | Friday 03 April 2026 05:54:00 +0000 (0:00:00.137) 0:02:55.243 ********** 2026-04-03 05:54:04.637534 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:04.637547 | orchestrator | 2026-04-03 05:54:04.637559 | orchestrator | TASK [keystone : Creating default user role] *********************************** 2026-04-03 05:54:04.637572 | orchestrator | Friday 03 April 2026 05:54:00 +0000 (0:00:00.544) 0:02:55.788 ********** 2026-04-03 05:54:04.637585 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:54:04.637599 | orchestrator | 2026-04-03 05:54:04.637611 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 05:54:04.637624 | orchestrator | Friday 03 April 2026 05:54:03 +0000 (0:00:02.962) 0:02:58.751 ********** 2026-04-03 05:54:04.637634 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:04.637645 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:04.637656 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:04.637667 | orchestrator | 2026-04-03 05:54:04.637678 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:54:04.637690 | orchestrator | testbed-node-0 : ok=33  changed=19  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 05:54:04.637702 | orchestrator | testbed-node-1 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 05:54:04.637713 | orchestrator | testbed-node-2 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 05:54:04.637724 | orchestrator | 2026-04-03 05:54:04.637735 | orchestrator | 2026-04-03 05:54:04.637746 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:54:04.637757 | orchestrator | Friday 03 April 2026 05:54:04 +0000 (0:00:00.449) 0:02:59.201 ********** 2026-04-03 05:54:04.637768 | orchestrator | =============================================================================== 2026-04-03 05:54:04.637779 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 48.61s 2026-04-03 05:54:04.637790 | orchestrator | service-ks-register : keystone | Creating services --------------------- 21.22s 2026-04-03 05:54:04.637801 | orchestrator | keystone : Running Keystone bootstrap container ------------------------ 13.34s 2026-04-03 05:54:04.637812 | orchestrator | keystone : Creating admin project, user, role, service, and endpoint --- 10.05s 2026-04-03 05:54:04.637823 | orchestrator | keystone : Running Keystone fernet bootstrap container ------------------ 9.94s 2026-04-03 05:54:04.637833 | orchestrator | keystone : Restart keystone-fernet container ---------------------------- 9.90s 2026-04-03 05:54:04.637844 | orchestrator | keystone : Copying files for keystone-fernet ---------------------------- 8.44s 2026-04-03 05:54:04.637855 | orchestrator | keystone : Restart keystone container ----------------------------------- 6.49s 2026-04-03 05:54:04.637914 | orchestrator | service-ks-register : keystone | Creating endpoints --------------------- 5.92s 2026-04-03 05:54:04.637954 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 4.60s 2026-04-03 05:54:04.637973 | orchestrator | keystone : Copying over config.json files for services ------------------ 3.11s 2026-04-03 05:54:04.637991 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.03s 2026-04-03 05:54:04.638009 | orchestrator | keystone : Creating default user role ----------------------------------- 2.96s 2026-04-03 05:54:04.638106 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.55s 2026-04-03 05:54:04.638124 | orchestrator | keystone : Creating keystone database ----------------------------------- 2.27s 2026-04-03 05:54:04.638141 | orchestrator | keystone : Check keystone containers ------------------------------------ 2.15s 2026-04-03 05:54:04.638158 | orchestrator | keystone : Creating Keystone database user and setting permissions ------ 2.10s 2026-04-03 05:54:04.638176 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 1.82s 2026-04-03 05:54:04.638193 | orchestrator | keystone : Run key distribution ----------------------------------------- 1.67s 2026-04-03 05:54:04.638212 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 1.61s 2026-04-03 05:54:07.017339 | orchestrator | 2026-04-03 05:54:07 | INFO  | Task d1e5e00f-1a1f-4651-a7c2-99e6728d0821 (placement) was prepared for execution. 2026-04-03 05:54:07.017441 | orchestrator | 2026-04-03 05:54:07 | INFO  | It takes a moment until task d1e5e00f-1a1f-4651-a7c2-99e6728d0821 (placement) has been started and output is visible here. 2026-04-03 05:54:41.382378 | orchestrator | 2026-04-03 05:54:41.382489 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:54:41.382507 | orchestrator | 2026-04-03 05:54:41.382519 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:54:41.382531 | orchestrator | Friday 03 April 2026 05:54:11 +0000 (0:00:00.259) 0:00:00.259 ********** 2026-04-03 05:54:41.382542 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:54:41.382554 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:54:41.382566 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:54:41.382577 | orchestrator | 2026-04-03 05:54:41.382588 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:54:41.382599 | orchestrator | Friday 03 April 2026 05:54:11 +0000 (0:00:00.329) 0:00:00.589 ********** 2026-04-03 05:54:41.382611 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-03 05:54:41.382622 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-03 05:54:41.382633 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-03 05:54:41.382644 | orchestrator | 2026-04-03 05:54:41.382670 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-03 05:54:41.382682 | orchestrator | 2026-04-03 05:54:41.382693 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 05:54:41.382704 | orchestrator | Friday 03 April 2026 05:54:11 +0000 (0:00:00.462) 0:00:01.051 ********** 2026-04-03 05:54:41.382716 | orchestrator | included: /ansible/roles/placement/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:54:41.382728 | orchestrator | 2026-04-03 05:54:41.382739 | orchestrator | TASK [service-ks-register : placement | Creating services] ********************* 2026-04-03 05:54:41.382750 | orchestrator | Friday 03 April 2026 05:54:12 +0000 (0:00:00.622) 0:00:01.673 ********** 2026-04-03 05:54:41.382761 | orchestrator | changed: [testbed-node-0] => (item=placement (placement)) 2026-04-03 05:54:41.382772 | orchestrator | 2026-04-03 05:54:41.382783 | orchestrator | TASK [service-ks-register : placement | Creating endpoints] ******************** 2026-04-03 05:54:41.382794 | orchestrator | Friday 03 April 2026 05:54:16 +0000 (0:00:03.678) 0:00:05.352 ********** 2026-04-03 05:54:41.382805 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-03 05:54:41.382837 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-03 05:54:41.382849 | orchestrator | 2026-04-03 05:54:41.382860 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-03 05:54:41.382895 | orchestrator | Friday 03 April 2026 05:54:22 +0000 (0:00:06.429) 0:00:11.781 ********** 2026-04-03 05:54:41.382906 | orchestrator | changed: [testbed-node-0] => (item=service) 2026-04-03 05:54:41.382918 | orchestrator | 2026-04-03 05:54:41.382931 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-03 05:54:41.382944 | orchestrator | Friday 03 April 2026 05:54:26 +0000 (0:00:03.508) 0:00:15.290 ********** 2026-04-03 05:54:41.382956 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 05:54:41.382968 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-03 05:54:41.382981 | orchestrator | 2026-04-03 05:54:41.382993 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-03 05:54:41.383006 | orchestrator | Friday 03 April 2026 05:54:30 +0000 (0:00:04.404) 0:00:19.694 ********** 2026-04-03 05:54:41.383018 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 05:54:41.383031 | orchestrator | 2026-04-03 05:54:41.383044 | orchestrator | TASK [service-ks-register : placement | Granting user roles] ******************* 2026-04-03 05:54:41.383057 | orchestrator | Friday 03 April 2026 05:54:33 +0000 (0:00:03.024) 0:00:22.719 ********** 2026-04-03 05:54:41.383068 | orchestrator | changed: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-03 05:54:41.383078 | orchestrator | 2026-04-03 05:54:41.383089 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 05:54:41.383100 | orchestrator | Friday 03 April 2026 05:54:37 +0000 (0:00:03.561) 0:00:26.281 ********** 2026-04-03 05:54:41.383111 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:41.383122 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:41.383133 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:41.383144 | orchestrator | 2026-04-03 05:54:41.383155 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-03 05:54:41.383165 | orchestrator | Friday 03 April 2026 05:54:37 +0000 (0:00:00.324) 0:00:26.605 ********** 2026-04-03 05:54:41.383181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:41.383220 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:41.383243 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:41.383255 | orchestrator | 2026-04-03 05:54:41.383267 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-03 05:54:41.383278 | orchestrator | Friday 03 April 2026 05:54:38 +0000 (0:00:01.113) 0:00:27.719 ********** 2026-04-03 05:54:41.383289 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:41.383301 | orchestrator | 2026-04-03 05:54:41.383312 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-03 05:54:41.383323 | orchestrator | Friday 03 April 2026 05:54:38 +0000 (0:00:00.314) 0:00:28.033 ********** 2026-04-03 05:54:41.383334 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:41.383344 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:41.383355 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:41.383366 | orchestrator | 2026-04-03 05:54:41.383377 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 05:54:41.383388 | orchestrator | Friday 03 April 2026 05:54:39 +0000 (0:00:00.307) 0:00:28.341 ********** 2026-04-03 05:54:41.383398 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 05:54:41.383409 | orchestrator | 2026-04-03 05:54:41.383420 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-03 05:54:41.383431 | orchestrator | Friday 03 April 2026 05:54:39 +0000 (0:00:00.543) 0:00:28.885 ********** 2026-04-03 05:54:41.383443 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:41.383464 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:44.223440 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:44.223587 | orchestrator | 2026-04-03 05:54:44.223606 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-03 05:54:44.223619 | orchestrator | Friday 03 April 2026 05:54:41 +0000 (0:00:01.597) 0:00:30.482 ********** 2026-04-03 05:54:44.223633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223645 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:44.223659 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223670 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:44.223682 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223715 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:44.223726 | orchestrator | 2026-04-03 05:54:44.223738 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-03 05:54:44.223766 | orchestrator | Friday 03 April 2026 05:54:41 +0000 (0:00:00.487) 0:00:30.970 ********** 2026-04-03 05:54:44.223786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223798 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:44.223810 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223822 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:44.223833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:44.223844 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:44.223855 | orchestrator | 2026-04-03 05:54:44.223893 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-03 05:54:44.223906 | orchestrator | Friday 03 April 2026 05:54:42 +0000 (0:00:00.699) 0:00:31.669 ********** 2026-04-03 05:54:44.223917 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:44.223952 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:51.120210 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:51.120302 | orchestrator | 2026-04-03 05:54:51.120312 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-03 05:54:51.120319 | orchestrator | Friday 03 April 2026 05:54:44 +0000 (0:00:01.658) 0:00:33.328 ********** 2026-04-03 05:54:51.120326 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:51.120333 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:51.120366 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:54:51.120373 | orchestrator | 2026-04-03 05:54:51.120379 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-03 05:54:51.120384 | orchestrator | Friday 03 April 2026 05:54:46 +0000 (0:00:02.246) 0:00:35.574 ********** 2026-04-03 05:54:51.120400 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-03 05:54:51.120406 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-03 05:54:51.120412 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-03 05:54:51.120418 | orchestrator | 2026-04-03 05:54:51.120423 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-03 05:54:51.120429 | orchestrator | Friday 03 April 2026 05:54:47 +0000 (0:00:01.443) 0:00:37.018 ********** 2026-04-03 05:54:51.120434 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:54:51.120441 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:54:51.120446 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:54:51.120451 | orchestrator | 2026-04-03 05:54:51.120457 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-03 05:54:51.120462 | orchestrator | Friday 03 April 2026 05:54:49 +0000 (0:00:01.348) 0:00:38.367 ********** 2026-04-03 05:54:51.120468 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:51.120474 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:54:51.120480 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:51.120490 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:54:51.120496 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-03 05:54:51.120501 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:54:51.120507 | orchestrator | 2026-04-03 05:54:51.120512 | orchestrator | TASK [placement : Check placement containers] ********************************** 2026-04-03 05:54:51.120521 | orchestrator | Friday 03 April 2026 05:54:50 +0000 (0:00:00.803) 0:00:39.170 ********** 2026-04-03 05:54:51.120532 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:55:18.551525 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:55:18.551672 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-03 05:55:18.551692 | orchestrator | 2026-04-03 05:55:18.551707 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-03 05:55:18.551721 | orchestrator | Friday 03 April 2026 05:54:51 +0000 (0:00:01.058) 0:00:40.229 ********** 2026-04-03 05:55:18.551732 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:55:18.551745 | orchestrator | 2026-04-03 05:55:18.551756 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-03 05:55:18.551767 | orchestrator | Friday 03 April 2026 05:54:53 +0000 (0:00:02.041) 0:00:42.270 ********** 2026-04-03 05:55:18.551778 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:55:18.551791 | orchestrator | 2026-04-03 05:55:18.551803 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-03 05:55:18.551814 | orchestrator | Friday 03 April 2026 05:54:55 +0000 (0:00:02.194) 0:00:44.464 ********** 2026-04-03 05:55:18.551825 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:55:18.551836 | orchestrator | 2026-04-03 05:55:18.551847 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 05:55:18.551858 | orchestrator | Friday 03 April 2026 05:55:08 +0000 (0:00:12.880) 0:00:57.345 ********** 2026-04-03 05:55:18.551927 | orchestrator | 2026-04-03 05:55:18.551941 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 05:55:18.551953 | orchestrator | Friday 03 April 2026 05:55:08 +0000 (0:00:00.066) 0:00:57.412 ********** 2026-04-03 05:55:18.551963 | orchestrator | 2026-04-03 05:55:18.551974 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 05:55:18.551985 | orchestrator | Friday 03 April 2026 05:55:08 +0000 (0:00:00.066) 0:00:57.478 ********** 2026-04-03 05:55:18.551996 | orchestrator | 2026-04-03 05:55:18.552008 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-03 05:55:18.552019 | orchestrator | Friday 03 April 2026 05:55:08 +0000 (0:00:00.066) 0:00:57.545 ********** 2026-04-03 05:55:18.552030 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:55:18.552057 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:55:18.552069 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:55:18.552081 | orchestrator | 2026-04-03 05:55:18.552093 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:55:18.552107 | orchestrator | testbed-node-0 : ok=21  changed=16  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 05:55:18.552119 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:55:18.552131 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 05:55:18.552142 | orchestrator | 2026-04-03 05:55:18.552155 | orchestrator | 2026-04-03 05:55:18.552166 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:55:18.552178 | orchestrator | Friday 03 April 2026 05:55:18 +0000 (0:00:09.766) 0:01:07.312 ********** 2026-04-03 05:55:18.552199 | orchestrator | =============================================================================== 2026-04-03 05:55:18.552210 | orchestrator | placement : Running placement bootstrap container ---------------------- 12.88s 2026-04-03 05:55:18.552238 | orchestrator | placement : Restart placement-api container ----------------------------- 9.77s 2026-04-03 05:55:18.552250 | orchestrator | service-ks-register : placement | Creating endpoints -------------------- 6.43s 2026-04-03 05:55:18.552262 | orchestrator | service-ks-register : placement | Creating users ------------------------ 4.40s 2026-04-03 05:55:18.552274 | orchestrator | service-ks-register : placement | Creating services --------------------- 3.68s 2026-04-03 05:55:18.552285 | orchestrator | service-ks-register : placement | Granting user roles ------------------- 3.56s 2026-04-03 05:55:18.552296 | orchestrator | service-ks-register : placement | Creating projects --------------------- 3.51s 2026-04-03 05:55:18.552307 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 3.02s 2026-04-03 05:55:18.552318 | orchestrator | placement : Copying over placement.conf --------------------------------- 2.25s 2026-04-03 05:55:18.552329 | orchestrator | placement : Creating placement databases user and setting permissions --- 2.19s 2026-04-03 05:55:18.552340 | orchestrator | placement : Creating placement databases -------------------------------- 2.04s 2026-04-03 05:55:18.552351 | orchestrator | placement : Copying over config.json files for services ----------------- 1.66s 2026-04-03 05:55:18.552363 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 1.60s 2026-04-03 05:55:18.552374 | orchestrator | placement : Copying over placement-api wsgi configuration --------------- 1.44s 2026-04-03 05:55:18.552385 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 1.35s 2026-04-03 05:55:18.552396 | orchestrator | placement : Ensuring config directories exist --------------------------- 1.11s 2026-04-03 05:55:18.552407 | orchestrator | placement : Check placement containers ---------------------------------- 1.06s 2026-04-03 05:55:18.552418 | orchestrator | placement : Copying over existing policy file --------------------------- 0.80s 2026-04-03 05:55:18.552429 | orchestrator | service-cert-copy : placement | Copying over backend internal TLS key --- 0.70s 2026-04-03 05:55:18.552440 | orchestrator | placement : include_tasks ----------------------------------------------- 0.62s 2026-04-03 05:55:20.945816 | orchestrator | 2026-04-03 05:55:20 | INFO  | Task eb590d26-48a1-4d2a-9332-60587101933c (neutron) was prepared for execution. 2026-04-03 05:55:20.945964 | orchestrator | 2026-04-03 05:55:20 | INFO  | It takes a moment until task eb590d26-48a1-4d2a-9332-60587101933c (neutron) has been started and output is visible here. 2026-04-03 05:56:07.957140 | orchestrator | 2026-04-03 05:56:07.957267 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 05:56:07.957292 | orchestrator | 2026-04-03 05:56:07.957309 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 05:56:07.957325 | orchestrator | Friday 03 April 2026 05:55:25 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-03 05:56:07.957341 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:56:07.957357 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:56:07.957372 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:56:07.957386 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:56:07.957401 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:56:07.957415 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:56:07.957428 | orchestrator | 2026-04-03 05:56:07.957443 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 05:56:07.957459 | orchestrator | Friday 03 April 2026 05:55:25 +0000 (0:00:00.717) 0:00:00.980 ********** 2026-04-03 05:56:07.957473 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-03 05:56:07.957487 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-03 05:56:07.957502 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-03 05:56:07.957516 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-03 05:56:07.957532 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-03 05:56:07.957577 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-03 05:56:07.957593 | orchestrator | 2026-04-03 05:56:07.957607 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-03 05:56:07.957623 | orchestrator | 2026-04-03 05:56:07.957638 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 05:56:07.957653 | orchestrator | Friday 03 April 2026 05:55:26 +0000 (0:00:00.646) 0:00:01.626 ********** 2026-04-03 05:56:07.957686 | orchestrator | included: /ansible/roles/neutron/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:56:07.957704 | orchestrator | 2026-04-03 05:56:07.957719 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-03 05:56:07.957735 | orchestrator | Friday 03 April 2026 05:55:27 +0000 (0:00:01.272) 0:00:02.899 ********** 2026-04-03 05:56:07.957750 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:56:07.957765 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:56:07.957782 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:56:07.957796 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:56:07.957809 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:56:07.957824 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:56:07.957837 | orchestrator | 2026-04-03 05:56:07.957853 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-03 05:56:07.957866 | orchestrator | Friday 03 April 2026 05:55:29 +0000 (0:00:01.315) 0:00:04.214 ********** 2026-04-03 05:56:07.957906 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:56:07.957922 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:56:07.957937 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:56:07.957951 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:56:07.957966 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:56:07.957981 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:56:07.957995 | orchestrator | 2026-04-03 05:56:07.958009 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-03 05:56:07.958091 | orchestrator | Friday 03 April 2026 05:55:30 +0000 (0:00:01.040) 0:00:05.255 ********** 2026-04-03 05:56:07.958106 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 05:56:07.958122 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958135 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958150 | orchestrator | } 2026-04-03 05:56:07.958164 | orchestrator | ok: [testbed-node-1] => { 2026-04-03 05:56:07.958178 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958192 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958206 | orchestrator | } 2026-04-03 05:56:07.958219 | orchestrator | ok: [testbed-node-2] => { 2026-04-03 05:56:07.958235 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958250 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958264 | orchestrator | } 2026-04-03 05:56:07.958278 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 05:56:07.958293 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958307 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958323 | orchestrator | } 2026-04-03 05:56:07.958337 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 05:56:07.958351 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958367 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958382 | orchestrator | } 2026-04-03 05:56:07.958397 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 05:56:07.958411 | orchestrator |  "changed": false, 2026-04-03 05:56:07.958426 | orchestrator |  "msg": "All assertions passed" 2026-04-03 05:56:07.958441 | orchestrator | } 2026-04-03 05:56:07.958456 | orchestrator | 2026-04-03 05:56:07.958470 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-03 05:56:07.958487 | orchestrator | Friday 03 April 2026 05:55:31 +0000 (0:00:00.856) 0:00:06.111 ********** 2026-04-03 05:56:07.958502 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:07.958518 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:07.958532 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:07.958561 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:07.958577 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:07.958592 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:07.958605 | orchestrator | 2026-04-03 05:56:07.958619 | orchestrator | TASK [service-ks-register : neutron | Creating services] *********************** 2026-04-03 05:56:07.958633 | orchestrator | Friday 03 April 2026 05:55:31 +0000 (0:00:00.649) 0:00:06.761 ********** 2026-04-03 05:56:07.958650 | orchestrator | changed: [testbed-node-0] => (item=neutron (network)) 2026-04-03 05:56:07.958664 | orchestrator | 2026-04-03 05:56:07.958679 | orchestrator | TASK [service-ks-register : neutron | Creating endpoints] ********************** 2026-04-03 05:56:07.958693 | orchestrator | Friday 03 April 2026 05:55:35 +0000 (0:00:03.571) 0:00:10.332 ********** 2026-04-03 05:56:07.958709 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api-int.testbed.osism.xyz:9696 -> internal) 2026-04-03 05:56:07.958724 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api.testbed.osism.xyz:9696 -> public) 2026-04-03 05:56:07.958739 | orchestrator | 2026-04-03 05:56:07.958778 | orchestrator | TASK [service-ks-register : neutron | Creating projects] *********************** 2026-04-03 05:56:07.958794 | orchestrator | Friday 03 April 2026 05:55:41 +0000 (0:00:06.432) 0:00:16.765 ********** 2026-04-03 05:56:07.958810 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 05:56:07.958825 | orchestrator | 2026-04-03 05:56:07.958839 | orchestrator | TASK [service-ks-register : neutron | Creating users] ************************** 2026-04-03 05:56:07.958853 | orchestrator | Friday 03 April 2026 05:55:44 +0000 (0:00:03.079) 0:00:19.845 ********** 2026-04-03 05:56:07.958868 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 05:56:07.958936 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service) 2026-04-03 05:56:07.958951 | orchestrator | 2026-04-03 05:56:07.958965 | orchestrator | TASK [service-ks-register : neutron | Creating roles] ************************** 2026-04-03 05:56:07.958979 | orchestrator | Friday 03 April 2026 05:55:48 +0000 (0:00:03.678) 0:00:23.523 ********** 2026-04-03 05:56:07.958994 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 05:56:07.959009 | orchestrator | 2026-04-03 05:56:07.959023 | orchestrator | TASK [service-ks-register : neutron | Granting user roles] ********************* 2026-04-03 05:56:07.959037 | orchestrator | Friday 03 April 2026 05:55:51 +0000 (0:00:03.026) 0:00:26.550 ********** 2026-04-03 05:56:07.959051 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> admin) 2026-04-03 05:56:07.959065 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> service) 2026-04-03 05:56:07.959078 | orchestrator | 2026-04-03 05:56:07.959093 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 05:56:07.959108 | orchestrator | Friday 03 April 2026 05:55:59 +0000 (0:00:07.568) 0:00:34.118 ********** 2026-04-03 05:56:07.959122 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:07.959136 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:07.959149 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:07.959163 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:07.959177 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:07.959202 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:07.959219 | orchestrator | 2026-04-03 05:56:07.959234 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-03 05:56:07.959249 | orchestrator | Friday 03 April 2026 05:55:59 +0000 (0:00:00.787) 0:00:34.905 ********** 2026-04-03 05:56:07.959265 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:07.959279 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:07.959293 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:07.959308 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:07.959323 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:07.959337 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:07.959351 | orchestrator | 2026-04-03 05:56:07.959367 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-03 05:56:07.959382 | orchestrator | Friday 03 April 2026 05:56:02 +0000 (0:00:02.316) 0:00:37.221 ********** 2026-04-03 05:56:07.959409 | orchestrator | ok: [testbed-node-0] 2026-04-03 05:56:07.959425 | orchestrator | ok: [testbed-node-1] 2026-04-03 05:56:07.959439 | orchestrator | ok: [testbed-node-2] 2026-04-03 05:56:07.959453 | orchestrator | ok: [testbed-node-3] 2026-04-03 05:56:07.959469 | orchestrator | ok: [testbed-node-4] 2026-04-03 05:56:07.959485 | orchestrator | ok: [testbed-node-5] 2026-04-03 05:56:07.959500 | orchestrator | 2026-04-03 05:56:07.959514 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-03 05:56:07.959529 | orchestrator | Friday 03 April 2026 05:56:03 +0000 (0:00:01.159) 0:00:38.381 ********** 2026-04-03 05:56:07.959543 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:07.959557 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:07.959571 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:07.959586 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:07.959601 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:07.959616 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:07.959631 | orchestrator | 2026-04-03 05:56:07.959645 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-03 05:56:07.959659 | orchestrator | Friday 03 April 2026 05:56:05 +0000 (0:00:02.193) 0:00:40.574 ********** 2026-04-03 05:56:07.959678 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:07.959717 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:13.290452 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:13.290576 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:13.290588 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:13.290597 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:13.290604 | orchestrator | 2026-04-03 05:56:13.290611 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-03 05:56:13.290620 | orchestrator | Friday 03 April 2026 05:56:07 +0000 (0:00:02.440) 0:00:43.015 ********** 2026-04-03 05:56:13.290626 | orchestrator | [WARNING]: Skipped 2026-04-03 05:56:13.290633 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-03 05:56:13.290640 | orchestrator | due to this access issue: 2026-04-03 05:56:13.290647 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-03 05:56:13.290654 | orchestrator | a directory 2026-04-03 05:56:13.290661 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 05:56:13.290667 | orchestrator | 2026-04-03 05:56:13.290673 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 05:56:13.290679 | orchestrator | Friday 03 April 2026 05:56:08 +0000 (0:00:00.813) 0:00:43.829 ********** 2026-04-03 05:56:13.290687 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 05:56:13.290696 | orchestrator | 2026-04-03 05:56:13.290702 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-03 05:56:13.290724 | orchestrator | Friday 03 April 2026 05:56:10 +0000 (0:00:01.297) 0:00:45.126 ********** 2026-04-03 05:56:13.290735 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:13.290748 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:13.290755 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:13.290762 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:13.290774 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:17.786009 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:17.786168 | orchestrator | 2026-04-03 05:56:17.786187 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-03 05:56:17.786200 | orchestrator | Friday 03 April 2026 05:56:13 +0000 (0:00:03.221) 0:00:48.348 ********** 2026-04-03 05:56:17.786214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:17.786227 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:17.786241 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:17.786252 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:17.786264 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:17.786275 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:17.786326 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:17.786340 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:17.786358 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:17.786370 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:17.786382 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:17.786393 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:17.786404 | orchestrator | 2026-04-03 05:56:17.786416 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-03 05:56:17.786427 | orchestrator | Friday 03 April 2026 05:56:15 +0000 (0:00:01.940) 0:00:50.288 ********** 2026-04-03 05:56:17.786439 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:17.786450 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:17.786469 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:22.781290 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:22.781418 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:22.781440 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:22.781454 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:22.781466 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:22.781477 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:22.781489 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:22.781507 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:22.781552 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:22.781574 | orchestrator | 2026-04-03 05:56:22.781594 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-03 05:56:22.781615 | orchestrator | Friday 03 April 2026 05:56:17 +0000 (0:00:02.556) 0:00:52.844 ********** 2026-04-03 05:56:22.781633 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:22.781650 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:22.781668 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:22.781685 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:22.781705 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:22.781724 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:22.781745 | orchestrator | 2026-04-03 05:56:22.781764 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-03 05:56:22.781785 | orchestrator | Friday 03 April 2026 05:56:19 +0000 (0:00:02.102) 0:00:54.947 ********** 2026-04-03 05:56:22.781805 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:22.781828 | orchestrator | 2026-04-03 05:56:22.781849 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-03 05:56:22.781927 | orchestrator | Friday 03 April 2026 05:56:20 +0000 (0:00:00.140) 0:00:55.087 ********** 2026-04-03 05:56:22.781952 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:22.781973 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:22.781992 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:22.782012 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:22.782113 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:22.782182 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:22.782201 | orchestrator | 2026-04-03 05:56:22.782221 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-03 05:56:22.782242 | orchestrator | Friday 03 April 2026 05:56:20 +0000 (0:00:00.613) 0:00:55.700 ********** 2026-04-03 05:56:22.782278 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:22.782292 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:22.782304 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:22.782316 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:22.782340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:22.782352 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:22.782364 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:22.782376 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:22.782408 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:30.965370 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:30.965475 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:30.965493 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:30.965504 | orchestrator | 2026-04-03 05:56:30.965515 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-03 05:56:30.965527 | orchestrator | Friday 03 April 2026 05:56:22 +0000 (0:00:02.132) 0:00:57.832 ********** 2026-04-03 05:56:30.965538 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:30.965575 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:30.965586 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:30.965626 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:30.965668 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:30.965685 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:30.965696 | orchestrator | 2026-04-03 05:56:30.965706 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-03 05:56:30.965716 | orchestrator | Friday 03 April 2026 05:56:25 +0000 (0:00:02.986) 0:01:00.819 ********** 2026-04-03 05:56:30.965727 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:30.965737 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:30.965760 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:35.831115 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:35.831245 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:35.831262 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:56:35.831275 | orchestrator | 2026-04-03 05:56:35.831288 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-03 05:56:35.831301 | orchestrator | Friday 03 April 2026 05:56:30 +0000 (0:00:05.200) 0:01:06.020 ********** 2026-04-03 05:56:35.831314 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:35.831342 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:35.831374 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:35.831396 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:35.831408 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:35.831419 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:35.831431 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:35.831442 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:35.831454 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:35.831466 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:35.831483 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:35.831494 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:35.831506 | orchestrator | 2026-04-03 05:56:35.831518 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-03 05:56:35.831536 | orchestrator | Friday 03 April 2026 05:56:33 +0000 (0:00:02.293) 0:01:08.314 ********** 2026-04-03 05:56:35.831547 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:35.831558 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:35.831569 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:35.831581 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:56:35.831592 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:56:35.831603 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:56:35.831614 | orchestrator | 2026-04-03 05:56:35.831625 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-03 05:56:35.831645 | orchestrator | Friday 03 April 2026 05:56:35 +0000 (0:00:02.570) 0:01:10.884 ********** 2026-04-03 05:56:54.449089 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:54.449209 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.449228 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:54.449242 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.449254 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:54.449265 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.449279 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:54.449349 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:54.449364 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:56:54.449376 | orchestrator | 2026-04-03 05:56:54.449388 | orchestrator | TASK [neutron : Copying over linuxbridge_agent.ini] **************************** 2026-04-03 05:56:54.449401 | orchestrator | Friday 03 April 2026 05:56:39 +0000 (0:00:03.224) 0:01:14.108 ********** 2026-04-03 05:56:54.449412 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.449423 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.449434 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.449445 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.449456 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.449467 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.449478 | orchestrator | 2026-04-03 05:56:54.449489 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-03 05:56:54.449500 | orchestrator | Friday 03 April 2026 05:56:41 +0000 (0:00:02.279) 0:01:16.388 ********** 2026-04-03 05:56:54.449511 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.449522 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.449533 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.449544 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.449555 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.449566 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.449577 | orchestrator | 2026-04-03 05:56:54.449588 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-03 05:56:54.449599 | orchestrator | Friday 03 April 2026 05:56:43 +0000 (0:00:02.280) 0:01:18.669 ********** 2026-04-03 05:56:54.449610 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.449721 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.449736 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.449749 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.449761 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.449773 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.449786 | orchestrator | 2026-04-03 05:56:54.449798 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-03 05:56:54.449821 | orchestrator | Friday 03 April 2026 05:56:45 +0000 (0:00:02.250) 0:01:20.919 ********** 2026-04-03 05:56:54.449834 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.449845 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.449856 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.449866 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.449904 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.449916 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.449927 | orchestrator | 2026-04-03 05:56:54.449938 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-03 05:56:54.449949 | orchestrator | Friday 03 April 2026 05:56:48 +0000 (0:00:02.193) 0:01:23.113 ********** 2026-04-03 05:56:54.449967 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.449986 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.450005 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.450113 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.450135 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.450165 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.450176 | orchestrator | 2026-04-03 05:56:54.450187 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-03 05:56:54.450198 | orchestrator | Friday 03 April 2026 05:56:50 +0000 (0:00:02.221) 0:01:25.334 ********** 2026-04-03 05:56:54.450209 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.450220 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.450230 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.450241 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:54.450260 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.450271 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:54.450282 | orchestrator | 2026-04-03 05:56:54.450293 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-03 05:56:54.450303 | orchestrator | Friday 03 April 2026 05:56:52 +0000 (0:00:02.121) 0:01:27.455 ********** 2026-04-03 05:56:54.450314 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:54.450326 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:54.450337 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:54.450347 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:54.450358 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:54.450369 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:54.450380 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:54.450391 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:54.450414 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:58.748811 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:58.748958 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 05:56:58.748976 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:58.748988 | orchestrator | 2026-04-03 05:56:58.749000 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-03 05:56:58.749012 | orchestrator | Friday 03 April 2026 05:56:54 +0000 (0:00:02.040) 0:01:29.496 ********** 2026-04-03 05:56:58.749027 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:58.749066 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:56:58.749079 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:58.749091 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:58.749102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:58.749114 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:58.749141 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:58.749153 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:56:58.749182 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:58.749202 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:56:58.749214 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:56:58.749225 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:56:58.749236 | orchestrator | 2026-04-03 05:56:58.749247 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-03 05:56:58.749259 | orchestrator | Friday 03 April 2026 05:56:56 +0000 (0:00:02.172) 0:01:31.668 ********** 2026-04-03 05:56:58.749270 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:58.749282 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:56:58.749298 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:56:58.749310 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:56:58.749329 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:57:24.170243 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.170363 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:24.170383 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.170396 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:24.170409 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.170422 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:24.170435 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.170448 | orchestrator | 2026-04-03 05:57:24.170461 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-03 05:57:24.170474 | orchestrator | Friday 03 April 2026 05:56:58 +0000 (0:00:02.136) 0:01:33.805 ********** 2026-04-03 05:57:24.170486 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.170498 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.170510 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.170522 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.170534 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.170546 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.170558 | orchestrator | 2026-04-03 05:57:24.170587 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-03 05:57:24.170607 | orchestrator | Friday 03 April 2026 05:57:00 +0000 (0:00:02.215) 0:01:36.020 ********** 2026-04-03 05:57:24.170625 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.170644 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.170662 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.170786 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:57:24.170814 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:57:24.170828 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:57:24.170842 | orchestrator | 2026-04-03 05:57:24.170854 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-03 05:57:24.170964 | orchestrator | Friday 03 April 2026 05:57:04 +0000 (0:00:03.894) 0:01:39.915 ********** 2026-04-03 05:57:24.170981 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.170994 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171006 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171019 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171031 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171044 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171056 | orchestrator | 2026-04-03 05:57:24.171068 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-03 05:57:24.171081 | orchestrator | Friday 03 April 2026 05:57:06 +0000 (0:00:02.014) 0:01:41.929 ********** 2026-04-03 05:57:24.171093 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.171105 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171118 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171130 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171141 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171152 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171163 | orchestrator | 2026-04-03 05:57:24.171174 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-03 05:57:24.171209 | orchestrator | Friday 03 April 2026 05:57:09 +0000 (0:00:02.172) 0:01:44.101 ********** 2026-04-03 05:57:24.171228 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171246 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.171263 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171281 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171299 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171319 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171337 | orchestrator | 2026-04-03 05:57:24.171356 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-03 05:57:24.171374 | orchestrator | Friday 03 April 2026 05:57:11 +0000 (0:00:02.077) 0:01:46.179 ********** 2026-04-03 05:57:24.171392 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171411 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171488 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.171508 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171526 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171545 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171564 | orchestrator | 2026-04-03 05:57:24.171583 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-03 05:57:24.171601 | orchestrator | Friday 03 April 2026 05:57:13 +0000 (0:00:02.216) 0:01:48.396 ********** 2026-04-03 05:57:24.171620 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171638 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.171656 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171675 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171694 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171712 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171731 | orchestrator | 2026-04-03 05:57:24.171748 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-03 05:57:24.171768 | orchestrator | Friday 03 April 2026 05:57:15 +0000 (0:00:02.130) 0:01:50.526 ********** 2026-04-03 05:57:24.171786 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.171804 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.171822 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.171839 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.171856 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.171874 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.171957 | orchestrator | 2026-04-03 05:57:24.171978 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-03 05:57:24.171998 | orchestrator | Friday 03 April 2026 05:57:17 +0000 (0:00:02.082) 0:01:52.609 ********** 2026-04-03 05:57:24.172017 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.172051 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.172071 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.172091 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.172111 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.172131 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.172149 | orchestrator | 2026-04-03 05:57:24.172168 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-03 05:57:24.172187 | orchestrator | Friday 03 April 2026 05:57:19 +0000 (0:00:02.348) 0:01:54.957 ********** 2026-04-03 05:57:24.172207 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172227 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.172246 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172257 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:24.172268 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172279 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:24.172289 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172301 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:24.172312 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172322 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:24.172333 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 05:57:24.172355 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:24.172366 | orchestrator | 2026-04-03 05:57:24.172377 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-03 05:57:24.172388 | orchestrator | Friday 03 April 2026 05:57:21 +0000 (0:00:01.930) 0:01:56.888 ********** 2026-04-03 05:57:24.172402 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:57:24.172416 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:57:24.172440 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:57:26.601763 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:57:26.601872 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-03 05:57:26.601937 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:57:26.601949 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:26.601958 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:57:26.601979 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:26.601988 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:57:26.601996 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 05:57:26.602004 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:57:26.602066 | orchestrator | 2026-04-03 05:57:26.602076 | orchestrator | TASK [neutron : Check neutron containers] ************************************** 2026-04-03 05:57:26.602087 | orchestrator | Friday 03 April 2026 05:57:24 +0000 (0:00:02.335) 0:01:59.224 ********** 2026-04-03 05:57:26.602111 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:57:26.602130 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:57:26.602143 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-03 05:57:26.602161 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:57:26.602170 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:57:26.602190 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 05:59:31.305698 | orchestrator | 2026-04-03 05:59:31.305858 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 05:59:31.305881 | orchestrator | Friday 03 April 2026 05:57:26 +0000 (0:00:02.436) 0:02:01.660 ********** 2026-04-03 05:59:31.305893 | orchestrator | skipping: [testbed-node-0] 2026-04-03 05:59:31.305968 | orchestrator | skipping: [testbed-node-1] 2026-04-03 05:59:31.305980 | orchestrator | skipping: [testbed-node-2] 2026-04-03 05:59:31.305991 | orchestrator | skipping: [testbed-node-3] 2026-04-03 05:59:31.306002 | orchestrator | skipping: [testbed-node-4] 2026-04-03 05:59:31.306070 | orchestrator | skipping: [testbed-node-5] 2026-04-03 05:59:31.306092 | orchestrator | 2026-04-03 05:59:31.306111 | orchestrator | TASK [neutron : Creating Neutron database] ************************************* 2026-04-03 05:59:31.306128 | orchestrator | Friday 03 April 2026 05:57:27 +0000 (0:00:00.788) 0:02:02.449 ********** 2026-04-03 05:59:31.306156 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:59:31.306173 | orchestrator | 2026-04-03 05:59:31.306191 | orchestrator | TASK [neutron : Creating Neutron database user and setting permissions] ******** 2026-04-03 05:59:31.306209 | orchestrator | Friday 03 April 2026 05:57:29 +0000 (0:00:02.005) 0:02:04.454 ********** 2026-04-03 05:59:31.306229 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:59:31.306247 | orchestrator | 2026-04-03 05:59:31.306266 | orchestrator | TASK [neutron : Running Neutron bootstrap container] *************************** 2026-04-03 05:59:31.306283 | orchestrator | Friday 03 April 2026 05:57:31 +0000 (0:00:02.128) 0:02:06.583 ********** 2026-04-03 05:59:31.306301 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:59:31.306318 | orchestrator | 2026-04-03 05:59:31.306336 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306354 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:36.989) 0:02:43.573 ********** 2026-04-03 05:59:31.306372 | orchestrator | 2026-04-03 05:59:31.306390 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306408 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.068) 0:02:43.641 ********** 2026-04-03 05:59:31.306427 | orchestrator | 2026-04-03 05:59:31.306446 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306464 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.072) 0:02:43.714 ********** 2026-04-03 05:59:31.306481 | orchestrator | 2026-04-03 05:59:31.306498 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306517 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.070) 0:02:43.784 ********** 2026-04-03 05:59:31.306535 | orchestrator | 2026-04-03 05:59:31.306574 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306594 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.067) 0:02:43.852 ********** 2026-04-03 05:59:31.306611 | orchestrator | 2026-04-03 05:59:31.306629 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 05:59:31.306646 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.070) 0:02:43.923 ********** 2026-04-03 05:59:31.306665 | orchestrator | 2026-04-03 05:59:31.306682 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-03 05:59:31.306699 | orchestrator | Friday 03 April 2026 05:58:08 +0000 (0:00:00.071) 0:02:43.994 ********** 2026-04-03 05:59:31.306747 | orchestrator | changed: [testbed-node-0] 2026-04-03 05:59:31.306765 | orchestrator | changed: [testbed-node-1] 2026-04-03 05:59:31.306783 | orchestrator | changed: [testbed-node-2] 2026-04-03 05:59:31.306801 | orchestrator | 2026-04-03 05:59:31.306819 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-03 05:59:31.306837 | orchestrator | Friday 03 April 2026 05:58:31 +0000 (0:00:22.673) 0:03:06.668 ********** 2026-04-03 05:59:31.306856 | orchestrator | changed: [testbed-node-3] 2026-04-03 05:59:31.306874 | orchestrator | changed: [testbed-node-5] 2026-04-03 05:59:31.306892 | orchestrator | changed: [testbed-node-4] 2026-04-03 05:59:31.306949 | orchestrator | 2026-04-03 05:59:31.306968 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 05:59:31.306987 | orchestrator | testbed-node-0 : ok=26  changed=15  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:59:31.307007 | orchestrator | testbed-node-1 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-03 05:59:31.307025 | orchestrator | testbed-node-2 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-03 05:59:31.307043 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:59:31.307059 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:59:31.307077 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-03 05:59:31.307093 | orchestrator | 2026-04-03 05:59:31.307110 | orchestrator | 2026-04-03 05:59:31.307127 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 05:59:31.307145 | orchestrator | Friday 03 April 2026 05:59:30 +0000 (0:00:59.212) 0:04:05.881 ********** 2026-04-03 05:59:31.307163 | orchestrator | =============================================================================== 2026-04-03 05:59:31.307180 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 59.21s 2026-04-03 05:59:31.307198 | orchestrator | neutron : Running Neutron bootstrap container -------------------------- 36.99s 2026-04-03 05:59:31.307216 | orchestrator | neutron : Restart neutron-server container ----------------------------- 22.67s 2026-04-03 05:59:31.307261 | orchestrator | service-ks-register : neutron | Granting user roles --------------------- 7.57s 2026-04-03 05:59:31.307281 | orchestrator | service-ks-register : neutron | Creating endpoints ---------------------- 6.43s 2026-04-03 05:59:31.307299 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 5.20s 2026-04-03 05:59:31.307318 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 3.89s 2026-04-03 05:59:31.307337 | orchestrator | service-ks-register : neutron | Creating users -------------------------- 3.68s 2026-04-03 05:59:31.307356 | orchestrator | service-ks-register : neutron | Creating services ----------------------- 3.57s 2026-04-03 05:59:31.307375 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 3.22s 2026-04-03 05:59:31.307392 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 3.22s 2026-04-03 05:59:31.307410 | orchestrator | service-ks-register : neutron | Creating projects ----------------------- 3.08s 2026-04-03 05:59:31.307427 | orchestrator | service-ks-register : neutron | Creating roles -------------------------- 3.03s 2026-04-03 05:59:31.307446 | orchestrator | neutron : Copying over config.json files for services ------------------- 2.99s 2026-04-03 05:59:31.307464 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 2.57s 2026-04-03 05:59:31.307484 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS key ----- 2.56s 2026-04-03 05:59:31.307520 | orchestrator | neutron : Ensuring config directories exist ----------------------------- 2.44s 2026-04-03 05:59:31.307534 | orchestrator | neutron : Check neutron containers -------------------------------------- 2.44s 2026-04-03 05:59:31.307545 | orchestrator | neutron : Copying over extra ml2 plugins -------------------------------- 2.35s 2026-04-03 05:59:31.307556 | orchestrator | neutron : Copying over neutron_taas.conf -------------------------------- 2.34s 2026-04-03 05:59:33.789296 | orchestrator | 2026-04-03 05:59:33 | INFO  | Task e65cb67b-80ff-49fa-9ea6-75b9a406a842 (nova) was prepared for execution. 2026-04-03 05:59:33.789375 | orchestrator | 2026-04-03 05:59:33 | INFO  | It takes a moment until task e65cb67b-80ff-49fa-9ea6-75b9a406a842 (nova) has been started and output is visible here. 2026-04-03 06:01:27.050567 | orchestrator | 2026-04-03 06:01:27.050698 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:01:27.050715 | orchestrator | 2026-04-03 06:01:27.050724 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-03 06:01:27.050732 | orchestrator | Friday 03 April 2026 05:59:38 +0000 (0:00:00.283) 0:00:00.283 ********** 2026-04-03 06:01:27.050740 | orchestrator | changed: [testbed-manager] 2026-04-03 06:01:27.050749 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.050757 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:01:27.050764 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:01:27.050772 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:01:27.050779 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:01:27.050787 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:01:27.050794 | orchestrator | 2026-04-03 06:01:27.050802 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:01:27.050810 | orchestrator | Friday 03 April 2026 05:59:39 +0000 (0:00:00.888) 0:00:01.172 ********** 2026-04-03 06:01:27.050817 | orchestrator | changed: [testbed-manager] 2026-04-03 06:01:27.050824 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.050832 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:01:27.050839 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:01:27.050846 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:01:27.050854 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:01:27.050862 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:01:27.050869 | orchestrator | 2026-04-03 06:01:27.050877 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:01:27.050884 | orchestrator | Friday 03 April 2026 05:59:39 +0000 (0:00:00.869) 0:00:02.041 ********** 2026-04-03 06:01:27.050892 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-03 06:01:27.050900 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-03 06:01:27.050908 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-03 06:01:27.050956 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-03 06:01:27.050964 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-03 06:01:27.050972 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-03 06:01:27.050979 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-03 06:01:27.050987 | orchestrator | 2026-04-03 06:01:27.050994 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-03 06:01:27.051002 | orchestrator | 2026-04-03 06:01:27.051009 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 06:01:27.051017 | orchestrator | Friday 03 April 2026 05:59:40 +0000 (0:00:00.736) 0:00:02.778 ********** 2026-04-03 06:01:27.051025 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:01:27.051032 | orchestrator | 2026-04-03 06:01:27.051040 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-03 06:01:27.051047 | orchestrator | Friday 03 April 2026 05:59:41 +0000 (0:00:00.760) 0:00:03.538 ********** 2026-04-03 06:01:27.051055 | orchestrator | changed: [testbed-node-0] => (item=nova_cell0) 2026-04-03 06:01:27.051082 | orchestrator | changed: [testbed-node-0] => (item=nova_api) 2026-04-03 06:01:27.051090 | orchestrator | 2026-04-03 06:01:27.051099 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-03 06:01:27.051109 | orchestrator | Friday 03 April 2026 05:59:45 +0000 (0:00:03.684) 0:00:07.222 ********** 2026-04-03 06:01:27.051118 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 06:01:27.051127 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 06:01:27.051136 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051147 | orchestrator | 2026-04-03 06:01:27.051157 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 06:01:27.051167 | orchestrator | Friday 03 April 2026 05:59:49 +0000 (0:00:04.127) 0:00:11.350 ********** 2026-04-03 06:01:27.051178 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051189 | orchestrator | 2026-04-03 06:01:27.051199 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-03 06:01:27.051210 | orchestrator | Friday 03 April 2026 05:59:49 +0000 (0:00:00.654) 0:00:12.005 ********** 2026-04-03 06:01:27.051221 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051231 | orchestrator | 2026-04-03 06:01:27.051242 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-03 06:01:27.051252 | orchestrator | Friday 03 April 2026 05:59:51 +0000 (0:00:01.330) 0:00:13.336 ********** 2026-04-03 06:01:27.051262 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051272 | orchestrator | 2026-04-03 06:01:27.051282 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 06:01:27.051292 | orchestrator | Friday 03 April 2026 05:59:53 +0000 (0:00:02.638) 0:00:15.975 ********** 2026-04-03 06:01:27.051303 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.051313 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051323 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051333 | orchestrator | 2026-04-03 06:01:27.051343 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-03 06:01:27.051353 | orchestrator | Friday 03 April 2026 05:59:54 +0000 (0:00:00.324) 0:00:16.299 ********** 2026-04-03 06:01:27.051363 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:01:27.051374 | orchestrator | 2026-04-03 06:01:27.051386 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-03 06:01:27.051396 | orchestrator | Friday 03 April 2026 06:00:24 +0000 (0:00:30.592) 0:00:46.892 ********** 2026-04-03 06:01:27.051404 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051413 | orchestrator | 2026-04-03 06:01:27.051422 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 06:01:27.051431 | orchestrator | Friday 03 April 2026 06:00:38 +0000 (0:00:13.471) 0:01:00.364 ********** 2026-04-03 06:01:27.051440 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:01:27.051448 | orchestrator | 2026-04-03 06:01:27.051457 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 06:01:27.051466 | orchestrator | Friday 03 April 2026 06:00:49 +0000 (0:00:11.262) 0:01:11.626 ********** 2026-04-03 06:01:27.051493 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:01:27.051502 | orchestrator | 2026-04-03 06:01:27.051517 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-03 06:01:27.051526 | orchestrator | Friday 03 April 2026 06:00:50 +0000 (0:00:00.708) 0:01:12.335 ********** 2026-04-03 06:01:27.051535 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.051543 | orchestrator | 2026-04-03 06:01:27.051552 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 06:01:27.051561 | orchestrator | Friday 03 April 2026 06:00:50 +0000 (0:00:00.500) 0:01:12.835 ********** 2026-04-03 06:01:27.051570 | orchestrator | included: /ansible/roles/nova/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:01:27.051579 | orchestrator | 2026-04-03 06:01:27.051588 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-03 06:01:27.051604 | orchestrator | Friday 03 April 2026 06:00:51 +0000 (0:00:00.671) 0:01:13.507 ********** 2026-04-03 06:01:27.051613 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:01:27.051621 | orchestrator | 2026-04-03 06:01:27.051630 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 06:01:27.051639 | orchestrator | Friday 03 April 2026 06:01:08 +0000 (0:00:17.119) 0:01:30.626 ********** 2026-04-03 06:01:27.051648 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.051657 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051665 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051674 | orchestrator | 2026-04-03 06:01:27.051683 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-03 06:01:27.051692 | orchestrator | 2026-04-03 06:01:27.051701 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 06:01:27.051709 | orchestrator | Friday 03 April 2026 06:01:08 +0000 (0:00:00.327) 0:01:30.953 ********** 2026-04-03 06:01:27.051718 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:01:27.051727 | orchestrator | 2026-04-03 06:01:27.051736 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-03 06:01:27.051745 | orchestrator | Friday 03 April 2026 06:01:09 +0000 (0:00:00.790) 0:01:31.744 ********** 2026-04-03 06:01:27.051754 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051762 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051771 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051780 | orchestrator | 2026-04-03 06:01:27.051788 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-03 06:01:27.051797 | orchestrator | Friday 03 April 2026 06:01:11 +0000 (0:00:02.002) 0:01:33.747 ********** 2026-04-03 06:01:27.051806 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051815 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051823 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.051832 | orchestrator | 2026-04-03 06:01:27.051841 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-03 06:01:27.051850 | orchestrator | Friday 03 April 2026 06:01:13 +0000 (0:00:02.056) 0:01:35.804 ********** 2026-04-03 06:01:27.051858 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.051867 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051876 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051885 | orchestrator | 2026-04-03 06:01:27.051893 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-03 06:01:27.051902 | orchestrator | Friday 03 April 2026 06:01:14 +0000 (0:00:00.551) 0:01:36.355 ********** 2026-04-03 06:01:27.051911 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 06:01:27.051967 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.051977 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 06:01:27.051986 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.051994 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 06:01:27.052003 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-03 06:01:27.052012 | orchestrator | 2026-04-03 06:01:27.052021 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-03 06:01:27.052030 | orchestrator | Friday 03 April 2026 06:01:21 +0000 (0:00:07.455) 0:01:43.811 ********** 2026-04-03 06:01:27.052039 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.052047 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.052056 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.052071 | orchestrator | 2026-04-03 06:01:27.052086 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-03 06:01:27.052100 | orchestrator | Friday 03 April 2026 06:01:22 +0000 (0:00:00.331) 0:01:44.143 ********** 2026-04-03 06:01:27.052113 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 06:01:27.052125 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:01:27.052139 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 06:01:27.052160 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.052173 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 06:01:27.052186 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.052199 | orchestrator | 2026-04-03 06:01:27.052212 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 06:01:27.052224 | orchestrator | Friday 03 April 2026 06:01:23 +0000 (0:00:01.131) 0:01:45.275 ********** 2026-04-03 06:01:27.052237 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.052251 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.052266 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.052279 | orchestrator | 2026-04-03 06:01:27.052293 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-03 06:01:27.052309 | orchestrator | Friday 03 April 2026 06:01:23 +0000 (0:00:00.463) 0:01:45.738 ********** 2026-04-03 06:01:27.052324 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.052339 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.052352 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:01:27.052362 | orchestrator | 2026-04-03 06:01:27.052371 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-03 06:01:27.052380 | orchestrator | Friday 03 April 2026 06:01:24 +0000 (0:00:00.996) 0:01:46.735 ********** 2026-04-03 06:01:27.052390 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:01:27.052405 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:01:27.052430 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:02:41.098549 | orchestrator | 2026-04-03 06:02:41.098632 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-03 06:02:41.098642 | orchestrator | Friday 03 April 2026 06:01:27 +0000 (0:00:02.421) 0:01:49.157 ********** 2026-04-03 06:02:41.098649 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098655 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098661 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:02:41.098667 | orchestrator | 2026-04-03 06:02:41.098673 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 06:02:41.098679 | orchestrator | Friday 03 April 2026 06:01:46 +0000 (0:00:19.927) 0:02:09.084 ********** 2026-04-03 06:02:41.098684 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098690 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098695 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:02:41.098701 | orchestrator | 2026-04-03 06:02:41.098707 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 06:02:41.098712 | orchestrator | Friday 03 April 2026 06:01:57 +0000 (0:00:10.485) 0:02:19.569 ********** 2026-04-03 06:02:41.098718 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:02:41.098723 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098729 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098734 | orchestrator | 2026-04-03 06:02:41.098740 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-03 06:02:41.098745 | orchestrator | Friday 03 April 2026 06:01:58 +0000 (0:00:01.054) 0:02:20.624 ********** 2026-04-03 06:02:41.098751 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098756 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098762 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:02:41.098767 | orchestrator | 2026-04-03 06:02:41.098773 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-03 06:02:41.098778 | orchestrator | Friday 03 April 2026 06:02:10 +0000 (0:00:12.329) 0:02:32.953 ********** 2026-04-03 06:02:41.098784 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:41.098789 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098795 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098800 | orchestrator | 2026-04-03 06:02:41.098806 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 06:02:41.098811 | orchestrator | Friday 03 April 2026 06:02:11 +0000 (0:00:01.085) 0:02:34.039 ********** 2026-04-03 06:02:41.098829 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:41.098835 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:41.098841 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:41.098846 | orchestrator | 2026-04-03 06:02:41.098852 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-03 06:02:41.098857 | orchestrator | 2026-04-03 06:02:41.098862 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 06:02:41.098868 | orchestrator | Friday 03 April 2026 06:02:12 +0000 (0:00:00.352) 0:02:34.392 ********** 2026-04-03 06:02:41.098873 | orchestrator | included: /ansible/roles/nova/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:02:41.098880 | orchestrator | 2026-04-03 06:02:41.098886 | orchestrator | TASK [service-ks-register : nova | Creating services] ************************** 2026-04-03 06:02:41.098891 | orchestrator | Friday 03 April 2026 06:02:13 +0000 (0:00:00.760) 0:02:35.152 ********** 2026-04-03 06:02:41.098897 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-03 06:02:41.098902 | orchestrator | changed: [testbed-node-0] => (item=nova (compute)) 2026-04-03 06:02:41.098908 | orchestrator | 2026-04-03 06:02:41.098913 | orchestrator | TASK [service-ks-register : nova | Creating endpoints] ************************* 2026-04-03 06:02:41.098919 | orchestrator | Friday 03 April 2026 06:02:16 +0000 (0:00:03.654) 0:02:38.807 ********** 2026-04-03 06:02:41.098924 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-03 06:02:41.098993 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-03 06:02:41.099001 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-03 06:02:41.099006 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-03 06:02:41.099012 | orchestrator | 2026-04-03 06:02:41.099018 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-03 06:02:41.099024 | orchestrator | Friday 03 April 2026 06:02:22 +0000 (0:00:06.123) 0:02:44.930 ********** 2026-04-03 06:02:41.099029 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:02:41.099035 | orchestrator | 2026-04-03 06:02:41.099041 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-03 06:02:41.099046 | orchestrator | Friday 03 April 2026 06:02:25 +0000 (0:00:03.085) 0:02:48.016 ********** 2026-04-03 06:02:41.099052 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:02:41.099057 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-03 06:02:41.099063 | orchestrator | 2026-04-03 06:02:41.099068 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-03 06:02:41.099074 | orchestrator | Friday 03 April 2026 06:02:29 +0000 (0:00:03.704) 0:02:51.720 ********** 2026-04-03 06:02:41.099080 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:02:41.099085 | orchestrator | 2026-04-03 06:02:41.099091 | orchestrator | TASK [service-ks-register : nova | Granting user roles] ************************ 2026-04-03 06:02:41.099096 | orchestrator | Friday 03 April 2026 06:02:32 +0000 (0:00:03.105) 0:02:54.826 ********** 2026-04-03 06:02:41.099102 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-03 06:02:41.099108 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> service) 2026-04-03 06:02:41.099114 | orchestrator | 2026-04-03 06:02:41.099119 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 06:02:41.099138 | orchestrator | Friday 03 April 2026 06:02:39 +0000 (0:00:07.049) 0:03:01.876 ********** 2026-04-03 06:02:41.099151 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:41.099168 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:41.099177 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:41.099193 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600198 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600297 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600313 | orchestrator | 2026-04-03 06:02:45.600324 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-03 06:02:45.600335 | orchestrator | Friday 03 April 2026 06:02:41 +0000 (0:00:01.333) 0:03:03.210 ********** 2026-04-03 06:02:45.600344 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:45.600354 | orchestrator | 2026-04-03 06:02:45.600363 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-03 06:02:45.600373 | orchestrator | Friday 03 April 2026 06:02:41 +0000 (0:00:00.144) 0:03:03.355 ********** 2026-04-03 06:02:45.600381 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:45.600390 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:45.600400 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:45.600408 | orchestrator | 2026-04-03 06:02:45.600417 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-03 06:02:45.600426 | orchestrator | Friday 03 April 2026 06:02:41 +0000 (0:00:00.295) 0:03:03.650 ********** 2026-04-03 06:02:45.600435 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:02:45.600444 | orchestrator | 2026-04-03 06:02:45.600453 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-03 06:02:45.600462 | orchestrator | Friday 03 April 2026 06:02:42 +0000 (0:00:00.707) 0:03:04.358 ********** 2026-04-03 06:02:45.600471 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:45.600480 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:45.600489 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:45.600498 | orchestrator | 2026-04-03 06:02:45.600507 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 06:02:45.600516 | orchestrator | Friday 03 April 2026 06:02:42 +0000 (0:00:00.555) 0:03:04.914 ********** 2026-04-03 06:02:45.600525 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:02:45.600535 | orchestrator | 2026-04-03 06:02:45.600545 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 06:02:45.600554 | orchestrator | Friday 03 April 2026 06:02:43 +0000 (0:00:00.589) 0:03:05.503 ********** 2026-04-03 06:02:45.600566 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:45.600630 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:45.600643 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:45.600654 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600663 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600683 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:45.600692 | orchestrator | 2026-04-03 06:02:45.600707 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 06:02:47.307445 | orchestrator | Friday 03 April 2026 06:02:45 +0000 (0:00:02.211) 0:03:07.714 ********** 2026-04-03 06:02:47.307589 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:47.307623 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:47.307642 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:47.307655 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:47.307691 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:47.307717 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:47.307751 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:47.307765 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:47.307777 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:47.307788 | orchestrator | 2026-04-03 06:02:47.307800 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 06:02:47.307812 | orchestrator | Friday 03 April 2026 06:02:46 +0000 (0:00:00.882) 0:03:08.596 ********** 2026-04-03 06:02:47.307824 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:47.307843 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:47.307855 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:47.307880 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:49.542221 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:49.542321 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:02:49.542342 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:49.542379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:49.542392 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:02:49.542404 | orchestrator | 2026-04-03 06:02:49.542417 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-03 06:02:49.542429 | orchestrator | Friday 03 April 2026 06:02:47 +0000 (0:00:00.829) 0:03:09.426 ********** 2026-04-03 06:02:49.542455 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:49.542488 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:49.542503 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:49.542526 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:49.542544 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:49.542564 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:55.913687 | orchestrator | 2026-04-03 06:02:55.913777 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-03 06:02:55.913788 | orchestrator | Friday 03 April 2026 06:02:49 +0000 (0:00:02.229) 0:03:11.655 ********** 2026-04-03 06:02:55.913801 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:55.913834 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:55.913857 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:02:55.913879 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:55.913888 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:55.913902 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:02:55.913909 | orchestrator | 2026-04-03 06:02:55.913916 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-03 06:02:55.913923 | orchestrator | Friday 03 April 2026 06:02:55 +0000 (0:00:05.749) 0:03:17.405 ********** 2026-04-03 06:02:55.913970 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:02:55.913978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:02:55.913983 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:02:55.913997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:03:00.215625 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:03:00.215736 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:00.215757 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-03 06:03:00.215792 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:03:00.215805 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:00.215817 | orchestrator | 2026-04-03 06:03:00.215829 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-03 06:03:00.215842 | orchestrator | Friday 03 April 2026 06:02:55 +0000 (0:00:00.623) 0:03:18.028 ********** 2026-04-03 06:03:00.215854 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:03:00.215864 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:03:00.215875 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:03:00.215886 | orchestrator | 2026-04-03 06:03:00.215897 | orchestrator | TASK [nova : Copying over vendordata file] ************************************* 2026-04-03 06:03:00.215909 | orchestrator | Friday 03 April 2026 06:02:57 +0000 (0:00:01.468) 0:03:19.497 ********** 2026-04-03 06:03:00.215920 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:00.215930 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:00.216006 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:00.216017 | orchestrator | 2026-04-03 06:03:00.216028 | orchestrator | TASK [nova : Check nova containers] ******************************************** 2026-04-03 06:03:00.216039 | orchestrator | Friday 03 April 2026 06:02:57 +0000 (0:00:00.348) 0:03:19.846 ********** 2026-04-03 06:03:00.216070 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:03:00.216107 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:03:00.216128 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-03 06:03:00.216143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:00.216167 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:00.216190 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:44.706905 | orchestrator | 2026-04-03 06:03:44.707069 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 06:03:44.707088 | orchestrator | Friday 03 April 2026 06:02:59 +0000 (0:00:02.022) 0:03:21.869 ********** 2026-04-03 06:03:44.707101 | orchestrator | 2026-04-03 06:03:44.707112 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 06:03:44.707124 | orchestrator | Friday 03 April 2026 06:02:59 +0000 (0:00:00.142) 0:03:22.011 ********** 2026-04-03 06:03:44.707135 | orchestrator | 2026-04-03 06:03:44.707146 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 06:03:44.707157 | orchestrator | Friday 03 April 2026 06:03:00 +0000 (0:00:00.147) 0:03:22.159 ********** 2026-04-03 06:03:44.707168 | orchestrator | 2026-04-03 06:03:44.707179 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-03 06:03:44.707191 | orchestrator | Friday 03 April 2026 06:03:00 +0000 (0:00:00.167) 0:03:22.326 ********** 2026-04-03 06:03:44.707202 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:03:44.707214 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:03:44.707225 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:03:44.707236 | orchestrator | 2026-04-03 06:03:44.707247 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-03 06:03:44.707259 | orchestrator | Friday 03 April 2026 06:03:22 +0000 (0:00:22.649) 0:03:44.976 ********** 2026-04-03 06:03:44.707270 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:03:44.707281 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:03:44.707292 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:03:44.707303 | orchestrator | 2026-04-03 06:03:44.707314 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-03 06:03:44.707325 | orchestrator | 2026-04-03 06:03:44.707336 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 06:03:44.707347 | orchestrator | Friday 03 April 2026 06:03:32 +0000 (0:00:09.696) 0:03:54.672 ********** 2026-04-03 06:03:44.707360 | orchestrator | included: /ansible/roles/nova-cell/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:03:44.707375 | orchestrator | 2026-04-03 06:03:44.707394 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 06:03:44.707433 | orchestrator | Friday 03 April 2026 06:03:33 +0000 (0:00:01.268) 0:03:55.941 ********** 2026-04-03 06:03:44.707454 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:03:44.707476 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:03:44.707496 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:03:44.707535 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:44.707549 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:44.707563 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:44.707575 | orchestrator | 2026-04-03 06:03:44.707588 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-03 06:03:44.707602 | orchestrator | Friday 03 April 2026 06:03:34 +0000 (0:00:00.791) 0:03:56.733 ********** 2026-04-03 06:03:44.707615 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:44.707627 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:44.707640 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:44.707653 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:03:44.707666 | orchestrator | 2026-04-03 06:03:44.707679 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 06:03:44.707692 | orchestrator | Friday 03 April 2026 06:03:35 +0000 (0:00:00.874) 0:03:57.607 ********** 2026-04-03 06:03:44.707705 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-03 06:03:44.707719 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-03 06:03:44.707737 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-03 06:03:44.707755 | orchestrator | 2026-04-03 06:03:44.707773 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 06:03:44.707792 | orchestrator | Friday 03 April 2026 06:03:36 +0000 (0:00:00.804) 0:03:58.411 ********** 2026-04-03 06:03:44.707810 | orchestrator | changed: [testbed-node-3] => (item=br_netfilter) 2026-04-03 06:03:44.707829 | orchestrator | changed: [testbed-node-4] => (item=br_netfilter) 2026-04-03 06:03:44.707848 | orchestrator | changed: [testbed-node-5] => (item=br_netfilter) 2026-04-03 06:03:44.707867 | orchestrator | 2026-04-03 06:03:44.707879 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 06:03:44.707890 | orchestrator | Friday 03 April 2026 06:03:37 +0000 (0:00:01.199) 0:03:59.610 ********** 2026-04-03 06:03:44.707901 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-03 06:03:44.707912 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:03:44.707923 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-03 06:03:44.707934 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:03:44.707987 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-03 06:03:44.707999 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:03:44.708069 | orchestrator | 2026-04-03 06:03:44.708088 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-03 06:03:44.708107 | orchestrator | Friday 03 April 2026 06:03:38 +0000 (0:00:00.618) 0:04:00.229 ********** 2026-04-03 06:03:44.708125 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 06:03:44.708145 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 06:03:44.708163 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 06:03:44.708182 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 06:03:44.708194 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:44.708205 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 06:03:44.708216 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 06:03:44.708245 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 06:03:44.708257 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:44.708268 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 06:03:44.708279 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 06:03:44.708290 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 06:03:44.708301 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 06:03:44.708325 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:44.708336 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 06:03:44.708347 | orchestrator | 2026-04-03 06:03:44.708358 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-03 06:03:44.708369 | orchestrator | Friday 03 April 2026 06:03:39 +0000 (0:00:01.197) 0:04:01.427 ********** 2026-04-03 06:03:44.708380 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:44.708391 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:44.708402 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:44.708413 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:03:44.708424 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:03:44.708435 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:03:44.708446 | orchestrator | 2026-04-03 06:03:44.708457 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-03 06:03:44.708468 | orchestrator | Friday 03 April 2026 06:03:40 +0000 (0:00:01.095) 0:04:02.522 ********** 2026-04-03 06:03:44.708479 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:44.708490 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:44.708509 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:44.708527 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:03:44.708547 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:03:44.708565 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:03:44.708581 | orchestrator | 2026-04-03 06:03:44.708593 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 06:03:44.708604 | orchestrator | Friday 03 April 2026 06:03:43 +0000 (0:00:02.607) 0:04:05.129 ********** 2026-04-03 06:03:44.708626 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:44.708645 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:44.708665 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497052 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497156 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497189 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497202 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497216 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497230 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497282 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497295 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497312 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497325 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497337 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497349 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:46.497368 | orchestrator | 2026-04-03 06:03:46.497382 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 06:03:46.497395 | orchestrator | Friday 03 April 2026 06:03:45 +0000 (0:00:02.187) 0:04:07.316 ********** 2026-04-03 06:03:46.497407 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:03:46.497420 | orchestrator | 2026-04-03 06:03:46.497431 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 06:03:46.497449 | orchestrator | Friday 03 April 2026 06:03:46 +0000 (0:00:01.294) 0:04:08.611 ********** 2026-04-03 06:03:49.755107 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755214 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755224 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755232 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755253 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755271 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755278 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755320 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755328 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755334 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755345 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755351 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:49.755361 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:51.296119 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:51.296240 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:03:51.296255 | orchestrator | 2026-04-03 06:03:51.296266 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 06:03:51.296276 | orchestrator | Friday 03 April 2026 06:03:49 +0000 (0:00:03.456) 0:04:12.067 ********** 2026-04-03 06:03:51.296288 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:03:51.296318 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:03:51.296328 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:03:51.296338 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:03:51.296370 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:03:51.296381 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:03:51.296390 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:03:51.296408 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:03:51.296418 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:03:51.296427 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:03:51.296444 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:03:52.875113 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:03:52.875233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:03:52.875255 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:03:52.875288 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:03:52.875301 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:03:52.875313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:03:52.875324 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:03:52.875336 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:03:52.875348 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:03:52.875359 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:03:52.875370 | orchestrator | 2026-04-03 06:03:52.875382 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 06:03:52.875396 | orchestrator | Friday 03 April 2026 06:03:51 +0000 (0:00:01.554) 0:04:13.622 ********** 2026-04-03 06:03:52.875431 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:03:52.875469 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:03:52.875485 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:03:52.875498 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:03:52.875521 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:03:52.875533 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:03:52.875559 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:00.244133 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:04:00.244269 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:00.244296 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:00.244316 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:04:00.244328 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:00.244339 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:00.244350 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:00.244360 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:00.244405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:00.244441 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:00.244455 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:00.244468 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:00.244480 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:00.244493 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:00.244505 | orchestrator | 2026-04-03 06:04:00.244518 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 06:04:00.244531 | orchestrator | Friday 03 April 2026 06:03:53 +0000 (0:00:01.961) 0:04:15.584 ********** 2026-04-03 06:04:00.244543 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:00.244554 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:00.244566 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:00.244578 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:04:00.244591 | orchestrator | 2026-04-03 06:04:00.244602 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-03 06:04:00.244614 | orchestrator | Friday 03 April 2026 06:03:54 +0000 (0:00:01.094) 0:04:16.678 ********** 2026-04-03 06:04:00.244626 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:04:00.244638 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:04:00.244649 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:04:00.244661 | orchestrator | 2026-04-03 06:04:00.244673 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-03 06:04:00.244686 | orchestrator | Friday 03 April 2026 06:03:55 +0000 (0:00:01.095) 0:04:17.774 ********** 2026-04-03 06:04:00.244698 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:04:00.244709 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:04:00.244721 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:04:00.244732 | orchestrator | 2026-04-03 06:04:00.244744 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-03 06:04:00.244756 | orchestrator | Friday 03 April 2026 06:03:56 +0000 (0:00:00.894) 0:04:18.668 ********** 2026-04-03 06:04:00.244775 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:04:00.244788 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:04:00.244800 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:04:00.244812 | orchestrator | 2026-04-03 06:04:00.244821 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-03 06:04:00.244831 | orchestrator | Friday 03 April 2026 06:03:57 +0000 (0:00:00.555) 0:04:19.224 ********** 2026-04-03 06:04:00.244841 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:04:00.244850 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:04:00.244860 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:04:00.244869 | orchestrator | 2026-04-03 06:04:00.244879 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-03 06:04:00.244889 | orchestrator | Friday 03 April 2026 06:03:57 +0000 (0:00:00.516) 0:04:19.740 ********** 2026-04-03 06:04:00.244899 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-03 06:04:00.244909 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-03 06:04:00.244919 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-03 06:04:00.244928 | orchestrator | 2026-04-03 06:04:00.244938 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-03 06:04:00.245017 | orchestrator | Friday 03 April 2026 06:03:59 +0000 (0:00:01.410) 0:04:21.151 ********** 2026-04-03 06:04:00.245043 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-03 06:04:00.245057 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-03 06:04:00.245075 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-03 06:04:18.178107 | orchestrator | 2026-04-03 06:04:18.178224 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-03 06:04:18.178242 | orchestrator | Friday 03 April 2026 06:04:00 +0000 (0:00:01.202) 0:04:22.354 ********** 2026-04-03 06:04:18.178255 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-03 06:04:18.178267 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-03 06:04:18.178278 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-03 06:04:18.178289 | orchestrator | changed: [testbed-node-3] => (item=nova-libvirt) 2026-04-03 06:04:18.178300 | orchestrator | changed: [testbed-node-4] => (item=nova-libvirt) 2026-04-03 06:04:18.178311 | orchestrator | changed: [testbed-node-5] => (item=nova-libvirt) 2026-04-03 06:04:18.178322 | orchestrator | 2026-04-03 06:04:18.178333 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-03 06:04:18.178344 | orchestrator | Friday 03 April 2026 06:04:03 +0000 (0:00:03.697) 0:04:26.051 ********** 2026-04-03 06:04:18.178356 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:18.178368 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:18.178379 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:18.178390 | orchestrator | 2026-04-03 06:04:18.178401 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-03 06:04:18.178412 | orchestrator | Friday 03 April 2026 06:04:04 +0000 (0:00:00.312) 0:04:26.364 ********** 2026-04-03 06:04:18.178423 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:18.178434 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:18.178445 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:18.178456 | orchestrator | 2026-04-03 06:04:18.178468 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-03 06:04:18.178479 | orchestrator | Friday 03 April 2026 06:04:04 +0000 (0:00:00.552) 0:04:26.916 ********** 2026-04-03 06:04:18.178490 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:04:18.178501 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:04:18.178512 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:04:18.178523 | orchestrator | 2026-04-03 06:04:18.178534 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-03 06:04:18.178545 | orchestrator | Friday 03 April 2026 06:04:06 +0000 (0:00:01.233) 0:04:28.150 ********** 2026-04-03 06:04:18.178557 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-03 06:04:18.178595 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-03 06:04:18.178607 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-03 06:04:18.178618 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-03 06:04:18.178629 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-03 06:04:18.178640 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-03 06:04:18.178651 | orchestrator | 2026-04-03 06:04:18.178662 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-03 06:04:18.178673 | orchestrator | Friday 03 April 2026 06:04:09 +0000 (0:00:03.224) 0:04:31.374 ********** 2026-04-03 06:04:18.178684 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 06:04:18.178695 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 06:04:18.178706 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 06:04:18.178717 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-03 06:04:18.178727 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:04:18.178739 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-03 06:04:18.178749 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:04:18.178760 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-03 06:04:18.178771 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:04:18.178782 | orchestrator | 2026-04-03 06:04:18.178793 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-03 06:04:18.178804 | orchestrator | Friday 03 April 2026 06:04:12 +0000 (0:00:03.195) 0:04:34.570 ********** 2026-04-03 06:04:18.178814 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:18.178825 | orchestrator | 2026-04-03 06:04:18.178836 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-03 06:04:18.178848 | orchestrator | Friday 03 April 2026 06:04:12 +0000 (0:00:00.137) 0:04:34.707 ********** 2026-04-03 06:04:18.178859 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:18.178870 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:18.178881 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:18.178891 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:18.178902 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:18.178913 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:18.178924 | orchestrator | 2026-04-03 06:04:18.178934 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-03 06:04:18.178995 | orchestrator | Friday 03 April 2026 06:04:13 +0000 (0:00:00.808) 0:04:35.516 ********** 2026-04-03 06:04:18.179009 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:04:18.179020 | orchestrator | 2026-04-03 06:04:18.179031 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-03 06:04:18.179042 | orchestrator | Friday 03 April 2026 06:04:14 +0000 (0:00:00.693) 0:04:36.210 ********** 2026-04-03 06:04:18.179066 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:18.179078 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:18.179089 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:18.179099 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:18.179129 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:18.179151 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:18.179163 | orchestrator | 2026-04-03 06:04:18.179174 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-03 06:04:18.179186 | orchestrator | Friday 03 April 2026 06:04:14 +0000 (0:00:00.817) 0:04:37.027 ********** 2026-04-03 06:04:18.179210 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:18.179226 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:18.179237 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:18.179250 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:18.179274 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678493 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678593 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678606 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678614 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678621 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678628 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678664 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678691 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678699 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678706 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:22.678713 | orchestrator | 2026-04-03 06:04:22.678721 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-03 06:04:22.678729 | orchestrator | Friday 03 April 2026 06:04:18 +0000 (0:00:03.457) 0:04:40.484 ********** 2026-04-03 06:04:22.678736 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:22.678748 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:22.678768 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:24.980548 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:24.980670 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:24.980688 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:24.980701 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980750 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980784 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980799 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980812 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980825 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980838 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980863 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980880 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:04:24.980899 | orchestrator | 2026-04-03 06:04:24.980919 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-03 06:04:24.981016 | orchestrator | Friday 03 April 2026 06:04:24 +0000 (0:00:06.610) 0:04:47.095 ********** 2026-04-03 06:04:46.374089 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:46.374253 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:46.374270 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:46.374283 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.374294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.374306 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.374317 | orchestrator | 2026-04-03 06:04:46.374330 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-03 06:04:46.374343 | orchestrator | Friday 03 April 2026 06:04:26 +0000 (0:00:01.341) 0:04:48.436 ********** 2026-04-03 06:04:46.374355 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 06:04:46.374368 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 06:04:46.374379 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 06:04:46.374390 | orchestrator | changed: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 06:04:46.374401 | orchestrator | changed: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 06:04:46.374412 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 06:04:46.374425 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.374436 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 06:04:46.374447 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.374459 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 06:04:46.374470 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.374481 | orchestrator | changed: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 06:04:46.374492 | orchestrator | changed: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 06:04:46.374505 | orchestrator | changed: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 06:04:46.374548 | orchestrator | changed: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 06:04:46.374562 | orchestrator | 2026-04-03 06:04:46.374576 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-03 06:04:46.374590 | orchestrator | Friday 03 April 2026 06:04:29 +0000 (0:00:03.566) 0:04:52.003 ********** 2026-04-03 06:04:46.374603 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:46.374616 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:46.374628 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:46.374643 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.374656 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.374669 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.374684 | orchestrator | 2026-04-03 06:04:46.374697 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-03 06:04:46.374711 | orchestrator | Friday 03 April 2026 06:04:30 +0000 (0:00:00.633) 0:04:52.636 ********** 2026-04-03 06:04:46.374725 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 06:04:46.374737 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 06:04:46.374751 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 06:04:46.374764 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 06:04:46.374777 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 06:04:46.374790 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 06:04:46.374832 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374846 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374860 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374871 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374881 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.374892 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374903 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.374914 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 06:04:46.374925 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.375009 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375024 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375056 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375068 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375079 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375090 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 06:04:46.375101 | orchestrator | 2026-04-03 06:04:46.375112 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-03 06:04:46.375123 | orchestrator | Friday 03 April 2026 06:04:35 +0000 (0:00:05.338) 0:04:57.975 ********** 2026-04-03 06:04:46.375145 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 06:04:46.375156 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 06:04:46.375167 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 06:04:46.375178 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 06:04:46.375189 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 06:04:46.375200 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 06:04:46.375211 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 06:04:46.375222 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 06:04:46.375233 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 06:04:46.375244 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 06:04:46.375255 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 06:04:46.375266 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 06:04:46.375276 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.375288 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 06:04:46.375298 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 06:04:46.375309 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.375320 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 06:04:46.375332 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 06:04:46.375343 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.375354 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 06:04:46.375365 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 06:04:46.375376 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 06:04:46.375387 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 06:04:46.375397 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 06:04:46.375408 | orchestrator | changed: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 06:04:46.375419 | orchestrator | changed: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 06:04:46.375430 | orchestrator | changed: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 06:04:46.375441 | orchestrator | 2026-04-03 06:04:46.375452 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-03 06:04:46.375469 | orchestrator | Friday 03 April 2026 06:04:42 +0000 (0:00:06.903) 0:05:04.878 ********** 2026-04-03 06:04:46.375480 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:46.375491 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:46.375502 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:46.375513 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.375524 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.375535 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.375546 | orchestrator | 2026-04-03 06:04:46.375557 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-03 06:04:46.375568 | orchestrator | Friday 03 April 2026 06:04:43 +0000 (0:00:00.815) 0:05:05.694 ********** 2026-04-03 06:04:46.375579 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:46.375598 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:46.375609 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:46.375620 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.375631 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.375642 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.375653 | orchestrator | 2026-04-03 06:04:46.375664 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-03 06:04:46.375675 | orchestrator | Friday 03 April 2026 06:04:44 +0000 (0:00:00.619) 0:05:06.313 ********** 2026-04-03 06:04:46.375686 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:46.375697 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:04:46.375708 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:46.375719 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:46.375744 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:04:46.375756 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:04:46.375777 | orchestrator | 2026-04-03 06:04:46.375796 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-03 06:04:47.514414 | orchestrator | Friday 03 April 2026 06:04:46 +0000 (0:00:02.162) 0:05:08.476 ********** 2026-04-03 06:04:47.514577 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:47.514600 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:47.514616 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:04:47.514630 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:47.514693 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:47.514733 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:47.514766 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:04:47.514779 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:47.514791 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 06:04:47.514804 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:47.514816 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 06:04:47.514842 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:47.514862 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 06:04:50.996525 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:50.996661 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:50.996680 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:50.996696 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:50.996708 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:50.996720 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 06:04:50.996732 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:04:50.996771 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:50.996784 | orchestrator | 2026-04-03 06:04:50.996796 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-03 06:04:50.996809 | orchestrator | Friday 03 April 2026 06:04:47 +0000 (0:00:01.467) 0:05:09.943 ********** 2026-04-03 06:04:50.996821 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-03 06:04:50.996832 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 06:04:50.996861 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:04:50.996872 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-03 06:04:50.996883 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 06:04:50.996894 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:04:50.996905 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-03 06:04:50.996916 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 06:04:50.996927 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:04:50.996938 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 06:04:50.996949 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 06:04:50.996987 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:04:50.996998 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 06:04:50.997009 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 06:04:50.997020 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:04:50.997031 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 06:04:50.997042 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 06:04:50.997053 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:04:50.997064 | orchestrator | 2026-04-03 06:04:50.997075 | orchestrator | TASK [nova-cell : Check nova-cell containers] ********************************** 2026-04-03 06:04:50.997087 | orchestrator | Friday 03 April 2026 06:04:48 +0000 (0:00:00.886) 0:05:10.830 ********** 2026-04-03 06:04:50.997121 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:50.997136 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:50.997156 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 06:04:50.997174 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:04:50.997188 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:04:50.997208 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110093 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110222 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110261 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110276 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110304 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110316 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110346 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110359 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110379 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 06:05:49.110391 | orchestrator | 2026-04-03 06:05:49.110405 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 06:05:49.110418 | orchestrator | Friday 03 April 2026 06:04:51 +0000 (0:00:02.611) 0:05:13.441 ********** 2026-04-03 06:05:49.110429 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:05:49.110441 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:05:49.110452 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:05:49.110463 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:05:49.110474 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:05:49.110485 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:05:49.110496 | orchestrator | 2026-04-03 06:05:49.110507 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110521 | orchestrator | Friday 03 April 2026 06:04:52 +0000 (0:00:00.839) 0:05:14.280 ********** 2026-04-03 06:05:49.110534 | orchestrator | 2026-04-03 06:05:49.110564 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110589 | orchestrator | Friday 03 April 2026 06:04:52 +0000 (0:00:00.140) 0:05:14.421 ********** 2026-04-03 06:05:49.110603 | orchestrator | 2026-04-03 06:05:49.110617 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110635 | orchestrator | Friday 03 April 2026 06:04:52 +0000 (0:00:00.138) 0:05:14.559 ********** 2026-04-03 06:05:49.110648 | orchestrator | 2026-04-03 06:05:49.110661 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110674 | orchestrator | Friday 03 April 2026 06:04:52 +0000 (0:00:00.142) 0:05:14.701 ********** 2026-04-03 06:05:49.110687 | orchestrator | 2026-04-03 06:05:49.110700 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110714 | orchestrator | Friday 03 April 2026 06:04:52 +0000 (0:00:00.138) 0:05:14.840 ********** 2026-04-03 06:05:49.110727 | orchestrator | 2026-04-03 06:05:49.110740 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 06:05:49.110753 | orchestrator | Friday 03 April 2026 06:04:53 +0000 (0:00:00.292) 0:05:15.132 ********** 2026-04-03 06:05:49.110766 | orchestrator | 2026-04-03 06:05:49.110780 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-03 06:05:49.110794 | orchestrator | Friday 03 April 2026 06:04:53 +0000 (0:00:00.134) 0:05:15.267 ********** 2026-04-03 06:05:49.110806 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:05:49.110819 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:05:49.110832 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:05:49.110845 | orchestrator | 2026-04-03 06:05:49.110858 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-03 06:05:49.110871 | orchestrator | Friday 03 April 2026 06:05:04 +0000 (0:00:11.602) 0:05:26.870 ********** 2026-04-03 06:05:49.110884 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:05:49.110897 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:05:49.110910 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:05:49.110922 | orchestrator | 2026-04-03 06:05:49.110933 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-03 06:05:49.110951 | orchestrator | Friday 03 April 2026 06:05:23 +0000 (0:00:18.517) 0:05:45.387 ********** 2026-04-03 06:05:49.110962 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:05:49.111005 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:05:49.111017 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:05:49.111028 | orchestrator | 2026-04-03 06:05:49.111046 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-03 06:08:11.645761 | orchestrator | Friday 03 April 2026 06:05:49 +0000 (0:00:25.826) 0:06:11.213 ********** 2026-04-03 06:08:11.645870 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:08:11.645885 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:08:11.645895 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:08:11.645906 | orchestrator | 2026-04-03 06:08:11.645916 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-03 06:08:11.645927 | orchestrator | Friday 03 April 2026 06:06:28 +0000 (0:00:39.471) 0:06:50.685 ********** 2026-04-03 06:08:11.645937 | orchestrator | FAILED - RETRYING: [testbed-node-4]: Checking libvirt container is ready (10 retries left). 2026-04-03 06:08:11.645947 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:08:11.645958 | orchestrator | FAILED - RETRYING: [testbed-node-5]: Checking libvirt container is ready (10 retries left). 2026-04-03 06:08:11.645967 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:08:11.645977 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:08:11.645987 | orchestrator | 2026-04-03 06:08:11.646081 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-03 06:08:11.646094 | orchestrator | Friday 03 April 2026 06:06:34 +0000 (0:00:06.197) 0:06:56.883 ********** 2026-04-03 06:08:11.646104 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:08:11.646114 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:08:11.646124 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:08:11.646134 | orchestrator | 2026-04-03 06:08:11.646144 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-03 06:08:11.646154 | orchestrator | Friday 03 April 2026 06:06:35 +0000 (0:00:00.813) 0:06:57.697 ********** 2026-04-03 06:08:11.646164 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:08:11.646174 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:08:11.646184 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:08:11.646194 | orchestrator | 2026-04-03 06:08:11.646204 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-03 06:08:11.646215 | orchestrator | Friday 03 April 2026 06:07:05 +0000 (0:00:30.097) 0:07:27.794 ********** 2026-04-03 06:08:11.646225 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:08:11.646235 | orchestrator | 2026-04-03 06:08:11.646245 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-03 06:08:11.646255 | orchestrator | Friday 03 April 2026 06:07:05 +0000 (0:00:00.127) 0:07:27.921 ********** 2026-04-03 06:08:11.646265 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:08:11.646275 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:08:11.646285 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:11.646294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:11.646304 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.646315 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for nova-compute services to register themselves (20 retries left). 2026-04-03 06:08:11.646330 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 06:08:11.646342 | orchestrator | 2026-04-03 06:08:11.646354 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-03 06:08:11.646367 | orchestrator | Friday 03 April 2026 06:07:27 +0000 (0:00:21.754) 0:07:49.676 ********** 2026-04-03 06:08:11.646378 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:08:11.646391 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:11.646402 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.646414 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:08:11.646446 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:11.646458 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:08:11.646469 | orchestrator | 2026-04-03 06:08:11.646481 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-03 06:08:11.646492 | orchestrator | Friday 03 April 2026 06:07:36 +0000 (0:00:09.204) 0:07:58.881 ********** 2026-04-03 06:08:11.646504 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:08:11.646521 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.646559 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:08:11.646581 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:11.646597 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:11.646614 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-4 2026-04-03 06:08:11.646629 | orchestrator | 2026-04-03 06:08:11.646647 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 06:08:11.646664 | orchestrator | Friday 03 April 2026 06:07:40 +0000 (0:00:03.993) 0:08:02.874 ********** 2026-04-03 06:08:11.646683 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 06:08:11.646699 | orchestrator | 2026-04-03 06:08:11.646716 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 06:08:11.646733 | orchestrator | Friday 03 April 2026 06:07:51 +0000 (0:00:10.910) 0:08:13.784 ********** 2026-04-03 06:08:11.646749 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 06:08:11.646767 | orchestrator | 2026-04-03 06:08:11.646782 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-03 06:08:11.646792 | orchestrator | Friday 03 April 2026 06:07:53 +0000 (0:00:01.526) 0:08:15.311 ********** 2026-04-03 06:08:11.646801 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:08:11.646811 | orchestrator | 2026-04-03 06:08:11.646821 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-03 06:08:11.646831 | orchestrator | Friday 03 April 2026 06:07:54 +0000 (0:00:01.500) 0:08:16.812 ********** 2026-04-03 06:08:11.646840 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 06:08:11.646850 | orchestrator | 2026-04-03 06:08:11.646860 | orchestrator | TASK [nova-cell : Remove old nova_libvirt_secrets container volume] ************ 2026-04-03 06:08:11.646869 | orchestrator | Friday 03 April 2026 06:08:06 +0000 (0:00:11.564) 0:08:28.376 ********** 2026-04-03 06:08:11.646879 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:08:11.646890 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:08:11.646899 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:08:11.646909 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:11.646919 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:11.646928 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:11.646938 | orchestrator | 2026-04-03 06:08:11.646963 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-03 06:08:11.646974 | orchestrator | 2026-04-03 06:08:11.646984 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-03 06:08:11.647032 | orchestrator | Friday 03 April 2026 06:08:08 +0000 (0:00:01.769) 0:08:30.146 ********** 2026-04-03 06:08:11.647045 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:08:11.647055 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:08:11.647065 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:08:11.647074 | orchestrator | 2026-04-03 06:08:11.647084 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-03 06:08:11.647094 | orchestrator | 2026-04-03 06:08:11.647104 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-03 06:08:11.647114 | orchestrator | Friday 03 April 2026 06:08:08 +0000 (0:00:00.908) 0:08:31.055 ********** 2026-04-03 06:08:11.647124 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.647133 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:11.647143 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:11.647153 | orchestrator | 2026-04-03 06:08:11.647163 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-03 06:08:11.647184 | orchestrator | 2026-04-03 06:08:11.647195 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-03 06:08:11.647213 | orchestrator | Friday 03 April 2026 06:08:09 +0000 (0:00:00.732) 0:08:31.787 ********** 2026-04-03 06:08:11.647239 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-03 06:08:11.647257 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-03 06:08:11.647273 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647290 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-03 06:08:11.647305 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-03 06:08:11.647320 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647336 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:08:11.647354 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-03 06:08:11.647371 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-03 06:08:11.647387 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647397 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-03 06:08:11.647407 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-03 06:08:11.647417 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647426 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:08:11.647436 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-03 06:08:11.647446 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-03 06:08:11.647456 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647466 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-03 06:08:11.647476 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-03 06:08:11.647485 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647495 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:08:11.647505 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-03 06:08:11.647515 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 06:08:11.647525 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647535 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-03 06:08:11.647544 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-03 06:08:11.647554 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647572 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.647582 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-03 06:08:11.647592 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 06:08:11.647602 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647612 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-03 06:08:11.647621 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-03 06:08:11.647631 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647641 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:11.647651 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-03 06:08:11.647661 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 06:08:11.647671 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 06:08:11.647680 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-03 06:08:11.647690 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-03 06:08:11.647700 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-03 06:08:11.647710 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:11.647728 | orchestrator | 2026-04-03 06:08:11.647738 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-03 06:08:11.647748 | orchestrator | 2026-04-03 06:08:11.647759 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-03 06:08:11.647776 | orchestrator | Friday 03 April 2026 06:08:11 +0000 (0:00:01.381) 0:08:33.168 ********** 2026-04-03 06:08:11.647801 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-03 06:08:11.647819 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-03 06:08:11.647834 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:11.647850 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-03 06:08:11.647867 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-03 06:08:11.647895 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:13.385365 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-03 06:08:13.385463 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-03 06:08:13.385478 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:13.385490 | orchestrator | 2026-04-03 06:08:13.385503 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-03 06:08:13.385515 | orchestrator | 2026-04-03 06:08:13.385526 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-03 06:08:13.385538 | orchestrator | Friday 03 April 2026 06:08:11 +0000 (0:00:00.591) 0:08:33.760 ********** 2026-04-03 06:08:13.385549 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:13.385560 | orchestrator | 2026-04-03 06:08:13.385571 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-03 06:08:13.385582 | orchestrator | 2026-04-03 06:08:13.385593 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-03 06:08:13.385604 | orchestrator | Friday 03 April 2026 06:08:12 +0000 (0:00:00.880) 0:08:34.641 ********** 2026-04-03 06:08:13.385615 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:13.385626 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:13.385637 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:13.385648 | orchestrator | 2026-04-03 06:08:13.385659 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:08:13.385670 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:08:13.385685 | orchestrator | testbed-node-0 : ok=54  changed=35  unreachable=0 failed=0 skipped=44  rescued=0 ignored=0 2026-04-03 06:08:13.385697 | orchestrator | testbed-node-1 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-03 06:08:13.385707 | orchestrator | testbed-node-2 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-03 06:08:13.385718 | orchestrator | testbed-node-3 : ok=38  changed=27  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-03 06:08:13.385729 | orchestrator | testbed-node-4 : ok=42  changed=27  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-03 06:08:13.385740 | orchestrator | testbed-node-5 : ok=37  changed=27  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 06:08:13.385751 | orchestrator | 2026-04-03 06:08:13.385763 | orchestrator | 2026-04-03 06:08:13.385774 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:08:13.385785 | orchestrator | Friday 03 April 2026 06:08:12 +0000 (0:00:00.470) 0:08:35.111 ********** 2026-04-03 06:08:13.385796 | orchestrator | =============================================================================== 2026-04-03 06:08:13.385807 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 39.47s 2026-04-03 06:08:13.385845 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 30.59s 2026-04-03 06:08:13.385856 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 30.10s 2026-04-03 06:08:13.385868 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 25.83s 2026-04-03 06:08:13.385906 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 22.65s 2026-04-03 06:08:13.385918 | orchestrator | nova-cell : Waiting for nova-compute services to register themselves --- 21.75s 2026-04-03 06:08:13.385929 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 19.93s 2026-04-03 06:08:13.385940 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 18.52s 2026-04-03 06:08:13.385950 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 17.12s 2026-04-03 06:08:13.385961 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 13.47s 2026-04-03 06:08:13.385972 | orchestrator | nova-cell : Create cell ------------------------------------------------ 12.33s 2026-04-03 06:08:13.385983 | orchestrator | nova-cell : Restart nova-conductor container --------------------------- 11.60s 2026-04-03 06:08:13.386084 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 11.56s 2026-04-03 06:08:13.386101 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 11.26s 2026-04-03 06:08:13.386112 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 10.91s 2026-04-03 06:08:13.386123 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 10.49s 2026-04-03 06:08:13.386134 | orchestrator | nova : Restart nova-api container --------------------------------------- 9.70s 2026-04-03 06:08:13.386145 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------- 9.20s 2026-04-03 06:08:13.386156 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------- 7.46s 2026-04-03 06:08:13.386167 | orchestrator | service-ks-register : nova | Granting user roles ------------------------ 7.05s 2026-04-03 06:08:15.719717 | orchestrator | 2026-04-03 06:08:15 | INFO  | Task 754b80f7-091a-49c8-824c-119bfeace8ec (horizon) was prepared for execution. 2026-04-03 06:08:15.719790 | orchestrator | 2026-04-03 06:08:15 | INFO  | It takes a moment until task 754b80f7-091a-49c8-824c-119bfeace8ec (horizon) has been started and output is visible here. 2026-04-03 06:08:23.019597 | orchestrator | 2026-04-03 06:08:23.019709 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:08:23.019726 | orchestrator | 2026-04-03 06:08:23.019739 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:08:23.019751 | orchestrator | Friday 03 April 2026 06:08:19 +0000 (0:00:00.261) 0:00:00.261 ********** 2026-04-03 06:08:23.019778 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:23.019791 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:23.019803 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:23.019814 | orchestrator | 2026-04-03 06:08:23.019825 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:08:23.019837 | orchestrator | Friday 03 April 2026 06:08:20 +0000 (0:00:00.309) 0:00:00.571 ********** 2026-04-03 06:08:23.019848 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-03 06:08:23.019860 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-03 06:08:23.019871 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-03 06:08:23.019883 | orchestrator | 2026-04-03 06:08:23.019894 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-03 06:08:23.019905 | orchestrator | 2026-04-03 06:08:23.019916 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 06:08:23.019928 | orchestrator | Friday 03 April 2026 06:08:20 +0000 (0:00:00.472) 0:00:01.044 ********** 2026-04-03 06:08:23.019940 | orchestrator | included: /ansible/roles/horizon/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:08:23.019971 | orchestrator | 2026-04-03 06:08:23.019983 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-03 06:08:23.019994 | orchestrator | Friday 03 April 2026 06:08:21 +0000 (0:00:00.551) 0:00:01.595 ********** 2026-04-03 06:08:23.020094 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:23.020132 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:23.020166 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:23.020181 | orchestrator | 2026-04-03 06:08:23.020195 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-03 06:08:23.020208 | orchestrator | Friday 03 April 2026 06:08:22 +0000 (0:00:01.126) 0:00:02.722 ********** 2026-04-03 06:08:23.020222 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:23.020235 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:23.020249 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:23.020262 | orchestrator | 2026-04-03 06:08:23.020276 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 06:08:23.020290 | orchestrator | Friday 03 April 2026 06:08:22 +0000 (0:00:00.460) 0:00:03.183 ********** 2026-04-03 06:08:23.020311 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 06:08:29.033662 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 06:08:29.033800 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 06:08:29.033828 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 06:08:29.033849 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 06:08:29.033869 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 06:08:29.033922 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-03 06:08:29.033942 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 06:08:29.033961 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 06:08:29.033980 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 06:08:29.034191 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 06:08:29.034227 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 06:08:29.034249 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 06:08:29.034271 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 06:08:29.034291 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-03 06:08:29.034311 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 06:08:29.034331 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 06:08:29.034350 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 06:08:29.034369 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 06:08:29.034390 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 06:08:29.034410 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 06:08:29.034431 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 06:08:29.034451 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-03 06:08:29.034472 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 06:08:29.034487 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-03 06:08:29.034500 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-03 06:08:29.034512 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-03 06:08:29.034539 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-03 06:08:29.034549 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-03 06:08:29.034559 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-03 06:08:29.034569 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-03 06:08:29.034579 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-03 06:08:29.034589 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-03 06:08:29.034600 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-03 06:08:29.034610 | orchestrator | 2026-04-03 06:08:29.034633 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.034644 | orchestrator | Friday 03 April 2026 06:08:23 +0000 (0:00:00.723) 0:00:03.906 ********** 2026-04-03 06:08:29.034654 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.034665 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.034675 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.034684 | orchestrator | 2026-04-03 06:08:29.034694 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.034704 | orchestrator | Friday 03 April 2026 06:08:23 +0000 (0:00:00.337) 0:00:04.244 ********** 2026-04-03 06:08:29.034714 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.034725 | orchestrator | 2026-04-03 06:08:29.034757 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.034768 | orchestrator | Friday 03 April 2026 06:08:24 +0000 (0:00:00.299) 0:00:04.543 ********** 2026-04-03 06:08:29.034777 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.034787 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.034797 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.034806 | orchestrator | 2026-04-03 06:08:29.034816 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.034826 | orchestrator | Friday 03 April 2026 06:08:24 +0000 (0:00:00.330) 0:00:04.873 ********** 2026-04-03 06:08:29.034835 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.034845 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.034855 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.034864 | orchestrator | 2026-04-03 06:08:29.034874 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.034883 | orchestrator | Friday 03 April 2026 06:08:24 +0000 (0:00:00.328) 0:00:05.202 ********** 2026-04-03 06:08:29.034893 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.034903 | orchestrator | 2026-04-03 06:08:29.034913 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.034923 | orchestrator | Friday 03 April 2026 06:08:25 +0000 (0:00:00.139) 0:00:05.342 ********** 2026-04-03 06:08:29.034933 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.034943 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.034952 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.034962 | orchestrator | 2026-04-03 06:08:29.034972 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.034981 | orchestrator | Friday 03 April 2026 06:08:25 +0000 (0:00:00.301) 0:00:05.644 ********** 2026-04-03 06:08:29.034991 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.035031 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.035042 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.035052 | orchestrator | 2026-04-03 06:08:29.035062 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.035071 | orchestrator | Friday 03 April 2026 06:08:25 +0000 (0:00:00.511) 0:00:06.155 ********** 2026-04-03 06:08:29.035081 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035091 | orchestrator | 2026-04-03 06:08:29.035100 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.035110 | orchestrator | Friday 03 April 2026 06:08:26 +0000 (0:00:00.135) 0:00:06.291 ********** 2026-04-03 06:08:29.035120 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035129 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.035139 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.035149 | orchestrator | 2026-04-03 06:08:29.035158 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.035168 | orchestrator | Friday 03 April 2026 06:08:26 +0000 (0:00:00.307) 0:00:06.599 ********** 2026-04-03 06:08:29.035178 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.035188 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.035197 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.035207 | orchestrator | 2026-04-03 06:08:29.035217 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.035235 | orchestrator | Friday 03 April 2026 06:08:26 +0000 (0:00:00.336) 0:00:06.936 ********** 2026-04-03 06:08:29.035244 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035254 | orchestrator | 2026-04-03 06:08:29.035264 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.035274 | orchestrator | Friday 03 April 2026 06:08:26 +0000 (0:00:00.136) 0:00:07.072 ********** 2026-04-03 06:08:29.035283 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035293 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.035303 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.035312 | orchestrator | 2026-04-03 06:08:29.035327 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.035337 | orchestrator | Friday 03 April 2026 06:08:27 +0000 (0:00:00.524) 0:00:07.596 ********** 2026-04-03 06:08:29.035347 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.035357 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.035367 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.035376 | orchestrator | 2026-04-03 06:08:29.035386 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.035396 | orchestrator | Friday 03 April 2026 06:08:27 +0000 (0:00:00.306) 0:00:07.902 ********** 2026-04-03 06:08:29.035406 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035415 | orchestrator | 2026-04-03 06:08:29.035425 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.035435 | orchestrator | Friday 03 April 2026 06:08:27 +0000 (0:00:00.139) 0:00:08.042 ********** 2026-04-03 06:08:29.035444 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035454 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.035464 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.035474 | orchestrator | 2026-04-03 06:08:29.035484 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.035493 | orchestrator | Friday 03 April 2026 06:08:28 +0000 (0:00:00.306) 0:00:08.348 ********** 2026-04-03 06:08:29.035503 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:29.035513 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:29.035522 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:29.035532 | orchestrator | 2026-04-03 06:08:29.035542 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:29.035552 | orchestrator | Friday 03 April 2026 06:08:28 +0000 (0:00:00.323) 0:00:08.672 ********** 2026-04-03 06:08:29.035568 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035584 | orchestrator | 2026-04-03 06:08:29.035599 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:29.035614 | orchestrator | Friday 03 April 2026 06:08:28 +0000 (0:00:00.315) 0:00:08.987 ********** 2026-04-03 06:08:29.035630 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:29.035645 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:29.035655 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:29.035665 | orchestrator | 2026-04-03 06:08:29.035675 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:29.035692 | orchestrator | Friday 03 April 2026 06:08:29 +0000 (0:00:00.302) 0:00:09.289 ********** 2026-04-03 06:08:42.682928 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:42.683084 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:42.683101 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:42.683112 | orchestrator | 2026-04-03 06:08:42.683124 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:42.683136 | orchestrator | Friday 03 April 2026 06:08:29 +0000 (0:00:00.324) 0:00:09.614 ********** 2026-04-03 06:08:42.683146 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683158 | orchestrator | 2026-04-03 06:08:42.683168 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:42.683178 | orchestrator | Friday 03 April 2026 06:08:29 +0000 (0:00:00.143) 0:00:09.757 ********** 2026-04-03 06:08:42.683188 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683218 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.683229 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.683240 | orchestrator | 2026-04-03 06:08:42.683250 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:42.683260 | orchestrator | Friday 03 April 2026 06:08:29 +0000 (0:00:00.298) 0:00:10.056 ********** 2026-04-03 06:08:42.683270 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:42.683280 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:42.683289 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:42.683299 | orchestrator | 2026-04-03 06:08:42.683309 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:42.683319 | orchestrator | Friday 03 April 2026 06:08:30 +0000 (0:00:00.536) 0:00:10.592 ********** 2026-04-03 06:08:42.683328 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683338 | orchestrator | 2026-04-03 06:08:42.683348 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:42.683358 | orchestrator | Friday 03 April 2026 06:08:30 +0000 (0:00:00.156) 0:00:10.749 ********** 2026-04-03 06:08:42.683367 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683377 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.683387 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.683397 | orchestrator | 2026-04-03 06:08:42.683406 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:42.683416 | orchestrator | Friday 03 April 2026 06:08:30 +0000 (0:00:00.302) 0:00:11.051 ********** 2026-04-03 06:08:42.683426 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:42.683436 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:42.683445 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:42.683455 | orchestrator | 2026-04-03 06:08:42.683465 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:42.683474 | orchestrator | Friday 03 April 2026 06:08:31 +0000 (0:00:00.339) 0:00:11.391 ********** 2026-04-03 06:08:42.683484 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683494 | orchestrator | 2026-04-03 06:08:42.683503 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:42.683513 | orchestrator | Friday 03 April 2026 06:08:31 +0000 (0:00:00.134) 0:00:11.525 ********** 2026-04-03 06:08:42.683523 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683533 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.683542 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.683552 | orchestrator | 2026-04-03 06:08:42.683562 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 06:08:42.683571 | orchestrator | Friday 03 April 2026 06:08:31 +0000 (0:00:00.517) 0:00:12.043 ********** 2026-04-03 06:08:42.683581 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:08:42.683591 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:08:42.683601 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:08:42.683610 | orchestrator | 2026-04-03 06:08:42.683620 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 06:08:42.683630 | orchestrator | Friday 03 April 2026 06:08:32 +0000 (0:00:00.348) 0:00:12.391 ********** 2026-04-03 06:08:42.683653 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683663 | orchestrator | 2026-04-03 06:08:42.683673 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 06:08:42.683682 | orchestrator | Friday 03 April 2026 06:08:32 +0000 (0:00:00.139) 0:00:12.530 ********** 2026-04-03 06:08:42.683692 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.683702 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.683712 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.683722 | orchestrator | 2026-04-03 06:08:42.683735 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-03 06:08:42.683753 | orchestrator | Friday 03 April 2026 06:08:32 +0000 (0:00:00.304) 0:00:12.835 ********** 2026-04-03 06:08:42.683765 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:08:42.683783 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:08:42.683793 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:08:42.683809 | orchestrator | 2026-04-03 06:08:42.683825 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-03 06:08:42.683841 | orchestrator | Friday 03 April 2026 06:08:34 +0000 (0:00:01.732) 0:00:14.567 ********** 2026-04-03 06:08:42.683856 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 06:08:42.683873 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 06:08:42.683889 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 06:08:42.683905 | orchestrator | 2026-04-03 06:08:42.683923 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-03 06:08:42.683978 | orchestrator | Friday 03 April 2026 06:08:36 +0000 (0:00:01.896) 0:00:16.464 ********** 2026-04-03 06:08:42.683989 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 06:08:42.684048 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 06:08:42.684061 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 06:08:42.684070 | orchestrator | 2026-04-03 06:08:42.684081 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-03 06:08:42.684108 | orchestrator | Friday 03 April 2026 06:08:37 +0000 (0:00:01.769) 0:00:18.234 ********** 2026-04-03 06:08:42.684119 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 06:08:42.684129 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 06:08:42.684139 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 06:08:42.684148 | orchestrator | 2026-04-03 06:08:42.684158 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-03 06:08:42.684168 | orchestrator | Friday 03 April 2026 06:08:39 +0000 (0:00:01.493) 0:00:19.727 ********** 2026-04-03 06:08:42.684178 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.684188 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.684197 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.684207 | orchestrator | 2026-04-03 06:08:42.684217 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-03 06:08:42.684226 | orchestrator | Friday 03 April 2026 06:08:39 +0000 (0:00:00.517) 0:00:20.245 ********** 2026-04-03 06:08:42.684236 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:42.684246 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:42.684256 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:42.684266 | orchestrator | 2026-04-03 06:08:42.684275 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 06:08:42.684285 | orchestrator | Friday 03 April 2026 06:08:40 +0000 (0:00:00.292) 0:00:20.537 ********** 2026-04-03 06:08:42.684295 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:08:42.684305 | orchestrator | 2026-04-03 06:08:42.684315 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-03 06:08:42.684325 | orchestrator | Friday 03 April 2026 06:08:40 +0000 (0:00:00.595) 0:00:21.133 ********** 2026-04-03 06:08:42.684348 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:42.684383 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:43.326922 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:08:43.327130 | orchestrator | 2026-04-03 06:08:43.327162 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-03 06:08:43.327182 | orchestrator | Friday 03 April 2026 06:08:42 +0000 (0:00:01.798) 0:00:22.931 ********** 2026-04-03 06:08:43.327226 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:43.327258 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:43.327291 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:43.327310 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:43.327340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:45.798532 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:45.798618 | orchestrator | 2026-04-03 06:08:45.798627 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-03 06:08:45.798648 | orchestrator | Friday 03 April 2026 06:08:43 +0000 (0:00:00.651) 0:00:23.582 ********** 2026-04-03 06:08:45.798658 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:45.798667 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:08:45.798686 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:45.798722 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:08:45.798758 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 06:08:45.798765 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:08:45.798772 | orchestrator | 2026-04-03 06:08:45.798779 | orchestrator | TASK [horizon : Deploy horizon container] ************************************** 2026-04-03 06:08:45.798785 | orchestrator | Friday 03 April 2026 06:08:44 +0000 (0:00:00.848) 0:00:24.431 ********** 2026-04-03 06:08:45.798806 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:09:30.687610 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:09:30.687793 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 06:09:30.687815 | orchestrator | 2026-04-03 06:09:30.687829 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 06:09:30.687842 | orchestrator | Friday 03 April 2026 06:08:45 +0000 (0:00:01.622) 0:00:26.054 ********** 2026-04-03 06:09:30.687853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:09:30.687866 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:09:30.687877 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:09:30.687888 | orchestrator | 2026-04-03 06:09:30.687900 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 06:09:30.687959 | orchestrator | Friday 03 April 2026 06:08:46 +0000 (0:00:00.325) 0:00:26.379 ********** 2026-04-03 06:09:30.687971 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:09:30.687983 | orchestrator | 2026-04-03 06:09:30.687996 | orchestrator | TASK [horizon : Creating Horizon database] ************************************* 2026-04-03 06:09:30.688064 | orchestrator | Friday 03 April 2026 06:08:46 +0000 (0:00:00.531) 0:00:26.911 ********** 2026-04-03 06:09:30.688083 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:09:30.688101 | orchestrator | 2026-04-03 06:09:30.688120 | orchestrator | TASK [horizon : Creating Horizon database user and setting permissions] ******** 2026-04-03 06:09:30.688133 | orchestrator | Friday 03 April 2026 06:08:48 +0000 (0:00:02.148) 0:00:29.059 ********** 2026-04-03 06:09:30.688147 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:09:30.688161 | orchestrator | 2026-04-03 06:09:30.688174 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-03 06:09:30.688197 | orchestrator | Friday 03 April 2026 06:08:51 +0000 (0:00:02.565) 0:00:31.624 ********** 2026-04-03 06:09:30.688210 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:09:30.688223 | orchestrator | 2026-04-03 06:09:30.688235 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 06:09:30.688247 | orchestrator | Friday 03 April 2026 06:09:06 +0000 (0:00:15.011) 0:00:46.635 ********** 2026-04-03 06:09:30.688260 | orchestrator | 2026-04-03 06:09:30.688272 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 06:09:30.688285 | orchestrator | Friday 03 April 2026 06:09:06 +0000 (0:00:00.068) 0:00:46.704 ********** 2026-04-03 06:09:30.688297 | orchestrator | 2026-04-03 06:09:30.688310 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 06:09:30.688322 | orchestrator | Friday 03 April 2026 06:09:06 +0000 (0:00:00.065) 0:00:46.770 ********** 2026-04-03 06:09:30.688336 | orchestrator | 2026-04-03 06:09:30.688348 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-03 06:09:30.688361 | orchestrator | Friday 03 April 2026 06:09:06 +0000 (0:00:00.071) 0:00:46.842 ********** 2026-04-03 06:09:30.688374 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:09:30.688388 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:09:30.688400 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:09:30.688413 | orchestrator | 2026-04-03 06:09:30.688425 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:09:30.688440 | orchestrator | testbed-node-0 : ok=37  changed=11  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 06:09:30.688454 | orchestrator | testbed-node-1 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-03 06:09:30.688467 | orchestrator | testbed-node-2 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-03 06:09:30.688479 | orchestrator | 2026-04-03 06:09:30.688493 | orchestrator | 2026-04-03 06:09:30.688506 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:09:30.688519 | orchestrator | Friday 03 April 2026 06:09:30 +0000 (0:00:24.079) 0:01:10.921 ********** 2026-04-03 06:09:30.688531 | orchestrator | =============================================================================== 2026-04-03 06:09:30.688542 | orchestrator | horizon : Restart horizon container ------------------------------------ 24.08s 2026-04-03 06:09:30.688553 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 15.01s 2026-04-03 06:09:30.688563 | orchestrator | horizon : Creating Horizon database user and setting permissions -------- 2.57s 2026-04-03 06:09:30.688581 | orchestrator | horizon : Creating Horizon database ------------------------------------- 2.15s 2026-04-03 06:09:30.688592 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 1.90s 2026-04-03 06:09:30.688603 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 1.80s 2026-04-03 06:09:30.688614 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 1.77s 2026-04-03 06:09:30.688625 | orchestrator | horizon : Copying over config.json files for services ------------------- 1.73s 2026-04-03 06:09:30.688635 | orchestrator | horizon : Deploy horizon container -------------------------------------- 1.62s 2026-04-03 06:09:30.688646 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 1.49s 2026-04-03 06:09:30.688657 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 1.13s 2026-04-03 06:09:30.688668 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 0.85s 2026-04-03 06:09:30.688678 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.72s 2026-04-03 06:09:30.688700 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 0.65s 2026-04-03 06:09:31.085570 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.60s 2026-04-03 06:09:31.085699 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.55s 2026-04-03 06:09:31.085715 | orchestrator | horizon : Update policy file name --------------------------------------- 0.54s 2026-04-03 06:09:31.085726 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.53s 2026-04-03 06:09:31.085738 | orchestrator | horizon : Update custom policy file name -------------------------------- 0.52s 2026-04-03 06:09:31.085749 | orchestrator | horizon : Copying over existing policy file ----------------------------- 0.52s 2026-04-03 06:09:33.483741 | orchestrator | 2026-04-03 06:09:33 | INFO  | Task 76dbeb7f-cdcc-4216-a6eb-28bd13add09d (skyline) was prepared for execution. 2026-04-03 06:09:33.483837 | orchestrator | 2026-04-03 06:09:33 | INFO  | It takes a moment until task 76dbeb7f-cdcc-4216-a6eb-28bd13add09d (skyline) has been started and output is visible here. 2026-04-03 06:10:03.591297 | orchestrator | 2026-04-03 06:10:03.591415 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:10:03.591427 | orchestrator | 2026-04-03 06:10:03.591434 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:10:03.591442 | orchestrator | Friday 03 April 2026 06:09:37 +0000 (0:00:00.261) 0:00:00.261 ********** 2026-04-03 06:10:03.591450 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:10:03.591458 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:10:03.591464 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:10:03.591471 | orchestrator | 2026-04-03 06:10:03.591478 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:10:03.591485 | orchestrator | Friday 03 April 2026 06:09:38 +0000 (0:00:00.308) 0:00:00.569 ********** 2026-04-03 06:10:03.591492 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-03 06:10:03.591499 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-03 06:10:03.591506 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-03 06:10:03.591513 | orchestrator | 2026-04-03 06:10:03.591520 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-03 06:10:03.591526 | orchestrator | 2026-04-03 06:10:03.591533 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-03 06:10:03.591540 | orchestrator | Friday 03 April 2026 06:09:38 +0000 (0:00:00.448) 0:00:01.018 ********** 2026-04-03 06:10:03.591547 | orchestrator | included: /ansible/roles/skyline/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:10:03.591555 | orchestrator | 2026-04-03 06:10:03.591562 | orchestrator | TASK [service-ks-register : skyline | Creating services] *********************** 2026-04-03 06:10:03.591568 | orchestrator | Friday 03 April 2026 06:09:39 +0000 (0:00:00.577) 0:00:01.595 ********** 2026-04-03 06:10:03.591575 | orchestrator | changed: [testbed-node-0] => (item=skyline (panel)) 2026-04-03 06:10:03.591582 | orchestrator | 2026-04-03 06:10:03.591589 | orchestrator | TASK [service-ks-register : skyline | Creating endpoints] ********************** 2026-04-03 06:10:03.591596 | orchestrator | Friday 03 April 2026 06:09:42 +0000 (0:00:03.257) 0:00:04.852 ********** 2026-04-03 06:10:03.591602 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api-int.testbed.osism.xyz:9998 -> internal) 2026-04-03 06:10:03.591610 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api.testbed.osism.xyz:9998 -> public) 2026-04-03 06:10:03.591617 | orchestrator | 2026-04-03 06:10:03.591624 | orchestrator | TASK [service-ks-register : skyline | Creating projects] *********************** 2026-04-03 06:10:03.591630 | orchestrator | Friday 03 April 2026 06:09:48 +0000 (0:00:06.222) 0:00:11.075 ********** 2026-04-03 06:10:03.591637 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:10:03.591645 | orchestrator | 2026-04-03 06:10:03.591652 | orchestrator | TASK [service-ks-register : skyline | Creating users] ************************** 2026-04-03 06:10:03.591659 | orchestrator | Friday 03 April 2026 06:09:51 +0000 (0:00:03.129) 0:00:14.204 ********** 2026-04-03 06:10:03.591666 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:10:03.591697 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service) 2026-04-03 06:10:03.591704 | orchestrator | 2026-04-03 06:10:03.591711 | orchestrator | TASK [service-ks-register : skyline | Creating roles] ************************** 2026-04-03 06:10:03.591717 | orchestrator | Friday 03 April 2026 06:09:55 +0000 (0:00:03.852) 0:00:18.057 ********** 2026-04-03 06:10:03.591724 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:10:03.591731 | orchestrator | 2026-04-03 06:10:03.591749 | orchestrator | TASK [service-ks-register : skyline | Granting user roles] ********************* 2026-04-03 06:10:03.591757 | orchestrator | Friday 03 April 2026 06:09:58 +0000 (0:00:03.058) 0:00:21.116 ********** 2026-04-03 06:10:03.591763 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service -> admin) 2026-04-03 06:10:03.591770 | orchestrator | 2026-04-03 06:10:03.591777 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-03 06:10:03.591783 | orchestrator | Friday 03 April 2026 06:10:02 +0000 (0:00:03.630) 0:00:24.746 ********** 2026-04-03 06:10:03.591794 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:03.591819 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:03.591827 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:03.591839 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:03.591853 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:03.591866 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.218997 | orchestrator | 2026-04-03 06:10:07.219111 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-03 06:10:07.219123 | orchestrator | Friday 03 April 2026 06:10:03 +0000 (0:00:01.326) 0:00:26.073 ********** 2026-04-03 06:10:07.219130 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:10:07.219137 | orchestrator | 2026-04-03 06:10:07.219144 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-03 06:10:07.219151 | orchestrator | Friday 03 April 2026 06:10:04 +0000 (0:00:00.739) 0:00:26.812 ********** 2026-04-03 06:10:07.219159 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219191 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219198 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219216 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219224 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219236 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:07.219243 | orchestrator | 2026-04-03 06:10:07.219250 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-03 06:10:07.219257 | orchestrator | Friday 03 April 2026 06:10:06 +0000 (0:00:02.336) 0:00:29.149 ********** 2026-04-03 06:10:07.219267 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:07.219274 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:07.219281 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:10:07.219293 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273637 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273726 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:10:08.273758 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273771 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273782 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:10:08.273794 | orchestrator | 2026-04-03 06:10:08.273806 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-03 06:10:08.273817 | orchestrator | Friday 03 April 2026 06:10:07 +0000 (0:00:00.563) 0:00:29.712 ********** 2026-04-03 06:10:08.273829 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273876 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273889 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:10:08.273905 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273918 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273929 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:10:08.273941 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-03 06:10:08.273967 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-03 06:10:16.200922 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:10:16.201097 | orchestrator | 2026-04-03 06:10:16.201118 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-03 06:10:16.201133 | orchestrator | Friday 03 April 2026 06:10:08 +0000 (0:00:01.047) 0:00:30.759 ********** 2026-04-03 06:10:16.201163 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201193 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201253 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201304 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201318 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201329 | orchestrator | 2026-04-03 06:10:16.201341 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-03 06:10:16.201353 | orchestrator | Friday 03 April 2026 06:10:10 +0000 (0:00:02.270) 0:00:33.030 ********** 2026-04-03 06:10:16.201364 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 06:10:16.201375 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 06:10:16.201386 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 06:10:16.201397 | orchestrator | 2026-04-03 06:10:16.201408 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-03 06:10:16.201419 | orchestrator | Friday 03 April 2026 06:10:11 +0000 (0:00:01.458) 0:00:34.489 ********** 2026-04-03 06:10:16.201440 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 06:10:16.201451 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 06:10:16.201464 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 06:10:16.201476 | orchestrator | 2026-04-03 06:10:16.201489 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-03 06:10:16.201502 | orchestrator | Friday 03 April 2026 06:10:13 +0000 (0:00:01.847) 0:00:36.336 ********** 2026-04-03 06:10:16.201516 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:16.201540 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177207 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177315 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177358 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177372 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177385 | orchestrator | 2026-04-03 06:10:18.177399 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-03 06:10:18.177412 | orchestrator | Friday 03 April 2026 06:10:16 +0000 (0:00:02.358) 0:00:38.694 ********** 2026-04-03 06:10:18.177424 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:10:18.177436 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:10:18.177447 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:10:18.177458 | orchestrator | 2026-04-03 06:10:18.177485 | orchestrator | TASK [skyline : Check skyline container] *************************************** 2026-04-03 06:10:18.177502 | orchestrator | Friday 03 April 2026 06:10:16 +0000 (0:00:00.299) 0:00:38.993 ********** 2026-04-03 06:10:18.177531 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177569 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177600 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177620 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:18.177660 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:50.771802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-03 06:10:50.771951 | orchestrator | 2026-04-03 06:10:50.771970 | orchestrator | TASK [skyline : Creating Skyline database] ************************************* 2026-04-03 06:10:50.771982 | orchestrator | Friday 03 April 2026 06:10:18 +0000 (0:00:01.674) 0:00:40.668 ********** 2026-04-03 06:10:50.771992 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:10:50.772002 | orchestrator | 2026-04-03 06:10:50.772011 | orchestrator | TASK [skyline : Creating Skyline database user and setting permissions] ******** 2026-04-03 06:10:50.772020 | orchestrator | Friday 03 April 2026 06:10:20 +0000 (0:00:02.037) 0:00:42.705 ********** 2026-04-03 06:10:50.772073 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:10:50.772083 | orchestrator | 2026-04-03 06:10:50.772092 | orchestrator | TASK [skyline : Running Skyline bootstrap container] *************************** 2026-04-03 06:10:50.772101 | orchestrator | Friday 03 April 2026 06:10:22 +0000 (0:00:02.164) 0:00:44.869 ********** 2026-04-03 06:10:50.772110 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:10:50.772120 | orchestrator | 2026-04-03 06:10:50.772129 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 06:10:50.772138 | orchestrator | Friday 03 April 2026 06:10:29 +0000 (0:00:07.538) 0:00:52.407 ********** 2026-04-03 06:10:50.772147 | orchestrator | 2026-04-03 06:10:50.772156 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 06:10:50.772165 | orchestrator | Friday 03 April 2026 06:10:29 +0000 (0:00:00.067) 0:00:52.475 ********** 2026-04-03 06:10:50.772174 | orchestrator | 2026-04-03 06:10:50.772183 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 06:10:50.772191 | orchestrator | Friday 03 April 2026 06:10:30 +0000 (0:00:00.068) 0:00:52.543 ********** 2026-04-03 06:10:50.772200 | orchestrator | 2026-04-03 06:10:50.772209 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-03 06:10:50.772218 | orchestrator | Friday 03 April 2026 06:10:30 +0000 (0:00:00.070) 0:00:52.614 ********** 2026-04-03 06:10:50.772227 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:10:50.772236 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:10:50.772244 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:10:50.772253 | orchestrator | 2026-04-03 06:10:50.772262 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-03 06:10:50.772271 | orchestrator | Friday 03 April 2026 06:10:41 +0000 (0:00:11.028) 0:01:03.643 ********** 2026-04-03 06:10:50.772280 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:10:50.772289 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:10:50.772297 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:10:50.772306 | orchestrator | 2026-04-03 06:10:50.772315 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:10:50.772326 | orchestrator | testbed-node-0 : ok=22  changed=16  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 06:10:50.772336 | orchestrator | testbed-node-1 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 06:10:50.772345 | orchestrator | testbed-node-2 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 06:10:50.772354 | orchestrator | 2026-04-03 06:10:50.772363 | orchestrator | 2026-04-03 06:10:50.772379 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:10:50.772389 | orchestrator | Friday 03 April 2026 06:10:50 +0000 (0:00:09.287) 0:01:12.931 ********** 2026-04-03 06:10:50.772398 | orchestrator | =============================================================================== 2026-04-03 06:10:50.772406 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 11.03s 2026-04-03 06:10:50.772430 | orchestrator | skyline : Restart skyline-console container ----------------------------- 9.29s 2026-04-03 06:10:50.772445 | orchestrator | skyline : Running Skyline bootstrap container --------------------------- 7.54s 2026-04-03 06:10:50.772459 | orchestrator | service-ks-register : skyline | Creating endpoints ---------------------- 6.22s 2026-04-03 06:10:50.772484 | orchestrator | service-ks-register : skyline | Creating users -------------------------- 3.85s 2026-04-03 06:10:50.772498 | orchestrator | service-ks-register : skyline | Granting user roles --------------------- 3.63s 2026-04-03 06:10:50.772511 | orchestrator | service-ks-register : skyline | Creating services ----------------------- 3.26s 2026-04-03 06:10:50.772525 | orchestrator | service-ks-register : skyline | Creating projects ----------------------- 3.13s 2026-04-03 06:10:50.772559 | orchestrator | service-ks-register : skyline | Creating roles -------------------------- 3.06s 2026-04-03 06:10:50.772574 | orchestrator | skyline : Copying over config.json files for services ------------------- 2.36s 2026-04-03 06:10:50.772589 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 2.34s 2026-04-03 06:10:50.772603 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 2.27s 2026-04-03 06:10:50.772618 | orchestrator | skyline : Creating Skyline database user and setting permissions -------- 2.16s 2026-04-03 06:10:50.772632 | orchestrator | skyline : Creating Skyline database ------------------------------------- 2.04s 2026-04-03 06:10:50.772646 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 1.85s 2026-04-03 06:10:50.772661 | orchestrator | skyline : Check skyline container --------------------------------------- 1.67s 2026-04-03 06:10:50.772676 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 1.46s 2026-04-03 06:10:50.772691 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 1.33s 2026-04-03 06:10:50.772704 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 1.05s 2026-04-03 06:10:50.772716 | orchestrator | skyline : include_tasks ------------------------------------------------- 0.74s 2026-04-03 06:10:53.102816 | orchestrator | 2026-04-03 06:10:53 | INFO  | Task 76949195-829e-4616-a53d-97988e88203e (glance) was prepared for execution. 2026-04-03 06:10:53.102918 | orchestrator | 2026-04-03 06:10:53 | INFO  | It takes a moment until task 76949195-829e-4616-a53d-97988e88203e (glance) has been started and output is visible here. 2026-04-03 06:11:25.994830 | orchestrator | 2026-04-03 06:11:25.994948 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:11:25.994966 | orchestrator | 2026-04-03 06:11:25.994978 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:11:25.994990 | orchestrator | Friday 03 April 2026 06:10:57 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-03 06:11:25.995001 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:11:25.995014 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:11:25.995025 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:11:25.995062 | orchestrator | 2026-04-03 06:11:25.995075 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:11:25.995086 | orchestrator | Friday 03 April 2026 06:10:57 +0000 (0:00:00.311) 0:00:00.574 ********** 2026-04-03 06:11:25.995097 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-03 06:11:25.995109 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-03 06:11:25.995120 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-03 06:11:25.995132 | orchestrator | 2026-04-03 06:11:25.995143 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-03 06:11:25.995181 | orchestrator | 2026-04-03 06:11:25.995193 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 06:11:25.995204 | orchestrator | Friday 03 April 2026 06:10:58 +0000 (0:00:00.456) 0:00:01.030 ********** 2026-04-03 06:11:25.995215 | orchestrator | included: /ansible/roles/glance/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:11:25.995227 | orchestrator | 2026-04-03 06:11:25.995238 | orchestrator | TASK [service-ks-register : glance | Creating services] ************************ 2026-04-03 06:11:25.995250 | orchestrator | Friday 03 April 2026 06:10:58 +0000 (0:00:00.579) 0:00:01.610 ********** 2026-04-03 06:11:25.995261 | orchestrator | changed: [testbed-node-0] => (item=glance (image)) 2026-04-03 06:11:25.995272 | orchestrator | 2026-04-03 06:11:25.995283 | orchestrator | TASK [service-ks-register : glance | Creating endpoints] *********************** 2026-04-03 06:11:25.995294 | orchestrator | Friday 03 April 2026 06:11:02 +0000 (0:00:03.356) 0:00:04.967 ********** 2026-04-03 06:11:25.995305 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api-int.testbed.osism.xyz:9292 -> internal) 2026-04-03 06:11:25.995316 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api.testbed.osism.xyz:9292 -> public) 2026-04-03 06:11:25.995327 | orchestrator | 2026-04-03 06:11:25.995339 | orchestrator | TASK [service-ks-register : glance | Creating projects] ************************ 2026-04-03 06:11:25.995351 | orchestrator | Friday 03 April 2026 06:11:08 +0000 (0:00:06.263) 0:00:11.231 ********** 2026-04-03 06:11:25.995362 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:11:25.995376 | orchestrator | 2026-04-03 06:11:25.995389 | orchestrator | TASK [service-ks-register : glance | Creating users] *************************** 2026-04-03 06:11:25.995401 | orchestrator | Friday 03 April 2026 06:11:11 +0000 (0:00:03.079) 0:00:14.310 ********** 2026-04-03 06:11:25.995413 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:11:25.995426 | orchestrator | changed: [testbed-node-0] => (item=glance -> service) 2026-04-03 06:11:25.995439 | orchestrator | 2026-04-03 06:11:25.995451 | orchestrator | TASK [service-ks-register : glance | Creating roles] *************************** 2026-04-03 06:11:25.995464 | orchestrator | Friday 03 April 2026 06:11:15 +0000 (0:00:03.924) 0:00:18.235 ********** 2026-04-03 06:11:25.995491 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:11:25.995505 | orchestrator | 2026-04-03 06:11:25.995517 | orchestrator | TASK [service-ks-register : glance | Granting user roles] ********************** 2026-04-03 06:11:25.995531 | orchestrator | Friday 03 April 2026 06:11:18 +0000 (0:00:03.042) 0:00:21.278 ********** 2026-04-03 06:11:25.995543 | orchestrator | changed: [testbed-node-0] => (item=glance -> service -> admin) 2026-04-03 06:11:25.995556 | orchestrator | 2026-04-03 06:11:25.995568 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-03 06:11:25.995581 | orchestrator | Friday 03 April 2026 06:11:22 +0000 (0:00:03.697) 0:00:24.976 ********** 2026-04-03 06:11:25.995621 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:25.995649 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:25.995670 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:25.995684 | orchestrator | 2026-04-03 06:11:25.995697 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 06:11:25.995717 | orchestrator | Friday 03 April 2026 06:11:25 +0000 (0:00:03.244) 0:00:28.220 ********** 2026-04-03 06:11:25.995731 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:11:25.995742 | orchestrator | 2026-04-03 06:11:25.995761 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-03 06:11:41.057200 | orchestrator | Friday 03 April 2026 06:11:25 +0000 (0:00:00.724) 0:00:28.945 ********** 2026-04-03 06:11:41.057315 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:11:41.057331 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:11:41.057343 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:11:41.057355 | orchestrator | 2026-04-03 06:11:41.057367 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-03 06:11:41.057379 | orchestrator | Friday 03 April 2026 06:11:29 +0000 (0:00:03.453) 0:00:32.398 ********** 2026-04-03 06:11:41.057391 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057403 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057414 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057426 | orchestrator | 2026-04-03 06:11:41.057437 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-03 06:11:41.057448 | orchestrator | Friday 03 April 2026 06:11:30 +0000 (0:00:01.478) 0:00:33.877 ********** 2026-04-03 06:11:41.057459 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057470 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057481 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:11:41.057492 | orchestrator | 2026-04-03 06:11:41.057503 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-03 06:11:41.057514 | orchestrator | Friday 03 April 2026 06:11:32 +0000 (0:00:01.356) 0:00:35.234 ********** 2026-04-03 06:11:41.057525 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:11:41.057537 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:11:41.057548 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:11:41.057559 | orchestrator | 2026-04-03 06:11:41.057571 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-03 06:11:41.057582 | orchestrator | Friday 03 April 2026 06:11:32 +0000 (0:00:00.646) 0:00:35.880 ********** 2026-04-03 06:11:41.057593 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:11:41.057604 | orchestrator | 2026-04-03 06:11:41.057616 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-03 06:11:41.057627 | orchestrator | Friday 03 April 2026 06:11:33 +0000 (0:00:00.137) 0:00:36.018 ********** 2026-04-03 06:11:41.057638 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:11:41.057649 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:11:41.057660 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:11:41.057671 | orchestrator | 2026-04-03 06:11:41.057682 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 06:11:41.057695 | orchestrator | Friday 03 April 2026 06:11:33 +0000 (0:00:00.326) 0:00:36.344 ********** 2026-04-03 06:11:41.057708 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:11:41.057721 | orchestrator | 2026-04-03 06:11:41.057735 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-03 06:11:41.057764 | orchestrator | Friday 03 April 2026 06:11:34 +0000 (0:00:00.791) 0:00:37.135 ********** 2026-04-03 06:11:41.057786 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:41.057848 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:41.057881 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:11:41.057905 | orchestrator | 2026-04-03 06:11:41.057917 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-03 06:11:41.057929 | orchestrator | Friday 03 April 2026 06:11:38 +0000 (0:00:03.838) 0:00:40.974 ********** 2026-04-03 06:11:41.057952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:11:44.586445 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:11:44.586551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:11:44.586582 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:11:44.586590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:11:44.586596 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:11:44.586602 | orchestrator | 2026-04-03 06:11:44.586609 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-03 06:11:44.586617 | orchestrator | Friday 03 April 2026 06:11:41 +0000 (0:00:03.033) 0:00:44.007 ********** 2026-04-03 06:11:44.586644 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:11:44.586658 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:11:44.586664 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:11:44.586671 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:11:44.586683 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 06:12:18.148859 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.148996 | orchestrator | 2026-04-03 06:12:18.149038 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-03 06:12:18.149106 | orchestrator | Friday 03 April 2026 06:11:44 +0000 (0:00:03.528) 0:00:47.536 ********** 2026-04-03 06:12:18.149118 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149129 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149138 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149148 | orchestrator | 2026-04-03 06:12:18.149158 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-03 06:12:18.149168 | orchestrator | Friday 03 April 2026 06:11:47 +0000 (0:00:03.209) 0:00:50.745 ********** 2026-04-03 06:12:18.149197 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:12:18.149212 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:12:18.149257 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:12:18.149270 | orchestrator | 2026-04-03 06:12:18.149280 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-03 06:12:18.149290 | orchestrator | Friday 03 April 2026 06:11:51 +0000 (0:00:03.826) 0:00:54.571 ********** 2026-04-03 06:12:18.149300 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:12:18.149310 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:12:18.149320 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:12:18.149329 | orchestrator | 2026-04-03 06:12:18.149339 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-03 06:12:18.149349 | orchestrator | Friday 03 April 2026 06:11:56 +0000 (0:00:05.381) 0:00:59.953 ********** 2026-04-03 06:12:18.149359 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149369 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149380 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149392 | orchestrator | 2026-04-03 06:12:18.149404 | orchestrator | TASK [glance : Copying over glance-swift.conf for glance_api] ****************** 2026-04-03 06:12:18.149415 | orchestrator | Friday 03 April 2026 06:12:00 +0000 (0:00:03.362) 0:01:03.316 ********** 2026-04-03 06:12:18.149430 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149447 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149463 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149478 | orchestrator | 2026-04-03 06:12:18.149495 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-03 06:12:18.149512 | orchestrator | Friday 03 April 2026 06:12:03 +0000 (0:00:03.323) 0:01:06.639 ********** 2026-04-03 06:12:18.149528 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149544 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149560 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149578 | orchestrator | 2026-04-03 06:12:18.149595 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-03 06:12:18.149614 | orchestrator | Friday 03 April 2026 06:12:07 +0000 (0:00:03.415) 0:01:10.055 ********** 2026-04-03 06:12:18.149631 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149647 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149659 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149669 | orchestrator | 2026-04-03 06:12:18.149678 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-03 06:12:18.149696 | orchestrator | Friday 03 April 2026 06:12:10 +0000 (0:00:03.318) 0:01:13.373 ********** 2026-04-03 06:12:18.149706 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149716 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149725 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149735 | orchestrator | 2026-04-03 06:12:18.149745 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-03 06:12:18.149755 | orchestrator | Friday 03 April 2026 06:12:10 +0000 (0:00:00.547) 0:01:13.921 ********** 2026-04-03 06:12:18.149764 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 06:12:18.149775 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:12:18.149784 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 06:12:18.149794 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:12:18.149803 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 06:12:18.149813 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:12:18.149823 | orchestrator | 2026-04-03 06:12:18.149832 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-03 06:12:18.149842 | orchestrator | Friday 03 April 2026 06:12:14 +0000 (0:00:03.083) 0:01:17.005 ********** 2026-04-03 06:12:18.149851 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:12:18.149861 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:12:18.149871 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:12:18.149880 | orchestrator | 2026-04-03 06:12:18.149890 | orchestrator | TASK [glance : Check glance containers] **************************************** 2026-04-03 06:12:18.149914 | orchestrator | Friday 03 April 2026 06:12:18 +0000 (0:00:04.089) 0:01:21.095 ********** 2026-04-03 06:13:31.409461 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:13:31.409800 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:13:31.409918 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 06:13:31.409946 | orchestrator | 2026-04-03 06:13:31.409962 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 06:13:31.409975 | orchestrator | Friday 03 April 2026 06:12:21 +0000 (0:00:03.681) 0:01:24.776 ********** 2026-04-03 06:13:31.409990 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:13:31.410004 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:13:31.410121 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:13:31.410138 | orchestrator | 2026-04-03 06:13:31.410152 | orchestrator | TASK [glance : Creating Glance database] *************************************** 2026-04-03 06:13:31.410165 | orchestrator | Friday 03 April 2026 06:12:22 +0000 (0:00:00.519) 0:01:25.296 ********** 2026-04-03 06:13:31.410178 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410190 | orchestrator | 2026-04-03 06:13:31.410201 | orchestrator | TASK [glance : Creating Glance database user and setting permissions] ********** 2026-04-03 06:13:31.410213 | orchestrator | Friday 03 April 2026 06:12:24 +0000 (0:00:02.028) 0:01:27.324 ********** 2026-04-03 06:13:31.410224 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410247 | orchestrator | 2026-04-03 06:13:31.410258 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-03 06:13:31.410269 | orchestrator | Friday 03 April 2026 06:12:26 +0000 (0:00:02.156) 0:01:29.481 ********** 2026-04-03 06:13:31.410280 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410290 | orchestrator | 2026-04-03 06:13:31.410301 | orchestrator | TASK [glance : Running Glance bootstrap container] ***************************** 2026-04-03 06:13:31.410321 | orchestrator | Friday 03 April 2026 06:12:28 +0000 (0:00:01.971) 0:01:31.453 ********** 2026-04-03 06:13:31.410338 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410357 | orchestrator | 2026-04-03 06:13:31.410375 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-03 06:13:31.410392 | orchestrator | Friday 03 April 2026 06:12:55 +0000 (0:00:26.687) 0:01:58.140 ********** 2026-04-03 06:13:31.410411 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410429 | orchestrator | 2026-04-03 06:13:31.410447 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 06:13:31.410465 | orchestrator | Friday 03 April 2026 06:12:57 +0000 (0:00:01.995) 0:02:00.135 ********** 2026-04-03 06:13:31.410485 | orchestrator | 2026-04-03 06:13:31.410503 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 06:13:31.410522 | orchestrator | Friday 03 April 2026 06:12:57 +0000 (0:00:00.077) 0:02:00.212 ********** 2026-04-03 06:13:31.410537 | orchestrator | 2026-04-03 06:13:31.410548 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 06:13:31.410559 | orchestrator | Friday 03 April 2026 06:12:57 +0000 (0:00:00.069) 0:02:00.281 ********** 2026-04-03 06:13:31.410570 | orchestrator | 2026-04-03 06:13:31.410581 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-03 06:13:31.410592 | orchestrator | Friday 03 April 2026 06:12:57 +0000 (0:00:00.085) 0:02:00.367 ********** 2026-04-03 06:13:31.410603 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:13:31.410614 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:13:31.410625 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:13:31.410636 | orchestrator | 2026-04-03 06:13:31.410647 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:13:31.410659 | orchestrator | testbed-node-0 : ok=27  changed=19  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 06:13:31.410672 | orchestrator | testbed-node-1 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 06:13:31.410683 | orchestrator | testbed-node-2 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 06:13:31.410694 | orchestrator | 2026-04-03 06:13:31.410705 | orchestrator | 2026-04-03 06:13:31.410716 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:13:31.410727 | orchestrator | Friday 03 April 2026 06:13:31 +0000 (0:00:33.979) 0:02:34.346 ********** 2026-04-03 06:13:31.410738 | orchestrator | =============================================================================== 2026-04-03 06:13:31.410749 | orchestrator | glance : Restart glance-api container ---------------------------------- 33.98s 2026-04-03 06:13:31.410759 | orchestrator | glance : Running Glance bootstrap container ---------------------------- 26.69s 2026-04-03 06:13:31.410770 | orchestrator | service-ks-register : glance | Creating endpoints ----------------------- 6.26s 2026-04-03 06:13:31.410794 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 5.38s 2026-04-03 06:13:31.721613 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 4.09s 2026-04-03 06:13:31.721712 | orchestrator | service-ks-register : glance | Creating users --------------------------- 3.92s 2026-04-03 06:13:31.721727 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 3.84s 2026-04-03 06:13:31.721739 | orchestrator | glance : Copying over config.json files for services -------------------- 3.83s 2026-04-03 06:13:31.721793 | orchestrator | service-ks-register : glance | Granting user roles ---------------------- 3.70s 2026-04-03 06:13:31.721806 | orchestrator | glance : Check glance containers ---------------------------------------- 3.68s 2026-04-03 06:13:31.721817 | orchestrator | service-cert-copy : glance | Copying over backend internal TLS key ------ 3.53s 2026-04-03 06:13:31.721827 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 3.45s 2026-04-03 06:13:31.721838 | orchestrator | glance : Copying over glance-image-import.conf -------------------------- 3.42s 2026-04-03 06:13:31.721849 | orchestrator | glance : Copying over glance-cache.conf for glance_api ------------------ 3.36s 2026-04-03 06:13:31.721860 | orchestrator | service-ks-register : glance | Creating services ------------------------ 3.36s 2026-04-03 06:13:31.721871 | orchestrator | glance : Copying over glance-swift.conf for glance_api ------------------ 3.32s 2026-04-03 06:13:31.721882 | orchestrator | glance : Copying over property-protections-rules.conf ------------------- 3.32s 2026-04-03 06:13:31.721893 | orchestrator | glance : Ensuring config directories exist ------------------------------ 3.24s 2026-04-03 06:13:31.721904 | orchestrator | glance : Creating TLS backend PEM File ---------------------------------- 3.21s 2026-04-03 06:13:31.721915 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 3.08s 2026-04-03 06:13:34.084001 | orchestrator | 2026-04-03 06:13:34 | INFO  | Task 49a914e5-8ecb-4f9a-96bf-7dfc98963aaa (cinder) was prepared for execution. 2026-04-03 06:13:34.084166 | orchestrator | 2026-04-03 06:13:34 | INFO  | It takes a moment until task 49a914e5-8ecb-4f9a-96bf-7dfc98963aaa (cinder) has been started and output is visible here. 2026-04-03 06:14:08.131381 | orchestrator | 2026-04-03 06:14:08.131495 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:14:08.131514 | orchestrator | 2026-04-03 06:14:08.131527 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:14:08.131539 | orchestrator | Friday 03 April 2026 06:13:38 +0000 (0:00:00.253) 0:00:00.253 ********** 2026-04-03 06:14:08.131550 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:14:08.131562 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:14:08.131573 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:14:08.131584 | orchestrator | 2026-04-03 06:14:08.131595 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:14:08.131606 | orchestrator | Friday 03 April 2026 06:13:38 +0000 (0:00:00.303) 0:00:00.557 ********** 2026-04-03 06:14:08.131617 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-03 06:14:08.131628 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-03 06:14:08.131639 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-03 06:14:08.131650 | orchestrator | 2026-04-03 06:14:08.131661 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-03 06:14:08.131672 | orchestrator | 2026-04-03 06:14:08.131683 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 06:14:08.131694 | orchestrator | Friday 03 April 2026 06:13:39 +0000 (0:00:00.440) 0:00:00.998 ********** 2026-04-03 06:14:08.131705 | orchestrator | included: /ansible/roles/cinder/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:14:08.131716 | orchestrator | 2026-04-03 06:14:08.131727 | orchestrator | TASK [service-ks-register : cinder | Creating services] ************************ 2026-04-03 06:14:08.131738 | orchestrator | Friday 03 April 2026 06:13:39 +0000 (0:00:00.552) 0:00:01.550 ********** 2026-04-03 06:14:08.131751 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 (volumev3)) 2026-04-03 06:14:08.131762 | orchestrator | 2026-04-03 06:14:08.131773 | orchestrator | TASK [service-ks-register : cinder | Creating endpoints] *********************** 2026-04-03 06:14:08.131784 | orchestrator | Friday 03 April 2026 06:13:42 +0000 (0:00:03.224) 0:00:04.774 ********** 2026-04-03 06:14:08.131795 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s -> internal) 2026-04-03 06:14:08.131807 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s -> public) 2026-04-03 06:14:08.131842 | orchestrator | 2026-04-03 06:14:08.131854 | orchestrator | TASK [service-ks-register : cinder | Creating projects] ************************ 2026-04-03 06:14:08.131864 | orchestrator | Friday 03 April 2026 06:13:49 +0000 (0:00:06.323) 0:00:11.098 ********** 2026-04-03 06:14:08.131875 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:14:08.131887 | orchestrator | 2026-04-03 06:14:08.131898 | orchestrator | TASK [service-ks-register : cinder | Creating users] *************************** 2026-04-03 06:14:08.131909 | orchestrator | Friday 03 April 2026 06:13:52 +0000 (0:00:03.052) 0:00:14.150 ********** 2026-04-03 06:14:08.131922 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:14:08.131935 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service) 2026-04-03 06:14:08.131948 | orchestrator | 2026-04-03 06:14:08.131961 | orchestrator | TASK [service-ks-register : cinder | Creating roles] *************************** 2026-04-03 06:14:08.131975 | orchestrator | Friday 03 April 2026 06:13:56 +0000 (0:00:03.815) 0:00:17.966 ********** 2026-04-03 06:14:08.131987 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:14:08.132000 | orchestrator | 2026-04-03 06:14:08.132013 | orchestrator | TASK [service-ks-register : cinder | Granting user roles] ********************** 2026-04-03 06:14:08.132027 | orchestrator | Friday 03 April 2026 06:13:59 +0000 (0:00:03.150) 0:00:21.117 ********** 2026-04-03 06:14:08.132040 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> admin) 2026-04-03 06:14:08.132053 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> service) 2026-04-03 06:14:08.132065 | orchestrator | 2026-04-03 06:14:08.132110 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-03 06:14:08.132150 | orchestrator | Friday 03 April 2026 06:14:06 +0000 (0:00:07.040) 0:00:28.158 ********** 2026-04-03 06:14:08.132172 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:08.132210 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:08.132226 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:08.132251 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:08.132266 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:08.132285 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:08.132298 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:08.132318 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:13.847522 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:13.847653 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:13.847670 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:13.847697 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:13.847717 | orchestrator | 2026-04-03 06:14:13.847738 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 06:14:13.847756 | orchestrator | Friday 03 April 2026 06:14:08 +0000 (0:00:01.969) 0:00:30.127 ********** 2026-04-03 06:14:13.847772 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:13.847791 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:13.847810 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:13.847822 | orchestrator | 2026-04-03 06:14:13.847833 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 06:14:13.847844 | orchestrator | Friday 03 April 2026 06:14:08 +0000 (0:00:00.498) 0:00:30.626 ********** 2026-04-03 06:14:13.847855 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:14:13.847866 | orchestrator | 2026-04-03 06:14:13.847876 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-03 06:14:13.847887 | orchestrator | Friday 03 April 2026 06:14:09 +0000 (0:00:00.559) 0:00:31.185 ********** 2026-04-03 06:14:13.847899 | orchestrator | changed: [testbed-node-0] => (item=cinder-volume) 2026-04-03 06:14:13.847921 | orchestrator | changed: [testbed-node-1] => (item=cinder-volume) 2026-04-03 06:14:13.847932 | orchestrator | changed: [testbed-node-2] => (item=cinder-volume) 2026-04-03 06:14:13.847943 | orchestrator | changed: [testbed-node-0] => (item=cinder-backup) 2026-04-03 06:14:13.847953 | orchestrator | changed: [testbed-node-1] => (item=cinder-backup) 2026-04-03 06:14:13.847964 | orchestrator | changed: [testbed-node-2] => (item=cinder-backup) 2026-04-03 06:14:13.847974 | orchestrator | 2026-04-03 06:14:13.847985 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-03 06:14:13.847996 | orchestrator | Friday 03 April 2026 06:14:10 +0000 (0:00:01.610) 0:00:32.795 ********** 2026-04-03 06:14:13.848027 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:13.848043 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:13.848061 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:13.848108 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:13.848141 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:24.317219 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-03 06:14:24.317333 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317362 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317371 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317400 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317425 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317480 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-03 06:14:24.317492 | orchestrator | 2026-04-03 06:14:24.317502 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-03 06:14:24.317513 | orchestrator | Friday 03 April 2026 06:14:14 +0000 (0:00:03.289) 0:00:36.084 ********** 2026-04-03 06:14:24.317522 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:14:24.317532 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:14:24.317540 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-03 06:14:24.317548 | orchestrator | 2026-04-03 06:14:24.317557 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-03 06:14:24.317565 | orchestrator | Friday 03 April 2026 06:14:15 +0000 (0:00:01.486) 0:00:37.571 ********** 2026-04-03 06:14:24.317574 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder.keyring) 2026-04-03 06:14:24.317582 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder.keyring) 2026-04-03 06:14:24.317595 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder.keyring) 2026-04-03 06:14:24.317603 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 06:14:24.317612 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 06:14:24.317620 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder-backup.keyring) 2026-04-03 06:14:24.317628 | orchestrator | 2026-04-03 06:14:24.317636 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-03 06:14:24.317651 | orchestrator | Friday 03 April 2026 06:14:18 +0000 (0:00:02.640) 0:00:40.211 ********** 2026-04-03 06:14:24.317660 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-03 06:14:24.317668 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-03 06:14:24.317676 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-03 06:14:24.317684 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-03 06:14:24.317692 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-03 06:14:24.317701 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-03 06:14:24.317710 | orchestrator | 2026-04-03 06:14:24.317720 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-03 06:14:24.317730 | orchestrator | Friday 03 April 2026 06:14:19 +0000 (0:00:01.002) 0:00:41.214 ********** 2026-04-03 06:14:24.317739 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:24.317749 | orchestrator | 2026-04-03 06:14:24.317757 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-03 06:14:24.317766 | orchestrator | Friday 03 April 2026 06:14:19 +0000 (0:00:00.138) 0:00:41.352 ********** 2026-04-03 06:14:24.317775 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:24.317785 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:24.317794 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:24.317803 | orchestrator | 2026-04-03 06:14:24.317813 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 06:14:24.317822 | orchestrator | Friday 03 April 2026 06:14:19 +0000 (0:00:00.507) 0:00:41.859 ********** 2026-04-03 06:14:24.317831 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:14:24.317841 | orchestrator | 2026-04-03 06:14:24.317850 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-03 06:14:24.317859 | orchestrator | Friday 03 April 2026 06:14:20 +0000 (0:00:00.567) 0:00:42.427 ********** 2026-04-03 06:14:24.317877 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:25.255535 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:25.255647 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:25.255689 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255704 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255716 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255745 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255759 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255784 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255797 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255809 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255820 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:25.255832 | orchestrator | 2026-04-03 06:14:25.255846 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-03 06:14:25.255859 | orchestrator | Friday 03 April 2026 06:14:24 +0000 (0:00:03.886) 0:00:46.313 ********** 2026-04-03 06:14:25.255879 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.354357 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354471 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354487 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354500 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:25.354512 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.354524 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354553 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354589 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354601 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:25.354612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.354622 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354633 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354643 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.354659 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:25.354669 | orchestrator | 2026-04-03 06:14:25.354680 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-03 06:14:25.354698 | orchestrator | Friday 03 April 2026 06:14:25 +0000 (0:00:00.948) 0:00:47.261 ********** 2026-04-03 06:14:25.898459 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.898665 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898684 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898697 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:25.898724 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.898776 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898797 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898809 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898821 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:25.898833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:25.898844 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:25.898871 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:30.287147 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:30.287226 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:30.287234 | orchestrator | 2026-04-03 06:14:30.287241 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-03 06:14:30.287308 | orchestrator | Friday 03 April 2026 06:14:26 +0000 (0:00:00.878) 0:00:48.140 ********** 2026-04-03 06:14:30.287315 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:30.287323 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:30.287329 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:30.287361 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287373 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287378 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287384 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287390 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287400 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:30.287408 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.799766 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.799886 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.799905 | orchestrator | 2026-04-03 06:14:42.799919 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-03 06:14:42.799933 | orchestrator | Friday 03 April 2026 06:14:30 +0000 (0:00:04.148) 0:00:52.288 ********** 2026-04-03 06:14:42.799944 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-03 06:14:42.799956 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-03 06:14:42.799967 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-03 06:14:42.799978 | orchestrator | 2026-04-03 06:14:42.799989 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-03 06:14:42.800001 | orchestrator | Friday 03 April 2026 06:14:32 +0000 (0:00:01.798) 0:00:54.086 ********** 2026-04-03 06:14:42.800013 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:42.800049 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:42.800154 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:42.800171 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.800184 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.800196 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.800216 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.800228 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:42.800254 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:45.159873 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:45.159984 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:45.160027 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:45.160041 | orchestrator | 2026-04-03 06:14:45.160055 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-03 06:14:45.160068 | orchestrator | Friday 03 April 2026 06:14:42 +0000 (0:00:10.713) 0:01:04.799 ********** 2026-04-03 06:14:45.160080 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:14:45.160127 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:14:45.160139 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:14:45.160150 | orchestrator | 2026-04-03 06:14:45.160161 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-03 06:14:45.160172 | orchestrator | Friday 03 April 2026 06:14:44 +0000 (0:00:01.437) 0:01:06.237 ********** 2026-04-03 06:14:45.160184 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:45.160213 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:45.160245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:45.160258 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:45.160277 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:45.160289 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:45.160349 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:45.160362 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:45.160390 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:48.479996 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:48.480138 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-03 06:14:48.480188 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:14:48.480203 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 06:14:48.480215 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 06:14:48.480227 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:48.480239 | orchestrator | 2026-04-03 06:14:48.480251 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-03 06:14:48.480263 | orchestrator | Friday 03 April 2026 06:14:45 +0000 (0:00:00.932) 0:01:07.170 ********** 2026-04-03 06:14:48.480274 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:14:48.480286 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:14:48.480298 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:14:48.480308 | orchestrator | 2026-04-03 06:14:48.480319 | orchestrator | TASK [cinder : Check cinder containers] **************************************** 2026-04-03 06:14:48.480329 | orchestrator | Friday 03 April 2026 06:14:45 +0000 (0:00:00.561) 0:01:07.732 ********** 2026-04-03 06:14:48.480378 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:48.480403 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:48.480416 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-03 06:14:48.480429 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:48.480441 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:48.480458 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:14:48.480498 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463212 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463347 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463367 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463380 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463409 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:11.463458 | orchestrator | 2026-04-03 06:16:11.463480 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 06:16:11.463500 | orchestrator | Friday 03 April 2026 06:14:48 +0000 (0:00:02.774) 0:01:10.507 ********** 2026-04-03 06:16:11.463519 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:16:11.463538 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:16:11.463555 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:16:11.463573 | orchestrator | 2026-04-03 06:16:11.463591 | orchestrator | TASK [cinder : Creating Cinder database] *************************************** 2026-04-03 06:16:11.463608 | orchestrator | Friday 03 April 2026 06:14:48 +0000 (0:00:00.356) 0:01:10.864 ********** 2026-04-03 06:16:11.463628 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.463646 | orchestrator | 2026-04-03 06:16:11.463688 | orchestrator | TASK [cinder : Creating Cinder database user and setting permissions] ********** 2026-04-03 06:16:11.463710 | orchestrator | Friday 03 April 2026 06:14:51 +0000 (0:00:02.120) 0:01:12.984 ********** 2026-04-03 06:16:11.463731 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.463752 | orchestrator | 2026-04-03 06:16:11.463773 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-03 06:16:11.463793 | orchestrator | Friday 03 April 2026 06:14:53 +0000 (0:00:02.155) 0:01:15.140 ********** 2026-04-03 06:16:11.463813 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.463836 | orchestrator | 2026-04-03 06:16:11.463857 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 06:16:11.463878 | orchestrator | Friday 03 April 2026 06:15:11 +0000 (0:00:18.292) 0:01:33.433 ********** 2026-04-03 06:16:11.463898 | orchestrator | 2026-04-03 06:16:11.463919 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 06:16:11.463940 | orchestrator | Friday 03 April 2026 06:15:11 +0000 (0:00:00.069) 0:01:33.502 ********** 2026-04-03 06:16:11.463960 | orchestrator | 2026-04-03 06:16:11.463981 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 06:16:11.464002 | orchestrator | Friday 03 April 2026 06:15:11 +0000 (0:00:00.070) 0:01:33.573 ********** 2026-04-03 06:16:11.464023 | orchestrator | 2026-04-03 06:16:11.464042 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-03 06:16:11.464059 | orchestrator | Friday 03 April 2026 06:15:11 +0000 (0:00:00.073) 0:01:33.647 ********** 2026-04-03 06:16:11.464077 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.464095 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:16:11.464164 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:16:11.464183 | orchestrator | 2026-04-03 06:16:11.464202 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-03 06:16:11.464220 | orchestrator | Friday 03 April 2026 06:15:37 +0000 (0:00:25.453) 0:01:59.101 ********** 2026-04-03 06:16:11.464239 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.464256 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:16:11.464275 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:16:11.464294 | orchestrator | 2026-04-03 06:16:11.464313 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-03 06:16:11.464330 | orchestrator | Friday 03 April 2026 06:15:42 +0000 (0:00:04.862) 0:02:03.963 ********** 2026-04-03 06:16:11.464347 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.464365 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:16:11.464413 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:16:11.464431 | orchestrator | 2026-04-03 06:16:11.464450 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-03 06:16:11.464491 | orchestrator | Friday 03 April 2026 06:16:00 +0000 (0:00:18.304) 0:02:22.267 ********** 2026-04-03 06:16:11.464510 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:16:11.464528 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:16:11.464546 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:16:11.464566 | orchestrator | 2026-04-03 06:16:11.464585 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-03 06:16:11.464605 | orchestrator | Friday 03 April 2026 06:16:11 +0000 (0:00:10.815) 0:02:33.083 ********** 2026-04-03 06:16:11.464617 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:16:11.464627 | orchestrator | 2026-04-03 06:16:11.464638 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:16:11.464651 | orchestrator | testbed-node-0 : ok=30  changed=22  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 06:16:11.464663 | orchestrator | testbed-node-1 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:16:11.464674 | orchestrator | testbed-node-2 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:16:11.464685 | orchestrator | 2026-04-03 06:16:11.464697 | orchestrator | 2026-04-03 06:16:11.464708 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:16:11.464719 | orchestrator | Friday 03 April 2026 06:16:11 +0000 (0:00:00.271) 0:02:33.354 ********** 2026-04-03 06:16:11.464729 | orchestrator | =============================================================================== 2026-04-03 06:16:11.464740 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 25.45s 2026-04-03 06:16:11.464762 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 18.30s 2026-04-03 06:16:11.464773 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 18.29s 2026-04-03 06:16:11.464784 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 10.82s 2026-04-03 06:16:11.464795 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 10.71s 2026-04-03 06:16:11.464805 | orchestrator | service-ks-register : cinder | Granting user roles ---------------------- 7.04s 2026-04-03 06:16:11.464816 | orchestrator | service-ks-register : cinder | Creating endpoints ----------------------- 6.32s 2026-04-03 06:16:11.464827 | orchestrator | cinder : Restart cinder-scheduler container ----------------------------- 4.86s 2026-04-03 06:16:11.464838 | orchestrator | cinder : Copying over config.json files for services -------------------- 4.15s 2026-04-03 06:16:11.464849 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 3.89s 2026-04-03 06:16:11.464860 | orchestrator | service-ks-register : cinder | Creating users --------------------------- 3.82s 2026-04-03 06:16:11.464871 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 3.29s 2026-04-03 06:16:11.464881 | orchestrator | service-ks-register : cinder | Creating services ------------------------ 3.22s 2026-04-03 06:16:11.464892 | orchestrator | service-ks-register : cinder | Creating roles --------------------------- 3.15s 2026-04-03 06:16:11.464919 | orchestrator | service-ks-register : cinder | Creating projects ------------------------ 3.05s 2026-04-03 06:16:11.818156 | orchestrator | cinder : Check cinder containers ---------------------------------------- 2.77s 2026-04-03 06:16:11.818256 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 2.64s 2026-04-03 06:16:11.818278 | orchestrator | cinder : Creating Cinder database user and setting permissions ---------- 2.16s 2026-04-03 06:16:11.818297 | orchestrator | cinder : Creating Cinder database --------------------------------------- 2.12s 2026-04-03 06:16:11.818316 | orchestrator | cinder : Ensuring config directories exist ------------------------------ 1.97s 2026-04-03 06:16:14.151495 | orchestrator | 2026-04-03 06:16:14 | INFO  | Task 7e93819c-6cb3-45c0-bd2b-82a503dd416b (barbican) was prepared for execution. 2026-04-03 06:16:14.151608 | orchestrator | 2026-04-03 06:16:14 | INFO  | It takes a moment until task 7e93819c-6cb3-45c0-bd2b-82a503dd416b (barbican) has been started and output is visible here. 2026-04-03 06:16:55.823593 | orchestrator | 2026-04-03 06:16:55.823701 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:16:55.823716 | orchestrator | 2026-04-03 06:16:55.823726 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:16:55.823736 | orchestrator | Friday 03 April 2026 06:16:18 +0000 (0:00:00.259) 0:00:00.260 ********** 2026-04-03 06:16:55.823745 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:16:55.823755 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:16:55.823764 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:16:55.823773 | orchestrator | 2026-04-03 06:16:55.823782 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:16:55.823791 | orchestrator | Friday 03 April 2026 06:16:18 +0000 (0:00:00.323) 0:00:00.583 ********** 2026-04-03 06:16:55.823800 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-03 06:16:55.823809 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-03 06:16:55.823818 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-03 06:16:55.823827 | orchestrator | 2026-04-03 06:16:55.823836 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-03 06:16:55.823844 | orchestrator | 2026-04-03 06:16:55.823853 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-03 06:16:55.823862 | orchestrator | Friday 03 April 2026 06:16:19 +0000 (0:00:00.491) 0:00:01.075 ********** 2026-04-03 06:16:55.823871 | orchestrator | included: /ansible/roles/barbican/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:16:55.823881 | orchestrator | 2026-04-03 06:16:55.823890 | orchestrator | TASK [service-ks-register : barbican | Creating services] ********************** 2026-04-03 06:16:55.823898 | orchestrator | Friday 03 April 2026 06:16:19 +0000 (0:00:00.552) 0:00:01.628 ********** 2026-04-03 06:16:55.823908 | orchestrator | changed: [testbed-node-0] => (item=barbican (key-manager)) 2026-04-03 06:16:55.823917 | orchestrator | 2026-04-03 06:16:55.823925 | orchestrator | TASK [service-ks-register : barbican | Creating endpoints] ********************* 2026-04-03 06:16:55.823934 | orchestrator | Friday 03 April 2026 06:16:23 +0000 (0:00:03.494) 0:00:05.123 ********** 2026-04-03 06:16:55.823943 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api-int.testbed.osism.xyz:9311 -> internal) 2026-04-03 06:16:55.823952 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api.testbed.osism.xyz:9311 -> public) 2026-04-03 06:16:55.823961 | orchestrator | 2026-04-03 06:16:55.823969 | orchestrator | TASK [service-ks-register : barbican | Creating projects] ********************** 2026-04-03 06:16:55.823978 | orchestrator | Friday 03 April 2026 06:16:28 +0000 (0:00:05.761) 0:00:10.885 ********** 2026-04-03 06:16:55.823987 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:16:55.823996 | orchestrator | 2026-04-03 06:16:55.824005 | orchestrator | TASK [service-ks-register : barbican | Creating users] ************************* 2026-04-03 06:16:55.824014 | orchestrator | Friday 03 April 2026 06:16:31 +0000 (0:00:03.032) 0:00:13.917 ********** 2026-04-03 06:16:55.824023 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:16:55.824031 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service) 2026-04-03 06:16:55.824040 | orchestrator | 2026-04-03 06:16:55.824049 | orchestrator | TASK [service-ks-register : barbican | Creating roles] ************************* 2026-04-03 06:16:55.824072 | orchestrator | Friday 03 April 2026 06:16:35 +0000 (0:00:03.962) 0:00:17.879 ********** 2026-04-03 06:16:55.824081 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:16:55.824090 | orchestrator | changed: [testbed-node-0] => (item=key-manager:service-admin) 2026-04-03 06:16:55.824099 | orchestrator | changed: [testbed-node-0] => (item=creator) 2026-04-03 06:16:55.824108 | orchestrator | changed: [testbed-node-0] => (item=observer) 2026-04-03 06:16:55.824170 | orchestrator | changed: [testbed-node-0] => (item=audit) 2026-04-03 06:16:55.824202 | orchestrator | 2026-04-03 06:16:55.824213 | orchestrator | TASK [service-ks-register : barbican | Granting user roles] ******************** 2026-04-03 06:16:55.824223 | orchestrator | Friday 03 April 2026 06:16:50 +0000 (0:00:14.796) 0:00:32.675 ********** 2026-04-03 06:16:55.824234 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service -> admin) 2026-04-03 06:16:55.824245 | orchestrator | 2026-04-03 06:16:55.824256 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-03 06:16:55.824266 | orchestrator | Friday 03 April 2026 06:16:54 +0000 (0:00:03.596) 0:00:36.272 ********** 2026-04-03 06:16:55.824280 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:16:55.824310 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:16:55.824322 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:16:55.824338 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:55.824359 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:55.824370 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:16:55.824389 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.451724 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.451954 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.451973 | orchestrator | 2026-04-03 06:17:01.451987 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-03 06:17:01.452000 | orchestrator | Friday 03 April 2026 06:16:55 +0000 (0:00:01.520) 0:00:37.792 ********** 2026-04-03 06:17:01.452012 | orchestrator | changed: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-03 06:17:01.452024 | orchestrator | changed: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-03 06:17:01.452035 | orchestrator | changed: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-03 06:17:01.452046 | orchestrator | 2026-04-03 06:17:01.452058 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-03 06:17:01.452093 | orchestrator | Friday 03 April 2026 06:16:56 +0000 (0:00:01.109) 0:00:38.902 ********** 2026-04-03 06:17:01.452139 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:01.452152 | orchestrator | 2026-04-03 06:17:01.452163 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-03 06:17:01.452174 | orchestrator | Friday 03 April 2026 06:16:57 +0000 (0:00:00.319) 0:00:39.221 ********** 2026-04-03 06:17:01.452185 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:01.452196 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:01.452207 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:01.452218 | orchestrator | 2026-04-03 06:17:01.452243 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-03 06:17:01.452254 | orchestrator | Friday 03 April 2026 06:16:57 +0000 (0:00:00.307) 0:00:39.529 ********** 2026-04-03 06:17:01.452268 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:17:01.452282 | orchestrator | 2026-04-03 06:17:01.452296 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-03 06:17:01.452309 | orchestrator | Friday 03 April 2026 06:16:58 +0000 (0:00:00.561) 0:00:40.091 ********** 2026-04-03 06:17:01.452324 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:01.452359 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:01.452373 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:01.452398 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.452426 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.452449 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.452468 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:01.452502 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:02.865782 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:02.865931 | orchestrator | 2026-04-03 06:17:02.865961 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-03 06:17:02.865980 | orchestrator | Friday 03 April 2026 06:17:01 +0000 (0:00:03.327) 0:00:43.419 ********** 2026-04-03 06:17:02.865997 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:02.866084 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866100 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866111 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:02.866160 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:02.866199 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866221 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866232 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:02.866247 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:02.866258 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866269 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:02.866292 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:02.866303 | orchestrator | 2026-04-03 06:17:02.866325 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-03 06:17:02.866338 | orchestrator | Friday 03 April 2026 06:17:02 +0000 (0:00:00.583) 0:00:44.002 ********** 2026-04-03 06:17:02.866359 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:06.284347 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284469 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284506 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:06.284522 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:06.284535 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284558 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284651 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:06.284684 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:06.284697 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:06.284728 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:06.284739 | orchestrator | 2026-04-03 06:17:06.284751 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-03 06:17:06.284764 | orchestrator | Friday 03 April 2026 06:17:02 +0000 (0:00:00.842) 0:00:44.845 ********** 2026-04-03 06:17:06.284776 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:06.284790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:06.284817 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:15.514315 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514432 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514449 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514463 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514496 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514509 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:15.514521 | orchestrator | 2026-04-03 06:17:15.514534 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-03 06:17:15.514547 | orchestrator | Friday 03 April 2026 06:17:06 +0000 (0:00:03.403) 0:00:48.248 ********** 2026-04-03 06:17:15.514559 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:15.514571 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:17:15.514582 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:17:15.514594 | orchestrator | 2026-04-03 06:17:15.514624 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-03 06:17:15.514636 | orchestrator | Friday 03 April 2026 06:17:07 +0000 (0:00:01.549) 0:00:49.798 ********** 2026-04-03 06:17:15.514647 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:17:15.514658 | orchestrator | 2026-04-03 06:17:15.514669 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-03 06:17:15.514682 | orchestrator | Friday 03 April 2026 06:17:08 +0000 (0:00:00.936) 0:00:50.734 ********** 2026-04-03 06:17:15.514695 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:15.514707 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:15.514720 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:15.514733 | orchestrator | 2026-04-03 06:17:15.514746 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-03 06:17:15.514759 | orchestrator | Friday 03 April 2026 06:17:09 +0000 (0:00:00.553) 0:00:51.288 ********** 2026-04-03 06:17:15.514807 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:15.514822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:15.514844 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:15.514863 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374534 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374635 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374652 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374687 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374700 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:16.374712 | orchestrator | 2026-04-03 06:17:16.374725 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-03 06:17:16.374738 | orchestrator | Friday 03 April 2026 06:17:15 +0000 (0:00:06.199) 0:00:57.488 ********** 2026-04-03 06:17:16.374767 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:16.374786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:16.374799 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:16.374823 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:16.374837 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:16.374849 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:16.374861 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:16.374873 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:16.374893 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-03 06:17:18.678373 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:17:18.678505 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:17:18.678525 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:18.678540 | orchestrator | 2026-04-03 06:17:18.678553 | orchestrator | TASK [barbican : Check barbican containers] ************************************ 2026-04-03 06:17:18.678566 | orchestrator | Friday 03 April 2026 06:17:16 +0000 (0:00:00.862) 0:00:58.350 ********** 2026-04-03 06:17:18.678578 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:18.678592 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:18.678627 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-03 06:17:18.678641 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678662 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678674 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678685 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678697 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678708 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:17:18.678720 | orchestrator | 2026-04-03 06:17:18.678732 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-03 06:17:18.678755 | orchestrator | Friday 03 April 2026 06:17:18 +0000 (0:00:02.297) 0:01:00.647 ********** 2026-04-03 06:17:59.978384 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:17:59.978528 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:17:59.978545 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:17:59.978557 | orchestrator | 2026-04-03 06:17:59.978571 | orchestrator | TASK [barbican : Creating barbican database] *********************************** 2026-04-03 06:17:59.978583 | orchestrator | Friday 03 April 2026 06:17:19 +0000 (0:00:00.347) 0:01:00.995 ********** 2026-04-03 06:17:59.978594 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978605 | orchestrator | 2026-04-03 06:17:59.978617 | orchestrator | TASK [barbican : Creating barbican database user and setting permissions] ****** 2026-04-03 06:17:59.978628 | orchestrator | Friday 03 April 2026 06:17:21 +0000 (0:00:02.076) 0:01:03.071 ********** 2026-04-03 06:17:59.978639 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978650 | orchestrator | 2026-04-03 06:17:59.978661 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-03 06:17:59.978672 | orchestrator | Friday 03 April 2026 06:17:23 +0000 (0:00:02.295) 0:01:05.367 ********** 2026-04-03 06:17:59.978683 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978694 | orchestrator | 2026-04-03 06:17:59.978705 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 06:17:59.978716 | orchestrator | Friday 03 April 2026 06:17:35 +0000 (0:00:12.159) 0:01:17.526 ********** 2026-04-03 06:17:59.978727 | orchestrator | 2026-04-03 06:17:59.978738 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 06:17:59.978749 | orchestrator | Friday 03 April 2026 06:17:35 +0000 (0:00:00.098) 0:01:17.625 ********** 2026-04-03 06:17:59.978760 | orchestrator | 2026-04-03 06:17:59.978771 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 06:17:59.978782 | orchestrator | Friday 03 April 2026 06:17:35 +0000 (0:00:00.068) 0:01:17.693 ********** 2026-04-03 06:17:59.978793 | orchestrator | 2026-04-03 06:17:59.978804 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-03 06:17:59.978815 | orchestrator | Friday 03 April 2026 06:17:35 +0000 (0:00:00.071) 0:01:17.765 ********** 2026-04-03 06:17:59.978826 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978837 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:17:59.978848 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:17:59.978859 | orchestrator | 2026-04-03 06:17:59.978870 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-03 06:17:59.978882 | orchestrator | Friday 03 April 2026 06:17:46 +0000 (0:00:11.210) 0:01:28.975 ********** 2026-04-03 06:17:59.978893 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:17:59.978904 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:17:59.978915 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978926 | orchestrator | 2026-04-03 06:17:59.978937 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-03 06:17:59.978948 | orchestrator | Friday 03 April 2026 06:17:54 +0000 (0:00:07.654) 0:01:36.630 ********** 2026-04-03 06:17:59.978959 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:17:59.978970 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:17:59.978981 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:17:59.978992 | orchestrator | 2026-04-03 06:17:59.979003 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:17:59.979016 | orchestrator | testbed-node-0 : ok=24  changed=18  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:17:59.979028 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:17:59.979039 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:17:59.979050 | orchestrator | 2026-04-03 06:17:59.979062 | orchestrator | 2026-04-03 06:17:59.979073 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:17:59.979092 | orchestrator | Friday 03 April 2026 06:17:59 +0000 (0:00:04.998) 0:01:41.628 ********** 2026-04-03 06:17:59.979103 | orchestrator | =============================================================================== 2026-04-03 06:17:59.979115 | orchestrator | service-ks-register : barbican | Creating roles ------------------------ 14.80s 2026-04-03 06:17:59.979125 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 12.16s 2026-04-03 06:17:59.979159 | orchestrator | barbican : Restart barbican-api container ------------------------------ 11.21s 2026-04-03 06:17:59.979171 | orchestrator | barbican : Restart barbican-keystone-listener container ----------------- 7.65s 2026-04-03 06:17:59.979182 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 6.20s 2026-04-03 06:17:59.979192 | orchestrator | service-ks-register : barbican | Creating endpoints --------------------- 5.76s 2026-04-03 06:17:59.979203 | orchestrator | barbican : Restart barbican-worker container ---------------------------- 5.00s 2026-04-03 06:17:59.979214 | orchestrator | service-ks-register : barbican | Creating users ------------------------- 3.96s 2026-04-03 06:17:59.979225 | orchestrator | service-ks-register : barbican | Granting user roles -------------------- 3.60s 2026-04-03 06:17:59.979236 | orchestrator | service-ks-register : barbican | Creating services ---------------------- 3.49s 2026-04-03 06:17:59.979247 | orchestrator | barbican : Copying over config.json files for services ------------------ 3.40s 2026-04-03 06:17:59.979258 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 3.33s 2026-04-03 06:17:59.979270 | orchestrator | service-ks-register : barbican | Creating projects ---------------------- 3.03s 2026-04-03 06:17:59.979281 | orchestrator | barbican : Check barbican containers ------------------------------------ 2.30s 2026-04-03 06:17:59.979292 | orchestrator | barbican : Creating barbican database user and setting permissions ------ 2.30s 2026-04-03 06:17:59.979334 | orchestrator | barbican : Creating barbican database ----------------------------------- 2.08s 2026-04-03 06:17:59.979347 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 1.55s 2026-04-03 06:17:59.979359 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 1.52s 2026-04-03 06:17:59.979370 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 1.11s 2026-04-03 06:17:59.979381 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 0.94s 2026-04-03 06:18:02.316105 | orchestrator | 2026-04-03 06:18:02 | INFO  | Task bf27e6cf-1b48-4d63-9d65-2bdab63746b7 (designate) was prepared for execution. 2026-04-03 06:18:02.316249 | orchestrator | 2026-04-03 06:18:02 | INFO  | It takes a moment until task bf27e6cf-1b48-4d63-9d65-2bdab63746b7 (designate) has been started and output is visible here. 2026-04-03 06:18:33.380937 | orchestrator | 2026-04-03 06:18:33.381054 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:18:33.381072 | orchestrator | 2026-04-03 06:18:33.381084 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:18:33.381096 | orchestrator | Friday 03 April 2026 06:18:06 +0000 (0:00:00.279) 0:00:00.279 ********** 2026-04-03 06:18:33.381108 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:18:33.381120 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:18:33.381132 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:18:33.381200 | orchestrator | 2026-04-03 06:18:33.381212 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:18:33.381224 | orchestrator | Friday 03 April 2026 06:18:06 +0000 (0:00:00.341) 0:00:00.621 ********** 2026-04-03 06:18:33.381236 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-03 06:18:33.381248 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-03 06:18:33.381259 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-03 06:18:33.381270 | orchestrator | 2026-04-03 06:18:33.381281 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-03 06:18:33.381292 | orchestrator | 2026-04-03 06:18:33.381304 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 06:18:33.381337 | orchestrator | Friday 03 April 2026 06:18:07 +0000 (0:00:00.447) 0:00:01.068 ********** 2026-04-03 06:18:33.381350 | orchestrator | included: /ansible/roles/designate/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:18:33.381362 | orchestrator | 2026-04-03 06:18:33.381373 | orchestrator | TASK [service-ks-register : designate | Creating services] ********************* 2026-04-03 06:18:33.381384 | orchestrator | Friday 03 April 2026 06:18:07 +0000 (0:00:00.599) 0:00:01.668 ********** 2026-04-03 06:18:33.381396 | orchestrator | changed: [testbed-node-0] => (item=designate (dns)) 2026-04-03 06:18:33.381406 | orchestrator | 2026-04-03 06:18:33.381417 | orchestrator | TASK [service-ks-register : designate | Creating endpoints] ******************** 2026-04-03 06:18:33.381428 | orchestrator | Friday 03 April 2026 06:18:11 +0000 (0:00:03.491) 0:00:05.159 ********** 2026-04-03 06:18:33.381440 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api-int.testbed.osism.xyz:9001 -> internal) 2026-04-03 06:18:33.381451 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api.testbed.osism.xyz:9001 -> public) 2026-04-03 06:18:33.381462 | orchestrator | 2026-04-03 06:18:33.381473 | orchestrator | TASK [service-ks-register : designate | Creating projects] ********************* 2026-04-03 06:18:33.381486 | orchestrator | Friday 03 April 2026 06:18:17 +0000 (0:00:06.183) 0:00:11.342 ********** 2026-04-03 06:18:33.381499 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:18:33.381512 | orchestrator | 2026-04-03 06:18:33.381525 | orchestrator | TASK [service-ks-register : designate | Creating users] ************************ 2026-04-03 06:18:33.381538 | orchestrator | Friday 03 April 2026 06:18:20 +0000 (0:00:03.150) 0:00:14.492 ********** 2026-04-03 06:18:33.381551 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:18:33.381564 | orchestrator | changed: [testbed-node-0] => (item=designate -> service) 2026-04-03 06:18:33.381576 | orchestrator | 2026-04-03 06:18:33.381588 | orchestrator | TASK [service-ks-register : designate | Creating roles] ************************ 2026-04-03 06:18:33.381601 | orchestrator | Friday 03 April 2026 06:18:24 +0000 (0:00:03.888) 0:00:18.381 ********** 2026-04-03 06:18:33.381614 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:18:33.381628 | orchestrator | 2026-04-03 06:18:33.381641 | orchestrator | TASK [service-ks-register : designate | Granting user roles] ******************* 2026-04-03 06:18:33.381654 | orchestrator | Friday 03 April 2026 06:18:27 +0000 (0:00:03.038) 0:00:21.420 ********** 2026-04-03 06:18:33.381667 | orchestrator | changed: [testbed-node-0] => (item=designate -> service -> admin) 2026-04-03 06:18:33.381680 | orchestrator | 2026-04-03 06:18:33.381694 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-03 06:18:33.381706 | orchestrator | Friday 03 April 2026 06:18:31 +0000 (0:00:03.719) 0:00:25.140 ********** 2026-04-03 06:18:33.381739 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:33.381777 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:33.381800 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:33.381812 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:33.381826 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:33.381837 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:33.381855 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:33.381882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431202 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431319 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431338 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431351 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431381 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431394 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431446 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431459 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431471 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431483 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:39.431495 | orchestrator | 2026-04-03 06:18:39.431510 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-03 06:18:39.431523 | orchestrator | Friday 03 April 2026 06:18:34 +0000 (0:00:02.773) 0:00:27.913 ********** 2026-04-03 06:18:39.431534 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:18:39.431547 | orchestrator | 2026-04-03 06:18:39.431558 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-03 06:18:39.431569 | orchestrator | Friday 03 April 2026 06:18:34 +0000 (0:00:00.147) 0:00:28.060 ********** 2026-04-03 06:18:39.431581 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:18:39.431592 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:18:39.431603 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:18:39.431614 | orchestrator | 2026-04-03 06:18:39.431625 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 06:18:39.431636 | orchestrator | Friday 03 April 2026 06:18:34 +0000 (0:00:00.507) 0:00:28.567 ********** 2026-04-03 06:18:39.431648 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:18:39.431671 | orchestrator | 2026-04-03 06:18:39.431685 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-03 06:18:39.431697 | orchestrator | Friday 03 April 2026 06:18:35 +0000 (0:00:00.547) 0:00:29.115 ********** 2026-04-03 06:18:39.431717 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:39.431743 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:41.214932 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:41.215004 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215011 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215042 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215048 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215062 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215067 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215071 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215077 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215090 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215094 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215099 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:41.215109 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:42.090010 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:42.090230 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:42.090249 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:42.090288 | orchestrator | 2026-04-03 06:18:42.090302 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-03 06:18:42.090315 | orchestrator | Friday 03 April 2026 06:18:41 +0000 (0:00:05.892) 0:00:35.008 ********** 2026-04-03 06:18:42.090343 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:42.090358 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:42.090389 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.090402 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.090415 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.090436 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.090448 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:18:42.090466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:42.090479 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:42.090491 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.090511 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837132 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837283 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837300 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:18:42.837328 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:42.837341 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:42.837352 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837390 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837426 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:18:42.837437 | orchestrator | 2026-04-03 06:18:42.837448 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-03 06:18:42.837459 | orchestrator | Friday 03 April 2026 06:18:42 +0000 (0:00:00.980) 0:00:35.988 ********** 2026-04-03 06:18:42.837480 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:42.837497 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:42.837514 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:42.837543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181484 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181496 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:18:43.181521 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:43.181533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:43.181542 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181550 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181588 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181597 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181604 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:18:43.181617 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:18:43.181625 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:18:43.181633 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181641 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:18:43.181659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:18:47.378310 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:18:47.378403 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:18:47.378417 | orchestrator | 2026-04-03 06:18:47.378427 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-03 06:18:47.378437 | orchestrator | Friday 03 April 2026 06:18:43 +0000 (0:00:00.983) 0:00:36.972 ********** 2026-04-03 06:18:47.378460 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:47.378472 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:47.378481 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:47.378520 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378532 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378545 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378554 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378564 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378578 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378588 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:47.378603 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555074 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555287 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555309 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555322 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555359 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555373 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555403 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555425 | orchestrator | 2026-04-03 06:18:58.555440 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-03 06:18:58.555452 | orchestrator | Friday 03 April 2026 06:18:49 +0000 (0:00:05.954) 0:00:42.926 ********** 2026-04-03 06:18:58.555471 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:58.555485 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:58.555505 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:18:58.555518 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:18:58.555540 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603266 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603381 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603400 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603436 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603450 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603464 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603494 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603514 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603527 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603547 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603559 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603571 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603583 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:06.603595 | orchestrator | 2026-04-03 06:19:06.603609 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-03 06:19:06.603623 | orchestrator | Friday 03 April 2026 06:19:02 +0000 (0:00:13.761) 0:00:56.688 ********** 2026-04-03 06:19:06.603645 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 06:19:10.775116 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 06:19:10.775256 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 06:19:10.775272 | orchestrator | 2026-04-03 06:19:10.775285 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-03 06:19:10.775296 | orchestrator | Friday 03 April 2026 06:19:06 +0000 (0:00:03.708) 0:01:00.397 ********** 2026-04-03 06:19:10.775308 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 06:19:10.775318 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 06:19:10.775347 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 06:19:10.775359 | orchestrator | 2026-04-03 06:19:10.775370 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-03 06:19:10.775402 | orchestrator | Friday 03 April 2026 06:19:09 +0000 (0:00:02.430) 0:01:02.828 ********** 2026-04-03 06:19:10.775418 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:10.775442 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:10.775462 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:10.775511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:10.775548 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:10.775580 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:10.775600 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:10.775621 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:10.775639 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:10.775659 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:10.775693 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:13.563451 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:13.563594 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:13.563613 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:13.563627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:13.563640 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:13.563652 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:13.563682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:13.563703 | orchestrator | 2026-04-03 06:19:13.563716 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-03 06:19:13.563735 | orchestrator | Friday 03 April 2026 06:19:11 +0000 (0:00:02.787) 0:01:05.615 ********** 2026-04-03 06:19:13.563748 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:13.563761 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:13.563773 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:13.563784 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:13.563802 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542541 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542642 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542659 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:14.542672 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542685 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542696 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542752 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:14.542765 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542777 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542790 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:14.542802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:14.542814 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:14.542833 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:14.542846 | orchestrator | 2026-04-03 06:19:14.542859 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 06:19:14.542879 | orchestrator | Friday 03 April 2026 06:19:14 +0000 (0:00:02.715) 0:01:08.331 ********** 2026-04-03 06:19:15.473610 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:19:15.473715 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:19:15.473759 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:19:15.473781 | orchestrator | 2026-04-03 06:19:15.473795 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-03 06:19:15.473808 | orchestrator | Friday 03 April 2026 06:19:14 +0000 (0:00:00.299) 0:01:08.630 ********** 2026-04-03 06:19:15.473823 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:15.473840 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:19:15.473854 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.473867 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.473900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.473935 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.473948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:19:15.473960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:15.473973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:19:15.473984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.473996 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.474072 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:15.474101 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:19:18.757814 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:19:18.757926 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-03 06:19:18.757947 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 06:19:18.757961 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 06:19:18.757974 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 06:19:18.758009 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 06:19:18.758074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:19:18.758087 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:19:18.758099 | orchestrator | 2026-04-03 06:19:18.758144 | orchestrator | TASK [designate : Check designate containers] ********************************** 2026-04-03 06:19:18.758230 | orchestrator | Friday 03 April 2026 06:19:15 +0000 (0:00:00.755) 0:01:09.385 ********** 2026-04-03 06:19:18.758243 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:19:18.758263 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:19:18.758282 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-03 06:19:18.758317 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:18.758356 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629693 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629781 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629795 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629831 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629840 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629875 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629885 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629893 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629901 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629915 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629923 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629931 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:19:20.629940 | orchestrator | 2026-04-03 06:19:20.629949 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 06:19:20.629958 | orchestrator | Friday 03 April 2026 06:19:20 +0000 (0:00:04.693) 0:01:14.079 ********** 2026-04-03 06:19:20.629966 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:19:20.629983 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:20:38.326929 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:20:38.327039 | orchestrator | 2026-04-03 06:20:38.327054 | orchestrator | TASK [designate : Creating Designate databases] ******************************** 2026-04-03 06:20:38.327067 | orchestrator | Friday 03 April 2026 06:19:20 +0000 (0:00:00.340) 0:01:14.420 ********** 2026-04-03 06:20:38.327078 | orchestrator | changed: [testbed-node-0] => (item=designate) 2026-04-03 06:20:38.327088 | orchestrator | 2026-04-03 06:20:38.327099 | orchestrator | TASK [designate : Creating Designate databases user and setting permissions] *** 2026-04-03 06:20:38.327109 | orchestrator | Friday 03 April 2026 06:19:22 +0000 (0:00:02.031) 0:01:16.452 ********** 2026-04-03 06:20:38.327119 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-03 06:20:38.327129 | orchestrator | changed: [testbed-node-0 -> {{ groups['designate-central'][0] }}] 2026-04-03 06:20:38.327139 | orchestrator | 2026-04-03 06:20:38.327149 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-03 06:20:38.327159 | orchestrator | Friday 03 April 2026 06:19:24 +0000 (0:00:02.182) 0:01:18.634 ********** 2026-04-03 06:20:38.327169 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327237 | orchestrator | 2026-04-03 06:20:38.327248 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 06:20:38.327258 | orchestrator | Friday 03 April 2026 06:19:40 +0000 (0:00:15.217) 0:01:33.851 ********** 2026-04-03 06:20:38.327268 | orchestrator | 2026-04-03 06:20:38.327301 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 06:20:38.327312 | orchestrator | Friday 03 April 2026 06:19:40 +0000 (0:00:00.107) 0:01:33.958 ********** 2026-04-03 06:20:38.327321 | orchestrator | 2026-04-03 06:20:38.327331 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 06:20:38.327341 | orchestrator | Friday 03 April 2026 06:19:40 +0000 (0:00:00.070) 0:01:34.029 ********** 2026-04-03 06:20:38.327351 | orchestrator | 2026-04-03 06:20:38.327361 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-03 06:20:38.327372 | orchestrator | Friday 03 April 2026 06:19:40 +0000 (0:00:00.072) 0:01:34.101 ********** 2026-04-03 06:20:38.327382 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327391 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327401 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327411 | orchestrator | 2026-04-03 06:20:38.327421 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-03 06:20:38.327431 | orchestrator | Friday 03 April 2026 06:19:52 +0000 (0:00:12.554) 0:01:46.656 ********** 2026-04-03 06:20:38.327440 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327450 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327460 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327470 | orchestrator | 2026-04-03 06:20:38.327482 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-03 06:20:38.327494 | orchestrator | Friday 03 April 2026 06:20:03 +0000 (0:00:10.388) 0:01:57.044 ********** 2026-04-03 06:20:38.327506 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327517 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327528 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327540 | orchestrator | 2026-04-03 06:20:38.327551 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-03 06:20:38.327563 | orchestrator | Friday 03 April 2026 06:20:08 +0000 (0:00:05.519) 0:02:02.564 ********** 2026-04-03 06:20:38.327575 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327586 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327598 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327609 | orchestrator | 2026-04-03 06:20:38.327620 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-03 06:20:38.327630 | orchestrator | Friday 03 April 2026 06:20:18 +0000 (0:00:10.086) 0:02:12.651 ********** 2026-04-03 06:20:38.327640 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327650 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327659 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327669 | orchestrator | 2026-04-03 06:20:38.327679 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-03 06:20:38.327689 | orchestrator | Friday 03 April 2026 06:20:24 +0000 (0:00:05.947) 0:02:18.599 ********** 2026-04-03 06:20:38.327699 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327708 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:20:38.327718 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:20:38.327728 | orchestrator | 2026-04-03 06:20:38.327738 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-03 06:20:38.327748 | orchestrator | Friday 03 April 2026 06:20:30 +0000 (0:00:05.617) 0:02:24.216 ********** 2026-04-03 06:20:38.327757 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:20:38.327767 | orchestrator | 2026-04-03 06:20:38.327777 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:20:38.327788 | orchestrator | testbed-node-0 : ok=29  changed=23  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:20:38.327798 | orchestrator | testbed-node-1 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:20:38.327808 | orchestrator | testbed-node-2 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:20:38.327825 | orchestrator | 2026-04-03 06:20:38.327835 | orchestrator | 2026-04-03 06:20:38.327845 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:20:38.327855 | orchestrator | Friday 03 April 2026 06:20:37 +0000 (0:00:07.520) 0:02:31.736 ********** 2026-04-03 06:20:38.327865 | orchestrator | =============================================================================== 2026-04-03 06:20:38.327875 | orchestrator | designate : Running Designate bootstrap container ---------------------- 15.22s 2026-04-03 06:20:38.327884 | orchestrator | designate : Copying over designate.conf -------------------------------- 13.76s 2026-04-03 06:20:38.327924 | orchestrator | designate : Restart designate-backend-bind9 container ------------------ 12.55s 2026-04-03 06:20:38.327936 | orchestrator | designate : Restart designate-api container ---------------------------- 10.39s 2026-04-03 06:20:38.327946 | orchestrator | designate : Restart designate-producer container ----------------------- 10.09s 2026-04-03 06:20:38.327955 | orchestrator | designate : Non-destructive DNS pools update ---------------------------- 7.52s 2026-04-03 06:20:38.327965 | orchestrator | service-ks-register : designate | Creating endpoints -------------------- 6.18s 2026-04-03 06:20:38.327975 | orchestrator | designate : Copying over config.json files for services ----------------- 5.95s 2026-04-03 06:20:38.327985 | orchestrator | designate : Restart designate-mdns container ---------------------------- 5.95s 2026-04-03 06:20:38.327995 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 5.89s 2026-04-03 06:20:38.328004 | orchestrator | designate : Restart designate-worker container -------------------------- 5.62s 2026-04-03 06:20:38.328014 | orchestrator | designate : Restart designate-central container ------------------------- 5.52s 2026-04-03 06:20:38.328024 | orchestrator | designate : Check designate containers ---------------------------------- 4.69s 2026-04-03 06:20:38.328034 | orchestrator | service-ks-register : designate | Creating users ------------------------ 3.89s 2026-04-03 06:20:38.328044 | orchestrator | service-ks-register : designate | Granting user roles ------------------- 3.72s 2026-04-03 06:20:38.328053 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 3.71s 2026-04-03 06:20:38.328063 | orchestrator | service-ks-register : designate | Creating services --------------------- 3.49s 2026-04-03 06:20:38.328073 | orchestrator | service-ks-register : designate | Creating projects --------------------- 3.15s 2026-04-03 06:20:38.328083 | orchestrator | service-ks-register : designate | Creating roles ------------------------ 3.04s 2026-04-03 06:20:38.328092 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 2.79s 2026-04-03 06:20:40.694468 | orchestrator | 2026-04-03 06:20:40 | INFO  | Task 17c1d594-0f93-486c-be18-c08ec8aab352 (octavia) was prepared for execution. 2026-04-03 06:20:40.694567 | orchestrator | 2026-04-03 06:20:40 | INFO  | It takes a moment until task 17c1d594-0f93-486c-be18-c08ec8aab352 (octavia) has been started and output is visible here. 2026-04-03 06:22:42.061262 | orchestrator | 2026-04-03 06:22:42.061382 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:22:42.061399 | orchestrator | 2026-04-03 06:22:42.061412 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:22:42.061424 | orchestrator | Friday 03 April 2026 06:20:44 +0000 (0:00:00.264) 0:00:00.264 ********** 2026-04-03 06:22:42.061435 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:22:42.061448 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:22:42.061459 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:22:42.061470 | orchestrator | 2026-04-03 06:22:42.061481 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:22:42.061492 | orchestrator | Friday 03 April 2026 06:20:45 +0000 (0:00:00.316) 0:00:00.580 ********** 2026-04-03 06:22:42.061504 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-03 06:22:42.061515 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-03 06:22:42.061527 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-03 06:22:42.061561 | orchestrator | 2026-04-03 06:22:42.061573 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-03 06:22:42.061584 | orchestrator | 2026-04-03 06:22:42.061595 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:22:42.061606 | orchestrator | Friday 03 April 2026 06:20:45 +0000 (0:00:00.439) 0:00:01.019 ********** 2026-04-03 06:22:42.061617 | orchestrator | included: /ansible/roles/octavia/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:22:42.061629 | orchestrator | 2026-04-03 06:22:42.061640 | orchestrator | TASK [service-ks-register : octavia | Creating services] *********************** 2026-04-03 06:22:42.061651 | orchestrator | Friday 03 April 2026 06:20:46 +0000 (0:00:00.545) 0:00:01.565 ********** 2026-04-03 06:22:42.061662 | orchestrator | changed: [testbed-node-0] => (item=octavia (load-balancer)) 2026-04-03 06:22:42.061673 | orchestrator | 2026-04-03 06:22:42.061684 | orchestrator | TASK [service-ks-register : octavia | Creating endpoints] ********************** 2026-04-03 06:22:42.061695 | orchestrator | Friday 03 April 2026 06:20:49 +0000 (0:00:03.351) 0:00:04.916 ********** 2026-04-03 06:22:42.061706 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api-int.testbed.osism.xyz:9876 -> internal) 2026-04-03 06:22:42.061717 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api.testbed.osism.xyz:9876 -> public) 2026-04-03 06:22:42.061728 | orchestrator | 2026-04-03 06:22:42.061739 | orchestrator | TASK [service-ks-register : octavia | Creating projects] *********************** 2026-04-03 06:22:42.061750 | orchestrator | Friday 03 April 2026 06:20:55 +0000 (0:00:06.190) 0:00:11.106 ********** 2026-04-03 06:22:42.061761 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:22:42.061772 | orchestrator | 2026-04-03 06:22:42.061783 | orchestrator | TASK [service-ks-register : octavia | Creating users] ************************** 2026-04-03 06:22:42.061794 | orchestrator | Friday 03 April 2026 06:20:58 +0000 (0:00:03.088) 0:00:14.195 ********** 2026-04-03 06:22:42.061805 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:22:42.061816 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-03 06:22:42.061827 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-03 06:22:42.061838 | orchestrator | 2026-04-03 06:22:42.061849 | orchestrator | TASK [service-ks-register : octavia | Creating roles] ************************** 2026-04-03 06:22:42.061875 | orchestrator | Friday 03 April 2026 06:21:06 +0000 (0:00:08.100) 0:00:22.295 ********** 2026-04-03 06:22:42.061886 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:22:42.061897 | orchestrator | 2026-04-03 06:22:42.061908 | orchestrator | TASK [service-ks-register : octavia | Granting user roles] ********************* 2026-04-03 06:22:42.061919 | orchestrator | Friday 03 April 2026 06:21:10 +0000 (0:00:03.243) 0:00:25.539 ********** 2026-04-03 06:22:42.061930 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-03 06:22:42.061941 | orchestrator | ok: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-03 06:22:42.061952 | orchestrator | 2026-04-03 06:22:42.061963 | orchestrator | TASK [octavia : Adding octavia related roles] ********************************** 2026-04-03 06:22:42.061973 | orchestrator | Friday 03 April 2026 06:21:17 +0000 (0:00:06.934) 0:00:32.473 ********** 2026-04-03 06:22:42.061984 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_observer) 2026-04-03 06:22:42.061995 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_global_observer) 2026-04-03 06:22:42.062006 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_member) 2026-04-03 06:22:42.062075 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_admin) 2026-04-03 06:22:42.062089 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_quota_admin) 2026-04-03 06:22:42.062100 | orchestrator | 2026-04-03 06:22:42.062111 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:22:42.062122 | orchestrator | Friday 03 April 2026 06:21:32 +0000 (0:00:15.133) 0:00:47.607 ********** 2026-04-03 06:22:42.062145 | orchestrator | included: /ansible/roles/octavia/tasks/prepare.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:22:42.062156 | orchestrator | 2026-04-03 06:22:42.062167 | orchestrator | TASK [octavia : Create amphora flavor] ***************************************** 2026-04-03 06:22:42.062178 | orchestrator | Friday 03 April 2026 06:21:32 +0000 (0:00:00.775) 0:00:48.382 ********** 2026-04-03 06:22:42.062189 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062200 | orchestrator | 2026-04-03 06:22:42.062211 | orchestrator | TASK [octavia : Create nova keypair for amphora] ******************************* 2026-04-03 06:22:42.062271 | orchestrator | Friday 03 April 2026 06:21:38 +0000 (0:00:05.139) 0:00:53.522 ********** 2026-04-03 06:22:42.062283 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062295 | orchestrator | 2026-04-03 06:22:42.062306 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-03 06:22:42.062335 | orchestrator | Friday 03 April 2026 06:21:41 +0000 (0:00:03.697) 0:00:57.219 ********** 2026-04-03 06:22:42.062347 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:22:42.062358 | orchestrator | 2026-04-03 06:22:42.062369 | orchestrator | TASK [octavia : Create security groups for octavia] **************************** 2026-04-03 06:22:42.062380 | orchestrator | Friday 03 April 2026 06:21:44 +0000 (0:00:03.115) 0:01:00.335 ********** 2026-04-03 06:22:42.062391 | orchestrator | changed: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-03 06:22:42.062402 | orchestrator | changed: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-03 06:22:42.062413 | orchestrator | 2026-04-03 06:22:42.062424 | orchestrator | TASK [octavia : Add rules for security groups] ********************************* 2026-04-03 06:22:42.062435 | orchestrator | Friday 03 April 2026 06:21:54 +0000 (0:00:09.345) 0:01:09.680 ********** 2026-04-03 06:22:42.062446 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'icmp'}]) 2026-04-03 06:22:42.062458 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': 22, 'dst_port': 22}]) 2026-04-03 06:22:42.062470 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': '9443', 'dst_port': '9443'}]) 2026-04-03 06:22:42.062482 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-health-mgr-sec-grp', 'enabled': True}, {'protocol': 'udp', 'src_port': '5555', 'dst_port': '5555'}]) 2026-04-03 06:22:42.062493 | orchestrator | 2026-04-03 06:22:42.062509 | orchestrator | TASK [octavia : Create loadbalancer management network] ************************ 2026-04-03 06:22:42.062521 | orchestrator | Friday 03 April 2026 06:22:09 +0000 (0:00:15.376) 0:01:25.057 ********** 2026-04-03 06:22:42.062532 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062543 | orchestrator | 2026-04-03 06:22:42.062554 | orchestrator | TASK [octavia : Create loadbalancer management subnet] ************************* 2026-04-03 06:22:42.062565 | orchestrator | Friday 03 April 2026 06:22:14 +0000 (0:00:04.793) 0:01:29.851 ********** 2026-04-03 06:22:42.062576 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062587 | orchestrator | 2026-04-03 06:22:42.062598 | orchestrator | TASK [octavia : Create loadbalancer management router for IPv6] **************** 2026-04-03 06:22:42.062609 | orchestrator | Friday 03 April 2026 06:22:19 +0000 (0:00:04.922) 0:01:34.774 ********** 2026-04-03 06:22:42.062620 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:22:42.062631 | orchestrator | 2026-04-03 06:22:42.062642 | orchestrator | TASK [octavia : Update loadbalancer management subnet] ************************* 2026-04-03 06:22:42.062653 | orchestrator | Friday 03 April 2026 06:22:19 +0000 (0:00:00.232) 0:01:35.006 ********** 2026-04-03 06:22:42.062664 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:22:42.062675 | orchestrator | 2026-04-03 06:22:42.062686 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:22:42.062697 | orchestrator | Friday 03 April 2026 06:22:23 +0000 (0:00:04.311) 0:01:39.317 ********** 2026-04-03 06:22:42.062708 | orchestrator | included: /ansible/roles/octavia/tasks/hm-interface.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:22:42.062727 | orchestrator | 2026-04-03 06:22:42.062739 | orchestrator | TASK [octavia : Create ports for Octavia health-manager nodes] ***************** 2026-04-03 06:22:42.062750 | orchestrator | Friday 03 April 2026 06:22:24 +0000 (0:00:01.104) 0:01:40.422 ********** 2026-04-03 06:22:42.062767 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.062778 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062789 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.062800 | orchestrator | 2026-04-03 06:22:42.062811 | orchestrator | TASK [octavia : Update Octavia health manager port host_id] ******************** 2026-04-03 06:22:42.062822 | orchestrator | Friday 03 April 2026 06:22:29 +0000 (0:00:04.861) 0:01:45.283 ********** 2026-04-03 06:22:42.062833 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.062844 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062855 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.062866 | orchestrator | 2026-04-03 06:22:42.062877 | orchestrator | TASK [octavia : Add Octavia port to openvswitch br-int] ************************ 2026-04-03 06:22:42.062888 | orchestrator | Friday 03 April 2026 06:22:34 +0000 (0:00:04.541) 0:01:49.825 ********** 2026-04-03 06:22:42.062899 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.062910 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.062921 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.062932 | orchestrator | 2026-04-03 06:22:42.062943 | orchestrator | TASK [octavia : Install isc-dhcp-client package] ******************************* 2026-04-03 06:22:42.062954 | orchestrator | Friday 03 April 2026 06:22:35 +0000 (0:00:01.010) 0:01:50.835 ********** 2026-04-03 06:22:42.062965 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:22:42.062976 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:22:42.062987 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:22:42.062998 | orchestrator | 2026-04-03 06:22:42.063009 | orchestrator | TASK [octavia : Create octavia dhclient conf] ********************************** 2026-04-03 06:22:42.063020 | orchestrator | Friday 03 April 2026 06:22:37 +0000 (0:00:01.934) 0:01:52.769 ********** 2026-04-03 06:22:42.063031 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.063042 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.063053 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.063064 | orchestrator | 2026-04-03 06:22:42.063075 | orchestrator | TASK [octavia : Create octavia-interface service] ****************************** 2026-04-03 06:22:42.063086 | orchestrator | Friday 03 April 2026 06:22:38 +0000 (0:00:01.277) 0:01:54.047 ********** 2026-04-03 06:22:42.063097 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.063108 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.063119 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.063130 | orchestrator | 2026-04-03 06:22:42.063141 | orchestrator | TASK [octavia : Restart octavia-interface.service if required] ***************** 2026-04-03 06:22:42.063153 | orchestrator | Friday 03 April 2026 06:22:39 +0000 (0:00:01.169) 0:01:55.217 ********** 2026-04-03 06:22:42.063164 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:22:42.063175 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:22:42.063186 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:22:42.063196 | orchestrator | 2026-04-03 06:22:42.063214 | orchestrator | TASK [octavia : Enable and start octavia-interface.service] ******************** 2026-04-03 06:23:08.317870 | orchestrator | Friday 03 April 2026 06:22:42 +0000 (0:00:02.258) 0:01:57.476 ********** 2026-04-03 06:23:08.317962 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:23:08.317974 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:23:08.317981 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:23:08.317988 | orchestrator | 2026-04-03 06:23:08.317995 | orchestrator | TASK [octavia : Wait for interface ohm0 ip appear] ***************************** 2026-04-03 06:23:08.318003 | orchestrator | Friday 03 April 2026 06:22:43 +0000 (0:00:01.367) 0:01:58.844 ********** 2026-04-03 06:23:08.318009 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318056 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:23:08.318063 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:23:08.318069 | orchestrator | 2026-04-03 06:23:08.318076 | orchestrator | TASK [octavia : Gather facts] ************************************************** 2026-04-03 06:23:08.318102 | orchestrator | Friday 03 April 2026 06:22:44 +0000 (0:00:00.636) 0:01:59.480 ********** 2026-04-03 06:23:08.318109 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:23:08.318115 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318121 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:23:08.318127 | orchestrator | 2026-04-03 06:23:08.318146 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:23:08.318153 | orchestrator | Friday 03 April 2026 06:22:47 +0000 (0:00:03.797) 0:02:03.278 ********** 2026-04-03 06:23:08.318160 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:23:08.318167 | orchestrator | 2026-04-03 06:23:08.318173 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-03 06:23:08.318180 | orchestrator | Friday 03 April 2026 06:22:48 +0000 (0:00:00.527) 0:02:03.806 ********** 2026-04-03 06:23:08.318186 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318192 | orchestrator | 2026-04-03 06:23:08.318198 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-03 06:23:08.318205 | orchestrator | Friday 03 April 2026 06:22:52 +0000 (0:00:04.065) 0:02:07.871 ********** 2026-04-03 06:23:08.318211 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318217 | orchestrator | 2026-04-03 06:23:08.318224 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-03 06:23:08.318269 | orchestrator | Friday 03 April 2026 06:22:55 +0000 (0:00:03.119) 0:02:10.991 ********** 2026-04-03 06:23:08.318276 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-03 06:23:08.318282 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-03 06:23:08.318289 | orchestrator | 2026-04-03 06:23:08.318296 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-03 06:23:08.318302 | orchestrator | Friday 03 April 2026 06:23:02 +0000 (0:00:07.035) 0:02:18.027 ********** 2026-04-03 06:23:08.318309 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318315 | orchestrator | 2026-04-03 06:23:08.318321 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-03 06:23:08.318327 | orchestrator | Friday 03 April 2026 06:23:05 +0000 (0:00:03.347) 0:02:21.375 ********** 2026-04-03 06:23:08.318333 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:23:08.318340 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:23:08.318346 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:23:08.318352 | orchestrator | 2026-04-03 06:23:08.318358 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-03 06:23:08.318364 | orchestrator | Friday 03 April 2026 06:23:06 +0000 (0:00:00.489) 0:02:21.864 ********** 2026-04-03 06:23:08.318385 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:08.318407 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:08.318421 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:08.318429 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:08.318438 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:08.318450 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:08.318458 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:08.318467 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:08.318486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822385 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822486 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822501 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822530 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822544 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822575 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:09.822589 | orchestrator | 2026-04-03 06:23:09.822603 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-03 06:23:09.822615 | orchestrator | Friday 03 April 2026 06:23:08 +0000 (0:00:02.300) 0:02:24.164 ********** 2026-04-03 06:23:09.822627 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:23:09.822639 | orchestrator | 2026-04-03 06:23:09.822650 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-03 06:23:09.822662 | orchestrator | Friday 03 April 2026 06:23:08 +0000 (0:00:00.118) 0:02:24.283 ********** 2026-04-03 06:23:09.822673 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:23:09.822699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:23:09.822711 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:23:09.822722 | orchestrator | 2026-04-03 06:23:09.822733 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-03 06:23:09.822744 | orchestrator | Friday 03 April 2026 06:23:09 +0000 (0:00:00.317) 0:02:24.600 ********** 2026-04-03 06:23:09.822758 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:09.822771 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:09.822789 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:09.822812 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:09.822824 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:09.822836 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:23:09.822857 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:14.534632 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:14.534734 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:14.534766 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:14.534802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:14.534814 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:23:14.534828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:14.534840 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:14.534868 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:14.534879 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:14.534923 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:14.534942 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:23:14.534953 | orchestrator | 2026-04-03 06:23:14.534964 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:23:14.534976 | orchestrator | Friday 03 April 2026 06:23:09 +0000 (0:00:00.731) 0:02:25.332 ********** 2026-04-03 06:23:14.534987 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:23:14.534997 | orchestrator | 2026-04-03 06:23:14.535007 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-03 06:23:14.535018 | orchestrator | Friday 03 April 2026 06:23:10 +0000 (0:00:00.753) 0:02:26.085 ********** 2026-04-03 06:23:14.535029 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:14.535041 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:14.535060 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:16.068061 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:16.068211 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:16.068285 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:16.068301 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068338 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068351 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068408 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068421 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068433 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068445 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068457 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:16.068468 | orchestrator | 2026-04-03 06:23:16.068481 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-03 06:23:16.068494 | orchestrator | Friday 03 April 2026 06:23:15 +0000 (0:00:04.822) 0:02:30.908 ********** 2026-04-03 06:23:16.068516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:16.162874 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:16.162954 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.162965 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.162974 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:16.162982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:23:16.162990 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:16.162998 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:16.163031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.163048 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.163055 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:16.163062 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:23:16.163069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:16.163076 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:16.163083 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.163098 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.945837 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:16.945941 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:23:16.945958 | orchestrator | 2026-04-03 06:23:16.945970 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-03 06:23:16.945982 | orchestrator | Friday 03 April 2026 06:23:16 +0000 (0:00:00.680) 0:02:31.588 ********** 2026-04-03 06:23:16.945995 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:16.946008 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:16.946075 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.946110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.946139 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:16.946160 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:23:16.946179 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:16.946191 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:16.946203 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.946214 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:16.946268 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:16.946281 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:23:16.946305 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 06:23:21.290403 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 06:23:21.290533 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 06:23:21.290551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 06:23:21.290566 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 06:23:21.290601 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:23:21.290616 | orchestrator | 2026-04-03 06:23:21.290628 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-03 06:23:21.290641 | orchestrator | Friday 03 April 2026 06:23:17 +0000 (0:00:01.255) 0:02:32.844 ********** 2026-04-03 06:23:21.290653 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:21.290699 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:21.290713 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:21.290725 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:21.290745 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:21.290757 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:21.290769 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:21.290792 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:36.853846 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:36.853951 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:36.853966 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:36.853997 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:36.854008 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:36.854067 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:36.854104 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:36.854116 | orchestrator | 2026-04-03 06:23:36.854127 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-03 06:23:36.854138 | orchestrator | Friday 03 April 2026 06:23:22 +0000 (0:00:04.827) 0:02:37.671 ********** 2026-04-03 06:23:36.854147 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 06:23:36.854157 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 06:23:36.854166 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 06:23:36.854175 | orchestrator | 2026-04-03 06:23:36.854184 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-03 06:23:36.854193 | orchestrator | Friday 03 April 2026 06:23:23 +0000 (0:00:01.569) 0:02:39.240 ********** 2026-04-03 06:23:36.854204 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:36.854223 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:36.854279 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:36.854301 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:51.790790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:51.790898 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:51.790936 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.790950 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.790961 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.790972 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791010 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791022 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791042 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791053 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791063 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:23:51.791074 | orchestrator | 2026-04-03 06:23:51.791086 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-03 06:23:51.791098 | orchestrator | Friday 03 April 2026 06:23:40 +0000 (0:00:16.293) 0:02:55.534 ********** 2026-04-03 06:23:51.791109 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:23:51.791120 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:23:51.791130 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:23:51.791140 | orchestrator | 2026-04-03 06:23:51.791150 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-03 06:23:51.791160 | orchestrator | Friday 03 April 2026 06:23:41 +0000 (0:00:01.679) 0:02:57.214 ********** 2026-04-03 06:23:51.791170 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 06:23:51.791181 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 06:23:51.791190 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 06:23:51.791200 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 06:23:51.791210 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 06:23:51.791220 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 06:23:51.791230 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 06:23:51.791264 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 06:23:51.791274 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 06:23:51.791284 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 06:23:51.791294 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 06:23:51.791309 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 06:23:51.791321 | orchestrator | 2026-04-03 06:23:51.791333 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-03 06:23:51.791344 | orchestrator | Friday 03 April 2026 06:23:46 +0000 (0:00:05.008) 0:03:02.222 ********** 2026-04-03 06:23:51.791356 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 06:23:51.791374 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 06:23:51.791393 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 06:23:59.848918 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.848997 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.849004 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.849010 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849015 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849020 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849025 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849030 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849035 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849041 | orchestrator | 2026-04-03 06:23:59.849047 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-03 06:23:59.849053 | orchestrator | Friday 03 April 2026 06:23:51 +0000 (0:00:04.986) 0:03:07.208 ********** 2026-04-03 06:23:59.849058 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 06:23:59.849063 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 06:23:59.849068 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 06:23:59.849073 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.849078 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.849083 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 06:23:59.849087 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849092 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849097 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 06:23:59.849102 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849107 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849112 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 06:23:59.849117 | orchestrator | 2026-04-03 06:23:59.849122 | orchestrator | TASK [octavia : Check octavia containers] ************************************** 2026-04-03 06:23:59.849127 | orchestrator | Friday 03 April 2026 06:23:56 +0000 (0:00:04.969) 0:03:12.178 ********** 2026-04-03 06:23:59.849135 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:59.849143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:59.849195 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 06:23:59.849202 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:59.849209 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:59.849214 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 06:23:59.849221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:59.849227 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:59.849291 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 06:23:59.849303 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715334 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715508 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715521 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715560 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:24.715573 | orchestrator | 2026-04-03 06:25:24.715587 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 06:25:24.715616 | orchestrator | Friday 03 April 2026 06:24:00 +0000 (0:00:03.924) 0:03:16.102 ********** 2026-04-03 06:25:24.715628 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:24.715641 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:24.715651 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:24.715662 | orchestrator | 2026-04-03 06:25:24.715674 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-03 06:25:24.715685 | orchestrator | Friday 03 April 2026 06:24:00 +0000 (0:00:00.315) 0:03:16.417 ********** 2026-04-03 06:25:24.715696 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.715707 | orchestrator | 2026-04-03 06:25:24.715718 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-03 06:25:24.715730 | orchestrator | Friday 03 April 2026 06:24:03 +0000 (0:00:02.047) 0:03:18.465 ********** 2026-04-03 06:25:24.715741 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.715752 | orchestrator | 2026-04-03 06:25:24.715763 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-03 06:25:24.715774 | orchestrator | Friday 03 April 2026 06:24:05 +0000 (0:00:02.083) 0:03:20.548 ********** 2026-04-03 06:25:24.715785 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.715796 | orchestrator | 2026-04-03 06:25:24.715808 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-03 06:25:24.715820 | orchestrator | Friday 03 April 2026 06:24:07 +0000 (0:00:02.216) 0:03:22.765 ********** 2026-04-03 06:25:24.715848 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.715860 | orchestrator | 2026-04-03 06:25:24.715871 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-03 06:25:24.715882 | orchestrator | Friday 03 April 2026 06:24:09 +0000 (0:00:02.240) 0:03:25.005 ********** 2026-04-03 06:25:24.715893 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.715904 | orchestrator | 2026-04-03 06:25:24.715915 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 06:25:24.715926 | orchestrator | Friday 03 April 2026 06:24:30 +0000 (0:00:20.504) 0:03:45.510 ********** 2026-04-03 06:25:24.715937 | orchestrator | 2026-04-03 06:25:24.715948 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 06:25:24.715958 | orchestrator | Friday 03 April 2026 06:24:30 +0000 (0:00:00.067) 0:03:45.578 ********** 2026-04-03 06:25:24.715969 | orchestrator | 2026-04-03 06:25:24.715980 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 06:25:24.715991 | orchestrator | Friday 03 April 2026 06:24:30 +0000 (0:00:00.069) 0:03:45.647 ********** 2026-04-03 06:25:24.716002 | orchestrator | 2026-04-03 06:25:24.716013 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-03 06:25:24.716024 | orchestrator | Friday 03 April 2026 06:24:30 +0000 (0:00:00.066) 0:03:45.714 ********** 2026-04-03 06:25:24.716034 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.716045 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:25:24.716064 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:25:24.716075 | orchestrator | 2026-04-03 06:25:24.716086 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-03 06:25:24.716097 | orchestrator | Friday 03 April 2026 06:24:46 +0000 (0:00:15.822) 0:04:01.536 ********** 2026-04-03 06:25:24.716108 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.716119 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:25:24.716130 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:25:24.716141 | orchestrator | 2026-04-03 06:25:24.716151 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-03 06:25:24.716162 | orchestrator | Friday 03 April 2026 06:24:56 +0000 (0:00:10.664) 0:04:12.201 ********** 2026-04-03 06:25:24.716173 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.716184 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:25:24.716195 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:25:24.716206 | orchestrator | 2026-04-03 06:25:24.716217 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-03 06:25:24.716228 | orchestrator | Friday 03 April 2026 06:25:06 +0000 (0:00:09.646) 0:04:21.847 ********** 2026-04-03 06:25:24.716239 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:25:24.716310 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:25:24.716322 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.716333 | orchestrator | 2026-04-03 06:25:24.716345 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-03 06:25:24.716356 | orchestrator | Friday 03 April 2026 06:25:14 +0000 (0:00:08.215) 0:04:30.063 ********** 2026-04-03 06:25:24.716367 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:25:24.716378 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:25:24.716389 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:25:24.716400 | orchestrator | 2026-04-03 06:25:24.716417 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:25:24.716438 | orchestrator | testbed-node-0 : ok=57  changed=38  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:25:24.716458 | orchestrator | testbed-node-1 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:25:24.716477 | orchestrator | testbed-node-2 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:25:24.716496 | orchestrator | 2026-04-03 06:25:24.716514 | orchestrator | 2026-04-03 06:25:24.716533 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:25:24.716552 | orchestrator | Friday 03 April 2026 06:25:24 +0000 (0:00:10.059) 0:04:40.122 ********** 2026-04-03 06:25:24.716569 | orchestrator | =============================================================================== 2026-04-03 06:25:24.716587 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 20.50s 2026-04-03 06:25:24.716606 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 16.29s 2026-04-03 06:25:24.716626 | orchestrator | octavia : Restart octavia-api container -------------------------------- 15.82s 2026-04-03 06:25:24.716655 | orchestrator | octavia : Add rules for security groups -------------------------------- 15.38s 2026-04-03 06:25:24.716674 | orchestrator | octavia : Adding octavia related roles --------------------------------- 15.13s 2026-04-03 06:25:24.716693 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 10.66s 2026-04-03 06:25:24.716712 | orchestrator | octavia : Restart octavia-worker container ----------------------------- 10.06s 2026-04-03 06:25:24.716731 | orchestrator | octavia : Restart octavia-health-manager container ---------------------- 9.65s 2026-04-03 06:25:24.716749 | orchestrator | octavia : Create security groups for octavia ---------------------------- 9.35s 2026-04-03 06:25:24.716769 | orchestrator | octavia : Restart octavia-housekeeping container ------------------------ 8.22s 2026-04-03 06:25:24.716790 | orchestrator | service-ks-register : octavia | Creating users -------------------------- 8.10s 2026-04-03 06:25:24.716824 | orchestrator | octavia : Get security groups for octavia ------------------------------- 7.04s 2026-04-03 06:25:24.716838 | orchestrator | service-ks-register : octavia | Granting user roles --------------------- 6.93s 2026-04-03 06:25:24.716849 | orchestrator | service-ks-register : octavia | Creating endpoints ---------------------- 6.19s 2026-04-03 06:25:24.716871 | orchestrator | octavia : Create amphora flavor ----------------------------------------- 5.14s 2026-04-03 06:25:25.052822 | orchestrator | octavia : Copying certificate files for octavia-worker ------------------ 5.01s 2026-04-03 06:25:25.052918 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 4.99s 2026-04-03 06:25:25.052933 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 4.97s 2026-04-03 06:25:25.052943 | orchestrator | octavia : Create loadbalancer management subnet ------------------------- 4.92s 2026-04-03 06:25:25.052954 | orchestrator | octavia : Create ports for Octavia health-manager nodes ----------------- 4.86s 2026-04-03 06:25:27.390396 | orchestrator | 2026-04-03 06:25:27 | INFO  | Task a065debb-b6ac-49c7-942e-32b43a9c1958 (ceilometer) was prepared for execution. 2026-04-03 06:25:27.390520 | orchestrator | 2026-04-03 06:25:27 | INFO  | It takes a moment until task a065debb-b6ac-49c7-942e-32b43a9c1958 (ceilometer) has been started and output is visible here. 2026-04-03 06:25:50.152872 | orchestrator | 2026-04-03 06:25:50.152989 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:25:50.153006 | orchestrator | 2026-04-03 06:25:50.153018 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:25:50.153031 | orchestrator | Friday 03 April 2026 06:25:31 +0000 (0:00:00.270) 0:00:00.270 ********** 2026-04-03 06:25:50.153044 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:25:50.153056 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:25:50.153067 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:25:50.153078 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:25:50.153089 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:25:50.153100 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:25:50.153111 | orchestrator | 2026-04-03 06:25:50.153122 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:25:50.153134 | orchestrator | Friday 03 April 2026 06:25:32 +0000 (0:00:00.708) 0:00:00.979 ********** 2026-04-03 06:25:50.153146 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153157 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153168 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153179 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153190 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153201 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-03 06:25:50.153212 | orchestrator | 2026-04-03 06:25:50.153223 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-03 06:25:50.153234 | orchestrator | 2026-04-03 06:25:50.153244 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-03 06:25:50.153301 | orchestrator | Friday 03 April 2026 06:25:32 +0000 (0:00:00.638) 0:00:01.618 ********** 2026-04-03 06:25:50.153314 | orchestrator | included: /ansible/roles/ceilometer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:25:50.153327 | orchestrator | 2026-04-03 06:25:50.153338 | orchestrator | TASK [service-ks-register : ceilometer | Creating services] ******************** 2026-04-03 06:25:50.153349 | orchestrator | Friday 03 April 2026 06:25:34 +0000 (0:00:01.255) 0:00:02.874 ********** 2026-04-03 06:25:50.153360 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:50.153371 | orchestrator | 2026-04-03 06:25:50.153382 | orchestrator | TASK [service-ks-register : ceilometer | Creating endpoints] ******************* 2026-04-03 06:25:50.153393 | orchestrator | Friday 03 April 2026 06:25:34 +0000 (0:00:00.151) 0:00:03.026 ********** 2026-04-03 06:25:50.153429 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:50.153442 | orchestrator | 2026-04-03 06:25:50.153455 | orchestrator | TASK [service-ks-register : ceilometer | Creating projects] ******************** 2026-04-03 06:25:50.153467 | orchestrator | Friday 03 April 2026 06:25:34 +0000 (0:00:00.134) 0:00:03.160 ********** 2026-04-03 06:25:50.153480 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:25:50.153493 | orchestrator | 2026-04-03 06:25:50.153506 | orchestrator | TASK [service-ks-register : ceilometer | Creating users] *********************** 2026-04-03 06:25:50.153518 | orchestrator | Friday 03 April 2026 06:25:37 +0000 (0:00:03.372) 0:00:06.532 ********** 2026-04-03 06:25:50.153531 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:25:50.153543 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service) 2026-04-03 06:25:50.153556 | orchestrator | 2026-04-03 06:25:50.153568 | orchestrator | TASK [service-ks-register : ceilometer | Creating roles] *********************** 2026-04-03 06:25:50.153677 | orchestrator | Friday 03 April 2026 06:25:41 +0000 (0:00:03.731) 0:00:10.263 ********** 2026-04-03 06:25:50.153692 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:25:50.153705 | orchestrator | 2026-04-03 06:25:50.153718 | orchestrator | TASK [service-ks-register : ceilometer | Granting user roles] ****************** 2026-04-03 06:25:50.153730 | orchestrator | Friday 03 April 2026 06:25:44 +0000 (0:00:03.086) 0:00:13.350 ********** 2026-04-03 06:25:50.153743 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service -> admin) 2026-04-03 06:25:50.153755 | orchestrator | 2026-04-03 06:25:50.153767 | orchestrator | TASK [ceilometer : Associate the ResellerAdmin role and ceilometer user] ******* 2026-04-03 06:25:50.153778 | orchestrator | Friday 03 April 2026 06:25:48 +0000 (0:00:03.885) 0:00:17.236 ********** 2026-04-03 06:25:50.153789 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:50.153800 | orchestrator | 2026-04-03 06:25:50.153811 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-03 06:25:50.153822 | orchestrator | Friday 03 April 2026 06:25:48 +0000 (0:00:00.139) 0:00:17.376 ********** 2026-04-03 06:25:50.153837 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:50.153872 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:50.153886 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:50.153910 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:50.153925 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:50.153943 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:25:50.153956 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:25:50.153976 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:25:54.834363 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:25:54.834461 | orchestrator | 2026-04-03 06:25:54.834470 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-03 06:25:54.834477 | orchestrator | Friday 03 April 2026 06:25:50 +0000 (0:00:01.412) 0:00:18.788 ********** 2026-04-03 06:25:54.834483 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:25:54.834490 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:25:54.834496 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:25:54.834501 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:25:54.834507 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:25:54.834512 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:25:54.834518 | orchestrator | 2026-04-03 06:25:54.834524 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-03 06:25:54.834530 | orchestrator | Friday 03 April 2026 06:25:51 +0000 (0:00:01.590) 0:00:20.379 ********** 2026-04-03 06:25:54.834535 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:25:54.834542 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:25:54.834547 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:25:54.834552 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:25:54.834558 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:25:54.834563 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:25:54.834568 | orchestrator | 2026-04-03 06:25:54.834574 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-03 06:25:54.834580 | orchestrator | Friday 03 April 2026 06:25:52 +0000 (0:00:00.641) 0:00:21.021 ********** 2026-04-03 06:25:54.834585 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:54.834591 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:54.834597 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:54.834602 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:25:54.834608 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:25:54.834613 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:25:54.834618 | orchestrator | 2026-04-03 06:25:54.834624 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-03 06:25:54.834630 | orchestrator | Friday 03 April 2026 06:25:53 +0000 (0:00:00.748) 0:00:21.769 ********** 2026-04-03 06:25:54.834636 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:25:54.834641 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:25:54.834647 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:25:54.834652 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:25:54.834657 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:25:54.834663 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:25:54.834668 | orchestrator | 2026-04-03 06:25:54.834705 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-03 06:25:54.834711 | orchestrator | Friday 03 April 2026 06:25:53 +0000 (0:00:00.629) 0:00:22.398 ********** 2026-04-03 06:25:54.834718 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:54.834725 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:54.834738 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:54.834755 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:54.834762 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:54.834768 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:54.834773 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:54.834779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:54.834789 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:54.834796 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:54.834801 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:25:54.834807 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:54.834818 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:25:54.834829 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.466901 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:25:59.467029 | orchestrator | 2026-04-03 06:25:59.467048 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-03 06:25:59.467061 | orchestrator | Friday 03 April 2026 06:25:54 +0000 (0:00:01.081) 0:00:23.479 ********** 2026-04-03 06:25:59.467075 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467091 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:59.467104 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:59.467132 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467145 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:59.467177 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:59.467189 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467201 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:25:59.467212 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:59.467241 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467323 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:25:59.467345 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467365 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:25:59.467394 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:25:59.467416 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:25:59.467428 | orchestrator | 2026-04-03 06:25:59.467443 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-03 06:25:59.467458 | orchestrator | Friday 03 April 2026 06:25:55 +0000 (0:00:00.840) 0:00:24.320 ********** 2026-04-03 06:25:59.467472 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:25:59.467484 | orchestrator | 2026-04-03 06:25:59.467497 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-03 06:25:59.467510 | orchestrator | Friday 03 April 2026 06:25:56 +0000 (0:00:00.677) 0:00:24.997 ********** 2026-04-03 06:25:59.467523 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:25:59.467536 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:25:59.467549 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:25:59.467561 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:25:59.467573 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:25:59.467586 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:25:59.467598 | orchestrator | 2026-04-03 06:25:59.467611 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-03 06:25:59.467624 | orchestrator | Friday 03 April 2026 06:25:57 +0000 (0:00:00.813) 0:00:25.811 ********** 2026-04-03 06:25:59.467636 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:25:59.467649 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:25:59.467662 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:25:59.467674 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:25:59.467686 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:25:59.467698 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:25:59.467710 | orchestrator | 2026-04-03 06:25:59.467723 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-03 06:25:59.467735 | orchestrator | Friday 03 April 2026 06:25:58 +0000 (0:00:00.906) 0:00:26.718 ********** 2026-04-03 06:25:59.467748 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:59.467761 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:59.467773 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:59.467786 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:25:59.467797 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:25:59.467808 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:25:59.467819 | orchestrator | 2026-04-03 06:25:59.467830 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-03 06:25:59.467841 | orchestrator | Friday 03 April 2026 06:25:58 +0000 (0:00:00.795) 0:00:27.513 ********** 2026-04-03 06:25:59.467853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:25:59.467864 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:25:59.467875 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:25:59.467886 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:25:59.467897 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:25:59.467908 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:25:59.467919 | orchestrator | 2026-04-03 06:26:04.392201 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-03 06:26:04.392322 | orchestrator | Friday 03 April 2026 06:25:59 +0000 (0:00:00.602) 0:00:28.116 ********** 2026-04-03 06:26:04.392338 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:26:04.392346 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:26:04.392353 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:26:04.392361 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:26:04.392368 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:26:04.392375 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:26:04.392382 | orchestrator | 2026-04-03 06:26:04.392391 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-03 06:26:04.392399 | orchestrator | Friday 03 April 2026 06:26:00 +0000 (0:00:01.460) 0:00:29.577 ********** 2026-04-03 06:26:04.392410 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392444 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:04.392466 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:04.392474 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392481 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:04.392489 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:04.392496 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392546 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:04.392555 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:04.392570 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392578 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:04.392589 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392596 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:04.392603 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:04.392609 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:04.392616 | orchestrator | 2026-04-03 06:26:04.392623 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-03 06:26:04.392630 | orchestrator | Friday 03 April 2026 06:26:01 +0000 (0:00:00.823) 0:00:30.400 ********** 2026-04-03 06:26:04.392636 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:04.392643 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:04.392649 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:04.392656 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:04.392663 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:04.392669 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:04.392675 | orchestrator | 2026-04-03 06:26:04.392681 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-03 06:26:04.392687 | orchestrator | Friday 03 April 2026 06:26:02 +0000 (0:00:00.793) 0:00:31.194 ********** 2026-04-03 06:26:04.392693 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:26:04.392699 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:26:04.392705 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:26:04.392712 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:26:04.392718 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:26:04.392724 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:26:04.392730 | orchestrator | 2026-04-03 06:26:04.392737 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-03 06:26:04.392744 | orchestrator | Friday 03 April 2026 06:26:03 +0000 (0:00:01.387) 0:00:32.582 ********** 2026-04-03 06:26:04.392759 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243004 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:10.243117 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:10.243135 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:10.243173 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:10.243183 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243192 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:10.243202 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:10.243231 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243240 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:10.243336 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243348 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:10.243357 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.243365 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:10.243374 | orchestrator | 2026-04-03 06:26:10.243383 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-03 06:26:10.243393 | orchestrator | Friday 03 April 2026 06:26:05 +0000 (0:00:01.103) 0:00:33.685 ********** 2026-04-03 06:26:10.243408 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:10.243416 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:10.243424 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:10.243433 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:10.243441 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:10.243450 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:10.243458 | orchestrator | 2026-04-03 06:26:10.243467 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-03 06:26:10.243476 | orchestrator | Friday 03 April 2026 06:26:05 +0000 (0:00:00.774) 0:00:34.460 ********** 2026-04-03 06:26:10.243484 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:10.243492 | orchestrator | 2026-04-03 06:26:10.243501 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-03 06:26:10.243510 | orchestrator | Friday 03 April 2026 06:26:05 +0000 (0:00:00.160) 0:00:34.620 ********** 2026-04-03 06:26:10.243519 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:10.243527 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:10.243535 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:10.243544 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:10.243553 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:10.243562 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:10.243580 | orchestrator | 2026-04-03 06:26:10.243590 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-03 06:26:10.243599 | orchestrator | Friday 03 April 2026 06:26:06 +0000 (0:00:00.679) 0:00:35.300 ********** 2026-04-03 06:26:10.243610 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:26:10.243620 | orchestrator | 2026-04-03 06:26:10.243629 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-03 06:26:10.243638 | orchestrator | Friday 03 April 2026 06:26:07 +0000 (0:00:01.302) 0:00:36.602 ********** 2026-04-03 06:26:10.243648 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.243666 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.756651 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.756775 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.756813 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.756846 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:10.756860 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:10.756872 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:10.756904 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:10.756917 | orchestrator | 2026-04-03 06:26:10.756930 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-03 06:26:10.756943 | orchestrator | Friday 03 April 2026 06:26:10 +0000 (0:00:02.282) 0:00:38.885 ********** 2026-04-03 06:26:10.756956 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.756974 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:10.756994 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:10.757007 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.757019 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:10.757030 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:10.757042 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:10.757062 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:12.573940 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:12.574082 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574099 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:12.574120 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574142 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:12.574149 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574156 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:12.574163 | orchestrator | 2026-04-03 06:26:12.574171 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-03 06:26:12.574179 | orchestrator | Friday 03 April 2026 06:26:11 +0000 (0:00:00.848) 0:00:39.733 ********** 2026-04-03 06:26:12.574187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574195 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:12.574218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:12.574235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574239 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:12.574243 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:12.574247 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:12.574288 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:12.574293 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574297 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:12.574301 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:12.574305 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:12.574315 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:19.731036 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:19.731143 | orchestrator | 2026-04-03 06:26:19.731158 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-03 06:26:19.731170 | orchestrator | Friday 03 April 2026 06:26:12 +0000 (0:00:01.482) 0:00:41.216 ********** 2026-04-03 06:26:19.731199 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731214 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731225 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731237 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731248 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731354 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731392 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:19.731405 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:19.731415 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:19.731426 | orchestrator | 2026-04-03 06:26:19.731436 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-03 06:26:19.731446 | orchestrator | Friday 03 April 2026 06:26:14 +0000 (0:00:02.393) 0:00:43.609 ********** 2026-04-03 06:26:19.731457 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731468 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:19.731491 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.923726 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.923854 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.923882 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.923894 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:28.923906 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:28.923938 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:28.923948 | orchestrator | 2026-04-03 06:26:28.923960 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-03 06:26:28.923971 | orchestrator | Friday 03 April 2026 06:26:19 +0000 (0:00:04.767) 0:00:48.377 ********** 2026-04-03 06:26:28.923997 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:26:28.924008 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:26:28.924017 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:26:28.924026 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:26:28.924034 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:26:28.924043 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:26:28.924052 | orchestrator | 2026-04-03 06:26:28.924061 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-03 06:26:28.924076 | orchestrator | Friday 03 April 2026 06:26:21 +0000 (0:00:01.460) 0:00:49.837 ********** 2026-04-03 06:26:28.924085 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:28.924094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:28.924103 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:28.924112 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:28.924120 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:28.924129 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:28.924138 | orchestrator | 2026-04-03 06:26:28.924146 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-03 06:26:28.924156 | orchestrator | Friday 03 April 2026 06:26:21 +0000 (0:00:00.654) 0:00:50.492 ********** 2026-04-03 06:26:28.924165 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:28.924173 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:28.924182 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:28.924190 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:26:28.924199 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:26:28.924208 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:26:28.924217 | orchestrator | 2026-04-03 06:26:28.924225 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-03 06:26:28.924234 | orchestrator | Friday 03 April 2026 06:26:23 +0000 (0:00:01.664) 0:00:52.156 ********** 2026-04-03 06:26:28.924245 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:28.924285 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:28.924297 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:28.924307 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:26:28.924318 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:26:28.924328 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:26:28.924337 | orchestrator | 2026-04-03 06:26:28.924348 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-03 06:26:28.924358 | orchestrator | Friday 03 April 2026 06:26:24 +0000 (0:00:01.397) 0:00:53.553 ********** 2026-04-03 06:26:28.924368 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:26:28.924378 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:26:28.924387 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:26:28.924397 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:26:28.924408 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:26:28.924427 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:26:28.924437 | orchestrator | 2026-04-03 06:26:28.924447 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-03 06:26:28.924456 | orchestrator | Friday 03 April 2026 06:26:26 +0000 (0:00:01.613) 0:00:55.166 ********** 2026-04-03 06:26:28.924468 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.924479 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.924490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:28.924520 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:29.732946 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:29.733080 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:26:29.733124 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:29.733139 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:29.733151 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:26:29.733163 | orchestrator | 2026-04-03 06:26:29.733176 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-03 06:26:29.733189 | orchestrator | Friday 03 April 2026 06:26:28 +0000 (0:00:02.399) 0:00:57.566 ********** 2026-04-03 06:26:29.733216 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:29.733248 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:29.733336 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:29.733359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:29.733371 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:29.733383 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:29.733394 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:29.733406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:29.733417 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:29.733435 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:29.733447 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:29.733467 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.087738 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:33.087841 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.087858 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:33.087870 | orchestrator | 2026-04-03 06:26:33.087881 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-03 06:26:33.087892 | orchestrator | Friday 03 April 2026 06:26:29 +0000 (0:00:00.813) 0:00:58.380 ********** 2026-04-03 06:26:33.087902 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:33.087912 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:33.087922 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:33.087935 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:33.087953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:33.087965 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:33.087975 | orchestrator | 2026-04-03 06:26:33.087985 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-03 06:26:33.087995 | orchestrator | Friday 03 April 2026 06:26:30 +0000 (0:00:00.791) 0:00:59.172 ********** 2026-04-03 06:26:33.088006 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088018 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:33.088030 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:26:33.088062 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088109 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:33.088122 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:26:33.088150 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088161 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 06:26:33.088171 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:26:33.088182 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088192 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:26:33.088202 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088212 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:26:33.088228 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-03 06:26:33.088246 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:26:33.088282 | orchestrator | 2026-04-03 06:26:33.088295 | orchestrator | TASK [ceilometer : Check ceilometer containers] ******************************** 2026-04-03 06:26:33.088307 | orchestrator | Friday 03 April 2026 06:26:31 +0000 (0:00:00.848) 0:01:00.020 ********** 2026-04-03 06:26:33.088328 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900037 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900141 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900153 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900164 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900208 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:27:06.900218 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:06.900240 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:27:06.900250 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 06:27:06.900298 | orchestrator | 2026-04-03 06:27:06.900308 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-03 06:27:06.900319 | orchestrator | Friday 03 April 2026 06:26:33 +0000 (0:00:01.711) 0:01:01.731 ********** 2026-04-03 06:27:06.900327 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:06.900337 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:27:06.900345 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:27:06.900353 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:27:06.900361 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:27:06.900369 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:27:06.900377 | orchestrator | 2026-04-03 06:27:06.900386 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-03 06:27:06.900394 | orchestrator | Friday 03 April 2026 06:26:33 +0000 (0:00:00.641) 0:01:02.373 ********** 2026-04-03 06:27:06.900402 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:27:06.900410 | orchestrator | 2026-04-03 06:27:06.900419 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900427 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:04.703) 0:01:07.076 ********** 2026-04-03 06:27:06.900434 | orchestrator | 2026-04-03 06:27:06.900452 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900460 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:00.072) 0:01:07.149 ********** 2026-04-03 06:27:06.900468 | orchestrator | 2026-04-03 06:27:06.900476 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900484 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:00.071) 0:01:07.221 ********** 2026-04-03 06:27:06.900492 | orchestrator | 2026-04-03 06:27:06.900500 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900509 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:00.244) 0:01:07.465 ********** 2026-04-03 06:27:06.900517 | orchestrator | 2026-04-03 06:27:06.900525 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900533 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:00.069) 0:01:07.535 ********** 2026-04-03 06:27:06.900541 | orchestrator | 2026-04-03 06:27:06.900549 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 06:27:06.900556 | orchestrator | Friday 03 April 2026 06:26:38 +0000 (0:00:00.071) 0:01:07.607 ********** 2026-04-03 06:27:06.900564 | orchestrator | 2026-04-03 06:27:06.900573 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-03 06:27:06.900581 | orchestrator | Friday 03 April 2026 06:26:39 +0000 (0:00:00.075) 0:01:07.682 ********** 2026-04-03 06:27:06.900589 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:27:06.900597 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:27:06.900606 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:27:06.900614 | orchestrator | 2026-04-03 06:27:06.900627 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-03 06:27:06.900636 | orchestrator | Friday 03 April 2026 06:26:46 +0000 (0:00:07.415) 0:01:15.098 ********** 2026-04-03 06:27:06.900645 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:27:06.900654 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:27:06.900662 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:27:06.900671 | orchestrator | 2026-04-03 06:27:06.900678 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-03 06:27:06.900686 | orchestrator | Friday 03 April 2026 06:26:55 +0000 (0:00:09.467) 0:01:24.565 ********** 2026-04-03 06:27:06.900694 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:27:06.900703 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:27:06.900712 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:27:06.900720 | orchestrator | 2026-04-03 06:27:06.900729 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:27:06.900739 | orchestrator | testbed-node-0 : ok=29  changed=13  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-03 06:27:06.900750 | orchestrator | testbed-node-1 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 06:27:06.900764 | orchestrator | testbed-node-2 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 06:27:07.359049 | orchestrator | testbed-node-3 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 06:27:07.359156 | orchestrator | testbed-node-4 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 06:27:07.359171 | orchestrator | testbed-node-5 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 06:27:07.359184 | orchestrator | 2026-04-03 06:27:07.359196 | orchestrator | 2026-04-03 06:27:07.359208 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:27:07.359221 | orchestrator | Friday 03 April 2026 06:27:06 +0000 (0:00:10.971) 0:01:35.537 ********** 2026-04-03 06:27:07.359318 | orchestrator | =============================================================================== 2026-04-03 06:27:07.359334 | orchestrator | ceilometer : Restart ceilometer-compute container ---------------------- 10.97s 2026-04-03 06:27:07.359345 | orchestrator | ceilometer : Restart ceilometer-central container ----------------------- 9.47s 2026-04-03 06:27:07.359356 | orchestrator | ceilometer : Restart ceilometer-notification container ------------------ 7.42s 2026-04-03 06:27:07.359367 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 4.77s 2026-04-03 06:27:07.359379 | orchestrator | ceilometer : Running Ceilometer bootstrap container --------------------- 4.70s 2026-04-03 06:27:07.359390 | orchestrator | service-ks-register : ceilometer | Granting user roles ------------------ 3.89s 2026-04-03 06:27:07.359401 | orchestrator | service-ks-register : ceilometer | Creating users ----------------------- 3.73s 2026-04-03 06:27:07.359412 | orchestrator | service-ks-register : ceilometer | Creating projects -------------------- 3.37s 2026-04-03 06:27:07.359423 | orchestrator | service-ks-register : ceilometer | Creating roles ----------------------- 3.09s 2026-04-03 06:27:07.359434 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 2.40s 2026-04-03 06:27:07.359445 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 2.39s 2026-04-03 06:27:07.359456 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 2.28s 2026-04-03 06:27:07.359467 | orchestrator | ceilometer : Check ceilometer containers -------------------------------- 1.71s 2026-04-03 06:27:07.359478 | orchestrator | ceilometer : Copying over event_definitions.yaml for notification service --- 1.66s 2026-04-03 06:27:07.359490 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 1.61s 2026-04-03 06:27:07.359501 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 1.59s 2026-04-03 06:27:07.359512 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 1.48s 2026-04-03 06:27:07.359523 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 1.46s 2026-04-03 06:27:07.359535 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 1.46s 2026-04-03 06:27:07.359545 | orchestrator | ceilometer : Ensuring config directories exist -------------------------- 1.41s 2026-04-03 06:27:09.710390 | orchestrator | 2026-04-03 06:27:09 | INFO  | Task 81b1ae69-5baf-475f-94f1-1372276291e7 (aodh) was prepared for execution. 2026-04-03 06:27:09.710510 | orchestrator | 2026-04-03 06:27:09 | INFO  | It takes a moment until task 81b1ae69-5baf-475f-94f1-1372276291e7 (aodh) has been started and output is visible here. 2026-04-03 06:27:40.812325 | orchestrator | 2026-04-03 06:27:40.812467 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:27:40.812485 | orchestrator | 2026-04-03 06:27:40.812498 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:27:40.812510 | orchestrator | Friday 03 April 2026 06:27:13 +0000 (0:00:00.320) 0:00:00.320 ********** 2026-04-03 06:27:40.812521 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:27:40.812533 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:27:40.812544 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:27:40.812555 | orchestrator | 2026-04-03 06:27:40.812583 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:27:40.812595 | orchestrator | Friday 03 April 2026 06:27:14 +0000 (0:00:00.321) 0:00:00.641 ********** 2026-04-03 06:27:40.812606 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-03 06:27:40.812618 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-03 06:27:40.812629 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-03 06:27:40.812640 | orchestrator | 2026-04-03 06:27:40.812651 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-03 06:27:40.812663 | orchestrator | 2026-04-03 06:27:40.812674 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-03 06:27:40.812685 | orchestrator | Friday 03 April 2026 06:27:14 +0000 (0:00:00.439) 0:00:01.081 ********** 2026-04-03 06:27:40.812716 | orchestrator | included: /ansible/roles/aodh/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:27:40.812729 | orchestrator | 2026-04-03 06:27:40.812740 | orchestrator | TASK [service-ks-register : aodh | Creating services] ************************** 2026-04-03 06:27:40.812751 | orchestrator | Friday 03 April 2026 06:27:15 +0000 (0:00:00.552) 0:00:01.633 ********** 2026-04-03 06:27:40.812763 | orchestrator | changed: [testbed-node-0] => (item=aodh (alarming)) 2026-04-03 06:27:40.812775 | orchestrator | 2026-04-03 06:27:40.812786 | orchestrator | TASK [service-ks-register : aodh | Creating endpoints] ************************* 2026-04-03 06:27:40.812797 | orchestrator | Friday 03 April 2026 06:27:18 +0000 (0:00:03.304) 0:00:04.938 ********** 2026-04-03 06:27:40.812808 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api-int.testbed.osism.xyz:8042 -> internal) 2026-04-03 06:27:40.812819 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api.testbed.osism.xyz:8042 -> public) 2026-04-03 06:27:40.812830 | orchestrator | 2026-04-03 06:27:40.812842 | orchestrator | TASK [service-ks-register : aodh | Creating projects] ************************** 2026-04-03 06:27:40.812855 | orchestrator | Friday 03 April 2026 06:27:24 +0000 (0:00:06.220) 0:00:11.158 ********** 2026-04-03 06:27:40.812868 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:27:40.812882 | orchestrator | 2026-04-03 06:27:40.812894 | orchestrator | TASK [service-ks-register : aodh | Creating users] ***************************** 2026-04-03 06:27:40.812907 | orchestrator | Friday 03 April 2026 06:27:28 +0000 (0:00:03.374) 0:00:14.533 ********** 2026-04-03 06:27:40.812920 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:27:40.812932 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service) 2026-04-03 06:27:40.812944 | orchestrator | 2026-04-03 06:27:40.812958 | orchestrator | TASK [service-ks-register : aodh | Creating roles] ***************************** 2026-04-03 06:27:40.812971 | orchestrator | Friday 03 April 2026 06:27:31 +0000 (0:00:03.826) 0:00:18.360 ********** 2026-04-03 06:27:40.812983 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:27:40.812996 | orchestrator | 2026-04-03 06:27:40.813009 | orchestrator | TASK [service-ks-register : aodh | Granting user roles] ************************ 2026-04-03 06:27:40.813021 | orchestrator | Friday 03 April 2026 06:27:35 +0000 (0:00:03.195) 0:00:21.555 ********** 2026-04-03 06:27:40.813033 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service -> admin) 2026-04-03 06:27:40.813046 | orchestrator | 2026-04-03 06:27:40.813065 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-03 06:27:40.813084 | orchestrator | Friday 03 April 2026 06:27:38 +0000 (0:00:03.711) 0:00:25.266 ********** 2026-04-03 06:27:40.813107 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:40.813154 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:40.813195 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:40.813219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:40.813241 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:40.813318 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:40.813335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:40.813357 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:42.086727 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:42.086809 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:42.086816 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:42.086822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:42.086827 | orchestrator | 2026-04-03 06:27:42.086833 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-03 06:27:42.086839 | orchestrator | Friday 03 April 2026 06:27:40 +0000 (0:00:01.985) 0:00:27.251 ********** 2026-04-03 06:27:42.086844 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:42.086849 | orchestrator | 2026-04-03 06:27:42.086854 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-03 06:27:42.086859 | orchestrator | Friday 03 April 2026 06:27:40 +0000 (0:00:00.130) 0:00:27.382 ********** 2026-04-03 06:27:42.086863 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:42.086868 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:27:42.086873 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:27:42.086877 | orchestrator | 2026-04-03 06:27:42.086882 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-03 06:27:42.086887 | orchestrator | Friday 03 April 2026 06:27:41 +0000 (0:00:00.504) 0:00:27.887 ********** 2026-04-03 06:27:42.086892 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:42.086923 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:42.086928 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:42.086933 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:42.086938 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:42.086943 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:42.086948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:42.086957 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:42.086966 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:46.892409 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:27:46.892546 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:46.892569 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:46.892584 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:46.892596 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:46.892608 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:27:46.892639 | orchestrator | 2026-04-03 06:27:46.892651 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-03 06:27:46.892664 | orchestrator | Friday 03 April 2026 06:27:42 +0000 (0:00:00.643) 0:00:28.531 ********** 2026-04-03 06:27:46.892675 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:27:46.892687 | orchestrator | 2026-04-03 06:27:46.892698 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-03 06:27:46.892709 | orchestrator | Friday 03 April 2026 06:27:42 +0000 (0:00:00.728) 0:00:29.259 ********** 2026-04-03 06:27:46.892720 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:46.892757 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:46.892770 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:46.892782 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:46.892793 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:46.892812 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:46.892824 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:46.892849 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:47.528081 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:47.528176 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:47.528192 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:47.528226 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:47.528239 | orchestrator | 2026-04-03 06:27:47.528252 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-03 06:27:47.528324 | orchestrator | Friday 03 April 2026 06:27:46 +0000 (0:00:04.071) 0:00:33.331 ********** 2026-04-03 06:27:47.528339 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:47.528366 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:47.528396 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:47.528409 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:47.528420 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:47.528434 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:47.528453 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:47.528465 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:47.528481 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:47.528493 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:27:47.528513 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:48.554870 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:48.555005 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555023 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555036 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:27:48.555050 | orchestrator | 2026-04-03 06:27:48.555062 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-03 06:27:48.555075 | orchestrator | Friday 03 April 2026 06:27:47 +0000 (0:00:00.638) 0:00:33.969 ********** 2026-04-03 06:27:48.555087 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:48.555115 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:48.555127 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555158 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555178 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:27:48.555190 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:48.555201 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:48.555212 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:48.555241 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:27:48.555308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-03 06:27:52.514668 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 06:27:52.514835 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 06:27:52.514866 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 06:27:52.514886 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:27:52.514908 | orchestrator | 2026-04-03 06:27:52.514927 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-03 06:27:52.514947 | orchestrator | Friday 03 April 2026 06:27:48 +0000 (0:00:01.023) 0:00:34.992 ********** 2026-04-03 06:27:52.514967 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:52.515008 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:52.515059 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:27:52.515095 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515116 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515136 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515154 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515183 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515206 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:27:52.515252 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713181 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713314 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713331 | orchestrator | 2026-04-03 06:28:00.713343 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-03 06:28:00.713355 | orchestrator | Friday 03 April 2026 06:27:52 +0000 (0:00:03.963) 0:00:38.955 ********** 2026-04-03 06:28:00.713366 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:00.713393 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:00.713425 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:00.713454 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713465 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713476 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713487 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713502 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713521 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713531 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:00.713549 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.559733 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.559871 | orchestrator | 2026-04-03 06:28:05.559901 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-03 06:28:05.559934 | orchestrator | Friday 03 April 2026 06:28:00 +0000 (0:00:08.195) 0:00:47.151 ********** 2026-04-03 06:28:05.559955 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:05.559974 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:28:05.559991 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:28:05.560008 | orchestrator | 2026-04-03 06:28:05.560025 | orchestrator | TASK [aodh : Check aodh containers] ******************************************** 2026-04-03 06:28:05.560043 | orchestrator | Friday 03 April 2026 06:28:02 +0000 (0:00:01.735) 0:00:48.886 ********** 2026-04-03 06:28:05.560062 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:05.560139 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:05.560163 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-03 06:28:05.560196 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560210 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560221 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560233 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560295 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560316 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560330 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:05.560352 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:58.558178 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 06:28:58.558337 | orchestrator | 2026-04-03 06:28:58.558356 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-03 06:28:58.558370 | orchestrator | Friday 03 April 2026 06:28:05 +0000 (0:00:03.114) 0:00:52.000 ********** 2026-04-03 06:28:58.558381 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:28:58.558393 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:28:58.558404 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:28:58.558415 | orchestrator | 2026-04-03 06:28:58.558427 | orchestrator | TASK [aodh : Creating aodh database] ******************************************* 2026-04-03 06:28:58.558438 | orchestrator | Friday 03 April 2026 06:28:05 +0000 (0:00:00.322) 0:00:52.323 ********** 2026-04-03 06:28:58.558448 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558459 | orchestrator | 2026-04-03 06:28:58.558470 | orchestrator | TASK [aodh : Creating aodh database user and setting permissions] ************** 2026-04-03 06:28:58.558506 | orchestrator | Friday 03 April 2026 06:28:07 +0000 (0:00:02.019) 0:00:54.343 ********** 2026-04-03 06:28:58.558517 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558528 | orchestrator | 2026-04-03 06:28:58.558539 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-03 06:28:58.558549 | orchestrator | Friday 03 April 2026 06:28:10 +0000 (0:00:02.173) 0:00:56.516 ********** 2026-04-03 06:28:58.558562 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558579 | orchestrator | 2026-04-03 06:28:58.558596 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 06:28:58.558615 | orchestrator | Friday 03 April 2026 06:28:22 +0000 (0:00:12.491) 0:01:09.007 ********** 2026-04-03 06:28:58.558633 | orchestrator | 2026-04-03 06:28:58.558654 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 06:28:58.558674 | orchestrator | Friday 03 April 2026 06:28:22 +0000 (0:00:00.071) 0:01:09.079 ********** 2026-04-03 06:28:58.558694 | orchestrator | 2026-04-03 06:28:58.558708 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 06:28:58.558721 | orchestrator | Friday 03 April 2026 06:28:22 +0000 (0:00:00.086) 0:01:09.165 ********** 2026-04-03 06:28:58.558733 | orchestrator | 2026-04-03 06:28:58.558760 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-03 06:28:58.558773 | orchestrator | Friday 03 April 2026 06:28:22 +0000 (0:00:00.273) 0:01:09.439 ********** 2026-04-03 06:28:58.558785 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558798 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:28:58.558810 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:28:58.558823 | orchestrator | 2026-04-03 06:28:58.558835 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-03 06:28:58.558848 | orchestrator | Friday 03 April 2026 06:28:28 +0000 (0:00:05.429) 0:01:14.869 ********** 2026-04-03 06:28:58.558860 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558873 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:28:58.558886 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:28:58.558897 | orchestrator | 2026-04-03 06:28:58.558908 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-03 06:28:58.558919 | orchestrator | Friday 03 April 2026 06:28:38 +0000 (0:00:09.920) 0:01:24.790 ********** 2026-04-03 06:28:58.558930 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.558941 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:28:58.558951 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:28:58.558962 | orchestrator | 2026-04-03 06:28:58.558973 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-03 06:28:58.558984 | orchestrator | Friday 03 April 2026 06:28:48 +0000 (0:00:09.920) 0:01:34.710 ********** 2026-04-03 06:28:58.558995 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:28:58.559005 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:28:58.559016 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:28:58.559027 | orchestrator | 2026-04-03 06:28:58.559037 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:28:58.559050 | orchestrator | testbed-node-0 : ok=23  changed=17  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:28:58.559062 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:28:58.559073 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:28:58.559083 | orchestrator | 2026-04-03 06:28:58.559094 | orchestrator | 2026-04-03 06:28:58.559105 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:28:58.559116 | orchestrator | Friday 03 April 2026 06:28:58 +0000 (0:00:09.962) 0:01:44.672 ********** 2026-04-03 06:28:58.559136 | orchestrator | =============================================================================== 2026-04-03 06:28:58.559147 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 12.49s 2026-04-03 06:28:58.559157 | orchestrator | aodh : Restart aodh-notifier container ---------------------------------- 9.96s 2026-04-03 06:28:58.559186 | orchestrator | aodh : Restart aodh-evaluator container --------------------------------- 9.92s 2026-04-03 06:28:58.559198 | orchestrator | aodh : Restart aodh-listener container ---------------------------------- 9.92s 2026-04-03 06:28:58.559209 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------- 8.20s 2026-04-03 06:28:58.559219 | orchestrator | service-ks-register : aodh | Creating endpoints ------------------------- 6.22s 2026-04-03 06:28:58.559230 | orchestrator | aodh : Restart aodh-api container --------------------------------------- 5.43s 2026-04-03 06:28:58.559241 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 4.07s 2026-04-03 06:28:58.559252 | orchestrator | aodh : Copying over config.json files for services ---------------------- 3.96s 2026-04-03 06:28:58.559262 | orchestrator | service-ks-register : aodh | Creating users ----------------------------- 3.83s 2026-04-03 06:28:58.559338 | orchestrator | service-ks-register : aodh | Granting user roles ------------------------ 3.71s 2026-04-03 06:28:58.559352 | orchestrator | service-ks-register : aodh | Creating projects -------------------------- 3.37s 2026-04-03 06:28:58.559362 | orchestrator | service-ks-register : aodh | Creating services -------------------------- 3.30s 2026-04-03 06:28:58.559373 | orchestrator | service-ks-register : aodh | Creating roles ----------------------------- 3.20s 2026-04-03 06:28:58.559384 | orchestrator | aodh : Check aodh containers -------------------------------------------- 3.11s 2026-04-03 06:28:58.559395 | orchestrator | aodh : Creating aodh database user and setting permissions -------------- 2.17s 2026-04-03 06:28:58.559405 | orchestrator | aodh : Creating aodh database ------------------------------------------- 2.02s 2026-04-03 06:28:58.559416 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 1.99s 2026-04-03 06:28:58.559427 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 1.74s 2026-04-03 06:28:58.559438 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 1.02s 2026-04-03 06:29:00.880417 | orchestrator | 2026-04-03 06:29:00 | INFO  | Task 92e8e873-5f56-4b16-a9b1-b0f7519360da (kolla-ceph-rgw) was prepared for execution. 2026-04-03 06:29:00.880544 | orchestrator | 2026-04-03 06:29:00 | INFO  | It takes a moment until task 92e8e873-5f56-4b16-a9b1-b0f7519360da (kolla-ceph-rgw) has been started and output is visible here. 2026-04-03 06:29:35.974852 | orchestrator | 2026-04-03 06:29:35.974973 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:29:35.974991 | orchestrator | 2026-04-03 06:29:35.975004 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:29:35.975016 | orchestrator | Friday 03 April 2026 06:29:05 +0000 (0:00:00.278) 0:00:00.279 ********** 2026-04-03 06:29:35.975045 | orchestrator | ok: [testbed-manager] 2026-04-03 06:29:35.975059 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:29:35.975071 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:29:35.975083 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:29:35.975094 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:29:35.975106 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:29:35.975118 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:29:35.975130 | orchestrator | 2026-04-03 06:29:35.975142 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:29:35.975154 | orchestrator | Friday 03 April 2026 06:29:05 +0000 (0:00:00.842) 0:00:01.121 ********** 2026-04-03 06:29:35.975167 | orchestrator | ok: [testbed-manager] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975179 | orchestrator | ok: [testbed-node-0] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975191 | orchestrator | ok: [testbed-node-1] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975202 | orchestrator | ok: [testbed-node-2] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975239 | orchestrator | ok: [testbed-node-3] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975251 | orchestrator | ok: [testbed-node-4] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975263 | orchestrator | ok: [testbed-node-5] => (item=enable_ceph_rgw_True) 2026-04-03 06:29:35.975275 | orchestrator | 2026-04-03 06:29:35.975344 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-03 06:29:35.975356 | orchestrator | 2026-04-03 06:29:35.975367 | orchestrator | TASK [ceph-rgw : include_tasks] ************************************************ 2026-04-03 06:29:35.975378 | orchestrator | Friday 03 April 2026 06:29:06 +0000 (0:00:00.763) 0:00:01.884 ********** 2026-04-03 06:29:35.975392 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:29:35.975407 | orchestrator | 2026-04-03 06:29:35.975420 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating services] ********************** 2026-04-03 06:29:35.975433 | orchestrator | Friday 03 April 2026 06:29:08 +0000 (0:00:01.578) 0:00:03.462 ********** 2026-04-03 06:29:35.975446 | orchestrator | changed: [testbed-manager] => (item=swift (object-store)) 2026-04-03 06:29:35.975459 | orchestrator | 2026-04-03 06:29:35.975471 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating endpoints] ********************* 2026-04-03 06:29:35.975484 | orchestrator | Friday 03 April 2026 06:29:12 +0000 (0:00:03.888) 0:00:07.351 ********** 2026-04-03 06:29:35.975497 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> internal) 2026-04-03 06:29:35.975512 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> public) 2026-04-03 06:29:35.975525 | orchestrator | 2026-04-03 06:29:35.975537 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating projects] ********************** 2026-04-03 06:29:35.975549 | orchestrator | Friday 03 April 2026 06:29:18 +0000 (0:00:06.013) 0:00:13.364 ********** 2026-04-03 06:29:35.975562 | orchestrator | ok: [testbed-manager] => (item=service) 2026-04-03 06:29:35.975574 | orchestrator | 2026-04-03 06:29:35.975587 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating users] ************************* 2026-04-03 06:29:35.975599 | orchestrator | Friday 03 April 2026 06:29:21 +0000 (0:00:03.097) 0:00:16.462 ********** 2026-04-03 06:29:35.975612 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:29:35.975624 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service) 2026-04-03 06:29:35.975637 | orchestrator | 2026-04-03 06:29:35.975649 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating roles] ************************* 2026-04-03 06:29:35.975662 | orchestrator | Friday 03 April 2026 06:29:24 +0000 (0:00:03.638) 0:00:20.100 ********** 2026-04-03 06:29:35.975674 | orchestrator | ok: [testbed-manager] => (item=admin) 2026-04-03 06:29:35.975687 | orchestrator | changed: [testbed-manager] => (item=ResellerAdmin) 2026-04-03 06:29:35.975700 | orchestrator | 2026-04-03 06:29:35.975713 | orchestrator | TASK [service-ks-register : ceph-rgw | Granting user roles] ******************** 2026-04-03 06:29:35.975725 | orchestrator | Friday 03 April 2026 06:29:30 +0000 (0:00:05.942) 0:00:26.043 ********** 2026-04-03 06:29:35.975738 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service -> admin) 2026-04-03 06:29:35.975750 | orchestrator | 2026-04-03 06:29:35.975761 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:29:35.975773 | orchestrator | testbed-manager : ok=9  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975784 | orchestrator | testbed-node-0 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975796 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975807 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975827 | orchestrator | testbed-node-3 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975855 | orchestrator | testbed-node-4 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975867 | orchestrator | testbed-node-5 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:35.975878 | orchestrator | 2026-04-03 06:29:35.975889 | orchestrator | 2026-04-03 06:29:35.975900 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:29:35.975917 | orchestrator | Friday 03 April 2026 06:29:35 +0000 (0:00:04.680) 0:00:30.723 ********** 2026-04-03 06:29:35.975929 | orchestrator | =============================================================================== 2026-04-03 06:29:35.975940 | orchestrator | service-ks-register : ceph-rgw | Creating endpoints --------------------- 6.01s 2026-04-03 06:29:35.975950 | orchestrator | service-ks-register : ceph-rgw | Creating roles ------------------------- 5.94s 2026-04-03 06:29:35.975962 | orchestrator | service-ks-register : ceph-rgw | Granting user roles -------------------- 4.68s 2026-04-03 06:29:35.975972 | orchestrator | service-ks-register : ceph-rgw | Creating services ---------------------- 3.89s 2026-04-03 06:29:35.975983 | orchestrator | service-ks-register : ceph-rgw | Creating users ------------------------- 3.64s 2026-04-03 06:29:35.975994 | orchestrator | service-ks-register : ceph-rgw | Creating projects ---------------------- 3.10s 2026-04-03 06:29:35.976005 | orchestrator | ceph-rgw : include_tasks ------------------------------------------------ 1.58s 2026-04-03 06:29:35.976016 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.84s 2026-04-03 06:29:35.976027 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.76s 2026-04-03 06:29:38.339500 | orchestrator | 2026-04-03 06:29:38 | INFO  | Task 54fb0cdf-4006-46da-9c96-5b94f7a4dc63 (gnocchi) was prepared for execution. 2026-04-03 06:29:38.339578 | orchestrator | 2026-04-03 06:29:38 | INFO  | It takes a moment until task 54fb0cdf-4006-46da-9c96-5b94f7a4dc63 (gnocchi) has been started and output is visible here. 2026-04-03 06:29:43.518579 | orchestrator | 2026-04-03 06:29:43.518690 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:29:43.518707 | orchestrator | 2026-04-03 06:29:43.518720 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:29:43.518732 | orchestrator | Friday 03 April 2026 06:29:42 +0000 (0:00:00.263) 0:00:00.263 ********** 2026-04-03 06:29:43.518743 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:29:43.518755 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:29:43.518766 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:29:43.518777 | orchestrator | 2026-04-03 06:29:43.518789 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:29:43.518800 | orchestrator | Friday 03 April 2026 06:29:42 +0000 (0:00:00.336) 0:00:00.600 ********** 2026-04-03 06:29:43.518811 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-03 06:29:43.518823 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-03 06:29:43.518835 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-03 06:29:43.518846 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-03 06:29:43.518857 | orchestrator | 2026-04-03 06:29:43.518868 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-03 06:29:43.518879 | orchestrator | skipping: no hosts matched 2026-04-03 06:29:43.518891 | orchestrator | 2026-04-03 06:29:43.518902 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:29:43.518914 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:43.518957 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:43.518969 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:29:43.518980 | orchestrator | 2026-04-03 06:29:43.518991 | orchestrator | 2026-04-03 06:29:43.519002 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:29:43.519013 | orchestrator | Friday 03 April 2026 06:29:43 +0000 (0:00:00.375) 0:00:00.975 ********** 2026-04-03 06:29:43.519024 | orchestrator | =============================================================================== 2026-04-03 06:29:43.519035 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.38s 2026-04-03 06:29:43.519046 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.34s 2026-04-03 06:29:45.852515 | orchestrator | 2026-04-03 06:29:45 | INFO  | Task 1d9c5ad9-ec9d-49d9-b33d-dedd1106139c (manila) was prepared for execution. 2026-04-03 06:29:45.852619 | orchestrator | 2026-04-03 06:29:45 | INFO  | It takes a moment until task 1d9c5ad9-ec9d-49d9-b33d-dedd1106139c (manila) has been started and output is visible here. 2026-04-03 06:30:26.051598 | orchestrator | 2026-04-03 06:30:26.051715 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:30:26.051732 | orchestrator | 2026-04-03 06:30:26.051745 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:30:26.051756 | orchestrator | Friday 03 April 2026 06:29:49 +0000 (0:00:00.260) 0:00:00.260 ********** 2026-04-03 06:30:26.051768 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:30:26.051780 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:30:26.051792 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:30:26.051803 | orchestrator | 2026-04-03 06:30:26.051815 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:30:26.051826 | orchestrator | Friday 03 April 2026 06:29:50 +0000 (0:00:00.320) 0:00:00.580 ********** 2026-04-03 06:30:26.051837 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-03 06:30:26.051849 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-03 06:30:26.051860 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-03 06:30:26.051872 | orchestrator | 2026-04-03 06:30:26.051883 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-03 06:30:26.051894 | orchestrator | 2026-04-03 06:30:26.051921 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 06:30:26.051933 | orchestrator | Friday 03 April 2026 06:29:50 +0000 (0:00:00.457) 0:00:01.038 ********** 2026-04-03 06:30:26.051945 | orchestrator | included: /ansible/roles/manila/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:30:26.051957 | orchestrator | 2026-04-03 06:30:26.051969 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 06:30:26.051980 | orchestrator | Friday 03 April 2026 06:29:51 +0000 (0:00:00.610) 0:00:01.648 ********** 2026-04-03 06:30:26.051991 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:26.052003 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:30:26.052014 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:30:26.052026 | orchestrator | 2026-04-03 06:30:26.052037 | orchestrator | TASK [service-ks-register : manila | Creating services] ************************ 2026-04-03 06:30:26.052048 | orchestrator | Friday 03 April 2026 06:29:51 +0000 (0:00:00.476) 0:00:02.125 ********** 2026-04-03 06:30:26.052060 | orchestrator | changed: [testbed-node-0] => (item=manila (share)) 2026-04-03 06:30:26.052071 | orchestrator | changed: [testbed-node-0] => (item=manilav2 (sharev2)) 2026-04-03 06:30:26.052082 | orchestrator | 2026-04-03 06:30:26.052093 | orchestrator | TASK [service-ks-register : manila | Creating endpoints] *********************** 2026-04-03 06:30:26.052104 | orchestrator | Friday 03 April 2026 06:29:57 +0000 (0:00:06.155) 0:00:08.281 ********** 2026-04-03 06:30:26.052116 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s -> internal) 2026-04-03 06:30:26.052152 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s -> public) 2026-04-03 06:30:26.052167 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api-int.testbed.osism.xyz:8786/v2 -> internal) 2026-04-03 06:30:26.052179 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api.testbed.osism.xyz:8786/v2 -> public) 2026-04-03 06:30:26.052192 | orchestrator | 2026-04-03 06:30:26.052205 | orchestrator | TASK [service-ks-register : manila | Creating projects] ************************ 2026-04-03 06:30:26.052217 | orchestrator | Friday 03 April 2026 06:30:10 +0000 (0:00:12.272) 0:00:20.553 ********** 2026-04-03 06:30:26.052230 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:30:26.052243 | orchestrator | 2026-04-03 06:30:26.052256 | orchestrator | TASK [service-ks-register : manila | Creating users] *************************** 2026-04-03 06:30:26.052269 | orchestrator | Friday 03 April 2026 06:30:13 +0000 (0:00:03.123) 0:00:23.677 ********** 2026-04-03 06:30:26.052282 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:30:26.052326 | orchestrator | changed: [testbed-node-0] => (item=manila -> service) 2026-04-03 06:30:26.052347 | orchestrator | 2026-04-03 06:30:26.052368 | orchestrator | TASK [service-ks-register : manila | Creating roles] *************************** 2026-04-03 06:30:26.052387 | orchestrator | Friday 03 April 2026 06:30:17 +0000 (0:00:03.752) 0:00:27.430 ********** 2026-04-03 06:30:26.052400 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:30:26.052411 | orchestrator | 2026-04-03 06:30:26.052422 | orchestrator | TASK [service-ks-register : manila | Granting user roles] ********************** 2026-04-03 06:30:26.052433 | orchestrator | Friday 03 April 2026 06:30:20 +0000 (0:00:03.082) 0:00:30.512 ********** 2026-04-03 06:30:26.052444 | orchestrator | changed: [testbed-node-0] => (item=manila -> service -> admin) 2026-04-03 06:30:26.052455 | orchestrator | 2026-04-03 06:30:26.052466 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-03 06:30:26.052477 | orchestrator | Friday 03 April 2026 06:30:23 +0000 (0:00:03.745) 0:00:34.258 ********** 2026-04-03 06:30:26.052510 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:26.052532 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:26.052545 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:26.052567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:26.052580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:26.052592 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:26.052611 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.283574 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.284450 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.284487 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.284500 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.284512 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:36.284524 | orchestrator | 2026-04-03 06:30:36.284537 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 06:30:36.284549 | orchestrator | Friday 03 April 2026 06:30:26 +0000 (0:00:02.194) 0:00:36.452 ********** 2026-04-03 06:30:36.284561 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:30:36.284572 | orchestrator | 2026-04-03 06:30:36.284584 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-03 06:30:36.284594 | orchestrator | Friday 03 April 2026 06:30:26 +0000 (0:00:00.595) 0:00:37.048 ********** 2026-04-03 06:30:36.284606 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:30:36.284618 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:30:36.284629 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:30:36.284640 | orchestrator | 2026-04-03 06:30:36.284651 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-03 06:30:36.284662 | orchestrator | Friday 03 April 2026 06:30:27 +0000 (0:00:00.914) 0:00:37.963 ********** 2026-04-03 06:30:36.284674 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284708 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284730 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284742 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284761 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284773 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284784 | orchestrator | 2026-04-03 06:30:36.284795 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-03 06:30:36.284806 | orchestrator | Friday 03 April 2026 06:30:29 +0000 (0:00:01.675) 0:00:39.638 ********** 2026-04-03 06:30:36.284817 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284828 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284839 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284850 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284860 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 06:30:36.284871 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 06:30:36.284882 | orchestrator | 2026-04-03 06:30:36.284893 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-03 06:30:36.284904 | orchestrator | Friday 03 April 2026 06:30:30 +0000 (0:00:01.195) 0:00:40.833 ********** 2026-04-03 06:30:36.284916 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-03 06:30:36.284927 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-03 06:30:36.284938 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-03 06:30:36.284949 | orchestrator | 2026-04-03 06:30:36.284960 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-03 06:30:36.284971 | orchestrator | Friday 03 April 2026 06:30:31 +0000 (0:00:00.665) 0:00:41.499 ********** 2026-04-03 06:30:36.284982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:36.284993 | orchestrator | 2026-04-03 06:30:36.285003 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-03 06:30:36.285014 | orchestrator | Friday 03 April 2026 06:30:31 +0000 (0:00:00.130) 0:00:41.630 ********** 2026-04-03 06:30:36.285025 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:36.285036 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:30:36.285047 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:30:36.285057 | orchestrator | 2026-04-03 06:30:36.285069 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 06:30:36.285080 | orchestrator | Friday 03 April 2026 06:30:31 +0000 (0:00:00.506) 0:00:42.137 ********** 2026-04-03 06:30:36.285091 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:30:36.285108 | orchestrator | 2026-04-03 06:30:36.285119 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-03 06:30:36.285130 | orchestrator | Friday 03 April 2026 06:30:32 +0000 (0:00:00.600) 0:00:42.738 ********** 2026-04-03 06:30:36.285150 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:37.158897 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:37.159000 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:37.159017 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159031 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159064 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159094 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159114 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159126 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159138 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159150 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159168 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:37.159180 | orchestrator | 2026-04-03 06:30:37.159194 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-03 06:30:37.159206 | orchestrator | Friday 03 April 2026 06:30:36 +0000 (0:00:03.967) 0:00:46.705 ********** 2026-04-03 06:30:37.159226 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:37.812768 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.812903 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.812926 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.812940 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:37.812955 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:37.812994 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813095 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:30:37.813114 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:37.813133 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813166 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813196 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:37.813221 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:30:37.813253 | orchestrator | 2026-04-03 06:30:37.813278 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-03 06:30:37.813325 | orchestrator | Friday 03 April 2026 06:30:37 +0000 (0:00:00.870) 0:00:47.576 ********** 2026-04-03 06:30:37.813368 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:42.305587 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305693 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305710 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305752 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:42.305767 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:42.305780 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305806 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305836 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305849 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:30:42.305861 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:42.305881 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305893 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305905 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:42.305916 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:30:42.305929 | orchestrator | 2026-04-03 06:30:42.305941 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-03 06:30:42.305954 | orchestrator | Friday 03 April 2026 06:30:38 +0000 (0:00:00.865) 0:00:48.441 ********** 2026-04-03 06:30:42.305980 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:48.929686 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:48.929821 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:48.929844 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929859 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929881 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929906 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929916 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929932 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929941 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929949 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929957 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:48.929966 | orchestrator | 2026-04-03 06:30:48.929981 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-03 06:30:48.929996 | orchestrator | Friday 03 April 2026 06:30:42 +0000 (0:00:04.490) 0:00:52.932 ********** 2026-04-03 06:30:48.930082 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:53.221808 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:53.221904 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:30:53.221919 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.221932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:53.221959 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.221986 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:53.222068 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.222082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:53.222095 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.222105 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.222116 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:30:53.222127 | orchestrator | 2026-04-03 06:30:53.222143 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-03 06:30:53.222155 | orchestrator | Friday 03 April 2026 06:30:49 +0000 (0:00:06.412) 0:00:59.344 ********** 2026-04-03 06:30:53.222166 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-03 06:30:53.222191 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-03 06:30:53.222201 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-03 06:30:53.222211 | orchestrator | 2026-04-03 06:30:53.222221 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-03 06:30:53.222231 | orchestrator | Friday 03 April 2026 06:30:52 +0000 (0:00:03.548) 0:01:02.893 ********** 2026-04-03 06:30:53.222250 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:56.438005 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438112 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438120 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438126 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:30:56.438144 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:56.438162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438167 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438182 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438188 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:30:56.438192 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-03 06:30:56.438197 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438201 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438212 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 06:30:56.438217 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:30:56.438222 | orchestrator | 2026-04-03 06:30:56.438227 | orchestrator | TASK [manila : Check manila containers] **************************************** 2026-04-03 06:30:56.438233 | orchestrator | Friday 03 April 2026 06:30:53 +0000 (0:00:00.742) 0:01:03.635 ********** 2026-04-03 06:30:56.438242 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:31:35.209774 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:31:35.209905 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-03 06:31:35.209924 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.209977 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.209990 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210080 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210096 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210108 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210120 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210147 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210159 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 06:31:35.210171 | orchestrator | 2026-04-03 06:31:35.210185 | orchestrator | TASK [manila : Creating Manila database] *************************************** 2026-04-03 06:31:35.210198 | orchestrator | Friday 03 April 2026 06:30:56 +0000 (0:00:03.220) 0:01:06.856 ********** 2026-04-03 06:31:35.210210 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:31:35.210222 | orchestrator | 2026-04-03 06:31:35.210234 | orchestrator | TASK [manila : Creating Manila database user and setting permissions] ********** 2026-04-03 06:31:35.210245 | orchestrator | Friday 03 April 2026 06:30:58 +0000 (0:00:02.057) 0:01:08.913 ********** 2026-04-03 06:31:35.210255 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:31:35.210267 | orchestrator | 2026-04-03 06:31:35.210278 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-03 06:31:35.210294 | orchestrator | Friday 03 April 2026 06:31:00 +0000 (0:00:02.190) 0:01:11.103 ********** 2026-04-03 06:31:35.210343 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:31:35.210362 | orchestrator | 2026-04-03 06:31:35.210380 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 06:31:35.210400 | orchestrator | Friday 03 April 2026 06:31:34 +0000 (0:00:34.189) 0:01:45.293 ********** 2026-04-03 06:31:35.210421 | orchestrator | 2026-04-03 06:31:35.210451 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 06:32:18.277849 | orchestrator | Friday 03 April 2026 06:31:35 +0000 (0:00:00.075) 0:01:45.368 ********** 2026-04-03 06:32:18.277965 | orchestrator | 2026-04-03 06:32:18.277982 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 06:32:18.277994 | orchestrator | Friday 03 April 2026 06:31:35 +0000 (0:00:00.074) 0:01:45.443 ********** 2026-04-03 06:32:18.278005 | orchestrator | 2026-04-03 06:32:18.278071 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-03 06:32:18.278084 | orchestrator | Friday 03 April 2026 06:31:35 +0000 (0:00:00.073) 0:01:45.516 ********** 2026-04-03 06:32:18.278095 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:32:18.278107 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:32:18.278118 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:32:18.278129 | orchestrator | 2026-04-03 06:32:18.278140 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-03 06:32:18.278151 | orchestrator | Friday 03 April 2026 06:31:49 +0000 (0:00:14.668) 0:02:00.185 ********** 2026-04-03 06:32:18.278162 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:32:18.278201 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:32:18.278213 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:32:18.278223 | orchestrator | 2026-04-03 06:32:18.278235 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-03 06:32:18.278246 | orchestrator | Friday 03 April 2026 06:31:55 +0000 (0:00:05.691) 0:02:05.877 ********** 2026-04-03 06:32:18.278257 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:32:18.278268 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:32:18.278278 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:32:18.278289 | orchestrator | 2026-04-03 06:32:18.278300 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-03 06:32:18.278376 | orchestrator | Friday 03 April 2026 06:32:00 +0000 (0:00:05.004) 0:02:10.881 ********** 2026-04-03 06:32:18.278388 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:32:18.278401 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:32:18.278414 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:32:18.278426 | orchestrator | 2026-04-03 06:32:18.278439 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:32:18.278454 | orchestrator | testbed-node-0 : ok=28  changed=20  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:32:18.278468 | orchestrator | testbed-node-1 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:32:18.278481 | orchestrator | testbed-node-2 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:32:18.278493 | orchestrator | 2026-04-03 06:32:18.278505 | orchestrator | 2026-04-03 06:32:18.278517 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:32:18.278529 | orchestrator | Friday 03 April 2026 06:32:17 +0000 (0:00:17.284) 0:02:28.165 ********** 2026-04-03 06:32:18.278542 | orchestrator | =============================================================================== 2026-04-03 06:32:18.278554 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 34.19s 2026-04-03 06:32:18.278567 | orchestrator | manila : Restart manila-share container -------------------------------- 17.28s 2026-04-03 06:32:18.278593 | orchestrator | manila : Restart manila-api container ---------------------------------- 14.67s 2026-04-03 06:32:18.278608 | orchestrator | service-ks-register : manila | Creating endpoints ---------------------- 12.27s 2026-04-03 06:32:18.278619 | orchestrator | manila : Copying over manila.conf --------------------------------------- 6.41s 2026-04-03 06:32:18.278632 | orchestrator | service-ks-register : manila | Creating services ------------------------ 6.16s 2026-04-03 06:32:18.278644 | orchestrator | manila : Restart manila-data container ---------------------------------- 5.69s 2026-04-03 06:32:18.278656 | orchestrator | manila : Restart manila-scheduler container ----------------------------- 5.00s 2026-04-03 06:32:18.278669 | orchestrator | manila : Copying over config.json files for services -------------------- 4.49s 2026-04-03 06:32:18.278681 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 3.97s 2026-04-03 06:32:18.278694 | orchestrator | service-ks-register : manila | Creating users --------------------------- 3.75s 2026-04-03 06:32:18.278706 | orchestrator | service-ks-register : manila | Granting user roles ---------------------- 3.75s 2026-04-03 06:32:18.278718 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 3.55s 2026-04-03 06:32:18.278729 | orchestrator | manila : Check manila containers ---------------------------------------- 3.22s 2026-04-03 06:32:18.278740 | orchestrator | service-ks-register : manila | Creating projects ------------------------ 3.12s 2026-04-03 06:32:18.278750 | orchestrator | service-ks-register : manila | Creating roles --------------------------- 3.08s 2026-04-03 06:32:18.278761 | orchestrator | manila : Ensuring config directories exist ------------------------------ 2.19s 2026-04-03 06:32:18.278772 | orchestrator | manila : Creating Manila database user and setting permissions ---------- 2.19s 2026-04-03 06:32:18.278791 | orchestrator | manila : Creating Manila database --------------------------------------- 2.06s 2026-04-03 06:32:18.278802 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 1.68s 2026-04-03 06:32:18.596993 | orchestrator | + sh -c /opt/configuration/scripts/deploy/400-monitoring.sh 2026-04-03 06:32:30.793546 | orchestrator | 2026-04-03 06:32:30 | INFO  | Task cd43c03a-4349-4e43-9615-122b4d2d9ae1 (netdata) was prepared for execution. 2026-04-03 06:32:30.793650 | orchestrator | 2026-04-03 06:32:30 | INFO  | It takes a moment until task cd43c03a-4349-4e43-9615-122b4d2d9ae1 (netdata) has been started and output is visible here. 2026-04-03 06:34:03.235959 | orchestrator | 2026-04-03 06:34:03.236074 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:34:03.236091 | orchestrator | 2026-04-03 06:34:03.236104 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:34:03.236116 | orchestrator | Friday 03 April 2026 06:32:35 +0000 (0:00:00.235) 0:00:00.235 ********** 2026-04-03 06:34:03.236128 | orchestrator | changed: [testbed-manager] => (item=enable_netdata_True) 2026-04-03 06:34:03.236139 | orchestrator | changed: [testbed-node-0] => (item=enable_netdata_True) 2026-04-03 06:34:03.236150 | orchestrator | changed: [testbed-node-1] => (item=enable_netdata_True) 2026-04-03 06:34:03.236161 | orchestrator | changed: [testbed-node-2] => (item=enable_netdata_True) 2026-04-03 06:34:03.236172 | orchestrator | changed: [testbed-node-3] => (item=enable_netdata_True) 2026-04-03 06:34:03.236184 | orchestrator | changed: [testbed-node-4] => (item=enable_netdata_True) 2026-04-03 06:34:03.236195 | orchestrator | changed: [testbed-node-5] => (item=enable_netdata_True) 2026-04-03 06:34:03.236206 | orchestrator | 2026-04-03 06:34:03.236216 | orchestrator | PLAY [Apply role netdata] ****************************************************** 2026-04-03 06:34:03.236227 | orchestrator | 2026-04-03 06:34:03.236238 | orchestrator | TASK [osism.services.netdata : Include distribution specific install tasks] **** 2026-04-03 06:34:03.236249 | orchestrator | Friday 03 April 2026 06:32:36 +0000 (0:00:00.914) 0:00:01.150 ********** 2026-04-03 06:34:03.236262 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:34:03.236276 | orchestrator | 2026-04-03 06:34:03.236287 | orchestrator | TASK [osism.services.netdata : Remove old architecture-dependent repository] *** 2026-04-03 06:34:03.236298 | orchestrator | Friday 03 April 2026 06:32:37 +0000 (0:00:01.344) 0:00:02.494 ********** 2026-04-03 06:34:03.236310 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:03.236322 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:03.236435 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:03.236449 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:03.236461 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:03.236472 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:03.236482 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:03.236494 | orchestrator | 2026-04-03 06:34:03.236507 | orchestrator | TASK [osism.services.netdata : Install apt-transport-https package] ************ 2026-04-03 06:34:03.236520 | orchestrator | Friday 03 April 2026 06:32:39 +0000 (0:00:01.914) 0:00:04.409 ********** 2026-04-03 06:34:03.236533 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:03.236545 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:03.236558 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:03.236571 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:03.236585 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:03.236597 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:03.236609 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:03.236621 | orchestrator | 2026-04-03 06:34:03.236634 | orchestrator | TASK [osism.services.netdata : Add repository gpg key] ************************* 2026-04-03 06:34:03.236647 | orchestrator | Friday 03 April 2026 06:32:41 +0000 (0:00:02.090) 0:00:06.500 ********** 2026-04-03 06:34:03.236659 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:34:03.236697 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.236710 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:34:03.236723 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:34:03.236735 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:34:03.236762 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:34:03.236775 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:34:03.236787 | orchestrator | 2026-04-03 06:34:03.236800 | orchestrator | TASK [osism.services.netdata : Add repository] ********************************* 2026-04-03 06:34:03.236812 | orchestrator | Friday 03 April 2026 06:32:43 +0000 (0:00:01.533) 0:00:08.033 ********** 2026-04-03 06:34:03.236825 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.236837 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:34:03.236851 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:34:03.236862 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:34:03.236873 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:34:03.236884 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:34:03.236894 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:34:03.236905 | orchestrator | 2026-04-03 06:34:03.236916 | orchestrator | TASK [osism.services.netdata : Install package netdata] ************************ 2026-04-03 06:34:03.236927 | orchestrator | Friday 03 April 2026 06:32:57 +0000 (0:00:14.508) 0:00:22.541 ********** 2026-04-03 06:34:03.236938 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:34:03.236949 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:34:03.236960 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:34:03.236971 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.236981 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:34:03.236992 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:34:03.237011 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:34:03.237029 | orchestrator | 2026-04-03 06:34:03.237047 | orchestrator | TASK [osism.services.netdata : Include config tasks] *************************** 2026-04-03 06:34:03.237066 | orchestrator | Friday 03 April 2026 06:33:38 +0000 (0:00:40.521) 0:01:03.063 ********** 2026-04-03 06:34:03.237084 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/config.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:34:03.237105 | orchestrator | 2026-04-03 06:34:03.237123 | orchestrator | TASK [osism.services.netdata : Copy configuration files] *********************** 2026-04-03 06:34:03.237141 | orchestrator | Friday 03 April 2026 06:33:39 +0000 (0:00:01.609) 0:01:04.672 ********** 2026-04-03 06:34:03.237158 | orchestrator | changed: [testbed-manager] => (item=netdata.conf) 2026-04-03 06:34:03.237177 | orchestrator | changed: [testbed-node-0] => (item=netdata.conf) 2026-04-03 06:34:03.237196 | orchestrator | changed: [testbed-node-1] => (item=netdata.conf) 2026-04-03 06:34:03.237214 | orchestrator | changed: [testbed-node-2] => (item=netdata.conf) 2026-04-03 06:34:03.237256 | orchestrator | changed: [testbed-node-3] => (item=netdata.conf) 2026-04-03 06:34:03.237276 | orchestrator | changed: [testbed-node-4] => (item=netdata.conf) 2026-04-03 06:34:03.237295 | orchestrator | changed: [testbed-node-5] => (item=netdata.conf) 2026-04-03 06:34:03.237315 | orchestrator | changed: [testbed-manager] => (item=stream.conf) 2026-04-03 06:34:03.237357 | orchestrator | changed: [testbed-node-0] => (item=stream.conf) 2026-04-03 06:34:03.237370 | orchestrator | changed: [testbed-node-2] => (item=stream.conf) 2026-04-03 06:34:03.237381 | orchestrator | changed: [testbed-node-1] => (item=stream.conf) 2026-04-03 06:34:03.237392 | orchestrator | changed: [testbed-node-3] => (item=stream.conf) 2026-04-03 06:34:03.237402 | orchestrator | changed: [testbed-node-4] => (item=stream.conf) 2026-04-03 06:34:03.237413 | orchestrator | changed: [testbed-node-5] => (item=stream.conf) 2026-04-03 06:34:03.237424 | orchestrator | 2026-04-03 06:34:03.237436 | orchestrator | TASK [osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status] *** 2026-04-03 06:34:03.237447 | orchestrator | Friday 03 April 2026 06:33:42 +0000 (0:00:03.247) 0:01:07.920 ********** 2026-04-03 06:34:03.237472 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:03.237483 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:03.237494 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:03.237504 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:03.237515 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:03.237526 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:03.237536 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:03.237547 | orchestrator | 2026-04-03 06:34:03.237558 | orchestrator | TASK [osism.services.netdata : Opt out from anonymous statistics] ************** 2026-04-03 06:34:03.237568 | orchestrator | Friday 03 April 2026 06:33:44 +0000 (0:00:01.319) 0:01:09.239 ********** 2026-04-03 06:34:03.237579 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.237590 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:34:03.237601 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:34:03.237612 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:34:03.237623 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:34:03.237634 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:34:03.237644 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:34:03.237655 | orchestrator | 2026-04-03 06:34:03.237666 | orchestrator | TASK [osism.services.netdata : Add netdata user to docker group] *************** 2026-04-03 06:34:03.237677 | orchestrator | Friday 03 April 2026 06:33:45 +0000 (0:00:01.286) 0:01:10.526 ********** 2026-04-03 06:34:03.237687 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:03.237698 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:03.237709 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:03.237720 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:03.237730 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:03.237741 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:03.237752 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:03.237762 | orchestrator | 2026-04-03 06:34:03.237773 | orchestrator | TASK [osism.services.netdata : Manage service netdata] ************************* 2026-04-03 06:34:03.237784 | orchestrator | Friday 03 April 2026 06:33:46 +0000 (0:00:01.222) 0:01:11.748 ********** 2026-04-03 06:34:03.237795 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:03.237806 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:03.237816 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:03.237827 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:03.237837 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:03.237848 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:03.237858 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:03.237869 | orchestrator | 2026-04-03 06:34:03.237880 | orchestrator | TASK [osism.services.netdata : Include host type specific tasks] *************** 2026-04-03 06:34:03.237891 | orchestrator | Friday 03 April 2026 06:33:48 +0000 (0:00:01.680) 0:01:13.429 ********** 2026-04-03 06:34:03.237909 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/server.yml for testbed-manager 2026-04-03 06:34:03.237923 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/client.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:34:03.237935 | orchestrator | 2026-04-03 06:34:03.237945 | orchestrator | TASK [osism.services.netdata : Set sysctl vm.max_map_count parameter] ********** 2026-04-03 06:34:03.237956 | orchestrator | Friday 03 April 2026 06:33:49 +0000 (0:00:01.368) 0:01:14.798 ********** 2026-04-03 06:34:03.237967 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.237978 | orchestrator | 2026-04-03 06:34:03.237988 | orchestrator | RUNNING HANDLER [osism.services.netdata : Restart service netdata] ************* 2026-04-03 06:34:03.237999 | orchestrator | Friday 03 April 2026 06:33:51 +0000 (0:00:02.097) 0:01:16.895 ********** 2026-04-03 06:34:03.238010 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:34:03.238079 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:34:03.238091 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:34:03.238102 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:34:03.238113 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:34:03.238131 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:34:03.238142 | orchestrator | changed: [testbed-manager] 2026-04-03 06:34:03.238153 | orchestrator | 2026-04-03 06:34:03.238164 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:34:03.238175 | orchestrator | testbed-manager : ok=16  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.238187 | orchestrator | testbed-node-0 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.238198 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.238210 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.238234 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.674221 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.674321 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:34:03.674396 | orchestrator | 2026-04-03 06:34:03.674410 | orchestrator | 2026-04-03 06:34:03.674423 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:34:03.674435 | orchestrator | Friday 03 April 2026 06:34:03 +0000 (0:00:11.308) 0:01:28.203 ********** 2026-04-03 06:34:03.674447 | orchestrator | =============================================================================== 2026-04-03 06:34:03.674458 | orchestrator | osism.services.netdata : Install package netdata ----------------------- 40.52s 2026-04-03 06:34:03.674469 | orchestrator | osism.services.netdata : Add repository -------------------------------- 14.51s 2026-04-03 06:34:03.674480 | orchestrator | osism.services.netdata : Restart service netdata ----------------------- 11.31s 2026-04-03 06:34:03.674491 | orchestrator | osism.services.netdata : Copy configuration files ----------------------- 3.25s 2026-04-03 06:34:03.674502 | orchestrator | osism.services.netdata : Set sysctl vm.max_map_count parameter ---------- 2.10s 2026-04-03 06:34:03.674513 | orchestrator | osism.services.netdata : Install apt-transport-https package ------------ 2.09s 2026-04-03 06:34:03.674524 | orchestrator | osism.services.netdata : Remove old architecture-dependent repository --- 1.91s 2026-04-03 06:34:03.674535 | orchestrator | osism.services.netdata : Manage service netdata ------------------------- 1.68s 2026-04-03 06:34:03.674546 | orchestrator | osism.services.netdata : Include config tasks --------------------------- 1.61s 2026-04-03 06:34:03.674557 | orchestrator | osism.services.netdata : Add repository gpg key ------------------------- 1.53s 2026-04-03 06:34:03.674568 | orchestrator | osism.services.netdata : Include host type specific tasks --------------- 1.37s 2026-04-03 06:34:03.674579 | orchestrator | osism.services.netdata : Include distribution specific install tasks ---- 1.34s 2026-04-03 06:34:03.674590 | orchestrator | osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status --- 1.32s 2026-04-03 06:34:03.674602 | orchestrator | osism.services.netdata : Opt out from anonymous statistics -------------- 1.29s 2026-04-03 06:34:03.674613 | orchestrator | osism.services.netdata : Add netdata user to docker group --------------- 1.22s 2026-04-03 06:34:03.674624 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.91s 2026-04-03 06:34:06.023796 | orchestrator | 2026-04-03 06:34:06 | INFO  | Task bb683004-d926-4683-8d10-6d4b7086562a (prometheus) was prepared for execution. 2026-04-03 06:34:06.023874 | orchestrator | 2026-04-03 06:34:06 | INFO  | It takes a moment until task bb683004-d926-4683-8d10-6d4b7086562a (prometheus) has been started and output is visible here. 2026-04-03 06:34:15.520274 | orchestrator | 2026-04-03 06:34:15.520486 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:34:15.520507 | orchestrator | 2026-04-03 06:34:15.520534 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:34:15.520546 | orchestrator | Friday 03 April 2026 06:34:10 +0000 (0:00:00.289) 0:00:00.289 ********** 2026-04-03 06:34:15.520557 | orchestrator | ok: [testbed-manager] 2026-04-03 06:34:15.520569 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:34:15.520580 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:34:15.520590 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:34:15.520603 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:34:15.520614 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:34:15.520624 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:34:15.520635 | orchestrator | 2026-04-03 06:34:15.520646 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:34:15.520657 | orchestrator | Friday 03 April 2026 06:34:11 +0000 (0:00:00.881) 0:00:01.170 ********** 2026-04-03 06:34:15.520669 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520680 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520691 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520702 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520712 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520723 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520734 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-03 06:34:15.520745 | orchestrator | 2026-04-03 06:34:15.520756 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-03 06:34:15.520766 | orchestrator | 2026-04-03 06:34:15.520777 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-03 06:34:15.520788 | orchestrator | Friday 03 April 2026 06:34:12 +0000 (0:00:00.906) 0:00:02.076 ********** 2026-04-03 06:34:15.520799 | orchestrator | included: /ansible/roles/prometheus/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:34:15.520812 | orchestrator | 2026-04-03 06:34:15.520826 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-03 06:34:15.520839 | orchestrator | Friday 03 April 2026 06:34:13 +0000 (0:00:01.337) 0:00:03.414 ********** 2026-04-03 06:34:15.520855 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 06:34:15.520873 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.520887 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.520925 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.520974 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:15.520989 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.521003 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:15.521016 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.521029 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:15.521044 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:15.521064 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:15.521085 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399552 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399658 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399674 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:16.399687 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399703 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 06:34:16.399742 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399772 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399791 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399805 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399816 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399828 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399839 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399859 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:16.399871 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:16.399896 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:21.061102 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:21.061216 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:21.061234 | orchestrator | 2026-04-03 06:34:21.061249 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-03 06:34:21.061262 | orchestrator | Friday 03 April 2026 06:34:16 +0000 (0:00:02.820) 0:00:06.235 ********** 2026-04-03 06:34:21.061275 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 06:34:21.061288 | orchestrator | 2026-04-03 06:34:21.061299 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-03 06:34:21.061311 | orchestrator | Friday 03 April 2026 06:34:18 +0000 (0:00:01.620) 0:00:07.855 ********** 2026-04-03 06:34:21.061323 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 06:34:21.061412 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061425 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061451 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061484 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061496 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061508 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061520 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:21.061539 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:21.061551 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:21.061563 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:21.061580 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:21.061600 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.191818 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.191906 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.191941 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:23.191950 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:23.191958 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.191967 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:23.191988 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.192015 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 06:34:23.192024 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.192037 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.192045 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.192052 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:23.192059 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:23.192071 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:23.192086 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:24.566407 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:24.566535 | orchestrator | 2026-04-03 06:34:24.566554 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-03 06:34:24.566569 | orchestrator | Friday 03 April 2026 06:34:23 +0000 (0:00:05.165) 0:00:13.020 ********** 2026-04-03 06:34:24.566586 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-03 06:34:24.566600 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.566613 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.566742 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-03 06:34:24.566787 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.566810 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:34:24.566823 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.566835 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.566847 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.566859 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.566871 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.566886 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:34:24.566905 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.566919 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.566941 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.893003 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893102 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.893118 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:34:24.893133 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.893145 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893157 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893168 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:34:24.893196 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.893208 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.893257 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.893270 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893282 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:24.893293 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:34:24.893305 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.893316 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893390 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:24.893405 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:34:24.893417 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:24.893444 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:26.154331 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:26.154530 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:34:26.154562 | orchestrator | 2026-04-03 06:34:26.154577 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-03 06:34:26.154603 | orchestrator | Friday 03 April 2026 06:34:24 +0000 (0:00:01.711) 0:00:14.731 ********** 2026-04-03 06:34:26.154617 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-03 06:34:26.154631 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:26.154644 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:26.154675 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-03 06:34:26.154730 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:26.154748 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:26.154770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:26.154791 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:26.154806 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:26.154817 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:26.154836 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:34:26.154854 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:26.154865 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:26.154886 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:27.264090 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264192 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:27.264209 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:34:27.264223 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:34:27.264235 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:27.264248 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:27.264295 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:27.264320 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:27.264448 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264465 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264477 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:34:27.264489 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 06:34:27.264501 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:34:27.264512 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:27.264533 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264552 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:27.264563 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:34:27.264575 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 06:34:27.264593 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 06:34:30.883329 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 06:34:30.883496 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:34:30.883513 | orchestrator | 2026-04-03 06:34:30.883526 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-03 06:34:30.883538 | orchestrator | Friday 03 April 2026 06:34:27 +0000 (0:00:02.356) 0:00:17.088 ********** 2026-04-03 06:34:30.883552 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 06:34:30.883589 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883602 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883628 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883640 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883669 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883681 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883693 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:30.883704 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:34:30.883723 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:30.883736 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:30.883752 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:30.883765 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:30.883785 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996327 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996492 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996533 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996546 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996575 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 06:34:32.996591 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996621 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996634 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996646 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996666 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996679 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:34:32.996696 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996708 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996719 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:32.996754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:34:37.023788 | orchestrator | 2026-04-03 06:34:37.023937 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-03 06:34:37.023964 | orchestrator | Friday 03 April 2026 06:34:32 +0000 (0:00:05.735) 0:00:22.824 ********** 2026-04-03 06:34:37.024011 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 06:34:37.024026 | orchestrator | 2026-04-03 06:34:37.024038 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-03 06:34:37.024049 | orchestrator | Friday 03 April 2026 06:34:33 +0000 (0:00:00.872) 0:00:23.697 ********** 2026-04-03 06:34:37.024064 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024080 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024092 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:37.024125 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024143 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024160 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024212 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024230 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024248 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1099926, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8833067, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024264 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024288 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024308 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024326 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:37.024398 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.883917 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884047 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884072 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884113 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884134 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884153 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884198 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884245 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1100086, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0185163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:38.884268 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884287 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884310 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884322 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884334 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884415 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:38.884438 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722472 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722555 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722579 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722588 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722614 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722623 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722630 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722651 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722659 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722671 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722678 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1099924, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:40.722697 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722705 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722713 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:40.722726 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615401 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615508 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615524 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615547 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615557 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615566 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615575 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615597 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615610 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615619 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615631 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615639 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615648 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:42.615656 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1100013, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0125163, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:42.615669 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941845 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941928 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941940 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941949 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941958 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941967 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.941975 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942001 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942053 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1099918, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8767636, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:43.942064 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942073 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942081 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942090 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942099 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:43.942116 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380798 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380888 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380904 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380916 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380928 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380941 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.380983 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381012 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381025 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381036 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381048 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381059 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381071 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1099930, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8845136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:45.381094 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:45.381113 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406138 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406223 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406239 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406252 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406263 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406307 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406320 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406391 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406405 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406417 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406428 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406449 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:34:46.406463 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406475 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:34:46.406492 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:46.406511 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714440 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714656 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714677 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:34:53.714692 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714705 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714743 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714770 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714783 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714812 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714825 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1100011, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.9195144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:53.714836 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714847 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:34:53.714869 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714881 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:34:53.714893 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-03 06:34:53.714904 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:34:53.714920 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1099931, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8865137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:34:53.714943 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1099925, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8815136, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472231 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1100084, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0147896, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472325 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099914, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8749769, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472337 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1100099, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472416 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1100083, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.014385, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472429 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1099923, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8790298, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472463 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1099916, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.876098, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472477 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1099934, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8895137, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472505 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1099932, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8875139, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472518 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1100093, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191204.0243444, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-03 06:35:02.472532 | orchestrator | 2026-04-03 06:35:02.472545 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-03 06:35:02.472564 | orchestrator | Friday 03 April 2026 06:34:59 +0000 (0:00:26.048) 0:00:49.745 ********** 2026-04-03 06:35:02.472572 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 06:35:02.472580 | orchestrator | 2026-04-03 06:35:02.472586 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-03 06:35:02.472593 | orchestrator | Friday 03 April 2026 06:35:00 +0000 (0:00:00.741) 0:00:50.487 ********** 2026-04-03 06:35:02.472600 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472607 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472615 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472624 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472640 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472654 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472664 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472675 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472686 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472696 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472707 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472718 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472730 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472741 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472752 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472760 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472766 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472773 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472779 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472786 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472793 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472799 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472806 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472813 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472819 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472826 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472838 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472845 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472852 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472859 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472865 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:02.472872 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472878 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-03 06:35:02.472885 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 06:35:02.472892 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-03 06:35:02.472899 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:35:02.472905 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 06:35:02.472912 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 06:35:02.472918 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 06:35:02.472925 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 06:35:02.472932 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 06:35:02.472945 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 06:35:02.472952 | orchestrator | 2026-04-03 06:35:02.472965 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-03 06:35:32.299972 | orchestrator | Friday 03 April 2026 06:35:02 +0000 (0:00:01.818) 0:00:52.305 ********** 2026-04-03 06:35:32.300111 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300137 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.300158 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300176 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.300195 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300277 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.300302 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300323 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.300343 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300391 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.300411 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 06:35:32.300431 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.300450 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-03 06:35:32.300470 | orchestrator | 2026-04-03 06:35:32.300490 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-03 06:35:32.300509 | orchestrator | Friday 03 April 2026 06:35:18 +0000 (0:00:16.029) 0:01:08.334 ********** 2026-04-03 06:35:32.300528 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300547 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300566 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.300585 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.300603 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300621 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.300640 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300658 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.300678 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300698 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.300716 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 06:35:32.300735 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.300754 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-03 06:35:32.300773 | orchestrator | 2026-04-03 06:35:32.300793 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-03 06:35:32.300812 | orchestrator | Friday 03 April 2026 06:35:21 +0000 (0:00:02.804) 0:01:11.139 ********** 2026-04-03 06:35:32.300831 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.300852 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.300872 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.300891 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.300910 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.300962 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.300982 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.301000 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.301037 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-03 06:35:32.301057 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.301076 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.301095 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 06:35:32.301113 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.301131 | orchestrator | 2026-04-03 06:35:32.301146 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-03 06:35:32.301158 | orchestrator | Friday 03 April 2026 06:35:23 +0000 (0:00:01.779) 0:01:12.918 ********** 2026-04-03 06:35:32.301169 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 06:35:32.301180 | orchestrator | 2026-04-03 06:35:32.301192 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-03 06:35:32.301203 | orchestrator | Friday 03 April 2026 06:35:23 +0000 (0:00:00.718) 0:01:13.636 ********** 2026-04-03 06:35:32.301214 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:35:32.301225 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.301236 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.301247 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.301281 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.301293 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.301304 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.301315 | orchestrator | 2026-04-03 06:35:32.301326 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-03 06:35:32.301337 | orchestrator | Friday 03 April 2026 06:35:24 +0000 (0:00:00.727) 0:01:14.364 ********** 2026-04-03 06:35:32.301381 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:35:32.301396 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.301407 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.301418 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.301429 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:35:32.301439 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:35:32.301450 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:35:32.301461 | orchestrator | 2026-04-03 06:35:32.301472 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-03 06:35:32.301483 | orchestrator | Friday 03 April 2026 06:35:26 +0000 (0:00:02.191) 0:01:16.556 ********** 2026-04-03 06:35:32.301494 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301505 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301516 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:35:32.301527 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301538 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301548 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.301559 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.301570 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.301581 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301592 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.301603 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301626 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.301637 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 06:35:32.301648 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.301659 | orchestrator | 2026-04-03 06:35:32.301670 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-03 06:35:32.301681 | orchestrator | Friday 03 April 2026 06:35:28 +0000 (0:00:01.472) 0:01:18.029 ********** 2026-04-03 06:35:32.301692 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301703 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301714 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.301725 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.301736 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301747 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.301757 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301768 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.301779 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301790 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.301801 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-03 06:35:32.301811 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 06:35:32.301822 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.301833 | orchestrator | 2026-04-03 06:35:32.301844 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-03 06:35:32.301855 | orchestrator | Friday 03 April 2026 06:35:29 +0000 (0:00:01.378) 0:01:19.407 ********** 2026-04-03 06:35:32.301866 | orchestrator | [WARNING]: Skipped 2026-04-03 06:35:32.301884 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-03 06:35:32.301895 | orchestrator | due to this access issue: 2026-04-03 06:35:32.301906 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-03 06:35:32.301917 | orchestrator | not a directory 2026-04-03 06:35:32.301928 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 06:35:32.301939 | orchestrator | 2026-04-03 06:35:32.301949 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-03 06:35:32.301960 | orchestrator | Friday 03 April 2026 06:35:30 +0000 (0:00:01.132) 0:01:20.539 ********** 2026-04-03 06:35:32.301971 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:35:32.301982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.301993 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.302004 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:32.302077 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:32.302092 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:32.302103 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:32.302114 | orchestrator | 2026-04-03 06:35:32.302125 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-03 06:35:32.302136 | orchestrator | Friday 03 April 2026 06:35:31 +0000 (0:00:00.947) 0:01:21.487 ********** 2026-04-03 06:35:32.302148 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:35:32.302159 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:35:32.302170 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:35:32.302189 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:35:34.975632 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:35:34.975754 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:35:34.975769 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:35:34.975779 | orchestrator | 2026-04-03 06:35:34.975789 | orchestrator | TASK [prometheus : Check prometheus containers] ******************************** 2026-04-03 06:35:34.975800 | orchestrator | Friday 03 April 2026 06:35:32 +0000 (0:00:00.917) 0:01:22.405 ********** 2026-04-03 06:35:34.975812 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975826 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-03 06:35:34.975837 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975846 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975869 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975879 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975907 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975931 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:34.975942 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 06:35:34.975952 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:34.975961 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:34.975972 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:34.975987 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:34.975998 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:34.976029 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445536 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445646 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445663 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445677 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445689 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445718 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445769 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-03 06:35:38.445785 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445798 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445809 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 06:35:38.445821 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445832 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445849 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445869 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 06:35:38.445881 | orchestrator | 2026-04-03 06:35:38.445894 | orchestrator | TASK [prometheus : Creating prometheus database user and setting permissions] *** 2026-04-03 06:35:38.445907 | orchestrator | Friday 03 April 2026 06:35:36 +0000 (0:00:03.922) 0:01:26.327 ********** 2026-04-03 06:35:38.445918 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-03 06:35:38.445936 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:37:22.074254 | orchestrator | 2026-04-03 06:37:22.074466 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074495 | orchestrator | Friday 03 April 2026 06:35:37 +0000 (0:00:01.239) 0:01:27.566 ********** 2026-04-03 06:37:22.074513 | orchestrator | 2026-04-03 06:37:22.074531 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074548 | orchestrator | Friday 03 April 2026 06:35:37 +0000 (0:00:00.264) 0:01:27.831 ********** 2026-04-03 06:37:22.074566 | orchestrator | 2026-04-03 06:37:22.074583 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074599 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.072) 0:01:27.903 ********** 2026-04-03 06:37:22.074615 | orchestrator | 2026-04-03 06:37:22.074633 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074648 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.072) 0:01:27.976 ********** 2026-04-03 06:37:22.074664 | orchestrator | 2026-04-03 06:37:22.074681 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074698 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.069) 0:01:28.045 ********** 2026-04-03 06:37:22.074716 | orchestrator | 2026-04-03 06:37:22.074733 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074750 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.067) 0:01:28.113 ********** 2026-04-03 06:37:22.074767 | orchestrator | 2026-04-03 06:37:22.074783 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 06:37:22.074800 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.066) 0:01:28.179 ********** 2026-04-03 06:37:22.074818 | orchestrator | 2026-04-03 06:37:22.074835 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-03 06:37:22.074852 | orchestrator | Friday 03 April 2026 06:35:38 +0000 (0:00:00.101) 0:01:28.281 ********** 2026-04-03 06:37:22.074869 | orchestrator | changed: [testbed-manager] 2026-04-03 06:37:22.074887 | orchestrator | 2026-04-03 06:37:22.074904 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-03 06:37:22.074921 | orchestrator | Friday 03 April 2026 06:36:01 +0000 (0:00:23.190) 0:01:51.471 ********** 2026-04-03 06:37:22.074939 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:37:22.074956 | orchestrator | changed: [testbed-manager] 2026-04-03 06:37:22.074972 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:37:22.074990 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:37:22.075008 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:37:22.075024 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:37:22.075072 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:37:22.075091 | orchestrator | 2026-04-03 06:37:22.075108 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-03 06:37:22.075125 | orchestrator | Friday 03 April 2026 06:36:15 +0000 (0:00:13.427) 0:02:04.898 ********** 2026-04-03 06:37:22.075141 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:37:22.075158 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:37:22.075174 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:37:22.075190 | orchestrator | 2026-04-03 06:37:22.075207 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-03 06:37:22.075224 | orchestrator | Friday 03 April 2026 06:36:25 +0000 (0:00:10.892) 0:02:15.791 ********** 2026-04-03 06:37:22.075239 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:37:22.075256 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:37:22.075272 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:37:22.075289 | orchestrator | 2026-04-03 06:37:22.075306 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-03 06:37:22.075323 | orchestrator | Friday 03 April 2026 06:36:36 +0000 (0:00:10.472) 0:02:26.263 ********** 2026-04-03 06:37:22.075340 | orchestrator | changed: [testbed-manager] 2026-04-03 06:37:22.075356 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:37:22.075394 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:37:22.075412 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:37:22.075429 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:37:22.075445 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:37:22.075462 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:37:22.075479 | orchestrator | 2026-04-03 06:37:22.075495 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-03 06:37:22.075531 | orchestrator | Friday 03 April 2026 06:36:51 +0000 (0:00:15.103) 0:02:41.367 ********** 2026-04-03 06:37:22.075549 | orchestrator | changed: [testbed-manager] 2026-04-03 06:37:22.075565 | orchestrator | 2026-04-03 06:37:22.075581 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-03 06:37:22.075599 | orchestrator | Friday 03 April 2026 06:37:00 +0000 (0:00:08.907) 0:02:50.274 ********** 2026-04-03 06:37:22.075616 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:37:22.075633 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:37:22.075649 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:37:22.075664 | orchestrator | 2026-04-03 06:37:22.075680 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-03 06:37:22.075695 | orchestrator | Friday 03 April 2026 06:37:10 +0000 (0:00:10.363) 0:03:00.637 ********** 2026-04-03 06:37:22.075711 | orchestrator | changed: [testbed-manager] 2026-04-03 06:37:22.075728 | orchestrator | 2026-04-03 06:37:22.075746 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-03 06:37:22.075763 | orchestrator | Friday 03 April 2026 06:37:16 +0000 (0:00:05.456) 0:03:06.094 ********** 2026-04-03 06:37:22.075780 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:37:22.075796 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:37:22.075813 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:37:22.075829 | orchestrator | 2026-04-03 06:37:22.075846 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:37:22.075865 | orchestrator | testbed-manager : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-03 06:37:22.075907 | orchestrator | testbed-node-0 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 06:37:22.075927 | orchestrator | testbed-node-1 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 06:37:22.075944 | orchestrator | testbed-node-2 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 06:37:22.075974 | orchestrator | testbed-node-3 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 06:37:22.075990 | orchestrator | testbed-node-4 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 06:37:22.076003 | orchestrator | testbed-node-5 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 06:37:22.076017 | orchestrator | 2026-04-03 06:37:22.076030 | orchestrator | 2026-04-03 06:37:22.076045 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:37:22.076059 | orchestrator | Friday 03 April 2026 06:37:21 +0000 (0:00:05.303) 0:03:11.397 ********** 2026-04-03 06:37:22.076073 | orchestrator | =============================================================================== 2026-04-03 06:37:22.076087 | orchestrator | prometheus : Copying over custom prometheus alert rules files ---------- 26.05s 2026-04-03 06:37:22.076100 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 23.19s 2026-04-03 06:37:22.076113 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 16.03s 2026-04-03 06:37:22.076127 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 15.10s 2026-04-03 06:37:22.076140 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 13.43s 2026-04-03 06:37:22.076153 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container -------------- 10.89s 2026-04-03 06:37:22.076166 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ----------- 10.47s 2026-04-03 06:37:22.076179 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container ------- 10.36s 2026-04-03 06:37:22.076192 | orchestrator | prometheus : Restart prometheus-alertmanager container ------------------ 8.91s 2026-04-03 06:37:22.076205 | orchestrator | prometheus : Copying over config.json files ----------------------------- 5.74s 2026-04-03 06:37:22.076218 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------- 5.46s 2026-04-03 06:37:22.076290 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container -------------- 5.30s 2026-04-03 06:37:22.076302 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 5.17s 2026-04-03 06:37:22.076310 | orchestrator | prometheus : Check prometheus containers -------------------------------- 3.92s 2026-04-03 06:37:22.076318 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 2.82s 2026-04-03 06:37:22.076326 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 2.80s 2026-04-03 06:37:22.076334 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 2.36s 2026-04-03 06:37:22.076342 | orchestrator | prometheus : Copying over my.cnf for mysqld_exporter -------------------- 2.19s 2026-04-03 06:37:22.076350 | orchestrator | prometheus : Find prometheus host config overrides ---------------------- 1.82s 2026-04-03 06:37:22.076358 | orchestrator | prometheus : Copying over prometheus alertmanager config file ----------- 1.78s 2026-04-03 06:37:24.492058 | orchestrator | 2026-04-03 06:37:24 | INFO  | Task 0ef7c9e5-2e80-4672-b930-023a87c8a4ab (grafana) was prepared for execution. 2026-04-03 06:37:24.492174 | orchestrator | 2026-04-03 06:37:24 | INFO  | It takes a moment until task 0ef7c9e5-2e80-4672-b930-023a87c8a4ab (grafana) has been started and output is visible here. 2026-04-03 06:37:34.391072 | orchestrator | 2026-04-03 06:37:34.391177 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:37:34.391190 | orchestrator | 2026-04-03 06:37:34.391198 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:37:34.391205 | orchestrator | Friday 03 April 2026 06:37:28 +0000 (0:00:00.267) 0:00:00.267 ********** 2026-04-03 06:37:34.391212 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:37:34.391220 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:37:34.391227 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:37:34.391252 | orchestrator | 2026-04-03 06:37:34.391259 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:37:34.391265 | orchestrator | Friday 03 April 2026 06:37:29 +0000 (0:00:00.320) 0:00:00.588 ********** 2026-04-03 06:37:34.391271 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-03 06:37:34.391279 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-03 06:37:34.391285 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-03 06:37:34.391291 | orchestrator | 2026-04-03 06:37:34.391298 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-03 06:37:34.391305 | orchestrator | 2026-04-03 06:37:34.391312 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-03 06:37:34.391318 | orchestrator | Friday 03 April 2026 06:37:29 +0000 (0:00:00.450) 0:00:01.038 ********** 2026-04-03 06:37:34.391326 | orchestrator | included: /ansible/roles/grafana/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:37:34.391331 | orchestrator | 2026-04-03 06:37:34.391335 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-03 06:37:34.391339 | orchestrator | Friday 03 April 2026 06:37:30 +0000 (0:00:00.605) 0:00:01.644 ********** 2026-04-03 06:37:34.391346 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391354 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391358 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391362 | orchestrator | 2026-04-03 06:37:34.391366 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-03 06:37:34.391370 | orchestrator | Friday 03 April 2026 06:37:31 +0000 (0:00:00.875) 0:00:02.519 ********** 2026-04-03 06:37:34.391418 | orchestrator | [WARNING]: Skipped '/operations/prometheus/grafana' path due to this access 2026-04-03 06:37:34.391424 | orchestrator | issue: '/operations/prometheus/grafana' is not a directory 2026-04-03 06:37:34.391428 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:37:34.391432 | orchestrator | 2026-04-03 06:37:34.391436 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-03 06:37:34.391445 | orchestrator | Friday 03 April 2026 06:37:31 +0000 (0:00:00.846) 0:00:03.366 ********** 2026-04-03 06:37:34.391449 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:37:34.391454 | orchestrator | 2026-04-03 06:37:34.391468 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-03 06:37:34.391472 | orchestrator | Friday 03 April 2026 06:37:32 +0000 (0:00:00.580) 0:00:03.947 ********** 2026-04-03 06:37:34.391489 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391494 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391498 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:34.391502 | orchestrator | 2026-04-03 06:37:34.391506 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-03 06:37:34.391510 | orchestrator | Friday 03 April 2026 06:37:33 +0000 (0:00:01.322) 0:00:05.269 ********** 2026-04-03 06:37:34.391514 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:34.391518 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:37:34.391522 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:34.391529 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:37:34.391544 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:41.282705 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:37:41.282814 | orchestrator | 2026-04-03 06:37:41.282830 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-03 06:37:41.282844 | orchestrator | Friday 03 April 2026 06:37:34 +0000 (0:00:00.614) 0:00:05.883 ********** 2026-04-03 06:37:41.282857 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:41.282873 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:37:41.282885 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:41.282896 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:37:41.282908 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-03 06:37:41.282920 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:37:41.282932 | orchestrator | 2026-04-03 06:37:41.282943 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-03 06:37:41.282954 | orchestrator | Friday 03 April 2026 06:37:34 +0000 (0:00:00.610) 0:00:06.494 ********** 2026-04-03 06:37:41.282966 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283013 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283045 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283057 | orchestrator | 2026-04-03 06:37:41.283069 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-03 06:37:41.283080 | orchestrator | Friday 03 April 2026 06:37:36 +0000 (0:00:01.238) 0:00:07.733 ********** 2026-04-03 06:37:41.283092 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283104 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283115 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:37:41.283134 | orchestrator | 2026-04-03 06:37:41.283146 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-03 06:37:41.283157 | orchestrator | Friday 03 April 2026 06:37:37 +0000 (0:00:01.672) 0:00:09.405 ********** 2026-04-03 06:37:41.283168 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:37:41.283179 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:37:41.283190 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:37:41.283201 | orchestrator | 2026-04-03 06:37:41.283212 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-03 06:37:41.283223 | orchestrator | Friday 03 April 2026 06:37:38 +0000 (0:00:00.345) 0:00:09.751 ********** 2026-04-03 06:37:41.283234 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 06:37:41.283248 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 06:37:41.283261 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 06:37:41.283273 | orchestrator | 2026-04-03 06:37:41.283286 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-03 06:37:41.283298 | orchestrator | Friday 03 April 2026 06:37:39 +0000 (0:00:01.271) 0:00:11.023 ********** 2026-04-03 06:37:41.283316 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 06:37:41.283330 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 06:37:41.283343 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 06:37:41.283355 | orchestrator | 2026-04-03 06:37:41.283368 | orchestrator | TASK [grafana : Find custom grafana dashboards] ******************************** 2026-04-03 06:37:41.283416 | orchestrator | Friday 03 April 2026 06:37:41 +0000 (0:00:01.748) 0:00:12.771 ********** 2026-04-03 06:37:47.582358 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:37:47.582509 | orchestrator | 2026-04-03 06:37:47.582523 | orchestrator | TASK [grafana : Find templated grafana dashboards] ***************************** 2026-04-03 06:37:47.582534 | orchestrator | Friday 03 April 2026 06:37:42 +0000 (0:00:00.755) 0:00:13.527 ********** 2026-04-03 06:37:47.582544 | orchestrator | [WARNING]: Skipped '/etc/kolla/grafana/dashboards' path due to this access 2026-04-03 06:37:47.582553 | orchestrator | issue: '/etc/kolla/grafana/dashboards' is not a directory 2026-04-03 06:37:47.582563 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:37:47.582572 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:37:47.582581 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:37:47.582590 | orchestrator | 2026-04-03 06:37:47.582599 | orchestrator | TASK [grafana : Prune templated Grafana dashboards] **************************** 2026-04-03 06:37:47.582608 | orchestrator | Friday 03 April 2026 06:37:42 +0000 (0:00:00.741) 0:00:14.268 ********** 2026-04-03 06:37:47.582618 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:37:47.582627 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:37:47.582635 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:37:47.582644 | orchestrator | 2026-04-03 06:37:47.582653 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-03 06:37:47.582662 | orchestrator | Friday 03 April 2026 06:37:43 +0000 (0:00:00.331) 0:00:14.599 ********** 2026-04-03 06:37:47.582674 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1099469, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6045804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582704 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1099469, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6045804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582714 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1099469, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6045804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582725 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1099544, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582763 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1099544, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582774 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1099544, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582783 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1099475, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582798 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1099475, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582808 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1099475, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582817 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1099546, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6755097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582830 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1099546, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6755097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:47.582847 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1099546, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6755097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346562 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1099481, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6215086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346692 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1099481, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6215086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346711 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1099481, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6215086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346724 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1099488, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6561599, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346754 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1099488, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6561599, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346766 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1099488, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6561599, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346799 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1099468, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6041403, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346819 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1099468, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6041403, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346831 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1099468, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6041403, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346843 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1099470, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6155083, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346854 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1099470, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6155083, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346871 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1099470, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6155083, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:51.346891 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1099477, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.981921 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1099477, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982120 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1099477, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6175084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982153 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1099483, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6236467, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982172 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1099483, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6236467, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982250 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1099483, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6236467, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982273 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1099541, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982337 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1099541, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982351 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1099541, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6685638, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982363 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1099474, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6165085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982375 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1099474, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6165085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982443 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1099474, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6165085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982465 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1099487, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6245086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:54.982496 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1099487, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6245086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.875988 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1099487, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6245086, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876233 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1099482, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.622892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876254 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1099482, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.622892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876266 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1099482, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.622892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876293 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1099480, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6205084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876302 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1099480, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6205084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876345 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1099480, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6205084, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876353 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1099479, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6195085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876360 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1099479, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6195085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876367 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1099479, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6195085, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876414 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1099485, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6240623, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1099485, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6240623, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:37:58.876441 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1099485, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6240623, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087114 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1099478, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6192095, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087249 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1099478, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6192095, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087278 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1099478, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6192095, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087300 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1099539, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6665094, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087342 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1099539, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6665094, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087431 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1099539, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6665094, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087485 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1099908, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8730965, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087510 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1099908, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8730965, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087531 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1099908, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8730965, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087553 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1099577, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.700355, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087582 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1099577, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.700355, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087616 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1099568, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.681848, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:03.087651 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1099577, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.700355, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1099568, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.681848, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842341 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1099611, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842357 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1099568, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.681848, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842442 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1099611, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842477 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1099558, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6780412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842489 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1099611, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842516 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1099558, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6780412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842528 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1099826, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8247466, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842538 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1099558, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6780412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842554 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1099826, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8247466, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842571 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1099612, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8179977, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842582 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1099826, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8247466, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:06.842602 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1099612, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8179977, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.653846 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1099830, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8275125, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.653936 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1099612, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8179977, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.653948 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1099830, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8275125, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.653988 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1099905, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8695135, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.653998 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1099830, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8275125, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654008 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1099905, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8695135, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654100 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1099820, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8243568, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654145 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1099905, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8695135, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654185 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1099820, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8243568, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654208 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1099606, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.70351, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654223 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1099820, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8243568, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654236 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1099606, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.70351, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:10.654264 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1099573, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.68551, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.381945 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1099606, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.70351, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382114 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1099573, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.68551, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382171 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1099597, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7032795, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382185 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1099573, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.68551, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382197 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1099597, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7032795, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382210 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1099569, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6830208, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382240 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1099597, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7032795, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382253 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1099569, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6830208, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382279 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1099609, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382292 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1099569, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6830208, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382304 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1099609, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382316 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1099842, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8685133, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:14.382336 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1099609, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.7055101, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171125 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1099842, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8685133, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171232 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1099834, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8310902, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171265 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1099842, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8685133, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171277 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1099834, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8310902, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171288 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1099561, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6785097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171299 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1099834, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8310902, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171347 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1099561, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6785097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171360 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1099564, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6812975, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171375 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1099561, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6785097, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171417 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1099564, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6812975, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171429 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1099815, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8193936, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171440 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1099564, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.6812975, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:38:18.171468 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1099815, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8193936, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:39:54.923952 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1099832, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8285127, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:39:54.924077 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1099832, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8285127, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:39:54.924094 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1099815, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8193936, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:39:54.924106 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1099832, 'dev': 176, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1775191203.8285127, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-03 06:39:54.924117 | orchestrator | 2026-04-03 06:39:54.924129 | orchestrator | TASK [grafana : Check grafana containers] ************************************** 2026-04-03 06:39:54.924140 | orchestrator | Friday 03 April 2026 06:38:19 +0000 (0:00:36.748) 0:00:51.348 ********** 2026-04-03 06:39:54.924151 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:39:54.924197 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:39:54.924210 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-03 06:39:54.924220 | orchestrator | 2026-04-03 06:39:54.924230 | orchestrator | TASK [grafana : Creating grafana database] ************************************* 2026-04-03 06:39:54.924245 | orchestrator | Friday 03 April 2026 06:38:20 +0000 (0:00:01.001) 0:00:52.349 ********** 2026-04-03 06:39:54.924255 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:39:54.924267 | orchestrator | 2026-04-03 06:39:54.924277 | orchestrator | TASK [grafana : Creating grafana database user and setting permissions] ******** 2026-04-03 06:39:54.924287 | orchestrator | Friday 03 April 2026 06:38:23 +0000 (0:00:02.335) 0:00:54.684 ********** 2026-04-03 06:39:54.924297 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:39:54.924307 | orchestrator | 2026-04-03 06:39:54.924317 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 06:39:54.924327 | orchestrator | Friday 03 April 2026 06:38:25 +0000 (0:00:02.298) 0:00:56.983 ********** 2026-04-03 06:39:54.924336 | orchestrator | 2026-04-03 06:39:54.924346 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 06:39:54.924356 | orchestrator | Friday 03 April 2026 06:38:25 +0000 (0:00:00.070) 0:00:57.054 ********** 2026-04-03 06:39:54.924366 | orchestrator | 2026-04-03 06:39:54.924376 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 06:39:54.924386 | orchestrator | Friday 03 April 2026 06:38:25 +0000 (0:00:00.071) 0:00:57.125 ********** 2026-04-03 06:39:54.924395 | orchestrator | 2026-04-03 06:39:54.924426 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-03 06:39:54.924437 | orchestrator | Friday 03 April 2026 06:38:25 +0000 (0:00:00.073) 0:00:57.199 ********** 2026-04-03 06:39:54.924447 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:39:54.924457 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:39:54.924467 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:39:54.924476 | orchestrator | 2026-04-03 06:39:54.924488 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-03 06:39:54.924503 | orchestrator | Friday 03 April 2026 06:38:27 +0000 (0:00:02.144) 0:00:59.343 ********** 2026-04-03 06:39:54.924519 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:39:54.924536 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:39:54.924563 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-03 06:39:54.924582 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-03 06:39:54.924596 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (10 retries left). 2026-04-03 06:39:54.924611 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (9 retries left). 2026-04-03 06:39:54.924626 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:39:54.924642 | orchestrator | 2026-04-03 06:39:54.924659 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-03 06:39:54.924674 | orchestrator | Friday 03 April 2026 06:39:18 +0000 (0:00:50.222) 0:01:49.566 ********** 2026-04-03 06:39:54.924689 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:39:54.924705 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:39:54.924720 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:39:54.924736 | orchestrator | 2026-04-03 06:39:54.924751 | orchestrator | TASK [grafana : Wait for grafana application ready] **************************** 2026-04-03 06:39:54.924767 | orchestrator | Friday 03 April 2026 06:39:49 +0000 (0:00:31.741) 0:02:21.307 ********** 2026-04-03 06:39:54.924784 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:39:54.924799 | orchestrator | 2026-04-03 06:39:54.924815 | orchestrator | TASK [grafana : Remove old grafana docker volume] ****************************** 2026-04-03 06:39:54.924831 | orchestrator | Friday 03 April 2026 06:39:51 +0000 (0:00:02.153) 0:02:23.461 ********** 2026-04-03 06:39:54.924847 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:39:54.924863 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:39:54.924880 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:39:54.924897 | orchestrator | 2026-04-03 06:39:54.924913 | orchestrator | TASK [grafana : Enable grafana datasources] ************************************ 2026-04-03 06:39:54.924927 | orchestrator | Friday 03 April 2026 06:39:52 +0000 (0:00:00.319) 0:02:23.780 ********** 2026-04-03 06:39:54.924938 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'influxdb', 'value': {'enabled': False, 'data': {'isDefault': True, 'database': 'telegraf', 'name': 'telegraf', 'type': 'influxdb', 'url': 'https://api-int.testbed.osism.xyz:8086', 'access': 'proxy', 'basicAuth': False}}})  2026-04-03 06:39:54.924961 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'data': {'name': 'opensearch', 'type': 'grafana-opensearch-datasource', 'access': 'proxy', 'url': 'https://api-int.testbed.osism.xyz:9200', 'jsonData': {'flavor': 'OpenSearch', 'database': 'flog-*', 'version': '2.11.1', 'timeField': '@timestamp', 'logLevelField': 'log_level'}}}}) 2026-04-03 06:39:55.579638 | orchestrator | 2026-04-03 06:39:55.579756 | orchestrator | TASK [grafana : Disable Getting Started panel] ********************************* 2026-04-03 06:39:55.579774 | orchestrator | Friday 03 April 2026 06:39:54 +0000 (0:00:02.629) 0:02:26.409 ********** 2026-04-03 06:39:55.579787 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:39:55.579801 | orchestrator | 2026-04-03 06:39:55.579813 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:39:55.579826 | orchestrator | testbed-node-0 : ok=21  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:39:55.579840 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:39:55.579852 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 06:39:55.579864 | orchestrator | 2026-04-03 06:39:55.579875 | orchestrator | 2026-04-03 06:39:55.579905 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:39:55.579917 | orchestrator | Friday 03 April 2026 06:39:55 +0000 (0:00:00.298) 0:02:26.707 ********** 2026-04-03 06:39:55.579951 | orchestrator | =============================================================================== 2026-04-03 06:39:55.579963 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 50.22s 2026-04-03 06:39:55.579975 | orchestrator | grafana : Copying over custom dashboards ------------------------------- 36.75s 2026-04-03 06:39:55.579987 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 31.74s 2026-04-03 06:39:55.579999 | orchestrator | grafana : Enable grafana datasources ------------------------------------ 2.63s 2026-04-03 06:39:55.580011 | orchestrator | grafana : Creating grafana database ------------------------------------- 2.34s 2026-04-03 06:39:55.580023 | orchestrator | grafana : Creating grafana database user and setting permissions -------- 2.30s 2026-04-03 06:39:55.580034 | orchestrator | grafana : Wait for grafana application ready ---------------------------- 2.15s 2026-04-03 06:39:55.580046 | orchestrator | grafana : Restart first grafana container ------------------------------- 2.14s 2026-04-03 06:39:55.580058 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 1.75s 2026-04-03 06:39:55.580070 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 1.67s 2026-04-03 06:39:55.580081 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 1.32s 2026-04-03 06:39:55.580093 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 1.27s 2026-04-03 06:39:55.580105 | orchestrator | grafana : Copying over config.json files -------------------------------- 1.24s 2026-04-03 06:39:55.580116 | orchestrator | grafana : Check grafana containers -------------------------------------- 1.00s 2026-04-03 06:39:55.580128 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 0.88s 2026-04-03 06:39:55.580140 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 0.85s 2026-04-03 06:39:55.580152 | orchestrator | grafana : Find custom grafana dashboards -------------------------------- 0.76s 2026-04-03 06:39:55.580164 | orchestrator | grafana : Find templated grafana dashboards ----------------------------- 0.74s 2026-04-03 06:39:55.580176 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS certificate --- 0.61s 2026-04-03 06:39:55.580190 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS key ----- 0.61s 2026-04-03 06:39:55.870874 | orchestrator | + sh -c /opt/configuration/scripts/deploy/510-clusterapi.sh 2026-04-03 06:39:55.880236 | orchestrator | + set -e 2026-04-03 06:39:55.880293 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 06:39:55.880307 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 06:39:55.880319 | orchestrator | ++ INTERACTIVE=false 2026-04-03 06:39:55.880329 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 06:39:55.880339 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 06:39:55.880349 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 06:39:55.880359 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 06:39:55.880369 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 06:39:55.880378 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 06:39:55.880388 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 06:39:55.880400 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 06:39:55.880461 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 06:39:55.880479 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:39:55.880495 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:39:55.880512 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 06:39:55.880528 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 06:39:55.880654 | orchestrator | ++ export ARA=false 2026-04-03 06:39:55.880673 | orchestrator | ++ ARA=false 2026-04-03 06:39:55.880688 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 06:39:55.880795 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 06:39:55.880812 | orchestrator | ++ export TEMPEST=false 2026-04-03 06:39:55.880828 | orchestrator | ++ TEMPEST=false 2026-04-03 06:39:55.880843 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 06:39:55.880858 | orchestrator | ++ IS_ZUUL=true 2026-04-03 06:39:55.880886 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:39:55.880904 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:39:55.880920 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 06:39:55.880937 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 06:39:55.880953 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 06:39:55.881000 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 06:39:55.881016 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 06:39:55.881032 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 06:39:55.881049 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 06:39:55.881065 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 06:39:55.882001 | orchestrator | ++ semver 9.5.0 8.0.0 2026-04-03 06:39:55.940641 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 06:39:55.940735 | orchestrator | + osism apply clusterapi 2026-04-03 06:39:57.963261 | orchestrator | 2026-04-03 06:39:57 | INFO  | Task eef7cfe9-1d8a-47ae-a7a7-7874f919c871 (clusterapi) was prepared for execution. 2026-04-03 06:39:57.963373 | orchestrator | 2026-04-03 06:39:57 | INFO  | It takes a moment until task eef7cfe9-1d8a-47ae-a7a7-7874f919c871 (clusterapi) has been started and output is visible here. 2026-04-03 06:40:56.066940 | orchestrator | 2026-04-03 06:40:56.067059 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-03 06:40:56.067076 | orchestrator | 2026-04-03 06:40:56.067089 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-03 06:40:56.067109 | orchestrator | Friday 03 April 2026 06:40:02 +0000 (0:00:00.192) 0:00:00.192 ********** 2026-04-03 06:40:56.067129 | orchestrator | included: cert_manager for testbed-manager 2026-04-03 06:40:56.067148 | orchestrator | 2026-04-03 06:40:56.067168 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-03 06:40:56.067188 | orchestrator | Friday 03 April 2026 06:40:02 +0000 (0:00:00.248) 0:00:00.440 ********** 2026-04-03 06:40:56.067209 | orchestrator | changed: [testbed-manager] 2026-04-03 06:40:56.067230 | orchestrator | 2026-04-03 06:40:56.067244 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-03 06:40:56.067255 | orchestrator | Friday 03 April 2026 06:40:07 +0000 (0:00:05.345) 0:00:05.785 ********** 2026-04-03 06:40:56.067266 | orchestrator | changed: [testbed-manager] 2026-04-03 06:40:56.067277 | orchestrator | 2026-04-03 06:40:56.067289 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-03 06:40:56.067300 | orchestrator | 2026-04-03 06:40:56.067311 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-03 06:40:56.067340 | orchestrator | Friday 03 April 2026 06:40:35 +0000 (0:00:27.130) 0:00:32.916 ********** 2026-04-03 06:40:56.067352 | orchestrator | ok: [testbed-manager] 2026-04-03 06:40:56.067363 | orchestrator | 2026-04-03 06:40:56.067374 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-03 06:40:56.067385 | orchestrator | Friday 03 April 2026 06:40:36 +0000 (0:00:01.152) 0:00:34.069 ********** 2026-04-03 06:40:56.067396 | orchestrator | ok: [testbed-manager] 2026-04-03 06:40:56.067407 | orchestrator | 2026-04-03 06:40:56.067450 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-03 06:40:56.067464 | orchestrator | Friday 03 April 2026 06:40:36 +0000 (0:00:00.155) 0:00:34.224 ********** 2026-04-03 06:40:56.067476 | orchestrator | ok: [testbed-manager] 2026-04-03 06:40:56.067490 | orchestrator | 2026-04-03 06:40:56.067503 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-03 06:40:56.067516 | orchestrator | Friday 03 April 2026 06:40:53 +0000 (0:00:16.942) 0:00:51.167 ********** 2026-04-03 06:40:56.067529 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:40:56.067541 | orchestrator | 2026-04-03 06:40:56.067554 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-03 06:40:56.067566 | orchestrator | Friday 03 April 2026 06:40:53 +0000 (0:00:00.146) 0:00:51.313 ********** 2026-04-03 06:40:56.067580 | orchestrator | changed: [testbed-manager] 2026-04-03 06:40:56.067592 | orchestrator | 2026-04-03 06:40:56.067605 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:40:56.067620 | orchestrator | testbed-manager : ok=7  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 06:40:56.067634 | orchestrator | 2026-04-03 06:40:56.067647 | orchestrator | 2026-04-03 06:40:56.067660 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:40:56.067696 | orchestrator | Friday 03 April 2026 06:40:55 +0000 (0:00:02.317) 0:00:53.630 ********** 2026-04-03 06:40:56.067709 | orchestrator | =============================================================================== 2026-04-03 06:40:56.067722 | orchestrator | cert_manager : Deploy cert-manager ------------------------------------- 27.13s 2026-04-03 06:40:56.067735 | orchestrator | Initialize the CAPI management cluster --------------------------------- 16.94s 2026-04-03 06:40:56.067748 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 5.35s 2026-04-03 06:40:56.067761 | orchestrator | Install openstack-resource-controller ----------------------------------- 2.32s 2026-04-03 06:40:56.067775 | orchestrator | Get capi-system namespace phase ----------------------------------------- 1.15s 2026-04-03 06:40:56.067787 | orchestrator | Include cert_manager role ----------------------------------------------- 0.25s 2026-04-03 06:40:56.067800 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 0.16s 2026-04-03 06:40:56.067813 | orchestrator | Upgrade the CAPI management cluster ------------------------------------- 0.15s 2026-04-03 06:40:56.375949 | orchestrator | + osism apply magnum 2026-04-03 06:40:58.394576 | orchestrator | 2026-04-03 06:40:58 | INFO  | Task c6df6fa0-6948-43b3-882e-f5bd0efec92f (magnum) was prepared for execution. 2026-04-03 06:40:58.394674 | orchestrator | 2026-04-03 06:40:58 | INFO  | It takes a moment until task c6df6fa0-6948-43b3-882e-f5bd0efec92f (magnum) has been started and output is visible here. 2026-04-03 06:41:40.498320 | orchestrator | 2026-04-03 06:41:40.498493 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:41:40.498513 | orchestrator | 2026-04-03 06:41:40.498527 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:41:40.498539 | orchestrator | Friday 03 April 2026 06:41:02 +0000 (0:00:00.273) 0:00:00.273 ********** 2026-04-03 06:41:40.498551 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:41:40.498563 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:41:40.498574 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:41:40.498585 | orchestrator | 2026-04-03 06:41:40.498596 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:41:40.498607 | orchestrator | Friday 03 April 2026 06:41:02 +0000 (0:00:00.345) 0:00:00.618 ********** 2026-04-03 06:41:40.498618 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-03 06:41:40.498630 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-03 06:41:40.498640 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-03 06:41:40.498651 | orchestrator | 2026-04-03 06:41:40.498663 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-03 06:41:40.498673 | orchestrator | 2026-04-03 06:41:40.498684 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-03 06:41:40.498695 | orchestrator | Friday 03 April 2026 06:41:03 +0000 (0:00:00.435) 0:00:01.054 ********** 2026-04-03 06:41:40.498706 | orchestrator | included: /ansible/roles/magnum/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:41:40.498718 | orchestrator | 2026-04-03 06:41:40.498729 | orchestrator | TASK [service-ks-register : magnum | Creating services] ************************ 2026-04-03 06:41:40.498740 | orchestrator | Friday 03 April 2026 06:41:03 +0000 (0:00:00.592) 0:00:01.646 ********** 2026-04-03 06:41:40.498751 | orchestrator | changed: [testbed-node-0] => (item=magnum (container-infra)) 2026-04-03 06:41:40.498762 | orchestrator | 2026-04-03 06:41:40.498773 | orchestrator | TASK [service-ks-register : magnum | Creating endpoints] *********************** 2026-04-03 06:41:40.498784 | orchestrator | Friday 03 April 2026 06:41:07 +0000 (0:00:03.624) 0:00:05.270 ********** 2026-04-03 06:41:40.498795 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api-int.testbed.osism.xyz:9511/v1 -> internal) 2026-04-03 06:41:40.498806 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api.testbed.osism.xyz:9511/v1 -> public) 2026-04-03 06:41:40.498817 | orchestrator | 2026-04-03 06:41:40.498852 | orchestrator | TASK [service-ks-register : magnum | Creating projects] ************************ 2026-04-03 06:41:40.498878 | orchestrator | Friday 03 April 2026 06:41:14 +0000 (0:00:06.544) 0:00:11.814 ********** 2026-04-03 06:41:40.498893 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 06:41:40.498905 | orchestrator | 2026-04-03 06:41:40.498917 | orchestrator | TASK [service-ks-register : magnum | Creating users] *************************** 2026-04-03 06:41:40.498930 | orchestrator | Friday 03 April 2026 06:41:17 +0000 (0:00:03.376) 0:00:15.190 ********** 2026-04-03 06:41:40.498942 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 06:41:40.498956 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service) 2026-04-03 06:41:40.498969 | orchestrator | 2026-04-03 06:41:40.498982 | orchestrator | TASK [service-ks-register : magnum | Creating roles] *************************** 2026-04-03 06:41:40.498994 | orchestrator | Friday 03 April 2026 06:41:21 +0000 (0:00:03.808) 0:00:18.999 ********** 2026-04-03 06:41:40.499007 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 06:41:40.499020 | orchestrator | 2026-04-03 06:41:40.499033 | orchestrator | TASK [service-ks-register : magnum | Granting user roles] ********************** 2026-04-03 06:41:40.499046 | orchestrator | Friday 03 April 2026 06:41:24 +0000 (0:00:03.236) 0:00:22.235 ********** 2026-04-03 06:41:40.499058 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service -> admin) 2026-04-03 06:41:40.499070 | orchestrator | 2026-04-03 06:41:40.499084 | orchestrator | TASK [magnum : Creating Magnum trustee domain] ********************************* 2026-04-03 06:41:40.499096 | orchestrator | Friday 03 April 2026 06:41:28 +0000 (0:00:03.628) 0:00:25.863 ********** 2026-04-03 06:41:40.499109 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:41:40.499122 | orchestrator | 2026-04-03 06:41:40.499135 | orchestrator | TASK [magnum : Creating Magnum trustee user] *********************************** 2026-04-03 06:41:40.499148 | orchestrator | Friday 03 April 2026 06:41:31 +0000 (0:00:03.262) 0:00:29.126 ********** 2026-04-03 06:41:40.499160 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:41:40.499174 | orchestrator | 2026-04-03 06:41:40.499187 | orchestrator | TASK [magnum : Creating Magnum trustee user role] ****************************** 2026-04-03 06:41:40.499199 | orchestrator | Friday 03 April 2026 06:41:35 +0000 (0:00:03.972) 0:00:33.098 ********** 2026-04-03 06:41:40.499212 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:41:40.499225 | orchestrator | 2026-04-03 06:41:40.499236 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-03 06:41:40.499247 | orchestrator | Friday 03 April 2026 06:41:38 +0000 (0:00:03.463) 0:00:36.562 ********** 2026-04-03 06:41:40.499282 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:40.499297 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:40.499323 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:40.499336 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:40.499349 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:40.499369 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:47.732646 | orchestrator | 2026-04-03 06:41:47.732759 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-03 06:41:47.732777 | orchestrator | Friday 03 April 2026 06:41:40 +0000 (0:00:01.572) 0:00:38.135 ********** 2026-04-03 06:41:47.732789 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:41:47.732801 | orchestrator | 2026-04-03 06:41:47.732812 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-03 06:41:47.732846 | orchestrator | Friday 03 April 2026 06:41:40 +0000 (0:00:00.131) 0:00:38.267 ********** 2026-04-03 06:41:47.732857 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:41:47.732868 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:41:47.732879 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:41:47.732890 | orchestrator | 2026-04-03 06:41:47.732900 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-03 06:41:47.732911 | orchestrator | Friday 03 April 2026 06:41:40 +0000 (0:00:00.315) 0:00:38.583 ********** 2026-04-03 06:41:47.732939 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 06:41:47.732950 | orchestrator | 2026-04-03 06:41:47.732961 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-03 06:41:47.732972 | orchestrator | Friday 03 April 2026 06:41:41 +0000 (0:00:00.848) 0:00:39.431 ********** 2026-04-03 06:41:47.732999 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:47.733017 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:47.733030 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:47.733059 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:47.733082 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:47.733098 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:47.733111 | orchestrator | 2026-04-03 06:41:47.733123 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-03 06:41:47.733134 | orchestrator | Friday 03 April 2026 06:41:44 +0000 (0:00:02.332) 0:00:41.763 ********** 2026-04-03 06:41:47.733146 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:41:47.733157 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:41:47.733168 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:41:47.733181 | orchestrator | 2026-04-03 06:41:47.733194 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-03 06:41:47.733206 | orchestrator | Friday 03 April 2026 06:41:44 +0000 (0:00:00.500) 0:00:42.264 ********** 2026-04-03 06:41:47.733219 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:41:47.733232 | orchestrator | 2026-04-03 06:41:47.733244 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-03 06:41:47.733257 | orchestrator | Friday 03 April 2026 06:41:45 +0000 (0:00:00.601) 0:00:42.866 ********** 2026-04-03 06:41:47.733270 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:47.733292 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:48.606812 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:48.606948 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:48.606966 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:48.606979 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:48.607012 | orchestrator | 2026-04-03 06:41:48.607027 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-03 06:41:48.607039 | orchestrator | Friday 03 April 2026 06:41:47 +0000 (0:00:02.515) 0:00:45.381 ********** 2026-04-03 06:41:48.607068 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:48.607081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:48.607094 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:41:48.607112 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:48.607125 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:48.607136 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:41:48.607148 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:48.607176 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:51.990136 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:41:51.990244 | orchestrator | 2026-04-03 06:41:51.990261 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-03 06:41:51.990275 | orchestrator | Friday 03 April 2026 06:41:48 +0000 (0:00:00.865) 0:00:46.247 ********** 2026-04-03 06:41:51.990290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:51.990323 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:51.990336 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:41:51.990348 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:51.990381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:51.990393 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:41:51.990422 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:41:51.990498 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:41:51.990512 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:41:51.990523 | orchestrator | 2026-04-03 06:41:51.990535 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-03 06:41:51.990546 | orchestrator | Friday 03 April 2026 06:41:49 +0000 (0:00:00.889) 0:00:47.136 ********** 2026-04-03 06:41:51.990559 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:51.990580 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:51.990601 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:58.085005 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085146 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085174 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085223 | orchestrator | 2026-04-03 06:41:58.085245 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-03 06:41:58.085264 | orchestrator | Friday 03 April 2026 06:41:51 +0000 (0:00:02.502) 0:00:49.639 ********** 2026-04-03 06:41:58.085284 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:58.085327 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:58.085350 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:41:58.085378 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085415 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085464 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:41:58.085484 | orchestrator | 2026-04-03 06:41:58.085503 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-03 06:41:58.085523 | orchestrator | Friday 03 April 2026 06:41:57 +0000 (0:00:05.401) 0:00:55.041 ********** 2026-04-03 06:41:58.085557 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:42:00.050261 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:42:00.050391 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:42:00.050412 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:42:00.050495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:42:00.050509 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:42:00.050521 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-03 06:42:00.050551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 06:42:00.050564 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:42:00.050575 | orchestrator | 2026-04-03 06:42:00.050588 | orchestrator | TASK [magnum : Check magnum containers] **************************************** 2026-04-03 06:42:00.050600 | orchestrator | Friday 03 April 2026 06:41:58 +0000 (0:00:00.694) 0:00:55.736 ********** 2026-04-03 06:42:00.050617 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:42:00.050638 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:42:00.050650 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-03 06:42:00.050662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:42:00.050684 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:42:47.040136 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 06:42:47.040305 | orchestrator | 2026-04-03 06:42:47.040327 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-03 06:42:47.040341 | orchestrator | Friday 03 April 2026 06:42:00 +0000 (0:00:01.958) 0:00:57.694 ********** 2026-04-03 06:42:47.040352 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:42:47.040365 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:42:47.040375 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:42:47.040386 | orchestrator | 2026-04-03 06:42:47.040397 | orchestrator | TASK [magnum : Creating Magnum database] *************************************** 2026-04-03 06:42:47.040409 | orchestrator | Friday 03 April 2026 06:42:00 +0000 (0:00:00.558) 0:00:58.253 ********** 2026-04-03 06:42:47.040429 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:42:47.040565 | orchestrator | 2026-04-03 06:42:47.040581 | orchestrator | TASK [magnum : Creating Magnum database user and setting permissions] ********** 2026-04-03 06:42:47.040592 | orchestrator | Friday 03 April 2026 06:42:02 +0000 (0:00:02.127) 0:01:00.380 ********** 2026-04-03 06:42:47.040604 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:42:47.040615 | orchestrator | 2026-04-03 06:42:47.040627 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-03 06:42:47.040640 | orchestrator | Friday 03 April 2026 06:42:05 +0000 (0:00:02.308) 0:01:02.688 ********** 2026-04-03 06:42:47.040653 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:42:47.040666 | orchestrator | 2026-04-03 06:42:47.040678 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 06:42:47.040691 | orchestrator | Friday 03 April 2026 06:42:21 +0000 (0:00:16.303) 0:01:18.992 ********** 2026-04-03 06:42:47.040704 | orchestrator | 2026-04-03 06:42:47.040717 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 06:42:47.040729 | orchestrator | Friday 03 April 2026 06:42:21 +0000 (0:00:00.073) 0:01:19.065 ********** 2026-04-03 06:42:47.040741 | orchestrator | 2026-04-03 06:42:47.040756 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 06:42:47.040777 | orchestrator | Friday 03 April 2026 06:42:21 +0000 (0:00:00.071) 0:01:19.137 ********** 2026-04-03 06:42:47.040798 | orchestrator | 2026-04-03 06:42:47.040818 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-03 06:42:47.040835 | orchestrator | Friday 03 April 2026 06:42:21 +0000 (0:00:00.073) 0:01:19.210 ********** 2026-04-03 06:42:47.040850 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:42:47.040870 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:42:47.040890 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:42:47.040909 | orchestrator | 2026-04-03 06:42:47.040928 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-03 06:42:47.040948 | orchestrator | Friday 03 April 2026 06:42:35 +0000 (0:00:14.342) 0:01:33.553 ********** 2026-04-03 06:42:47.040969 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:42:47.040988 | orchestrator | changed: [testbed-node-1] 2026-04-03 06:42:47.041007 | orchestrator | changed: [testbed-node-2] 2026-04-03 06:42:47.041025 | orchestrator | 2026-04-03 06:42:47.041043 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:42:47.041065 | orchestrator | testbed-node-0 : ok=26  changed=18  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 06:42:47.041086 | orchestrator | testbed-node-1 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:42:47.041106 | orchestrator | testbed-node-2 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 06:42:47.041130 | orchestrator | 2026-04-03 06:42:47.041141 | orchestrator | 2026-04-03 06:42:47.041152 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:42:47.041163 | orchestrator | Friday 03 April 2026 06:42:46 +0000 (0:00:10.790) 0:01:44.343 ********** 2026-04-03 06:42:47.041174 | orchestrator | =============================================================================== 2026-04-03 06:42:47.041185 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 16.30s 2026-04-03 06:42:47.041196 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 14.34s 2026-04-03 06:42:47.041207 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 10.79s 2026-04-03 06:42:47.041218 | orchestrator | service-ks-register : magnum | Creating endpoints ----------------------- 6.54s 2026-04-03 06:42:47.041229 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 5.40s 2026-04-03 06:42:47.041240 | orchestrator | magnum : Creating Magnum trustee user ----------------------------------- 3.97s 2026-04-03 06:42:47.041251 | orchestrator | service-ks-register : magnum | Creating users --------------------------- 3.81s 2026-04-03 06:42:47.041293 | orchestrator | service-ks-register : magnum | Granting user roles ---------------------- 3.63s 2026-04-03 06:42:47.041313 | orchestrator | service-ks-register : magnum | Creating services ------------------------ 3.62s 2026-04-03 06:42:47.041391 | orchestrator | magnum : Creating Magnum trustee user role ------------------------------ 3.46s 2026-04-03 06:42:47.041404 | orchestrator | service-ks-register : magnum | Creating projects ------------------------ 3.38s 2026-04-03 06:42:47.041415 | orchestrator | magnum : Creating Magnum trustee domain --------------------------------- 3.26s 2026-04-03 06:42:47.041435 | orchestrator | service-ks-register : magnum | Creating roles --------------------------- 3.24s 2026-04-03 06:42:47.041471 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 2.52s 2026-04-03 06:42:47.041482 | orchestrator | magnum : Copying over config.json files for services -------------------- 2.50s 2026-04-03 06:42:47.041493 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 2.33s 2026-04-03 06:42:47.041504 | orchestrator | magnum : Creating Magnum database user and setting permissions ---------- 2.31s 2026-04-03 06:42:47.041515 | orchestrator | magnum : Creating Magnum database --------------------------------------- 2.13s 2026-04-03 06:42:47.041526 | orchestrator | magnum : Check magnum containers ---------------------------------------- 1.96s 2026-04-03 06:42:47.041537 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 1.57s 2026-04-03 06:42:47.862217 | orchestrator | ok: Runtime: 1:39:53.969830 2026-04-03 06:42:48.136588 | 2026-04-03 06:42:48.136738 | TASK [Deploy in a nutshell] 2026-04-03 06:42:48.670951 | orchestrator | skipping: Conditional result was False 2026-04-03 06:42:48.695550 | 2026-04-03 06:42:48.695717 | TASK [Bootstrap services] 2026-04-03 06:42:49.379921 | orchestrator | 2026-04-03 06:42:49.380065 | orchestrator | # BOOTSTRAP 2026-04-03 06:42:49.380076 | orchestrator | 2026-04-03 06:42:49.380081 | orchestrator | + set -e 2026-04-03 06:42:49.380086 | orchestrator | + echo 2026-04-03 06:42:49.380091 | orchestrator | + echo '# BOOTSTRAP' 2026-04-03 06:42:49.380098 | orchestrator | + echo 2026-04-03 06:42:49.380121 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap-services.sh 2026-04-03 06:42:49.388900 | orchestrator | + set -e 2026-04-03 06:42:49.388970 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/300-openstack.sh 2026-04-03 06:42:51.574337 | orchestrator | 2026-04-03 06:42:51 | INFO  | It takes a moment until task 482024ed-5358-4de8-9627-8b0c1a2cd49b (flavor-manager) has been started and output is visible here. 2026-04-03 06:42:59.305254 | orchestrator | 2026-04-03 06:42:54 | INFO  | Flavor SCS-1L-1 created 2026-04-03 06:42:59.305386 | orchestrator | 2026-04-03 06:42:54 | INFO  | Flavor SCS-1L-1-5 created 2026-04-03 06:42:59.305409 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-2 created 2026-04-03 06:42:59.305421 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-2-5 created 2026-04-03 06:42:59.305433 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-4 created 2026-04-03 06:42:59.305490 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-4-10 created 2026-04-03 06:42:59.305505 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-8 created 2026-04-03 06:42:59.305517 | orchestrator | 2026-04-03 06:42:55 | INFO  | Flavor SCS-1V-8-20 created 2026-04-03 06:42:59.305539 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-4 created 2026-04-03 06:42:59.305551 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-4-10 created 2026-04-03 06:42:59.305562 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-8 created 2026-04-03 06:42:59.305573 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-8-20 created 2026-04-03 06:42:59.305584 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-16 created 2026-04-03 06:42:59.305595 | orchestrator | 2026-04-03 06:42:56 | INFO  | Flavor SCS-2V-16-50 created 2026-04-03 06:42:59.305606 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-8 created 2026-04-03 06:42:59.305617 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-8-20 created 2026-04-03 06:42:59.305628 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-16 created 2026-04-03 06:42:59.305639 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-16-50 created 2026-04-03 06:42:59.305650 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-32 created 2026-04-03 06:42:59.305661 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-4V-32-100 created 2026-04-03 06:42:59.305673 | orchestrator | 2026-04-03 06:42:57 | INFO  | Flavor SCS-8V-16 created 2026-04-03 06:42:59.305684 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-8V-16-50 created 2026-04-03 06:42:59.305695 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-8V-32 created 2026-04-03 06:42:59.305706 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-8V-32-100 created 2026-04-03 06:42:59.305717 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-16V-32 created 2026-04-03 06:42:59.305728 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-16V-32-100 created 2026-04-03 06:42:59.305739 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-2V-4-20s created 2026-04-03 06:42:59.305750 | orchestrator | 2026-04-03 06:42:58 | INFO  | Flavor SCS-4V-8-50s created 2026-04-03 06:42:59.305761 | orchestrator | 2026-04-03 06:42:59 | INFO  | Flavor SCS-8V-32-100s created 2026-04-03 06:43:01.625996 | orchestrator | 2026-04-03 06:43:01 | INFO  | Trying to run play bootstrap-basic in environment openstack 2026-04-03 06:43:11.693345 | orchestrator | 2026-04-03 06:43:11 | INFO  | Task 90ab02cf-3fe0-4467-b591-fa1f69cd6255 (bootstrap-basic) was prepared for execution. 2026-04-03 06:43:11.693518 | orchestrator | 2026-04-03 06:43:11 | INFO  | It takes a moment until task 90ab02cf-3fe0-4467-b591-fa1f69cd6255 (bootstrap-basic) has been started and output is visible here. 2026-04-03 06:43:55.257767 | orchestrator | 2026-04-03 06:43:55.257887 | orchestrator | PLAY [Bootstrap basic OpenStack services] ************************************** 2026-04-03 06:43:55.257902 | orchestrator | 2026-04-03 06:43:55.257915 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 06:43:55.257927 | orchestrator | Friday 03 April 2026 06:43:16 +0000 (0:00:00.072) 0:00:00.072 ********** 2026-04-03 06:43:55.257940 | orchestrator | ok: [localhost] 2026-04-03 06:43:55.257952 | orchestrator | 2026-04-03 06:43:55.257962 | orchestrator | TASK [Get volume type LUKS] **************************************************** 2026-04-03 06:43:55.257975 | orchestrator | Friday 03 April 2026 06:43:17 +0000 (0:00:01.875) 0:00:01.948 ********** 2026-04-03 06:43:55.257987 | orchestrator | ok: [localhost] 2026-04-03 06:43:55.257998 | orchestrator | 2026-04-03 06:43:55.258011 | orchestrator | TASK [Create volume type LUKS] ************************************************* 2026-04-03 06:43:55.258070 | orchestrator | Friday 03 April 2026 06:43:24 +0000 (0:00:07.065) 0:00:09.014 ********** 2026-04-03 06:43:55.258083 | orchestrator | changed: [localhost] 2026-04-03 06:43:55.258096 | orchestrator | 2026-04-03 06:43:55.258107 | orchestrator | TASK [Create public network] *************************************************** 2026-04-03 06:43:55.258120 | orchestrator | Friday 03 April 2026 06:43:31 +0000 (0:00:06.423) 0:00:15.437 ********** 2026-04-03 06:43:55.258133 | orchestrator | changed: [localhost] 2026-04-03 06:43:55.258145 | orchestrator | 2026-04-03 06:43:55.258157 | orchestrator | TASK [Set public network to default] ******************************************* 2026-04-03 06:43:55.258169 | orchestrator | Friday 03 April 2026 06:43:36 +0000 (0:00:05.291) 0:00:20.729 ********** 2026-04-03 06:43:55.258185 | orchestrator | changed: [localhost] 2026-04-03 06:43:55.258198 | orchestrator | 2026-04-03 06:43:55.258210 | orchestrator | TASK [Create public subnet] **************************************************** 2026-04-03 06:43:55.258222 | orchestrator | Friday 03 April 2026 06:43:43 +0000 (0:00:06.565) 0:00:27.295 ********** 2026-04-03 06:43:55.258234 | orchestrator | changed: [localhost] 2026-04-03 06:43:55.258245 | orchestrator | 2026-04-03 06:43:55.258257 | orchestrator | TASK [Create default IPv4 subnet pool] ***************************************** 2026-04-03 06:43:55.258269 | orchestrator | Friday 03 April 2026 06:43:47 +0000 (0:00:04.301) 0:00:31.596 ********** 2026-04-03 06:43:55.258281 | orchestrator | changed: [localhost] 2026-04-03 06:43:55.258293 | orchestrator | 2026-04-03 06:43:55.258304 | orchestrator | TASK [Create manager role] ***************************************************** 2026-04-03 06:43:55.258324 | orchestrator | Friday 03 April 2026 06:43:51 +0000 (0:00:03.815) 0:00:35.411 ********** 2026-04-03 06:43:55.258337 | orchestrator | ok: [localhost] 2026-04-03 06:43:55.258350 | orchestrator | 2026-04-03 06:43:55.258362 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:43:55.258375 | orchestrator | localhost : ok=8  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 06:43:55.258388 | orchestrator | 2026-04-03 06:43:55.258401 | orchestrator | 2026-04-03 06:43:55.258414 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:43:55.258424 | orchestrator | Friday 03 April 2026 06:43:54 +0000 (0:00:03.615) 0:00:39.027 ********** 2026-04-03 06:43:55.258436 | orchestrator | =============================================================================== 2026-04-03 06:43:55.258449 | orchestrator | Get volume type LUKS ---------------------------------------------------- 7.07s 2026-04-03 06:43:55.258481 | orchestrator | Set public network to default ------------------------------------------- 6.57s 2026-04-03 06:43:55.258493 | orchestrator | Create volume type LUKS ------------------------------------------------- 6.42s 2026-04-03 06:43:55.258506 | orchestrator | Create public network --------------------------------------------------- 5.29s 2026-04-03 06:43:55.258544 | orchestrator | Create public subnet ---------------------------------------------------- 4.30s 2026-04-03 06:43:55.258558 | orchestrator | Create default IPv4 subnet pool ----------------------------------------- 3.82s 2026-04-03 06:43:55.258571 | orchestrator | Create manager role ----------------------------------------------------- 3.62s 2026-04-03 06:43:55.258583 | orchestrator | Gathering Facts --------------------------------------------------------- 1.88s 2026-04-03 06:43:57.685203 | orchestrator | 2026-04-03 06:43:57 | INFO  | It takes a moment until task 42457a78-2353-4fde-9b71-4ef4b2600c15 (image-manager) has been started and output is visible here. 2026-04-03 06:44:40.090997 | orchestrator | 2026-04-03 06:44:00 | INFO  | Processing image 'Cirros 0.6.2' 2026-04-03 06:44:40.091092 | orchestrator | 2026-04-03 06:44:00 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img: 302 2026-04-03 06:44:40.091105 | orchestrator | 2026-04-03 06:44:00 | INFO  | Importing image Cirros 0.6.2 2026-04-03 06:44:40.091113 | orchestrator | 2026-04-03 06:44:00 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-03 06:44:40.091122 | orchestrator | 2026-04-03 06:44:02 | INFO  | Waiting for image to leave queued state... 2026-04-03 06:44:40.091131 | orchestrator | 2026-04-03 06:44:04 | INFO  | Waiting for import to complete... 2026-04-03 06:44:40.091138 | orchestrator | 2026-04-03 06:44:15 | INFO  | Import of 'Cirros 0.6.2' successfully completed, reloading images 2026-04-03 06:44:40.091147 | orchestrator | 2026-04-03 06:44:15 | INFO  | Checking parameters of 'Cirros 0.6.2' 2026-04-03 06:44:40.091154 | orchestrator | 2026-04-03 06:44:15 | INFO  | Setting internal_version = 0.6.2 2026-04-03 06:44:40.091162 | orchestrator | 2026-04-03 06:44:15 | INFO  | Setting image_original_user = cirros 2026-04-03 06:44:40.091170 | orchestrator | 2026-04-03 06:44:15 | INFO  | Adding tag os:cirros 2026-04-03 06:44:40.091177 | orchestrator | 2026-04-03 06:44:15 | INFO  | Setting property architecture: x86_64 2026-04-03 06:44:40.091184 | orchestrator | 2026-04-03 06:44:15 | INFO  | Setting property hw_disk_bus: scsi 2026-04-03 06:44:40.091191 | orchestrator | 2026-04-03 06:44:16 | INFO  | Setting property hw_rng_model: virtio 2026-04-03 06:44:40.091199 | orchestrator | 2026-04-03 06:44:16 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-03 06:44:40.091206 | orchestrator | 2026-04-03 06:44:16 | INFO  | Setting property hw_watchdog_action: reset 2026-04-03 06:44:40.091214 | orchestrator | 2026-04-03 06:44:16 | INFO  | Setting property hypervisor_type: qemu 2026-04-03 06:44:40.091221 | orchestrator | 2026-04-03 06:44:17 | INFO  | Setting property os_distro: cirros 2026-04-03 06:44:40.091228 | orchestrator | 2026-04-03 06:44:17 | INFO  | Setting property os_purpose: minimal 2026-04-03 06:44:40.091235 | orchestrator | 2026-04-03 06:44:17 | INFO  | Setting property replace_frequency: never 2026-04-03 06:44:40.091243 | orchestrator | 2026-04-03 06:44:17 | INFO  | Setting property uuid_validity: none 2026-04-03 06:44:40.091250 | orchestrator | 2026-04-03 06:44:17 | INFO  | Setting property provided_until: none 2026-04-03 06:44:40.091257 | orchestrator | 2026-04-03 06:44:18 | INFO  | Setting property image_description: Cirros 2026-04-03 06:44:40.091264 | orchestrator | 2026-04-03 06:44:18 | INFO  | Setting property image_name: Cirros 2026-04-03 06:44:40.091272 | orchestrator | 2026-04-03 06:44:18 | INFO  | Setting property internal_version: 0.6.2 2026-04-03 06:44:40.091279 | orchestrator | 2026-04-03 06:44:18 | INFO  | Setting property image_original_user: cirros 2026-04-03 06:44:40.091308 | orchestrator | 2026-04-03 06:44:19 | INFO  | Setting property os_version: 0.6.2 2026-04-03 06:44:40.091324 | orchestrator | 2026-04-03 06:44:19 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-03 06:44:40.091333 | orchestrator | 2026-04-03 06:44:19 | INFO  | Setting property image_build_date: 2023-05-30 2026-04-03 06:44:40.091340 | orchestrator | 2026-04-03 06:44:19 | INFO  | Checking status of 'Cirros 0.6.2' 2026-04-03 06:44:40.091348 | orchestrator | 2026-04-03 06:44:19 | INFO  | Checking visibility of 'Cirros 0.6.2' 2026-04-03 06:44:40.091355 | orchestrator | 2026-04-03 06:44:19 | INFO  | Setting visibility of 'Cirros 0.6.2' to 'public' 2026-04-03 06:44:40.091362 | orchestrator | 2026-04-03 06:44:20 | INFO  | Processing image 'Cirros 0.6.3' 2026-04-03 06:44:40.091373 | orchestrator | 2026-04-03 06:44:20 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img: 302 2026-04-03 06:44:40.091381 | orchestrator | 2026-04-03 06:44:20 | INFO  | Importing image Cirros 0.6.3 2026-04-03 06:44:40.091388 | orchestrator | 2026-04-03 06:44:20 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-03 06:44:40.091395 | orchestrator | 2026-04-03 06:44:21 | INFO  | Waiting for image to leave queued state... 2026-04-03 06:44:40.091402 | orchestrator | 2026-04-03 06:44:23 | INFO  | Waiting for import to complete... 2026-04-03 06:44:40.091424 | orchestrator | 2026-04-03 06:44:34 | INFO  | Import of 'Cirros 0.6.3' successfully completed, reloading images 2026-04-03 06:44:40.091432 | orchestrator | 2026-04-03 06:44:34 | INFO  | Checking parameters of 'Cirros 0.6.3' 2026-04-03 06:44:40.091439 | orchestrator | 2026-04-03 06:44:34 | INFO  | Setting internal_version = 0.6.3 2026-04-03 06:44:40.091446 | orchestrator | 2026-04-03 06:44:34 | INFO  | Setting image_original_user = cirros 2026-04-03 06:44:40.091453 | orchestrator | 2026-04-03 06:44:34 | INFO  | Adding tag os:cirros 2026-04-03 06:44:40.091460 | orchestrator | 2026-04-03 06:44:34 | INFO  | Setting property architecture: x86_64 2026-04-03 06:44:40.091507 | orchestrator | 2026-04-03 06:44:34 | INFO  | Setting property hw_disk_bus: scsi 2026-04-03 06:44:40.091517 | orchestrator | 2026-04-03 06:44:35 | INFO  | Setting property hw_rng_model: virtio 2026-04-03 06:44:40.091525 | orchestrator | 2026-04-03 06:44:35 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-03 06:44:40.091533 | orchestrator | 2026-04-03 06:44:35 | INFO  | Setting property hw_watchdog_action: reset 2026-04-03 06:44:40.091541 | orchestrator | 2026-04-03 06:44:35 | INFO  | Setting property hypervisor_type: qemu 2026-04-03 06:44:40.091549 | orchestrator | 2026-04-03 06:44:35 | INFO  | Setting property os_distro: cirros 2026-04-03 06:44:40.091557 | orchestrator | 2026-04-03 06:44:36 | INFO  | Setting property os_purpose: minimal 2026-04-03 06:44:40.091565 | orchestrator | 2026-04-03 06:44:36 | INFO  | Setting property replace_frequency: never 2026-04-03 06:44:40.091573 | orchestrator | 2026-04-03 06:44:36 | INFO  | Setting property uuid_validity: none 2026-04-03 06:44:40.091581 | orchestrator | 2026-04-03 06:44:36 | INFO  | Setting property provided_until: none 2026-04-03 06:44:40.091589 | orchestrator | 2026-04-03 06:44:37 | INFO  | Setting property image_description: Cirros 2026-04-03 06:44:40.091597 | orchestrator | 2026-04-03 06:44:37 | INFO  | Setting property image_name: Cirros 2026-04-03 06:44:40.091606 | orchestrator | 2026-04-03 06:44:37 | INFO  | Setting property internal_version: 0.6.3 2026-04-03 06:44:40.091620 | orchestrator | 2026-04-03 06:44:37 | INFO  | Setting property image_original_user: cirros 2026-04-03 06:44:40.091628 | orchestrator | 2026-04-03 06:44:38 | INFO  | Setting property os_version: 0.6.3 2026-04-03 06:44:40.091636 | orchestrator | 2026-04-03 06:44:38 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-03 06:44:40.091644 | orchestrator | 2026-04-03 06:44:38 | INFO  | Setting property image_build_date: 2024-09-26 2026-04-03 06:44:40.091651 | orchestrator | 2026-04-03 06:44:38 | INFO  | Checking status of 'Cirros 0.6.3' 2026-04-03 06:44:40.091659 | orchestrator | 2026-04-03 06:44:38 | INFO  | Checking visibility of 'Cirros 0.6.3' 2026-04-03 06:44:40.091667 | orchestrator | 2026-04-03 06:44:38 | INFO  | Setting visibility of 'Cirros 0.6.3' to 'public' 2026-04-03 06:44:40.457826 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/301-openstack-octavia-amhpora-image.sh 2026-04-03 06:44:42.694792 | orchestrator | 2026-04-03 06:44:42 | INFO  | date: 2026-04-03 2026-04-03 06:44:42.694888 | orchestrator | 2026-04-03 06:44:42 | INFO  | image: octavia-amphora-haproxy-2024.2.20260403.qcow2 2026-04-03 06:44:42.694926 | orchestrator | 2026-04-03 06:44:42 | INFO  | url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260403.qcow2 2026-04-03 06:44:42.694940 | orchestrator | 2026-04-03 06:44:42 | INFO  | checksum_url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260403.qcow2.CHECKSUM 2026-04-03 06:44:42.880417 | orchestrator | 2026-04-03 06:44:42 | INFO  | checksum: 9296772343c1db2698e624621b60df9166f030ac326c14002db992c2b8a03de2 2026-04-03 06:44:42.957415 | orchestrator | 2026-04-03 06:44:42 | INFO  | It takes a moment until task fe51d404-7fdb-4de2-a68f-4cfa473007ef (image-manager) has been started and output is visible here. 2026-04-03 06:45:55.520060 | orchestrator | 2026-04-03 06:44:45 | INFO  | Processing image 'OpenStack Octavia Amphora 2026-04-03' 2026-04-03 06:45:55.520181 | orchestrator | 2026-04-03 06:44:45 | INFO  | Tested URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260403.qcow2: 200 2026-04-03 06:45:55.520199 | orchestrator | 2026-04-03 06:44:45 | INFO  | Importing image OpenStack Octavia Amphora 2026-04-03 2026-04-03 06:45:55.520211 | orchestrator | 2026-04-03 06:44:45 | INFO  | Importing from URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260403.qcow2 2026-04-03 06:45:55.520224 | orchestrator | 2026-04-03 06:44:46 | INFO  | Waiting for image to leave queued state... 2026-04-03 06:45:55.520236 | orchestrator | 2026-04-03 06:44:48 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520256 | orchestrator | 2026-04-03 06:44:58 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520268 | orchestrator | 2026-04-03 06:45:09 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520278 | orchestrator | 2026-04-03 06:45:19 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520292 | orchestrator | 2026-04-03 06:45:29 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520322 | orchestrator | 2026-04-03 06:45:39 | INFO  | Waiting for import to complete... 2026-04-03 06:45:55.520345 | orchestrator | 2026-04-03 06:45:49 | INFO  | Import of 'OpenStack Octavia Amphora 2026-04-03' successfully completed, reloading images 2026-04-03 06:45:55.520358 | orchestrator | 2026-04-03 06:45:50 | INFO  | Checking parameters of 'OpenStack Octavia Amphora 2026-04-03' 2026-04-03 06:45:55.520399 | orchestrator | 2026-04-03 06:45:50 | INFO  | Setting internal_version = 2026-04-03 2026-04-03 06:45:55.520411 | orchestrator | 2026-04-03 06:45:50 | INFO  | Setting image_original_user = ubuntu 2026-04-03 06:45:55.520423 | orchestrator | 2026-04-03 06:45:50 | INFO  | Adding tag amphora 2026-04-03 06:45:55.520433 | orchestrator | 2026-04-03 06:45:50 | INFO  | Adding tag os:ubuntu 2026-04-03 06:45:55.520444 | orchestrator | 2026-04-03 06:45:50 | INFO  | Setting property architecture: x86_64 2026-04-03 06:45:55.520455 | orchestrator | 2026-04-03 06:45:50 | INFO  | Setting property hw_disk_bus: scsi 2026-04-03 06:45:55.520466 | orchestrator | 2026-04-03 06:45:51 | INFO  | Setting property hw_rng_model: virtio 2026-04-03 06:45:55.520477 | orchestrator | 2026-04-03 06:45:51 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-03 06:45:55.520521 | orchestrator | 2026-04-03 06:45:51 | INFO  | Setting property hw_watchdog_action: reset 2026-04-03 06:45:55.520541 | orchestrator | 2026-04-03 06:45:51 | INFO  | Setting property hypervisor_type: qemu 2026-04-03 06:45:55.520560 | orchestrator | 2026-04-03 06:45:52 | INFO  | Setting property os_distro: ubuntu 2026-04-03 06:45:55.520580 | orchestrator | 2026-04-03 06:45:52 | INFO  | Setting property replace_frequency: quarterly 2026-04-03 06:45:55.520595 | orchestrator | 2026-04-03 06:45:52 | INFO  | Setting property uuid_validity: last-1 2026-04-03 06:45:55.520608 | orchestrator | 2026-04-03 06:45:52 | INFO  | Setting property provided_until: none 2026-04-03 06:45:55.520621 | orchestrator | 2026-04-03 06:45:53 | INFO  | Setting property os_purpose: network 2026-04-03 06:45:55.520649 | orchestrator | 2026-04-03 06:45:53 | INFO  | Setting property image_description: OpenStack Octavia Amphora 2026-04-03 06:45:55.520662 | orchestrator | 2026-04-03 06:45:53 | INFO  | Setting property image_name: OpenStack Octavia Amphora 2026-04-03 06:45:55.520676 | orchestrator | 2026-04-03 06:45:53 | INFO  | Setting property internal_version: 2026-04-03 2026-04-03 06:45:55.520688 | orchestrator | 2026-04-03 06:45:54 | INFO  | Setting property image_original_user: ubuntu 2026-04-03 06:45:55.520701 | orchestrator | 2026-04-03 06:45:54 | INFO  | Setting property os_version: 2026-04-03 2026-04-03 06:45:55.520714 | orchestrator | 2026-04-03 06:45:54 | INFO  | Setting property image_source: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260403.qcow2 2026-04-03 06:45:55.520727 | orchestrator | 2026-04-03 06:45:54 | INFO  | Setting property image_build_date: 2026-04-03 2026-04-03 06:45:55.520739 | orchestrator | 2026-04-03 06:45:55 | INFO  | Checking status of 'OpenStack Octavia Amphora 2026-04-03' 2026-04-03 06:45:55.520752 | orchestrator | 2026-04-03 06:45:55 | INFO  | Checking visibility of 'OpenStack Octavia Amphora 2026-04-03' 2026-04-03 06:45:55.520784 | orchestrator | 2026-04-03 06:45:55 | INFO  | Processing image 'Cirros 0.6.3' (removal candidate) 2026-04-03 06:45:55.520798 | orchestrator | 2026-04-03 06:45:55 | WARNING  | No image definition found for 'Cirros 0.6.3', image will be ignored 2026-04-03 06:45:55.520812 | orchestrator | 2026-04-03 06:45:55 | INFO  | Processing image 'Cirros 0.6.2' (removal candidate) 2026-04-03 06:45:55.520825 | orchestrator | 2026-04-03 06:45:55 | WARNING  | No image definition found for 'Cirros 0.6.2', image will be ignored 2026-04-03 06:45:55.895021 | orchestrator | ok: Runtime: 0:03:06.821690 2026-04-03 06:45:55.909122 | 2026-04-03 06:45:55.909248 | TASK [Run checks] 2026-04-03 06:45:56.674966 | orchestrator | + set -e 2026-04-03 06:45:56.675209 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 06:45:56.675247 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 06:45:56.675281 | orchestrator | ++ INTERACTIVE=false 2026-04-03 06:45:56.675304 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 06:45:56.675325 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 06:45:56.675365 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 06:45:56.676357 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:45:56.683000 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:45:56.683032 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:45:56.683040 | orchestrator | + echo 2026-04-03 06:45:56.683191 | orchestrator | 2026-04-03 06:45:56.683207 | orchestrator | # CHECK 2026-04-03 06:45:56.683236 | orchestrator | 2026-04-03 06:45:56.683254 | orchestrator | + echo '# CHECK' 2026-04-03 06:45:56.683263 | orchestrator | + echo 2026-04-03 06:45:56.683318 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 06:45:56.684320 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-03 06:45:56.744480 | orchestrator | 2026-04-03 06:45:56.744596 | orchestrator | ## Containers @ testbed-manager 2026-04-03 06:45:56.744610 | orchestrator | 2026-04-03 06:45:56.744621 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 06:45:56.744630 | orchestrator | + echo 2026-04-03 06:45:56.744640 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-03 06:45:56.744650 | orchestrator | + echo 2026-04-03 06:45:56.744659 | orchestrator | + osism container testbed-manager ps 2026-04-03 06:45:58.682946 | orchestrator | 2026-04-03 06:45:58 | INFO  | Creating empty known_hosts file: /share/known_hosts 2026-04-03 06:45:59.064769 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 06:45:59.064930 | orchestrator | 5688413d5ecb registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130 "dumb-init --single-…" 8 minutes ago Up 8 minutes prometheus_blackbox_exporter 2026-04-03 06:45:59.064970 | orchestrator | df17d5b56c52 registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130 "dumb-init --single-…" 9 minutes ago Up 8 minutes prometheus_alertmanager 2026-04-03 06:45:59.064991 | orchestrator | f05b831c0125 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-03 06:45:59.065010 | orchestrator | 1a5cc1c9ef73 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_node_exporter 2026-04-03 06:45:59.065031 | orchestrator | 5503fe96346f registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_server 2026-04-03 06:45:59.065055 | orchestrator | ab510183c934 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" 56 minutes ago Up 56 minutes cephclient 2026-04-03 06:45:59.065077 | orchestrator | b5a08a061657 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-03 06:45:59.065097 | orchestrator | 48c0e4d8974a registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-03 06:45:59.065175 | orchestrator | ae64acdca76a registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-03 06:45:59.065198 | orchestrator | 7cf9c44df7dd registry.osism.tech/osism/openstackclient:2024.2 "/usr/bin/dumb-init …" 2 hours ago Up 2 hours openstackclient 2026-04-03 06:45:59.065219 | orchestrator | 9eac53bd51e9 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 2 hours ago Up 2 hours (healthy) 80/tcp phpmyadmin 2026-04-03 06:45:59.065239 | orchestrator | f1425466f2eb registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 2 hours ago Up 2 hours (healthy) 8080/tcp homer 2026-04-03 06:45:59.065258 | orchestrator | 397c59606551 registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 2 hours ago Up 2 hours 80/tcp cgit 2026-04-03 06:45:59.065277 | orchestrator | 663e8b30f5b5 registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-03 06:45:59.065297 | orchestrator | 57ee8df96b64 registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" 2 hours ago Up 2 hours (healthy) manager-inventory_reconciler-1 2026-04-03 06:45:59.065330 | orchestrator | d89158b4d4ab registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) ceph-ansible 2026-04-03 06:45:59.065343 | orchestrator | 16e7e59342b6 registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) kolla-ansible 2026-04-03 06:45:59.065355 | orchestrator | 0209463838c8 registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-kubernetes 2026-04-03 06:45:59.065366 | orchestrator | 973bed7c80af registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-ansible 2026-04-03 06:45:59.065377 | orchestrator | 77c585af9f52 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 2 hours ago Up 2 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-03 06:45:59.065389 | orchestrator | ac50025e6218 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-flower-1 2026-04-03 06:45:59.065400 | orchestrator | 2e60786e6547 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" 2 hours ago Up 2 hours (healthy) osismclient 2026-04-03 06:45:59.065422 | orchestrator | 398ac56990e6 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-03 06:45:59.065433 | orchestrator | f9697c0afa26 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-03 06:45:59.065458 | orchestrator | c83d41b79fd2 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-openstack-1 2026-04-03 06:45:59.065470 | orchestrator | 93cc39652a58 registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" 2 hours ago Up 2 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-03 06:45:59.065481 | orchestrator | 8c50f9b6b789 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 6379/tcp manager-redis-1 2026-04-03 06:45:59.065525 | orchestrator | da714f098edf registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-beat-1 2026-04-03 06:45:59.065536 | orchestrator | 9db7f9d0a614 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-listener-1 2026-04-03 06:45:59.065557 | orchestrator | f2bc5fd89ede registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-03 06:45:59.377575 | orchestrator | 2026-04-03 06:45:59.377696 | orchestrator | ## Images @ testbed-manager 2026-04-03 06:45:59.377715 | orchestrator | 2026-04-03 06:45:59.377728 | orchestrator | + echo 2026-04-03 06:45:59.377740 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-03 06:45:59.377752 | orchestrator | + echo 2026-04-03 06:45:59.377767 | orchestrator | + osism container testbed-manager images 2026-04-03 06:46:01.772137 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 06:46:01.772239 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 cd42573b3301 3 hours ago 239MB 2026-04-03 06:46:01.772252 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 2 months ago 41.4MB 2026-04-03 06:46:01.772258 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-03 06:46:01.772263 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-03 06:46:01.772268 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 06:46:01.772273 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 06:46:01.772278 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 06:46:01.772284 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-03 06:46:01.772289 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 06:46:01.772313 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-03 06:46:01.772318 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-03 06:46:01.772323 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 06:46:01.772327 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-03 06:46:01.772332 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-03 06:46:01.772337 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-03 06:46:01.772341 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-03 06:46:01.772346 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-03 06:46:01.772351 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-03 06:46:01.772355 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 4 months ago 334MB 2026-04-03 06:46:01.772360 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 5 months ago 742MB 2026-04-03 06:46:01.772365 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 7 months ago 275MB 2026-04-03 06:46:01.772369 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 8 months ago 226MB 2026-04-03 06:46:01.772374 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 10 months ago 453MB 2026-04-03 06:46:01.772378 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-03 06:46:01.772383 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-03 06:46:02.117270 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 06:46:02.117456 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-03 06:46:02.170668 | orchestrator | 2026-04-03 06:46:02.170762 | orchestrator | ## Containers @ testbed-node-0 2026-04-03 06:46:02.170775 | orchestrator | 2026-04-03 06:46:02.170784 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 06:46:02.170794 | orchestrator | + echo 2026-04-03 06:46:02.170803 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-03 06:46:02.170813 | orchestrator | + echo 2026-04-03 06:46:02.170822 | orchestrator | + osism container testbed-node-0 ps 2026-04-03 06:46:04.590669 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 06:46:04.590776 | orchestrator | 29794ebfd91c registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-03 06:46:04.590815 | orchestrator | e7eea4c84583 registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-03 06:46:04.590828 | orchestrator | 77507e886e1a registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 7 minutes ago Up 7 minutes grafana 2026-04-03 06:46:04.590840 | orchestrator | 4718db98eb7d registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 8 minutes prometheus_elasticsearch_exporter 2026-04-03 06:46:04.590877 | orchestrator | 607dc5f996e0 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-03 06:46:04.590888 | orchestrator | 0ff363ff3893 registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_memcached_exporter 2026-04-03 06:46:04.590906 | orchestrator | 68f4eb4d7d4d registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_mysqld_exporter 2026-04-03 06:46:04.590918 | orchestrator | f4d5a737835b registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_node_exporter 2026-04-03 06:46:04.590929 | orchestrator | e1343031d925 registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_share 2026-04-03 06:46:04.590941 | orchestrator | 42ad1a5c50fb registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-03 06:46:04.590952 | orchestrator | 2a385e5f64c9 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-03 06:46:04.590963 | orchestrator | f265246f5820 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-03 06:46:04.590974 | orchestrator | 8ab0c7322ce9 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-03 06:46:04.590985 | orchestrator | b09b3515c308 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-03 06:46:04.590995 | orchestrator | a1f85cb3ba29 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_evaluator 2026-04-03 06:46:04.591006 | orchestrator | f2092081c24e registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_api 2026-04-03 06:46:04.591017 | orchestrator | 86754f25cf30 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-03 06:46:04.591028 | orchestrator | 323a0ad610ab registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-03 06:46:04.591039 | orchestrator | bb7bcf64ab8b registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) octavia_worker 2026-04-03 06:46:04.591074 | orchestrator | fb3d856633a3 registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) octavia_housekeeping 2026-04-03 06:46:04.591087 | orchestrator | 8a8c13e2459e registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-03 06:46:04.591098 | orchestrator | 15a12a072a26 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-03 06:46:04.591116 | orchestrator | 1524ad8beb66 registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-03 06:46:04.591127 | orchestrator | fd7299ef2061 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-03 06:46:04.591138 | orchestrator | 28185a0a7a4b registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_mdns 2026-04-03 06:46:04.591153 | orchestrator | c4b5a2c91aba registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_producer 2026-04-03 06:46:04.591165 | orchestrator | d2796f2de652 registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_central 2026-04-03 06:46:04.591176 | orchestrator | 74efc5827f80 registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-03 06:46:04.591187 | orchestrator | fbce73067a4b registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 06:46:04.591198 | orchestrator | 98ac72de2de6 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 06:46:04.591209 | orchestrator | d88c5b5d06a4 registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 06:46:04.591220 | orchestrator | c4a81f9b3431 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 06:46:04.591231 | orchestrator | 7a5ef734bb66 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-03 06:46:04.591242 | orchestrator | 13075dba817f registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-03 06:46:04.591253 | orchestrator | 77e1b1df76c4 registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-03 06:46:04.591264 | orchestrator | e8c944b41ceb registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_api 2026-04-03 06:46:04.591275 | orchestrator | 9092d005225a registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) glance_api 2026-04-03 06:46:04.591286 | orchestrator | bee952f31d5a registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-03 06:46:04.591297 | orchestrator | 038222a5f4a3 registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-03 06:46:04.591315 | orchestrator | 59bddb35cf1c registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 36 minutes ago Up 36 minutes (healthy) horizon 2026-04-03 06:46:04.591333 | orchestrator | 3263e837179b registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-03 06:46:04.591345 | orchestrator | 9e9c54e2d714 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-03 06:46:04.591362 | orchestrator | f9390548ade9 registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-03 06:46:04.591381 | orchestrator | 9eb8ba2dde12 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) nova_scheduler 2026-04-03 06:46:04.591401 | orchestrator | a258cacffcbc registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-03 06:46:04.591419 | orchestrator | 7bb5c95b6d1c registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 50 minutes ago Up 50 minutes (healthy) placement_api 2026-04-03 06:46:04.591438 | orchestrator | d4fa4a3b2ed3 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 52 minutes ago Up 52 minutes (healthy) keystone 2026-04-03 06:46:04.591451 | orchestrator | 547166fc1278 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 52 minutes (healthy) keystone_fernet 2026-04-03 06:46:04.591462 | orchestrator | 18203c90ed4a registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_ssh 2026-04-03 06:46:04.591473 | orchestrator | 27249f9eec5d registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-0 2026-04-03 06:46:04.591484 | orchestrator | 6f67e1a48c2f registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-03 06:46:04.591527 | orchestrator | 190174266bca registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-0 2026-04-03 06:46:04.591538 | orchestrator | 1045f329724b registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-03 06:46:04.591549 | orchestrator | 53147f131d53 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-03 06:46:04.591560 | orchestrator | 5293c02ada27 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-03 06:46:04.591571 | orchestrator | b87c94e46a39 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-03 06:46:04.591588 | orchestrator | 4d96e03c2bb4 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-03 06:46:04.591599 | orchestrator | 6f560ff336f1 registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-03 06:46:04.591617 | orchestrator | 7519645f02c5 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-03 06:46:04.591636 | orchestrator | 1ef3c6582aa4 registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-03 06:46:04.591647 | orchestrator | 170f0e698f97 registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-03 06:46:04.591658 | orchestrator | b0c4834d094a registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-03 06:46:04.591669 | orchestrator | f24f8475fcdd registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-03 06:46:04.591680 | orchestrator | 6566e17e14fa registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-03 06:46:04.591691 | orchestrator | 1774fc8b90e6 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-03 06:46:04.591702 | orchestrator | 7901798ac231 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-03 06:46:04.591713 | orchestrator | 69e00bef6011 registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-03 06:46:04.591724 | orchestrator | 145df7e2c20a registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) haproxy 2026-04-03 06:46:04.591735 | orchestrator | 04262355e1e8 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-03 06:46:04.591746 | orchestrator | 91407821d61b registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-03 06:46:04.591757 | orchestrator | 128b67b50316 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-03 06:46:04.902005 | orchestrator | 2026-04-03 06:46:04.902156 | orchestrator | ## Images @ testbed-node-0 2026-04-03 06:46:04.902174 | orchestrator | 2026-04-03 06:46:04.902187 | orchestrator | + echo 2026-04-03 06:46:04.902199 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-03 06:46:04.902212 | orchestrator | + echo 2026-04-03 06:46:04.902223 | orchestrator | + osism container testbed-node-0 images 2026-04-03 06:46:07.388065 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 06:46:07.388180 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 06:46:07.388191 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 06:46:07.388200 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 06:46:07.388213 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 06:46:07.388237 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 06:46:07.388245 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 06:46:07.388253 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 06:46:07.388260 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 06:46:07.388267 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 06:46:07.388275 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 06:46:07.388282 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 06:46:07.388289 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 06:46:07.388296 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 06:46:07.388303 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 06:46:07.388311 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 06:46:07.388318 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 06:46:07.388325 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 06:46:07.388333 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 06:46:07.388340 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 06:46:07.388347 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 06:46:07.388354 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 06:46:07.388362 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 06:46:07.388369 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 06:46:07.388376 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 06:46:07.388383 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 06:46:07.388391 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 06:46:07.388398 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 06:46:07.388410 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 06:46:07.388417 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 06:46:07.388424 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 06:46:07.388437 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 06:46:07.388459 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 06:46:07.388467 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 06:46:07.388475 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 06:46:07.388482 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 06:46:07.388515 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 06:46:07.388523 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 06:46:07.388530 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 06:46:07.388537 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 06:46:07.388545 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 06:46:07.388552 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 06:46:07.388559 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 06:46:07.388566 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 06:46:07.388574 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 06:46:07.388581 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 06:46:07.388588 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 06:46:07.388596 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 06:46:07.388603 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 06:46:07.388611 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 06:46:07.388618 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 06:46:07.388625 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 06:46:07.388632 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 06:46:07.388640 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 06:46:07.388647 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 06:46:07.388654 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 06:46:07.388661 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 06:46:07.388675 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 06:46:07.388682 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 06:46:07.388693 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 06:46:07.388701 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 06:46:07.388708 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 06:46:07.388715 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 06:46:07.388723 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 06:46:07.388735 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 06:46:07.388743 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 06:46:07.388750 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 06:46:07.388757 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 06:46:07.388764 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 06:46:07.388772 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 06:46:07.707618 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 06:46:07.707736 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-03 06:46:07.759283 | orchestrator | 2026-04-03 06:46:07.759384 | orchestrator | ## Containers @ testbed-node-1 2026-04-03 06:46:07.759404 | orchestrator | 2026-04-03 06:46:07.759416 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 06:46:07.759428 | orchestrator | + echo 2026-04-03 06:46:07.759440 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-03 06:46:07.759453 | orchestrator | + echo 2026-04-03 06:46:07.759464 | orchestrator | + osism container testbed-node-1 ps 2026-04-03 06:46:10.214779 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 06:46:10.215080 | orchestrator | 9d8f62ab86b0 registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-03 06:46:10.216753 | orchestrator | a8a4e03d6415 registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-03 06:46:10.216805 | orchestrator | 7203c4745b8e registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 6 minutes ago Up 6 minutes grafana 2026-04-03 06:46:10.216827 | orchestrator | 4569a772184a registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_elasticsearch_exporter 2026-04-03 06:46:10.216849 | orchestrator | c17ba5972354 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-03 06:46:10.216868 | orchestrator | df6ff54a8d4d registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_memcached_exporter 2026-04-03 06:46:10.216922 | orchestrator | c267777c6cb3 registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_mysqld_exporter 2026-04-03 06:46:10.216942 | orchestrator | 176fbb7ca8dd registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 9 minutes prometheus_node_exporter 2026-04-03 06:46:10.216960 | orchestrator | 43af819345bd registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_share 2026-04-03 06:46:10.216979 | orchestrator | 0dcb14740e4e registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-03 06:46:10.216998 | orchestrator | bbdbfbca82c3 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-03 06:46:10.217017 | orchestrator | 73ff74eedb72 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-03 06:46:10.217057 | orchestrator | e50668d0d032 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-03 06:46:10.217077 | orchestrator | 9f40a7d18649 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-03 06:46:10.217096 | orchestrator | d7df5d8a58db registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_evaluator 2026-04-03 06:46:10.217115 | orchestrator | 83b2d0b02437 registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_api 2026-04-03 06:46:10.217134 | orchestrator | 9f0d8e58895f registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-03 06:46:10.217153 | orchestrator | 401fe1b8e927 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-03 06:46:10.217171 | orchestrator | c54fb244b7eb registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) octavia_worker 2026-04-03 06:46:10.217190 | orchestrator | ca26f906040f registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 20 minutes (healthy) octavia_housekeeping 2026-04-03 06:46:10.217208 | orchestrator | e4b5b312cf1f registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-03 06:46:10.217244 | orchestrator | 8aaec6923d16 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-03 06:46:10.217264 | orchestrator | a48a84f43304 registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-03 06:46:10.217296 | orchestrator | dabb72f118e8 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-03 06:46:10.217315 | orchestrator | 762241395e44 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_mdns 2026-04-03 06:46:10.217333 | orchestrator | 30c991a893d1 registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_producer 2026-04-03 06:46:10.217353 | orchestrator | 734a73989baa registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-03 06:46:10.217373 | orchestrator | bc220444101c registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-03 06:46:10.217392 | orchestrator | 9dac0be83398 registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 06:46:10.217411 | orchestrator | 41d0c028e4c4 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 06:46:10.217430 | orchestrator | fbb36474205e registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 06:46:10.217450 | orchestrator | fb47e1f17404 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 06:46:10.217470 | orchestrator | d179ae1019be registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-03 06:46:10.217515 | orchestrator | 5699dbc1144b registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-03 06:46:10.217535 | orchestrator | 8a992e4cc813 registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-03 06:46:10.217554 | orchestrator | de91e79932f7 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_api 2026-04-03 06:46:10.217575 | orchestrator | 68ffae127533 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) glance_api 2026-04-03 06:46:10.217602 | orchestrator | 686dd28e03f7 registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-03 06:46:10.217622 | orchestrator | ba9b6949c535 registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-03 06:46:10.217641 | orchestrator | 4f82099bf8dc registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 36 minutes ago Up 36 minutes (healthy) horizon 2026-04-03 06:46:10.217660 | orchestrator | e20b4d0bf37f registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-03 06:46:10.217690 | orchestrator | f13db146e5f4 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-03 06:46:10.217721 | orchestrator | 8ac04f0984ac registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-03 06:46:10.217740 | orchestrator | 838afe0508a0 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_scheduler 2026-04-03 06:46:10.217758 | orchestrator | 46c68cb6d6ad registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-03 06:46:10.217777 | orchestrator | f5879be95be5 registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 50 minutes ago Up 50 minutes (healthy) placement_api 2026-04-03 06:46:10.217798 | orchestrator | b0c981088023 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 52 minutes ago Up 52 minutes (healthy) keystone 2026-04-03 06:46:10.217817 | orchestrator | 9ad58449d714 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_fernet 2026-04-03 06:46:10.217835 | orchestrator | 23de5e1e65fe registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_ssh 2026-04-03 06:46:10.217854 | orchestrator | eb08c7d9de68 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-1 2026-04-03 06:46:10.217872 | orchestrator | 075123289c35 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-03 06:46:10.217891 | orchestrator | a19b2cd80470 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-1 2026-04-03 06:46:10.217909 | orchestrator | e5f199d3e47e registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-03 06:46:10.217928 | orchestrator | 2bebf773ac28 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-03 06:46:10.217947 | orchestrator | 117a1fc04157 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-03 06:46:10.217966 | orchestrator | 242c5b4576e9 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-03 06:46:10.217984 | orchestrator | a30cb8f806c8 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-03 06:46:10.218002 | orchestrator | 5837610c2552 registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-03 06:46:10.218098 | orchestrator | 5acdc4a5ee32 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-03 06:46:10.218136 | orchestrator | 9c9116067f83 registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-03 06:46:10.218155 | orchestrator | b8b745825477 registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-03 06:46:10.218174 | orchestrator | 0a8683ca0d68 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-03 06:46:10.218206 | orchestrator | 3e5658f638d2 registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-03 06:46:10.218226 | orchestrator | 93ee7051a985 registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-03 06:46:10.218245 | orchestrator | d5952486e245 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-03 06:46:10.218273 | orchestrator | 046c032e87a4 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-03 06:46:10.218294 | orchestrator | 47cc35049bff registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-03 06:46:10.218314 | orchestrator | 5c46c1ff7a7a registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) haproxy 2026-04-03 06:46:10.218333 | orchestrator | 645b94e78d1f registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-03 06:46:10.218359 | orchestrator | f6f87ab2ee0d registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-03 06:46:10.218379 | orchestrator | 641304b5304e registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-03 06:46:10.579110 | orchestrator | 2026-04-03 06:46:10.579220 | orchestrator | ## Images @ testbed-node-1 2026-04-03 06:46:10.579236 | orchestrator | 2026-04-03 06:46:10.579248 | orchestrator | + echo 2026-04-03 06:46:10.579260 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-03 06:46:10.579272 | orchestrator | + echo 2026-04-03 06:46:10.579283 | orchestrator | + osism container testbed-node-1 images 2026-04-03 06:46:13.004031 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 06:46:13.004127 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 06:46:13.004139 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 06:46:13.004149 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 06:46:13.004159 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 06:46:13.004169 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 06:46:13.004205 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 06:46:13.004214 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 06:46:13.004223 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 06:46:13.004232 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 06:46:13.004241 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 06:46:13.004249 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 06:46:13.004261 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 06:46:13.004275 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 06:46:13.004290 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 06:46:13.004305 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 06:46:13.004320 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 06:46:13.004335 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 06:46:13.004350 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 06:46:13.004364 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 06:46:13.004380 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 06:46:13.004395 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 06:46:13.004410 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 06:46:13.004425 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 06:46:13.004440 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 06:46:13.004456 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 06:46:13.004469 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 06:46:13.004478 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 06:46:13.004542 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 06:46:13.004553 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 06:46:13.004562 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 06:46:13.004571 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 06:46:13.004601 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 06:46:13.004622 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 06:46:13.004633 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 06:46:13.004644 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 06:46:13.004655 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 06:46:13.004665 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 06:46:13.004675 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 06:46:13.004686 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 06:46:13.004712 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 06:46:13.004723 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 06:46:13.004733 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 06:46:13.004743 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 06:46:13.004753 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 06:46:13.004763 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 06:46:13.004773 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 06:46:13.004784 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 06:46:13.004794 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 06:46:13.004805 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 06:46:13.004815 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 06:46:13.004825 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 06:46:13.004836 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 06:46:13.004846 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 06:46:13.004856 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 06:46:13.004867 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 06:46:13.004877 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 06:46:13.004887 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 06:46:13.004899 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 06:46:13.004915 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 06:46:13.004929 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 06:46:13.004940 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 06:46:13.004951 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 06:46:13.004961 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 06:46:13.004977 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 06:46:13.004987 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 06:46:13.004996 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 06:46:13.005004 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 06:46:13.005013 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 06:46:13.005022 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 06:46:13.317100 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 06:46:13.317280 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-03 06:46:13.379970 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 06:46:13.380611 | orchestrator | 2026-04-03 06:46:13.380645 | orchestrator | ## Containers @ testbed-node-2 2026-04-03 06:46:13.380659 | orchestrator | 2026-04-03 06:46:13.380674 | orchestrator | + echo 2026-04-03 06:46:13.380686 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-03 06:46:13.380698 | orchestrator | + echo 2026-04-03 06:46:13.380709 | orchestrator | + osism container testbed-node-2 ps 2026-04-03 06:46:15.813322 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 06:46:15.813421 | orchestrator | 9ebd87ee035e registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-03 06:46:15.813437 | orchestrator | dc1b46b359de registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-03 06:46:15.813450 | orchestrator | 11efa6919cf0 registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 6 minutes ago Up 6 minutes grafana 2026-04-03 06:46:15.813461 | orchestrator | b9a1fbc36fa2 registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_elasticsearch_exporter 2026-04-03 06:46:15.813474 | orchestrator | 6f1b1627bb60 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-03 06:46:15.813486 | orchestrator | c222ceb0ba7c registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_memcached_exporter 2026-04-03 06:46:15.813526 | orchestrator | 237c3bde6ca3 registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_mysqld_exporter 2026-04-03 06:46:15.813563 | orchestrator | 14ab2ff31040 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-03 06:46:15.813575 | orchestrator | ed79f1a6616e registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_share 2026-04-03 06:46:15.813586 | orchestrator | e973e33c8eae registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-03 06:46:15.813597 | orchestrator | 3d4b3b89c99a registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-03 06:46:15.813608 | orchestrator | 9474e4f9802f registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-03 06:46:15.813619 | orchestrator | 0c46eb659eda registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-03 06:46:15.813631 | orchestrator | 1b46edaeb7e4 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-03 06:46:15.813661 | orchestrator | aa28a50b7ecc registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_evaluator 2026-04-03 06:46:15.813673 | orchestrator | 4e950844d87c registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_api 2026-04-03 06:46:15.813683 | orchestrator | 68dcd8f15616 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-03 06:46:15.813694 | orchestrator | f9e7a4ab0451 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-03 06:46:15.813705 | orchestrator | d430f4df52ad registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) octavia_worker 2026-04-03 06:46:15.813736 | orchestrator | 3950996115cb registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_housekeeping 2026-04-03 06:46:15.813748 | orchestrator | 80256458a212 registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-03 06:46:15.813759 | orchestrator | c0d72cd198f0 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-03 06:46:15.813770 | orchestrator | 55ce06ba1a1f registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-03 06:46:15.813781 | orchestrator | d36522e3c076 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-03 06:46:15.813792 | orchestrator | d5aeadb08fb5 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_mdns 2026-04-03 06:46:15.813810 | orchestrator | 972a6df0a7af registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-03 06:46:15.813821 | orchestrator | 9deb021d4e6e registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-03 06:46:15.813832 | orchestrator | d223fc414ca8 registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-03 06:46:15.813844 | orchestrator | 6933327f8b71 registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 06:46:15.813855 | orchestrator | d5de60f379e0 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 06:46:15.813868 | orchestrator | 585f85c33d64 registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 06:46:15.813881 | orchestrator | d3a5169ce3ea registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 06:46:15.813899 | orchestrator | 987203006a6a registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-03 06:46:15.813913 | orchestrator | 1119e876575d registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-03 06:46:15.813925 | orchestrator | b9f13a3f44c5 registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-03 06:46:15.813938 | orchestrator | 9657ba7a9ab3 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_api 2026-04-03 06:46:15.813951 | orchestrator | a2374d166a39 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) glance_api 2026-04-03 06:46:15.813965 | orchestrator | d1562b30968e registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-03 06:46:15.813978 | orchestrator | 891f967a160e registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-03 06:46:15.813999 | orchestrator | 8f783435cedc registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 36 minutes ago Up 36 minutes (healthy) horizon 2026-04-03 06:46:15.814013 | orchestrator | 4ef70c5e1638 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-03 06:46:15.814086 | orchestrator | 4c31cf52a24a registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-03 06:46:15.814107 | orchestrator | 186e0f8543b7 registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-03 06:46:15.814120 | orchestrator | bdd689cdd463 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_scheduler 2026-04-03 06:46:15.814133 | orchestrator | 8b1681254563 registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-03 06:46:15.814146 | orchestrator | 1a3b0cd235be registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) placement_api 2026-04-03 06:46:15.814159 | orchestrator | 9195e0bda806 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 52 minutes ago Up 52 minutes (healthy) keystone 2026-04-03 06:46:15.814171 | orchestrator | 1c591493c3c0 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_fernet 2026-04-03 06:46:15.814184 | orchestrator | abe4e44160be registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_ssh 2026-04-03 06:46:15.814197 | orchestrator | f9c93bdcb6f8 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-2 2026-04-03 06:46:15.814210 | orchestrator | 7c272c8613dc registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-03 06:46:15.814223 | orchestrator | 998d77407386 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-2 2026-04-03 06:46:15.814234 | orchestrator | 4b2348b7764a registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-03 06:46:15.814245 | orchestrator | 1763e713b0bc registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-03 06:46:15.814262 | orchestrator | 035c780053af registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-03 06:46:15.814273 | orchestrator | 15f64eafd150 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-03 06:46:15.814284 | orchestrator | 933ce1946a91 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-03 06:46:15.814295 | orchestrator | 0251cda66fcd registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-03 06:46:15.814306 | orchestrator | 5c87a0369383 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-03 06:46:15.814324 | orchestrator | 9c84ab200086 registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-03 06:46:15.814342 | orchestrator | e34a2e3eb52f registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-03 06:46:15.814353 | orchestrator | 98c2ae75484a registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-03 06:46:15.814364 | orchestrator | 0659f2a20415 registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-03 06:46:15.814375 | orchestrator | 5228fa5f267e registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-03 06:46:15.814386 | orchestrator | 24ab2e87adcd registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-03 06:46:15.814397 | orchestrator | d0c67e3a9be5 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-03 06:46:15.814408 | orchestrator | 6a4e09b72a3b registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-03 06:46:15.814419 | orchestrator | 53aec0405fce registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) haproxy 2026-04-03 06:46:15.814430 | orchestrator | a59dd18d4b2a registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-03 06:46:15.814441 | orchestrator | c09f5e16eb1d registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-03 06:46:15.814452 | orchestrator | 35792e2ff7f7 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-03 06:46:16.132120 | orchestrator | 2026-04-03 06:46:16.132215 | orchestrator | ## Images @ testbed-node-2 2026-04-03 06:46:16.132230 | orchestrator | 2026-04-03 06:46:16.132242 | orchestrator | + echo 2026-04-03 06:46:16.132254 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-03 06:46:16.132267 | orchestrator | + echo 2026-04-03 06:46:16.132278 | orchestrator | + osism container testbed-node-2 images 2026-04-03 06:46:18.493278 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 06:46:18.493428 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 06:46:18.493474 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 06:46:18.494131 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 06:46:18.494152 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 06:46:18.494164 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 06:46:18.494174 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 06:46:18.494184 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 06:46:18.494216 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 06:46:18.494226 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 06:46:18.494236 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 06:46:18.494251 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 06:46:18.494262 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 06:46:18.494272 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 06:46:18.494282 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 06:46:18.494292 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 06:46:18.494301 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 06:46:18.494311 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 06:46:18.494321 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 06:46:18.494330 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 06:46:18.494340 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 06:46:18.494350 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 06:46:18.494360 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 06:46:18.494370 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 06:46:18.494379 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 06:46:18.494389 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 06:46:18.494399 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 06:46:18.494408 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 06:46:18.494418 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 06:46:18.494428 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 06:46:18.494438 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 06:46:18.494447 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 06:46:18.494477 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 06:46:18.494488 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 06:46:18.494529 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 06:46:18.494554 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 06:46:18.494564 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 06:46:18.494574 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 06:46:18.494584 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 06:46:18.494594 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 06:46:18.494603 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 06:46:18.494613 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 06:46:18.494623 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 06:46:18.494632 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 06:46:18.494652 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 06:46:18.494662 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 06:46:18.494671 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 06:46:18.494681 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 06:46:18.494691 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 06:46:18.494701 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 06:46:18.494710 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 06:46:18.494720 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 06:46:18.494729 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 06:46:18.494739 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 06:46:18.494749 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 06:46:18.494758 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 06:46:18.494768 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 06:46:18.494778 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 06:46:18.494788 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 06:46:18.494797 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 06:46:18.494807 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 06:46:18.494823 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 06:46:18.494833 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 06:46:18.494842 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 06:46:18.494860 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 06:46:18.494870 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 06:46:18.494881 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 06:46:18.494894 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 06:46:18.494905 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 06:46:18.494915 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 06:46:18.798874 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-03 06:46:18.805652 | orchestrator | + set -e 2026-04-03 06:46:18.805701 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 06:46:18.805721 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 06:46:18.805733 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 06:46:18.805745 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 06:46:18.805756 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 06:46:18.805767 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 06:46:18.805779 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 06:46:18.805791 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:46:18.805802 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:46:18.805813 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 06:46:18.805824 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 06:46:18.805835 | orchestrator | ++ export ARA=false 2026-04-03 06:46:18.805846 | orchestrator | ++ ARA=false 2026-04-03 06:46:18.805857 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 06:46:18.805868 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 06:46:18.805879 | orchestrator | ++ export TEMPEST=false 2026-04-03 06:46:18.805889 | orchestrator | ++ TEMPEST=false 2026-04-03 06:46:18.805900 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 06:46:18.805911 | orchestrator | ++ IS_ZUUL=true 2026-04-03 06:46:18.805922 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:46:18.805934 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:46:18.805945 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 06:46:18.805955 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 06:46:18.805966 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 06:46:18.805977 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 06:46:18.805988 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 06:46:18.805999 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 06:46:18.806010 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 06:46:18.806072 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 06:46:18.806084 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 06:46:18.806095 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-03 06:46:18.813922 | orchestrator | + set -e 2026-04-03 06:46:18.813978 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 06:46:18.813999 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 06:46:18.814075 | orchestrator | ++ INTERACTIVE=false 2026-04-03 06:46:18.814089 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 06:46:18.814100 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 06:46:18.814112 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 06:46:18.815762 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:46:18.818703 | orchestrator | 2026-04-03 06:46:18.818752 | orchestrator | # Ceph status 2026-04-03 06:46:18.818766 | orchestrator | 2026-04-03 06:46:18.818804 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:46:18.818816 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:46:18.818828 | orchestrator | + echo 2026-04-03 06:46:18.818840 | orchestrator | + echo '# Ceph status' 2026-04-03 06:46:18.818851 | orchestrator | + echo 2026-04-03 06:46:18.818862 | orchestrator | + ceph -s 2026-04-03 06:46:19.406199 | orchestrator | cluster: 2026-04-03 06:46:19.406287 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-03 06:46:19.406298 | orchestrator | health: HEALTH_OK 2026-04-03 06:46:19.406308 | orchestrator | 2026-04-03 06:46:19.406316 | orchestrator | services: 2026-04-03 06:46:19.406325 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 67m) 2026-04-03 06:46:19.406345 | orchestrator | mgr: testbed-node-2(active, since 54m), standbys: testbed-node-0, testbed-node-1 2026-04-03 06:46:19.406354 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-03 06:46:19.406362 | orchestrator | osd: 6 osds: 6 up (since 63m), 6 in (since 64m) 2026-04-03 06:46:19.406370 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-03 06:46:19.406377 | orchestrator | 2026-04-03 06:46:19.406385 | orchestrator | data: 2026-04-03 06:46:19.406393 | orchestrator | volumes: 1/1 healthy 2026-04-03 06:46:19.406401 | orchestrator | pools: 14 pools, 401 pgs 2026-04-03 06:46:19.406409 | orchestrator | objects: 556 objects, 2.2 GiB 2026-04-03 06:46:19.406417 | orchestrator | usage: 7.1 GiB used, 113 GiB / 120 GiB avail 2026-04-03 06:46:19.406424 | orchestrator | pgs: 401 active+clean 2026-04-03 06:46:19.406432 | orchestrator | 2026-04-03 06:46:19.450243 | orchestrator | 2026-04-03 06:46:19.450340 | orchestrator | # Ceph versions 2026-04-03 06:46:19.450357 | orchestrator | 2026-04-03 06:46:19.450371 | orchestrator | + echo 2026-04-03 06:46:19.450385 | orchestrator | + echo '# Ceph versions' 2026-04-03 06:46:19.450400 | orchestrator | + echo 2026-04-03 06:46:19.450413 | orchestrator | + ceph versions 2026-04-03 06:46:20.122135 | orchestrator | { 2026-04-03 06:46:20.122242 | orchestrator | "mon": { 2026-04-03 06:46:20.122259 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 06:46:20.122273 | orchestrator | }, 2026-04-03 06:46:20.122284 | orchestrator | "mgr": { 2026-04-03 06:46:20.122296 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 06:46:20.122307 | orchestrator | }, 2026-04-03 06:46:20.122318 | orchestrator | "osd": { 2026-04-03 06:46:20.122329 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-03 06:46:20.122340 | orchestrator | }, 2026-04-03 06:46:20.122351 | orchestrator | "mds": { 2026-04-03 06:46:20.122362 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 06:46:20.122373 | orchestrator | }, 2026-04-03 06:46:20.122384 | orchestrator | "rgw": { 2026-04-03 06:46:20.122395 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 06:46:20.122406 | orchestrator | }, 2026-04-03 06:46:20.122417 | orchestrator | "overall": { 2026-04-03 06:46:20.122429 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-03 06:46:20.122440 | orchestrator | } 2026-04-03 06:46:20.122451 | orchestrator | } 2026-04-03 06:46:20.167254 | orchestrator | 2026-04-03 06:46:20.167346 | orchestrator | # Ceph OSD tree 2026-04-03 06:46:20.167361 | orchestrator | 2026-04-03 06:46:20.167373 | orchestrator | + echo 2026-04-03 06:46:20.167384 | orchestrator | + echo '# Ceph OSD tree' 2026-04-03 06:46:20.167396 | orchestrator | + echo 2026-04-03 06:46:20.167408 | orchestrator | + ceph osd df tree 2026-04-03 06:46:20.712628 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-03 06:46:20.712742 | orchestrator | -1 0.11691 - 120 GiB 7.1 GiB 6.7 GiB 6 KiB 390 MiB 113 GiB 5.88 1.00 - root default 2026-04-03 06:46:20.712760 | orchestrator | -5 0.03897 - 40 GiB 2.4 GiB 2.2 GiB 2 KiB 139 MiB 38 GiB 5.91 1.00 - host testbed-node-3 2026-04-03 06:46:20.712772 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.2 GiB 1 KiB 66 MiB 19 GiB 6.36 1.08 190 up osd.1 2026-04-03 06:46:20.712783 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.1 GiB 1.0 GiB 1 KiB 74 MiB 19 GiB 5.46 0.93 202 up osd.4 2026-04-03 06:46:20.712795 | orchestrator | -3 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 123 MiB 38 GiB 5.87 1.00 - host testbed-node-4 2026-04-03 06:46:20.712835 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 984 MiB 923 MiB 1 KiB 62 MiB 19 GiB 4.81 0.82 189 up osd.0 2026-04-03 06:46:20.712848 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.4 GiB 1.3 GiB 1 KiB 62 MiB 19 GiB 6.92 1.18 201 up osd.3 2026-04-03 06:46:20.712859 | orchestrator | -7 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 127 MiB 38 GiB 5.88 1.00 - host testbed-node-5 2026-04-03 06:46:20.712871 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.4 GiB 1 KiB 62 MiB 19 GiB 7.39 1.26 191 up osd.2 2026-04-03 06:46:20.712883 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 893 MiB 827 MiB 1 KiB 66 MiB 19 GiB 4.36 0.74 197 up osd.5 2026-04-03 06:46:20.712894 | orchestrator | TOTAL 120 GiB 7.1 GiB 6.7 GiB 9.3 KiB 390 MiB 113 GiB 5.88 2026-04-03 06:46:20.712906 | orchestrator | MIN/MAX VAR: 0.74/1.26 STDDEV: 1.10 2026-04-03 06:46:20.764970 | orchestrator | 2026-04-03 06:46:20.765058 | orchestrator | # Ceph monitor status 2026-04-03 06:46:20.765073 | orchestrator | 2026-04-03 06:46:20.765086 | orchestrator | + echo 2026-04-03 06:46:20.765098 | orchestrator | + echo '# Ceph monitor status' 2026-04-03 06:46:20.765109 | orchestrator | + echo 2026-04-03 06:46:20.765120 | orchestrator | + ceph mon stat 2026-04-03 06:46:21.368286 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 6, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-03 06:46:21.412081 | orchestrator | 2026-04-03 06:46:21.412176 | orchestrator | + echo 2026-04-03 06:46:21.412192 | orchestrator | + echo '# Ceph quorum status' 2026-04-03 06:46:21.412391 | orchestrator | # Ceph quorum status 2026-04-03 06:46:21.412425 | orchestrator | 2026-04-03 06:46:21.412446 | orchestrator | + echo 2026-04-03 06:46:21.412462 | orchestrator | + ceph quorum_status 2026-04-03 06:46:21.413223 | orchestrator | + jq 2026-04-03 06:46:22.060275 | orchestrator | { 2026-04-03 06:46:22.060366 | orchestrator | "election_epoch": 6, 2026-04-03 06:46:22.060381 | orchestrator | "quorum": [ 2026-04-03 06:46:22.060391 | orchestrator | 0, 2026-04-03 06:46:22.060401 | orchestrator | 1, 2026-04-03 06:46:22.060411 | orchestrator | 2 2026-04-03 06:46:22.060420 | orchestrator | ], 2026-04-03 06:46:22.060584 | orchestrator | "quorum_names": [ 2026-04-03 06:46:22.060598 | orchestrator | "testbed-node-0", 2026-04-03 06:46:22.060608 | orchestrator | "testbed-node-1", 2026-04-03 06:46:22.060618 | orchestrator | "testbed-node-2" 2026-04-03 06:46:22.060628 | orchestrator | ], 2026-04-03 06:46:22.060638 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-03 06:46:22.060649 | orchestrator | "quorum_age": 4029, 2026-04-03 06:46:22.060659 | orchestrator | "features": { 2026-04-03 06:46:22.060669 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-03 06:46:22.060679 | orchestrator | "quorum_mon": [ 2026-04-03 06:46:22.060689 | orchestrator | "kraken", 2026-04-03 06:46:22.060699 | orchestrator | "luminous", 2026-04-03 06:46:22.060709 | orchestrator | "mimic", 2026-04-03 06:46:22.060718 | orchestrator | "osdmap-prune", 2026-04-03 06:46:22.060728 | orchestrator | "nautilus", 2026-04-03 06:46:22.060738 | orchestrator | "octopus", 2026-04-03 06:46:22.060747 | orchestrator | "pacific", 2026-04-03 06:46:22.060757 | orchestrator | "elector-pinging", 2026-04-03 06:46:22.060767 | orchestrator | "quincy", 2026-04-03 06:46:22.060777 | orchestrator | "reef" 2026-04-03 06:46:22.060787 | orchestrator | ] 2026-04-03 06:46:22.060796 | orchestrator | }, 2026-04-03 06:46:22.060806 | orchestrator | "monmap": { 2026-04-03 06:46:22.060816 | orchestrator | "epoch": 1, 2026-04-03 06:46:22.060826 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-03 06:46:22.060837 | orchestrator | "modified": "2026-04-03T05:38:49.986205Z", 2026-04-03 06:46:22.060847 | orchestrator | "created": "2026-04-03T05:38:49.986205Z", 2026-04-03 06:46:22.060856 | orchestrator | "min_mon_release": 18, 2026-04-03 06:46:22.060866 | orchestrator | "min_mon_release_name": "reef", 2026-04-03 06:46:22.060876 | orchestrator | "election_strategy": 1, 2026-04-03 06:46:22.060886 | orchestrator | "disallowed_leaders: ": "", 2026-04-03 06:46:22.060896 | orchestrator | "stretch_mode": false, 2026-04-03 06:46:22.060905 | orchestrator | "tiebreaker_mon": "", 2026-04-03 06:46:22.060937 | orchestrator | "removed_ranks: ": "", 2026-04-03 06:46:22.060947 | orchestrator | "features": { 2026-04-03 06:46:22.060957 | orchestrator | "persistent": [ 2026-04-03 06:46:22.060967 | orchestrator | "kraken", 2026-04-03 06:46:22.060976 | orchestrator | "luminous", 2026-04-03 06:46:22.060986 | orchestrator | "mimic", 2026-04-03 06:46:22.060995 | orchestrator | "osdmap-prune", 2026-04-03 06:46:22.061005 | orchestrator | "nautilus", 2026-04-03 06:46:22.061014 | orchestrator | "octopus", 2026-04-03 06:46:22.061024 | orchestrator | "pacific", 2026-04-03 06:46:22.061033 | orchestrator | "elector-pinging", 2026-04-03 06:46:22.061043 | orchestrator | "quincy", 2026-04-03 06:46:22.061053 | orchestrator | "reef" 2026-04-03 06:46:22.061063 | orchestrator | ], 2026-04-03 06:46:22.061072 | orchestrator | "optional": [] 2026-04-03 06:46:22.061082 | orchestrator | }, 2026-04-03 06:46:22.061092 | orchestrator | "mons": [ 2026-04-03 06:46:22.061102 | orchestrator | { 2026-04-03 06:46:22.061111 | orchestrator | "rank": 0, 2026-04-03 06:46:22.061121 | orchestrator | "name": "testbed-node-0", 2026-04-03 06:46:22.061131 | orchestrator | "public_addrs": { 2026-04-03 06:46:22.061141 | orchestrator | "addrvec": [ 2026-04-03 06:46:22.061150 | orchestrator | { 2026-04-03 06:46:22.061160 | orchestrator | "type": "v2", 2026-04-03 06:46:22.061170 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-03 06:46:22.061180 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061190 | orchestrator | }, 2026-04-03 06:46:22.061202 | orchestrator | { 2026-04-03 06:46:22.061213 | orchestrator | "type": "v1", 2026-04-03 06:46:22.061224 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-03 06:46:22.061236 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061247 | orchestrator | } 2026-04-03 06:46:22.061258 | orchestrator | ] 2026-04-03 06:46:22.061269 | orchestrator | }, 2026-04-03 06:46:22.061281 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-03 06:46:22.061292 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-03 06:46:22.061303 | orchestrator | "priority": 0, 2026-04-03 06:46:22.061314 | orchestrator | "weight": 0, 2026-04-03 06:46:22.061325 | orchestrator | "crush_location": "{}" 2026-04-03 06:46:22.061336 | orchestrator | }, 2026-04-03 06:46:22.061347 | orchestrator | { 2026-04-03 06:46:22.061359 | orchestrator | "rank": 1, 2026-04-03 06:46:22.061371 | orchestrator | "name": "testbed-node-1", 2026-04-03 06:46:22.061382 | orchestrator | "public_addrs": { 2026-04-03 06:46:22.061394 | orchestrator | "addrvec": [ 2026-04-03 06:46:22.061405 | orchestrator | { 2026-04-03 06:46:22.061416 | orchestrator | "type": "v2", 2026-04-03 06:46:22.061442 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-03 06:46:22.061454 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061466 | orchestrator | }, 2026-04-03 06:46:22.061477 | orchestrator | { 2026-04-03 06:46:22.061488 | orchestrator | "type": "v1", 2026-04-03 06:46:22.061516 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-03 06:46:22.061526 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061536 | orchestrator | } 2026-04-03 06:46:22.061545 | orchestrator | ] 2026-04-03 06:46:22.061555 | orchestrator | }, 2026-04-03 06:46:22.061565 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-03 06:46:22.061574 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-03 06:46:22.061584 | orchestrator | "priority": 0, 2026-04-03 06:46:22.061594 | orchestrator | "weight": 0, 2026-04-03 06:46:22.061604 | orchestrator | "crush_location": "{}" 2026-04-03 06:46:22.061613 | orchestrator | }, 2026-04-03 06:46:22.061623 | orchestrator | { 2026-04-03 06:46:22.061632 | orchestrator | "rank": 2, 2026-04-03 06:46:22.061642 | orchestrator | "name": "testbed-node-2", 2026-04-03 06:46:22.061652 | orchestrator | "public_addrs": { 2026-04-03 06:46:22.061661 | orchestrator | "addrvec": [ 2026-04-03 06:46:22.061671 | orchestrator | { 2026-04-03 06:46:22.061681 | orchestrator | "type": "v2", 2026-04-03 06:46:22.061690 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-03 06:46:22.061700 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061710 | orchestrator | }, 2026-04-03 06:46:22.061719 | orchestrator | { 2026-04-03 06:46:22.061729 | orchestrator | "type": "v1", 2026-04-03 06:46:22.061738 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-03 06:46:22.061748 | orchestrator | "nonce": 0 2026-04-03 06:46:22.061758 | orchestrator | } 2026-04-03 06:46:22.061767 | orchestrator | ] 2026-04-03 06:46:22.061784 | orchestrator | }, 2026-04-03 06:46:22.061793 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-03 06:46:22.061803 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-03 06:46:22.061813 | orchestrator | "priority": 0, 2026-04-03 06:46:22.061823 | orchestrator | "weight": 0, 2026-04-03 06:46:22.061832 | orchestrator | "crush_location": "{}" 2026-04-03 06:46:22.061842 | orchestrator | } 2026-04-03 06:46:22.061852 | orchestrator | ] 2026-04-03 06:46:22.061862 | orchestrator | } 2026-04-03 06:46:22.061871 | orchestrator | } 2026-04-03 06:46:22.061893 | orchestrator | 2026-04-03 06:46:22.061904 | orchestrator | # Ceph free space status 2026-04-03 06:46:22.061914 | orchestrator | 2026-04-03 06:46:22.061923 | orchestrator | + echo 2026-04-03 06:46:22.061938 | orchestrator | + echo '# Ceph free space status' 2026-04-03 06:46:22.061948 | orchestrator | + echo 2026-04-03 06:46:22.061958 | orchestrator | + ceph df 2026-04-03 06:46:22.670575 | orchestrator | --- RAW STORAGE --- 2026-04-03 06:46:22.670706 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-03 06:46:22.670735 | orchestrator | hdd 120 GiB 113 GiB 7.1 GiB 7.1 GiB 5.88 2026-04-03 06:46:22.670746 | orchestrator | TOTAL 120 GiB 113 GiB 7.1 GiB 7.1 GiB 5.88 2026-04-03 06:46:22.670756 | orchestrator | 2026-04-03 06:46:22.670768 | orchestrator | --- POOLS --- 2026-04-03 06:46:22.670778 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-03 06:46:22.670789 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 53 GiB 2026-04-03 06:46:22.670800 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-03 06:46:22.670810 | orchestrator | cephfs_metadata 3 16 4.4 KiB 22 96 KiB 0 35 GiB 2026-04-03 06:46:22.670820 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-03 06:46:22.670830 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-03 06:46:22.670840 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-03 06:46:22.670851 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-03 06:46:22.670861 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-03 06:46:22.670871 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 53 GiB 2026-04-03 06:46:22.670880 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 06:46:22.670890 | orchestrator | volumes 11 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 06:46:22.670900 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 5.96 35 GiB 2026-04-03 06:46:22.670910 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 06:46:22.670920 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 06:46:22.715197 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-03 06:46:22.773768 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 06:46:22.773860 | orchestrator | + osism apply facts 2026-04-03 06:46:34.916167 | orchestrator | 2026-04-03 06:46:34 | INFO  | Task 3046bae8-3ea2-423d-b300-2ed16b10ebe8 (facts) was prepared for execution. 2026-04-03 06:46:34.916241 | orchestrator | 2026-04-03 06:46:34 | INFO  | It takes a moment until task 3046bae8-3ea2-423d-b300-2ed16b10ebe8 (facts) has been started and output is visible here. 2026-04-03 06:46:48.530490 | orchestrator | 2026-04-03 06:46:48.530659 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-03 06:46:48.530676 | orchestrator | 2026-04-03 06:46:48.530688 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 06:46:48.530700 | orchestrator | Friday 03 April 2026 06:46:39 +0000 (0:00:00.291) 0:00:00.291 ********** 2026-04-03 06:46:48.530711 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:46:48.530723 | orchestrator | ok: [testbed-manager] 2026-04-03 06:46:48.530734 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:46:48.530745 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:46:48.530755 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:46:48.530766 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:46:48.530777 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:46:48.530816 | orchestrator | 2026-04-03 06:46:48.530828 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 06:46:48.530839 | orchestrator | Friday 03 April 2026 06:46:40 +0000 (0:00:01.249) 0:00:01.540 ********** 2026-04-03 06:46:48.530850 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:46:48.530862 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:46:48.530873 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:46:48.530883 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:46:48.530894 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:46:48.530905 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:46:48.530915 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:46:48.530926 | orchestrator | 2026-04-03 06:46:48.530937 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 06:46:48.530947 | orchestrator | 2026-04-03 06:46:48.530959 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 06:46:48.530969 | orchestrator | Friday 03 April 2026 06:46:42 +0000 (0:00:01.390) 0:00:02.931 ********** 2026-04-03 06:46:48.530980 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:46:48.530991 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:46:48.531002 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:46:48.531015 | orchestrator | ok: [testbed-manager] 2026-04-03 06:46:48.531033 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:46:48.531052 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:46:48.531071 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:46:48.531087 | orchestrator | 2026-04-03 06:46:48.531104 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 06:46:48.531122 | orchestrator | 2026-04-03 06:46:48.531139 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 06:46:48.531157 | orchestrator | Friday 03 April 2026 06:46:47 +0000 (0:00:05.463) 0:00:08.394 ********** 2026-04-03 06:46:48.531173 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:46:48.531192 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:46:48.531208 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:46:48.531228 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:46:48.531244 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:46:48.531262 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:46:48.531279 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:46:48.531297 | orchestrator | 2026-04-03 06:46:48.531317 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:46:48.531407 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531423 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531452 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531464 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531475 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531485 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531521 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:46:48.531538 | orchestrator | 2026-04-03 06:46:48.531549 | orchestrator | 2026-04-03 06:46:48.531561 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:46:48.531572 | orchestrator | Friday 03 April 2026 06:46:48 +0000 (0:00:00.580) 0:00:08.974 ********** 2026-04-03 06:46:48.531595 | orchestrator | =============================================================================== 2026-04-03 06:46:48.531606 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.46s 2026-04-03 06:46:48.531617 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.39s 2026-04-03 06:46:48.531628 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.25s 2026-04-03 06:46:48.531639 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.58s 2026-04-03 06:46:48.841487 | orchestrator | + osism validate ceph-mons 2026-04-03 06:47:21.548061 | orchestrator | 2026-04-03 06:47:21.548167 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-03 06:47:21.548184 | orchestrator | 2026-04-03 06:47:21.548196 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 06:47:21.548214 | orchestrator | Friday 03 April 2026 06:47:05 +0000 (0:00:00.482) 0:00:00.482 ********** 2026-04-03 06:47:21.548235 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.548254 | orchestrator | 2026-04-03 06:47:21.548272 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 06:47:21.548292 | orchestrator | Friday 03 April 2026 06:47:06 +0000 (0:00:00.828) 0:00:01.311 ********** 2026-04-03 06:47:21.548311 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.548329 | orchestrator | 2026-04-03 06:47:21.548348 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 06:47:21.548366 | orchestrator | Friday 03 April 2026 06:47:07 +0000 (0:00:00.998) 0:00:02.310 ********** 2026-04-03 06:47:21.548386 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548406 | orchestrator | 2026-04-03 06:47:21.548425 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-03 06:47:21.548445 | orchestrator | Friday 03 April 2026 06:47:07 +0000 (0:00:00.126) 0:00:02.436 ********** 2026-04-03 06:47:21.548464 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548484 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:21.548502 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:21.548554 | orchestrator | 2026-04-03 06:47:21.548572 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-03 06:47:21.548591 | orchestrator | Friday 03 April 2026 06:47:07 +0000 (0:00:00.305) 0:00:02.741 ********** 2026-04-03 06:47:21.548603 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:21.548614 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:21.548625 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548636 | orchestrator | 2026-04-03 06:47:21.548648 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-03 06:47:21.548659 | orchestrator | Friday 03 April 2026 06:47:08 +0000 (0:00:01.017) 0:00:03.759 ********** 2026-04-03 06:47:21.548670 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.548681 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:47:21.548692 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:47:21.548703 | orchestrator | 2026-04-03 06:47:21.548714 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-03 06:47:21.548725 | orchestrator | Friday 03 April 2026 06:47:09 +0000 (0:00:00.300) 0:00:04.060 ********** 2026-04-03 06:47:21.548736 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548747 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:21.548758 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:21.548768 | orchestrator | 2026-04-03 06:47:21.548780 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:47:21.548791 | orchestrator | Friday 03 April 2026 06:47:09 +0000 (0:00:00.496) 0:00:04.557 ********** 2026-04-03 06:47:21.548801 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548812 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:21.548823 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:21.548834 | orchestrator | 2026-04-03 06:47:21.548845 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-03 06:47:21.548856 | orchestrator | Friday 03 April 2026 06:47:10 +0000 (0:00:00.324) 0:00:04.881 ********** 2026-04-03 06:47:21.548892 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.548903 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:47:21.548914 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:47:21.548925 | orchestrator | 2026-04-03 06:47:21.548936 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-03 06:47:21.548947 | orchestrator | Friday 03 April 2026 06:47:10 +0000 (0:00:00.315) 0:00:05.197 ********** 2026-04-03 06:47:21.548958 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.548968 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:21.548979 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:21.548990 | orchestrator | 2026-04-03 06:47:21.549001 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:47:21.549012 | orchestrator | Friday 03 April 2026 06:47:10 +0000 (0:00:00.498) 0:00:05.695 ********** 2026-04-03 06:47:21.549023 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549034 | orchestrator | 2026-04-03 06:47:21.549045 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:47:21.549056 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.263) 0:00:05.959 ********** 2026-04-03 06:47:21.549067 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549078 | orchestrator | 2026-04-03 06:47:21.549089 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:47:21.549100 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.271) 0:00:06.231 ********** 2026-04-03 06:47:21.549110 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549121 | orchestrator | 2026-04-03 06:47:21.549132 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:21.549143 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.277) 0:00:06.508 ********** 2026-04-03 06:47:21.549154 | orchestrator | 2026-04-03 06:47:21.549165 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:21.549175 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.074) 0:00:06.583 ********** 2026-04-03 06:47:21.549186 | orchestrator | 2026-04-03 06:47:21.549197 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:21.549208 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.074) 0:00:06.657 ********** 2026-04-03 06:47:21.549218 | orchestrator | 2026-04-03 06:47:21.549229 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:47:21.549240 | orchestrator | Friday 03 April 2026 06:47:11 +0000 (0:00:00.087) 0:00:06.744 ********** 2026-04-03 06:47:21.549251 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549261 | orchestrator | 2026-04-03 06:47:21.549272 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-03 06:47:21.549283 | orchestrator | Friday 03 April 2026 06:47:12 +0000 (0:00:00.272) 0:00:07.016 ********** 2026-04-03 06:47:21.549294 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549353 | orchestrator | 2026-04-03 06:47:21.549388 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-03 06:47:21.549400 | orchestrator | Friday 03 April 2026 06:47:12 +0000 (0:00:00.247) 0:00:07.264 ********** 2026-04-03 06:47:21.549410 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549422 | orchestrator | 2026-04-03 06:47:21.549433 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-03 06:47:21.549443 | orchestrator | Friday 03 April 2026 06:47:12 +0000 (0:00:00.128) 0:00:07.393 ********** 2026-04-03 06:47:21.549454 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:47:21.549465 | orchestrator | 2026-04-03 06:47:21.549481 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-03 06:47:21.549492 | orchestrator | Friday 03 April 2026 06:47:14 +0000 (0:00:01.611) 0:00:09.004 ********** 2026-04-03 06:47:21.549524 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549536 | orchestrator | 2026-04-03 06:47:21.549547 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-03 06:47:21.549567 | orchestrator | Friday 03 April 2026 06:47:14 +0000 (0:00:00.538) 0:00:09.543 ********** 2026-04-03 06:47:21.549578 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549589 | orchestrator | 2026-04-03 06:47:21.549618 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-03 06:47:21.549630 | orchestrator | Friday 03 April 2026 06:47:14 +0000 (0:00:00.131) 0:00:09.675 ********** 2026-04-03 06:47:21.549641 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549652 | orchestrator | 2026-04-03 06:47:21.549663 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-03 06:47:21.549674 | orchestrator | Friday 03 April 2026 06:47:15 +0000 (0:00:00.332) 0:00:10.008 ********** 2026-04-03 06:47:21.549685 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549695 | orchestrator | 2026-04-03 06:47:21.549706 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-03 06:47:21.549717 | orchestrator | Friday 03 April 2026 06:47:15 +0000 (0:00:00.328) 0:00:10.336 ********** 2026-04-03 06:47:21.549728 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549738 | orchestrator | 2026-04-03 06:47:21.549749 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-03 06:47:21.549760 | orchestrator | Friday 03 April 2026 06:47:15 +0000 (0:00:00.121) 0:00:10.458 ********** 2026-04-03 06:47:21.549771 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549782 | orchestrator | 2026-04-03 06:47:21.549793 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-03 06:47:21.549803 | orchestrator | Friday 03 April 2026 06:47:15 +0000 (0:00:00.136) 0:00:10.595 ********** 2026-04-03 06:47:21.549814 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549825 | orchestrator | 2026-04-03 06:47:21.549836 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-03 06:47:21.549847 | orchestrator | Friday 03 April 2026 06:47:15 +0000 (0:00:00.125) 0:00:10.721 ********** 2026-04-03 06:47:21.549857 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:47:21.549868 | orchestrator | 2026-04-03 06:47:21.549879 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-03 06:47:21.549890 | orchestrator | Friday 03 April 2026 06:47:17 +0000 (0:00:01.337) 0:00:12.058 ********** 2026-04-03 06:47:21.549901 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549911 | orchestrator | 2026-04-03 06:47:21.549922 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-03 06:47:21.549933 | orchestrator | Friday 03 April 2026 06:47:17 +0000 (0:00:00.336) 0:00:12.395 ********** 2026-04-03 06:47:21.549944 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.549955 | orchestrator | 2026-04-03 06:47:21.549966 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-03 06:47:21.549976 | orchestrator | Friday 03 April 2026 06:47:17 +0000 (0:00:00.157) 0:00:12.553 ********** 2026-04-03 06:47:21.549987 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:21.549998 | orchestrator | 2026-04-03 06:47:21.550008 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-03 06:47:21.550083 | orchestrator | Friday 03 April 2026 06:47:17 +0000 (0:00:00.149) 0:00:12.702 ********** 2026-04-03 06:47:21.550095 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.550106 | orchestrator | 2026-04-03 06:47:21.550122 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-03 06:47:21.550133 | orchestrator | Friday 03 April 2026 06:47:18 +0000 (0:00:00.144) 0:00:12.847 ********** 2026-04-03 06:47:21.550144 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.550155 | orchestrator | 2026-04-03 06:47:21.550166 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 06:47:21.550177 | orchestrator | Friday 03 April 2026 06:47:18 +0000 (0:00:00.327) 0:00:13.175 ********** 2026-04-03 06:47:21.550188 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.550199 | orchestrator | 2026-04-03 06:47:21.550210 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 06:47:21.550228 | orchestrator | Friday 03 April 2026 06:47:18 +0000 (0:00:00.269) 0:00:13.444 ********** 2026-04-03 06:47:21.550239 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:21.550250 | orchestrator | 2026-04-03 06:47:21.550260 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:47:21.550271 | orchestrator | Friday 03 April 2026 06:47:18 +0000 (0:00:00.260) 0:00:13.704 ********** 2026-04-03 06:47:21.550282 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.550293 | orchestrator | 2026-04-03 06:47:21.550304 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:47:21.550314 | orchestrator | Friday 03 April 2026 06:47:20 +0000 (0:00:01.811) 0:00:15.516 ********** 2026-04-03 06:47:21.550325 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.550336 | orchestrator | 2026-04-03 06:47:21.550347 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:47:21.550358 | orchestrator | Friday 03 April 2026 06:47:20 +0000 (0:00:00.270) 0:00:15.786 ********** 2026-04-03 06:47:21.550369 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:21.550379 | orchestrator | 2026-04-03 06:47:21.550398 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:24.271501 | orchestrator | Friday 03 April 2026 06:47:21 +0000 (0:00:00.313) 0:00:16.099 ********** 2026-04-03 06:47:24.271647 | orchestrator | 2026-04-03 06:47:24.271664 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:24.271676 | orchestrator | Friday 03 April 2026 06:47:21 +0000 (0:00:00.072) 0:00:16.172 ********** 2026-04-03 06:47:24.271687 | orchestrator | 2026-04-03 06:47:24.271699 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:24.271711 | orchestrator | Friday 03 April 2026 06:47:21 +0000 (0:00:00.073) 0:00:16.245 ********** 2026-04-03 06:47:24.271722 | orchestrator | 2026-04-03 06:47:24.271733 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 06:47:24.271744 | orchestrator | Friday 03 April 2026 06:47:21 +0000 (0:00:00.077) 0:00:16.323 ********** 2026-04-03 06:47:24.271756 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:24.271767 | orchestrator | 2026-04-03 06:47:24.271778 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:47:24.271789 | orchestrator | Friday 03 April 2026 06:47:23 +0000 (0:00:01.557) 0:00:17.880 ********** 2026-04-03 06:47:24.271800 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-03 06:47:24.271811 | orchestrator |  "msg": [ 2026-04-03 06:47:24.271823 | orchestrator |  "Validator run completed.", 2026-04-03 06:47:24.271835 | orchestrator |  "You can find the report file here:", 2026-04-03 06:47:24.271846 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-03T06:47:06+00:00-report.json", 2026-04-03 06:47:24.271858 | orchestrator |  "on the following host:", 2026-04-03 06:47:24.271869 | orchestrator |  "testbed-manager" 2026-04-03 06:47:24.271880 | orchestrator |  ] 2026-04-03 06:47:24.271891 | orchestrator | } 2026-04-03 06:47:24.271902 | orchestrator | 2026-04-03 06:47:24.271913 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:47:24.271926 | orchestrator | testbed-node-0 : ok=24  changed=5  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-03 06:47:24.271938 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:47:24.271950 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:47:24.271961 | orchestrator | 2026-04-03 06:47:24.271972 | orchestrator | 2026-04-03 06:47:24.271984 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:47:24.272022 | orchestrator | Friday 03 April 2026 06:47:23 +0000 (0:00:00.838) 0:00:18.719 ********** 2026-04-03 06:47:24.272034 | orchestrator | =============================================================================== 2026-04-03 06:47:24.272046 | orchestrator | Aggregate test results step one ----------------------------------------- 1.81s 2026-04-03 06:47:24.272059 | orchestrator | Get monmap info from one mon container ---------------------------------- 1.61s 2026-04-03 06:47:24.272072 | orchestrator | Write report file ------------------------------------------------------- 1.56s 2026-04-03 06:47:24.272085 | orchestrator | Gather status data ------------------------------------------------------ 1.34s 2026-04-03 06:47:24.272098 | orchestrator | Get container info ------------------------------------------------------ 1.02s 2026-04-03 06:47:24.272111 | orchestrator | Create report output directory ------------------------------------------ 1.00s 2026-04-03 06:47:24.272123 | orchestrator | Print report file information ------------------------------------------- 0.84s 2026-04-03 06:47:24.272136 | orchestrator | Get timestamp for report file ------------------------------------------- 0.83s 2026-04-03 06:47:24.272165 | orchestrator | Set quorum test data ---------------------------------------------------- 0.54s 2026-04-03 06:47:24.272179 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 0.50s 2026-04-03 06:47:24.272192 | orchestrator | Set test result to passed if container is existing ---------------------- 0.50s 2026-04-03 06:47:24.272204 | orchestrator | Set health test data ---------------------------------------------------- 0.34s 2026-04-03 06:47:24.272217 | orchestrator | Pass quorum test if all monitors are in quorum -------------------------- 0.33s 2026-04-03 06:47:24.272229 | orchestrator | Set fsid test vars ------------------------------------------------------ 0.33s 2026-04-03 06:47:24.272242 | orchestrator | Pass cluster-health if status is OK (strict) ---------------------------- 0.33s 2026-04-03 06:47:24.272254 | orchestrator | Prepare test data ------------------------------------------------------- 0.32s 2026-04-03 06:47:24.272267 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 0.32s 2026-04-03 06:47:24.272280 | orchestrator | Aggregate test results step three --------------------------------------- 0.31s 2026-04-03 06:47:24.272292 | orchestrator | Prepare test data for container existance test -------------------------- 0.31s 2026-04-03 06:47:24.272306 | orchestrator | Set test result to failed if container is missing ----------------------- 0.30s 2026-04-03 06:47:24.605163 | orchestrator | + osism validate ceph-mgrs 2026-04-03 06:47:55.991677 | orchestrator | 2026-04-03 06:47:55.991801 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-03 06:47:55.991829 | orchestrator | 2026-04-03 06:47:55.991850 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 06:47:55.991873 | orchestrator | Friday 03 April 2026 06:47:41 +0000 (0:00:00.437) 0:00:00.437 ********** 2026-04-03 06:47:55.991894 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.991913 | orchestrator | 2026-04-03 06:47:55.991933 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 06:47:55.991951 | orchestrator | Friday 03 April 2026 06:47:42 +0000 (0:00:00.885) 0:00:01.322 ********** 2026-04-03 06:47:55.991970 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.991982 | orchestrator | 2026-04-03 06:47:55.991994 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 06:47:55.992005 | orchestrator | Friday 03 April 2026 06:47:43 +0000 (0:00:00.961) 0:00:02.284 ********** 2026-04-03 06:47:55.992017 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992030 | orchestrator | 2026-04-03 06:47:55.992041 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-03 06:47:55.992053 | orchestrator | Friday 03 April 2026 06:47:43 +0000 (0:00:00.118) 0:00:02.403 ********** 2026-04-03 06:47:55.992064 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992075 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:55.992087 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:55.992099 | orchestrator | 2026-04-03 06:47:55.992149 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-03 06:47:55.992169 | orchestrator | Friday 03 April 2026 06:47:43 +0000 (0:00:00.294) 0:00:02.697 ********** 2026-04-03 06:47:55.992190 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:55.992205 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:55.992218 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992231 | orchestrator | 2026-04-03 06:47:55.992243 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-03 06:47:55.992256 | orchestrator | Friday 03 April 2026 06:47:44 +0000 (0:00:01.040) 0:00:03.738 ********** 2026-04-03 06:47:55.992269 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.992283 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:47:55.992295 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:47:55.992307 | orchestrator | 2026-04-03 06:47:55.992325 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-03 06:47:55.992344 | orchestrator | Friday 03 April 2026 06:47:45 +0000 (0:00:00.295) 0:00:04.033 ********** 2026-04-03 06:47:55.992407 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992433 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:55.992446 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:55.992460 | orchestrator | 2026-04-03 06:47:55.992474 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:47:55.992486 | orchestrator | Friday 03 April 2026 06:47:45 +0000 (0:00:00.470) 0:00:04.504 ********** 2026-04-03 06:47:55.992499 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992535 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:55.992546 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:55.992557 | orchestrator | 2026-04-03 06:47:55.992568 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-03 06:47:55.992579 | orchestrator | Friday 03 April 2026 06:47:45 +0000 (0:00:00.301) 0:00:04.805 ********** 2026-04-03 06:47:55.992590 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.992601 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:47:55.992612 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:47:55.992623 | orchestrator | 2026-04-03 06:47:55.992634 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-03 06:47:55.992645 | orchestrator | Friday 03 April 2026 06:47:46 +0000 (0:00:00.300) 0:00:05.105 ********** 2026-04-03 06:47:55.992656 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.992667 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:47:55.992677 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:47:55.992688 | orchestrator | 2026-04-03 06:47:55.992699 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:47:55.992716 | orchestrator | Friday 03 April 2026 06:47:46 +0000 (0:00:00.500) 0:00:05.605 ********** 2026-04-03 06:47:55.992734 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.992752 | orchestrator | 2026-04-03 06:47:55.992772 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:47:55.992789 | orchestrator | Friday 03 April 2026 06:47:46 +0000 (0:00:00.266) 0:00:05.872 ********** 2026-04-03 06:47:55.992809 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.992820 | orchestrator | 2026-04-03 06:47:55.992832 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:47:55.992843 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.260) 0:00:06.133 ********** 2026-04-03 06:47:55.992854 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.992865 | orchestrator | 2026-04-03 06:47:55.992876 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.992887 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.266) 0:00:06.399 ********** 2026-04-03 06:47:55.992898 | orchestrator | 2026-04-03 06:47:55.992909 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.992920 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.079) 0:00:06.479 ********** 2026-04-03 06:47:55.992931 | orchestrator | 2026-04-03 06:47:55.992952 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.992963 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.078) 0:00:06.557 ********** 2026-04-03 06:47:55.992974 | orchestrator | 2026-04-03 06:47:55.992985 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:47:55.992996 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.084) 0:00:06.642 ********** 2026-04-03 06:47:55.993006 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.993017 | orchestrator | 2026-04-03 06:47:55.993028 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-03 06:47:55.993040 | orchestrator | Friday 03 April 2026 06:47:47 +0000 (0:00:00.259) 0:00:06.901 ********** 2026-04-03 06:47:55.993050 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.993062 | orchestrator | 2026-04-03 06:47:55.993096 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-03 06:47:55.993110 | orchestrator | Friday 03 April 2026 06:47:48 +0000 (0:00:00.245) 0:00:07.147 ********** 2026-04-03 06:47:55.993121 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.993132 | orchestrator | 2026-04-03 06:47:55.993143 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-03 06:47:55.993154 | orchestrator | Friday 03 April 2026 06:47:48 +0000 (0:00:00.111) 0:00:07.258 ********** 2026-04-03 06:47:55.993165 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:47:55.993176 | orchestrator | 2026-04-03 06:47:55.993187 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-03 06:47:55.993198 | orchestrator | Friday 03 April 2026 06:47:50 +0000 (0:00:02.042) 0:00:09.301 ********** 2026-04-03 06:47:55.993209 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.993220 | orchestrator | 2026-04-03 06:47:55.993231 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-03 06:47:55.993242 | orchestrator | Friday 03 April 2026 06:47:50 +0000 (0:00:00.464) 0:00:09.766 ********** 2026-04-03 06:47:55.993253 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.993264 | orchestrator | 2026-04-03 06:47:55.993275 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-03 06:47:55.993286 | orchestrator | Friday 03 April 2026 06:47:51 +0000 (0:00:00.322) 0:00:10.088 ********** 2026-04-03 06:47:55.993297 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.993308 | orchestrator | 2026-04-03 06:47:55.993319 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-03 06:47:55.993330 | orchestrator | Friday 03 April 2026 06:47:51 +0000 (0:00:00.143) 0:00:10.232 ********** 2026-04-03 06:47:55.993341 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:47:55.993351 | orchestrator | 2026-04-03 06:47:55.993362 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 06:47:55.993373 | orchestrator | Friday 03 April 2026 06:47:51 +0000 (0:00:00.174) 0:00:10.407 ********** 2026-04-03 06:47:55.993384 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.993395 | orchestrator | 2026-04-03 06:47:55.993406 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 06:47:55.993417 | orchestrator | Friday 03 April 2026 06:47:51 +0000 (0:00:00.259) 0:00:10.666 ********** 2026-04-03 06:47:55.993428 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:47:55.993439 | orchestrator | 2026-04-03 06:47:55.993450 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:47:55.993479 | orchestrator | Friday 03 April 2026 06:47:51 +0000 (0:00:00.238) 0:00:10.904 ********** 2026-04-03 06:47:55.993490 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.993501 | orchestrator | 2026-04-03 06:47:55.993536 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:47:55.993548 | orchestrator | Friday 03 April 2026 06:47:53 +0000 (0:00:01.303) 0:00:12.208 ********** 2026-04-03 06:47:55.993559 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.993570 | orchestrator | 2026-04-03 06:47:55.993589 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:47:55.993600 | orchestrator | Friday 03 April 2026 06:47:53 +0000 (0:00:00.249) 0:00:12.458 ********** 2026-04-03 06:47:55.993611 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.993622 | orchestrator | 2026-04-03 06:47:55.993633 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.993644 | orchestrator | Friday 03 April 2026 06:47:53 +0000 (0:00:00.254) 0:00:12.712 ********** 2026-04-03 06:47:55.993655 | orchestrator | 2026-04-03 06:47:55.993666 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.993677 | orchestrator | Friday 03 April 2026 06:47:53 +0000 (0:00:00.071) 0:00:12.784 ********** 2026-04-03 06:47:55.993688 | orchestrator | 2026-04-03 06:47:55.993699 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:47:55.993710 | orchestrator | Friday 03 April 2026 06:47:53 +0000 (0:00:00.072) 0:00:12.856 ********** 2026-04-03 06:47:55.993721 | orchestrator | 2026-04-03 06:47:55.993732 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 06:47:55.993743 | orchestrator | Friday 03 April 2026 06:47:54 +0000 (0:00:00.264) 0:00:13.121 ********** 2026-04-03 06:47:55.993754 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 06:47:55.993765 | orchestrator | 2026-04-03 06:47:55.993776 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:47:55.993787 | orchestrator | Friday 03 April 2026 06:47:55 +0000 (0:00:01.377) 0:00:14.498 ********** 2026-04-03 06:47:55.993803 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-03 06:47:55.993814 | orchestrator |  "msg": [ 2026-04-03 06:47:55.993826 | orchestrator |  "Validator run completed.", 2026-04-03 06:47:55.993837 | orchestrator |  "You can find the report file here:", 2026-04-03 06:47:55.993848 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-03T06:47:42+00:00-report.json", 2026-04-03 06:47:55.993860 | orchestrator |  "on the following host:", 2026-04-03 06:47:55.993871 | orchestrator |  "testbed-manager" 2026-04-03 06:47:55.993882 | orchestrator |  ] 2026-04-03 06:47:55.993894 | orchestrator | } 2026-04-03 06:47:55.993905 | orchestrator | 2026-04-03 06:47:55.993916 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:47:55.993928 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 06:47:55.993940 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:47:55.993959 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:47:56.350727 | orchestrator | 2026-04-03 06:47:56.350820 | orchestrator | 2026-04-03 06:47:56.350836 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:47:56.350849 | orchestrator | Friday 03 April 2026 06:47:55 +0000 (0:00:00.430) 0:00:14.929 ********** 2026-04-03 06:47:56.350860 | orchestrator | =============================================================================== 2026-04-03 06:47:56.350871 | orchestrator | Gather list of mgr modules ---------------------------------------------- 2.04s 2026-04-03 06:47:56.350882 | orchestrator | Write report file ------------------------------------------------------- 1.38s 2026-04-03 06:47:56.350893 | orchestrator | Aggregate test results step one ----------------------------------------- 1.30s 2026-04-03 06:47:56.350904 | orchestrator | Get container info ------------------------------------------------------ 1.04s 2026-04-03 06:47:56.350915 | orchestrator | Create report output directory ------------------------------------------ 0.96s 2026-04-03 06:47:56.350926 | orchestrator | Get timestamp for report file ------------------------------------------- 0.89s 2026-04-03 06:47:56.350937 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 0.50s 2026-04-03 06:47:56.350970 | orchestrator | Set test result to passed if container is existing ---------------------- 0.47s 2026-04-03 06:47:56.350982 | orchestrator | Parse mgr module list from json ----------------------------------------- 0.46s 2026-04-03 06:47:56.350993 | orchestrator | Print report file information ------------------------------------------- 0.43s 2026-04-03 06:47:56.351004 | orchestrator | Flush handlers ---------------------------------------------------------- 0.41s 2026-04-03 06:47:56.351015 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 0.32s 2026-04-03 06:47:56.351025 | orchestrator | Prepare test data ------------------------------------------------------- 0.30s 2026-04-03 06:47:56.351036 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 0.30s 2026-04-03 06:47:56.351047 | orchestrator | Set test result to failed if container is missing ----------------------- 0.30s 2026-04-03 06:47:56.351058 | orchestrator | Prepare test data for container existance test -------------------------- 0.29s 2026-04-03 06:47:56.351069 | orchestrator | Aggregate test results step one ----------------------------------------- 0.27s 2026-04-03 06:47:56.351079 | orchestrator | Aggregate test results step three --------------------------------------- 0.27s 2026-04-03 06:47:56.351090 | orchestrator | Aggregate test results step two ----------------------------------------- 0.26s 2026-04-03 06:47:56.351101 | orchestrator | Print report file information ------------------------------------------- 0.26s 2026-04-03 06:47:56.666129 | orchestrator | + osism validate ceph-osds 2026-04-03 06:48:07.838811 | orchestrator | 2026-04-03 06:48:07.838920 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-03 06:48:07.838935 | orchestrator | 2026-04-03 06:48:07.838948 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 06:48:07.838959 | orchestrator | Friday 03 April 2026 06:48:03 +0000 (0:00:00.428) 0:00:00.428 ********** 2026-04-03 06:48:07.838971 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:07.838982 | orchestrator | 2026-04-03 06:48:07.838994 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 06:48:07.839005 | orchestrator | Friday 03 April 2026 06:48:04 +0000 (0:00:00.828) 0:00:01.256 ********** 2026-04-03 06:48:07.839016 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:07.839027 | orchestrator | 2026-04-03 06:48:07.839038 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 06:48:07.839049 | orchestrator | Friday 03 April 2026 06:48:04 +0000 (0:00:00.510) 0:00:01.766 ********** 2026-04-03 06:48:07.839061 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:07.839072 | orchestrator | 2026-04-03 06:48:07.839083 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 06:48:07.839094 | orchestrator | Friday 03 April 2026 06:48:05 +0000 (0:00:00.721) 0:00:02.488 ********** 2026-04-03 06:48:07.839105 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:07.839117 | orchestrator | 2026-04-03 06:48:07.839129 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-03 06:48:07.839140 | orchestrator | Friday 03 April 2026 06:48:05 +0000 (0:00:00.113) 0:00:02.601 ********** 2026-04-03 06:48:07.839152 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:07.839163 | orchestrator | 2026-04-03 06:48:07.839174 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-03 06:48:07.839201 | orchestrator | Friday 03 April 2026 06:48:05 +0000 (0:00:00.132) 0:00:02.733 ********** 2026-04-03 06:48:07.839213 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:07.839224 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:07.839235 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:07.839246 | orchestrator | 2026-04-03 06:48:07.839257 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-03 06:48:07.839268 | orchestrator | Friday 03 April 2026 06:48:06 +0000 (0:00:00.338) 0:00:03.072 ********** 2026-04-03 06:48:07.839279 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:07.839313 | orchestrator | 2026-04-03 06:48:07.839324 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-03 06:48:07.839335 | orchestrator | Friday 03 April 2026 06:48:06 +0000 (0:00:00.163) 0:00:03.235 ********** 2026-04-03 06:48:07.839347 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:07.839360 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:07.839373 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:07.839385 | orchestrator | 2026-04-03 06:48:07.839398 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-03 06:48:07.839411 | orchestrator | Friday 03 April 2026 06:48:06 +0000 (0:00:00.302) 0:00:03.538 ********** 2026-04-03 06:48:07.839424 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:07.839437 | orchestrator | 2026-04-03 06:48:07.839450 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:48:07.839463 | orchestrator | Friday 03 April 2026 06:48:07 +0000 (0:00:00.770) 0:00:04.308 ********** 2026-04-03 06:48:07.839476 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:07.839489 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:07.839502 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:07.839541 | orchestrator | 2026-04-03 06:48:07.839555 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-03 06:48:07.839568 | orchestrator | Friday 03 April 2026 06:48:07 +0000 (0:00:00.300) 0:00:04.609 ********** 2026-04-03 06:48:07.839585 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'bab67b8e1909de8e074f16121bea2dcc860a9d166c9e842b220c8e073f0e9224', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:07.839602 | orchestrator | skipping: [testbed-node-3] => (item={'id': '7e4afbd7d238c44460c32816b46a593a17b369b65b86b99c384af2dc0f11dbed', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:07.839616 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f0ceae1b3e70d1020426d9a1d781580fa328c666f415772089e9621ded902767', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-03 06:48:07.839630 | orchestrator | skipping: [testbed-node-3] => (item={'id': '659346f722b0c10b195b8ccedc5bb586a2e23f5e07505f2223621aafac0278d1', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 19 minutes (unhealthy)'})  2026-04-03 06:48:07.839644 | orchestrator | skipping: [testbed-node-3] => (item={'id': '44cf4fae30bfb044b0581dc63c842dd34d60a752ab5818e70cbeb2b30e040bae', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-03 06:48:07.839682 | orchestrator | skipping: [testbed-node-3] => (item={'id': '9bc53092296729c83c87ae0452e0f21a2df32f4d094b9a8f9d5d4ffdef698733', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-03 06:48:07.839697 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c075be7d025ce9b49af360855cc23d695998b909fe192f4c1f7b241f130105e4', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 41 minutes (healthy)'})  2026-04-03 06:48:07.839711 | orchestrator | skipping: [testbed-node-3] => (item={'id': '64f534e69772584e5cbeca55d6a7363be9d7988e692592581f9fa46b591a119b', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 06:48:07.839723 | orchestrator | skipping: [testbed-node-3] => (item={'id': '97fcc14d532de89e4842c58b455a1a845bb051086caf78e9c9628ed2c36270f3', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:07.839761 | orchestrator | skipping: [testbed-node-3] => (item={'id': '4988ea9e73241be152c32390404c82ba8c9a6c1f9e3c4932f8902f96e3681e22', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:07.839774 | orchestrator | skipping: [testbed-node-3] => (item={'id': '2cc3e5429457ddcf2f5633bbe7af034f3415730a7b80ca7eedcbff83a04c413a', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:07.839787 | orchestrator | ok: [testbed-node-3] => (item={'id': 'a1436392ed5a9216a96f83a5af06a90e53c08d7282f5466d44d0fead36b2fc9f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:07.839799 | orchestrator | ok: [testbed-node-3] => (item={'id': 'fbe3e0a9c59f8dac6927211c7a987ef50d02faee9caa6666ce89e818f9e37178', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:07.839810 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'aff198b99ae8f229699e42be5b32739e165897f61d016c34b74e5ff581e3f4ca', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:07.839821 | orchestrator | skipping: [testbed-node-3] => (item={'id': '158915fe87b5a2db5bdb3830beddcc44e9fb95ce3feda54e235e80438563ef4d', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:07.839833 | orchestrator | skipping: [testbed-node-3] => (item={'id': '53e09988b53ced8b9002e4524add97778987aa65805b9f515a8e2f3b30eed88b', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:07.839845 | orchestrator | skipping: [testbed-node-3] => (item={'id': '0d0408f5ad085f46e36cb21463618af9e7e0e362ac5c2fd860cdf1e0a3201ecc', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:07.839856 | orchestrator | skipping: [testbed-node-3] => (item={'id': '58f673df05a1ccfaab2e605610cb9561cb5f3620958a2cf1f6552a58e79e6ec1', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:07.839868 | orchestrator | skipping: [testbed-node-3] => (item={'id': '431b4097853359325e7725a76bc04b9515bc910dcf97a7a6a1ed13378bf06508', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:07.839879 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'd59688eb57492b4a4ab6e5e3dcccbc8a728d5870f65f09d07a488658f858fe39', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:07.839898 | orchestrator | skipping: [testbed-node-4] => (item={'id': '3642e032d7a0628158bc2dd02508efad00346edf4ad29201a692cc441e85bbb4', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:08.130173 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ba02a9ce049bd5b7a07541513eb9930c834813a48067bfd0eb52aedcda73c9b7', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-03 06:48:08.130286 | orchestrator | skipping: [testbed-node-4] => (item={'id': '6dea97f74ff6cb0ef6c727c0d5d924df0ecbd0c3fb479efd106ad6760cb0217e', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 19 minutes (unhealthy)'})  2026-04-03 06:48:08.130299 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'c87c95637cf99471fff36195e4061e961f7a717d0b44a53bed3b666fd1184f9b', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-03 06:48:08.130311 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ae98c99ef8f0773e8c785d14d7769b34532929a2c1c731eecf59aa9ab1a95b57', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-03 06:48:08.130321 | orchestrator | skipping: [testbed-node-4] => (item={'id': '181a61df0ff7f9f68fc1f75cd1a07e9806db20dc72b688ab6f435c810bff1744', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 41 minutes (healthy)'})  2026-04-03 06:48:08.130372 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'c15e6b8fb8601e4381e4fef25a85570a7f75ea737396262a56e9adea8b1eb279', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 06:48:08.130383 | orchestrator | skipping: [testbed-node-4] => (item={'id': '7e578cba975bcad5ccfc4d2b5e19ae8bc2315c25c51b0cd61f7b2b7107b093e9', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130393 | orchestrator | skipping: [testbed-node-4] => (item={'id': '28ccff12facb9dc1800d5e51e77a1308d6e8b077696261e3c58009a49840d849', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130403 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'addad19d67fc6704f6faa874c53cffb2c397cf2a77bfccd5abf76a83ed899209', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130414 | orchestrator | ok: [testbed-node-4] => (item={'id': 'f3ada89ded370556442296a532cbdf0abed23a77c4f61954903384031ef2c456', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:08.130423 | orchestrator | ok: [testbed-node-4] => (item={'id': 'd56e7269384561cd0f912ef06dc4780f6e7f0303f109eda82d430c04447de341', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:08.130433 | orchestrator | skipping: [testbed-node-4] => (item={'id': '369dc127787bf5e75c3f7b1a5e9f43456ae96713caba7a961c696da985b3aa4d', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130442 | orchestrator | skipping: [testbed-node-4] => (item={'id': '0fba4ad0fdca966764e308d10e85c96e0837957362fbf8ffd1e0504a3502a778', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:08.130451 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'd2a7a3453e16510ce76750f4fb49b76f5cf345665b8bdeac84cf624abbfc28f2', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:08.130477 | orchestrator | skipping: [testbed-node-4] => (item={'id': '894f8d1b226e7ec260a291388ebd0ad98dfdc6815aa81e97082a0cac096e6f73', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:08.130494 | orchestrator | skipping: [testbed-node-4] => (item={'id': '229dc684a81bf9615d1f729b25b63e9887004c39feef8505ad827e1dd441c05a', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:08.130504 | orchestrator | skipping: [testbed-node-4] => (item={'id': '3c7907a6b9189c3db160ee3a269aa964eb253ee73e0edaf14e3914bfdcb81765', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:08.130513 | orchestrator | skipping: [testbed-node-5] => (item={'id': '20cadf4e3be0350c1a54afaec4bb2566f35dd7908e06a155de9efa2b83222ede', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:08.130578 | orchestrator | skipping: [testbed-node-5] => (item={'id': '5e76d663e09083d2bda6022be12bd288718e7439c68e09d335f0d621dfc6b358', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 9 minutes'})  2026-04-03 06:48:08.130594 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'cb3fb4c682e759269fab16a9fc41185e939f3b57dd695afea3ad33ef52b60183', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-03 06:48:08.130608 | orchestrator | skipping: [testbed-node-5] => (item={'id': '07f4be2377e06a31969363cff2b7336ddff8ec3edd291b143a9429fda3eb2298', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 19 minutes (unhealthy)'})  2026-04-03 06:48:08.130622 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'df21bf09891a3e9190b94b0017e5c85f018e2dab1bbfdc0e6ddef2bbdfd62fc2', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-03 06:48:08.130632 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'b1013867132b7c4bdf67a5528400104aa9bffed136339e0f2791f7a83fbd104f', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-03 06:48:08.130641 | orchestrator | skipping: [testbed-node-5] => (item={'id': '576bfcbbb5e5c364d744babf4ba59bd32dbf0404cdf4179f2612e22604b2e34d', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-03 06:48:08.130650 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'f9a0e1449d4efcb56668896cc38385a7eccb6027a2a4df1b3e0666d7aa23cb41', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 06:48:08.130659 | orchestrator | skipping: [testbed-node-5] => (item={'id': '6ce766fccc5d3c1b4a59934ba9b84c5a2c6f6a7ed4417af004d99165c0048b2e', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130668 | orchestrator | skipping: [testbed-node-5] => (item={'id': '01027af26271b9b7c3c5667f2eb3150a4947052e8f253cb1b438ef1cfb45069d', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130677 | orchestrator | skipping: [testbed-node-5] => (item={'id': '71610917f3ef7a9ca4e624a28ac48eb96adf76e1fec63433c20a92f93221c7f4', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:08.130693 | orchestrator | ok: [testbed-node-5] => (item={'id': '37e842b9926208c355f5e9c622a2e37d24ff5062efc73ca423f209394bb5e43f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:08.130709 | orchestrator | ok: [testbed-node-5] => (item={'id': 'a4262cae3d8cb8b14e8af23f8cd86a02657d6d57c6463c8c37ff540ee3d25f0f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-03 06:48:19.162414 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2675901ec684fee3d2515516ea95f16aea94674684c1342afe20cee3ad29a90b', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 06:48:19.162630 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'd790b11447df6d511c88294c252c07c9d4536d40f95707988dc4347506654262', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:19.162650 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2532dc74d92a7e4b8cf5c5047bbc9850c81e5be3eb74977b29cee739023806de', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 06:48:19.162683 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7f69e650d6a53d74f9da1e07484c10f71d4ce9bb9e821a3e9bfba90160f38122', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:19.162697 | orchestrator | skipping: [testbed-node-5] => (item={'id': '6efa88c09d239fa9d27e0d6175f9cc10c5155c2ccd7508625116f4b3ae42ab41', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:19.162710 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'df0f43da4256733f54e41a766b37e9ddbfaf7c06cee0539d291da22d27d62a34', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 06:48:19.162722 | orchestrator | 2026-04-03 06:48:19.162736 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-03 06:48:19.162749 | orchestrator | Friday 03 April 2026 06:48:08 +0000 (0:00:00.554) 0:00:05.163 ********** 2026-04-03 06:48:19.162760 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.162772 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.162783 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.162794 | orchestrator | 2026-04-03 06:48:19.162805 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-03 06:48:19.162816 | orchestrator | Friday 03 April 2026 06:48:08 +0000 (0:00:00.291) 0:00:05.454 ********** 2026-04-03 06:48:19.162843 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.162855 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:19.162867 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:19.162889 | orchestrator | 2026-04-03 06:48:19.162901 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-03 06:48:19.162912 | orchestrator | Friday 03 April 2026 06:48:08 +0000 (0:00:00.486) 0:00:05.941 ********** 2026-04-03 06:48:19.162923 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.162935 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.162946 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.162959 | orchestrator | 2026-04-03 06:48:19.162972 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:48:19.162984 | orchestrator | Friday 03 April 2026 06:48:09 +0000 (0:00:00.307) 0:00:06.248 ********** 2026-04-03 06:48:19.163019 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.163032 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.163044 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.163056 | orchestrator | 2026-04-03 06:48:19.163069 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-03 06:48:19.163081 | orchestrator | Friday 03 April 2026 06:48:09 +0000 (0:00:00.294) 0:00:06.543 ********** 2026-04-03 06:48:19.163094 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-03 06:48:19.163108 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-03 06:48:19.163121 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163134 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-03 06:48:19.163146 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-03 06:48:19.163159 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:19.163171 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-03 06:48:19.163184 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-03 06:48:19.163196 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:19.163208 | orchestrator | 2026-04-03 06:48:19.163219 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-03 06:48:19.163230 | orchestrator | Friday 03 April 2026 06:48:09 +0000 (0:00:00.363) 0:00:06.907 ********** 2026-04-03 06:48:19.163241 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.163252 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.163263 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.163274 | orchestrator | 2026-04-03 06:48:19.163286 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-03 06:48:19.163297 | orchestrator | Friday 03 April 2026 06:48:10 +0000 (0:00:00.553) 0:00:07.460 ********** 2026-04-03 06:48:19.163308 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163338 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:19.163350 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:19.163362 | orchestrator | 2026-04-03 06:48:19.163373 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-03 06:48:19.163384 | orchestrator | Friday 03 April 2026 06:48:10 +0000 (0:00:00.316) 0:00:07.777 ********** 2026-04-03 06:48:19.163396 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163407 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:19.163418 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:19.163429 | orchestrator | 2026-04-03 06:48:19.163441 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-03 06:48:19.163452 | orchestrator | Friday 03 April 2026 06:48:11 +0000 (0:00:00.304) 0:00:08.082 ********** 2026-04-03 06:48:19.163463 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.163474 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.163485 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.163496 | orchestrator | 2026-04-03 06:48:19.163507 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:48:19.163537 | orchestrator | Friday 03 April 2026 06:48:11 +0000 (0:00:00.499) 0:00:08.581 ********** 2026-04-03 06:48:19.163549 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163560 | orchestrator | 2026-04-03 06:48:19.163571 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:48:19.163582 | orchestrator | Friday 03 April 2026 06:48:11 +0000 (0:00:00.254) 0:00:08.836 ********** 2026-04-03 06:48:19.163600 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163611 | orchestrator | 2026-04-03 06:48:19.163622 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:48:19.163633 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.267) 0:00:09.103 ********** 2026-04-03 06:48:19.163652 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163664 | orchestrator | 2026-04-03 06:48:19.163675 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:19.163686 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.266) 0:00:09.370 ********** 2026-04-03 06:48:19.163697 | orchestrator | 2026-04-03 06:48:19.163708 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:19.163719 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.093) 0:00:09.463 ********** 2026-04-03 06:48:19.163730 | orchestrator | 2026-04-03 06:48:19.163742 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:19.163753 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.099) 0:00:09.563 ********** 2026-04-03 06:48:19.163764 | orchestrator | 2026-04-03 06:48:19.163775 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:48:19.163786 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.073) 0:00:09.637 ********** 2026-04-03 06:48:19.163797 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163808 | orchestrator | 2026-04-03 06:48:19.163820 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-03 06:48:19.163831 | orchestrator | Friday 03 April 2026 06:48:12 +0000 (0:00:00.266) 0:00:09.904 ********** 2026-04-03 06:48:19.163842 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.163853 | orchestrator | 2026-04-03 06:48:19.163864 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:48:19.163875 | orchestrator | Friday 03 April 2026 06:48:13 +0000 (0:00:00.244) 0:00:10.148 ********** 2026-04-03 06:48:19.163886 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.163897 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.163908 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.163919 | orchestrator | 2026-04-03 06:48:19.163930 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-03 06:48:19.163941 | orchestrator | Friday 03 April 2026 06:48:13 +0000 (0:00:00.298) 0:00:10.446 ********** 2026-04-03 06:48:19.163952 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.163963 | orchestrator | 2026-04-03 06:48:19.163975 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-03 06:48:19.163986 | orchestrator | Friday 03 April 2026 06:48:14 +0000 (0:00:00.647) 0:00:11.094 ********** 2026-04-03 06:48:19.163997 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 06:48:19.164008 | orchestrator | 2026-04-03 06:48:19.164019 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-03 06:48:19.164030 | orchestrator | Friday 03 April 2026 06:48:15 +0000 (0:00:01.595) 0:00:12.690 ********** 2026-04-03 06:48:19.164041 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.164052 | orchestrator | 2026-04-03 06:48:19.164063 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-03 06:48:19.164075 | orchestrator | Friday 03 April 2026 06:48:15 +0000 (0:00:00.140) 0:00:12.831 ********** 2026-04-03 06:48:19.164086 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.164097 | orchestrator | 2026-04-03 06:48:19.164108 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-03 06:48:19.164119 | orchestrator | Friday 03 April 2026 06:48:16 +0000 (0:00:00.310) 0:00:13.141 ********** 2026-04-03 06:48:19.164130 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:19.164141 | orchestrator | 2026-04-03 06:48:19.164152 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-03 06:48:19.164164 | orchestrator | Friday 03 April 2026 06:48:16 +0000 (0:00:00.145) 0:00:13.287 ********** 2026-04-03 06:48:19.164175 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.164186 | orchestrator | 2026-04-03 06:48:19.164197 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:48:19.164208 | orchestrator | Friday 03 April 2026 06:48:16 +0000 (0:00:00.140) 0:00:13.427 ********** 2026-04-03 06:48:19.164219 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:19.164236 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:19.164248 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:19.164259 | orchestrator | 2026-04-03 06:48:19.164270 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-03 06:48:19.164281 | orchestrator | Friday 03 April 2026 06:48:16 +0000 (0:00:00.316) 0:00:13.744 ********** 2026-04-03 06:48:19.164292 | orchestrator | changed: [testbed-node-3] 2026-04-03 06:48:19.164304 | orchestrator | changed: [testbed-node-4] 2026-04-03 06:48:19.164315 | orchestrator | changed: [testbed-node-5] 2026-04-03 06:48:29.616050 | orchestrator | 2026-04-03 06:48:29.616157 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-03 06:48:29.616184 | orchestrator | Friday 03 April 2026 06:48:19 +0000 (0:00:02.448) 0:00:16.193 ********** 2026-04-03 06:48:29.616203 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616222 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616250 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616270 | orchestrator | 2026-04-03 06:48:29.616290 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-03 06:48:29.616310 | orchestrator | Friday 03 April 2026 06:48:19 +0000 (0:00:00.372) 0:00:16.565 ********** 2026-04-03 06:48:29.616330 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616347 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616359 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616370 | orchestrator | 2026-04-03 06:48:29.616381 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-03 06:48:29.616392 | orchestrator | Friday 03 April 2026 06:48:20 +0000 (0:00:00.545) 0:00:17.111 ********** 2026-04-03 06:48:29.616403 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:29.616415 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:29.616426 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:29.616437 | orchestrator | 2026-04-03 06:48:29.616448 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-03 06:48:29.616460 | orchestrator | Friday 03 April 2026 06:48:20 +0000 (0:00:00.325) 0:00:17.437 ********** 2026-04-03 06:48:29.616471 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616482 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616493 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616504 | orchestrator | 2026-04-03 06:48:29.616515 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-03 06:48:29.616568 | orchestrator | Friday 03 April 2026 06:48:20 +0000 (0:00:00.550) 0:00:17.987 ********** 2026-04-03 06:48:29.616579 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:29.616592 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:29.616625 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:29.616638 | orchestrator | 2026-04-03 06:48:29.616651 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-03 06:48:29.616664 | orchestrator | Friday 03 April 2026 06:48:21 +0000 (0:00:00.309) 0:00:18.297 ********** 2026-04-03 06:48:29.616677 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:29.616690 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:29.616703 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:29.616715 | orchestrator | 2026-04-03 06:48:29.616728 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 06:48:29.616742 | orchestrator | Friday 03 April 2026 06:48:21 +0000 (0:00:00.289) 0:00:18.586 ********** 2026-04-03 06:48:29.616755 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616768 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616781 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616794 | orchestrator | 2026-04-03 06:48:29.616807 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-03 06:48:29.616820 | orchestrator | Friday 03 April 2026 06:48:22 +0000 (0:00:00.495) 0:00:19.082 ********** 2026-04-03 06:48:29.616833 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616845 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616858 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616894 | orchestrator | 2026-04-03 06:48:29.616908 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-03 06:48:29.616921 | orchestrator | Friday 03 April 2026 06:48:22 +0000 (0:00:00.763) 0:00:19.845 ********** 2026-04-03 06:48:29.616935 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.616947 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.616958 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.616969 | orchestrator | 2026-04-03 06:48:29.616979 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-03 06:48:29.616991 | orchestrator | Friday 03 April 2026 06:48:23 +0000 (0:00:00.320) 0:00:20.166 ********** 2026-04-03 06:48:29.617002 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:29.617013 | orchestrator | skipping: [testbed-node-4] 2026-04-03 06:48:29.617024 | orchestrator | skipping: [testbed-node-5] 2026-04-03 06:48:29.617034 | orchestrator | 2026-04-03 06:48:29.617046 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-03 06:48:29.617056 | orchestrator | Friday 03 April 2026 06:48:23 +0000 (0:00:00.304) 0:00:20.471 ********** 2026-04-03 06:48:29.617067 | orchestrator | ok: [testbed-node-3] 2026-04-03 06:48:29.617078 | orchestrator | ok: [testbed-node-4] 2026-04-03 06:48:29.617089 | orchestrator | ok: [testbed-node-5] 2026-04-03 06:48:29.617099 | orchestrator | 2026-04-03 06:48:29.617111 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 06:48:29.617121 | orchestrator | Friday 03 April 2026 06:48:23 +0000 (0:00:00.521) 0:00:20.993 ********** 2026-04-03 06:48:29.617132 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:29.617143 | orchestrator | 2026-04-03 06:48:29.617155 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 06:48:29.617171 | orchestrator | Friday 03 April 2026 06:48:24 +0000 (0:00:00.275) 0:00:21.269 ********** 2026-04-03 06:48:29.617190 | orchestrator | skipping: [testbed-node-3] 2026-04-03 06:48:29.617208 | orchestrator | 2026-04-03 06:48:29.617226 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 06:48:29.617244 | orchestrator | Friday 03 April 2026 06:48:24 +0000 (0:00:00.264) 0:00:21.534 ********** 2026-04-03 06:48:29.617262 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:29.617280 | orchestrator | 2026-04-03 06:48:29.617300 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 06:48:29.617319 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:01.670) 0:00:23.204 ********** 2026-04-03 06:48:29.617337 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:29.617356 | orchestrator | 2026-04-03 06:48:29.617375 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 06:48:29.617392 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:00.275) 0:00:23.479 ********** 2026-04-03 06:48:29.617410 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:29.617427 | orchestrator | 2026-04-03 06:48:29.617467 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:29.617486 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:00.261) 0:00:23.741 ********** 2026-04-03 06:48:29.617503 | orchestrator | 2026-04-03 06:48:29.617542 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:29.617562 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:00.071) 0:00:23.813 ********** 2026-04-03 06:48:29.617578 | orchestrator | 2026-04-03 06:48:29.617595 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 06:48:29.617612 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:00.071) 0:00:23.884 ********** 2026-04-03 06:48:29.617629 | orchestrator | 2026-04-03 06:48:29.617646 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 06:48:29.617665 | orchestrator | Friday 03 April 2026 06:48:26 +0000 (0:00:00.074) 0:00:23.959 ********** 2026-04-03 06:48:29.617691 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 06:48:29.617724 | orchestrator | 2026-04-03 06:48:29.617741 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 06:48:29.617758 | orchestrator | Friday 03 April 2026 06:48:28 +0000 (0:00:01.504) 0:00:25.464 ********** 2026-04-03 06:48:29.617776 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-03 06:48:29.617795 | orchestrator |  "msg": [ 2026-04-03 06:48:29.617811 | orchestrator |  "Validator run completed.", 2026-04-03 06:48:29.617837 | orchestrator |  "You can find the report file here:", 2026-04-03 06:48:29.617854 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-03T06:48:04+00:00-report.json", 2026-04-03 06:48:29.617872 | orchestrator |  "on the following host:", 2026-04-03 06:48:29.617889 | orchestrator |  "testbed-manager" 2026-04-03 06:48:29.617905 | orchestrator |  ] 2026-04-03 06:48:29.617922 | orchestrator | } 2026-04-03 06:48:29.617939 | orchestrator | 2026-04-03 06:48:29.617956 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:48:29.617976 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 06:48:29.617996 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 06:48:29.618014 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 06:48:29.618125 | orchestrator | 2026-04-03 06:48:29.618145 | orchestrator | 2026-04-03 06:48:29.618163 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:48:29.618183 | orchestrator | Friday 03 April 2026 06:48:29 +0000 (0:00:00.841) 0:00:26.305 ********** 2026-04-03 06:48:29.618204 | orchestrator | =============================================================================== 2026-04-03 06:48:29.618223 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 2.45s 2026-04-03 06:48:29.618242 | orchestrator | Aggregate test results step one ----------------------------------------- 1.67s 2026-04-03 06:48:29.618262 | orchestrator | Get ceph osd tree ------------------------------------------------------- 1.60s 2026-04-03 06:48:29.618279 | orchestrator | Write report file ------------------------------------------------------- 1.51s 2026-04-03 06:48:29.618290 | orchestrator | Print report file information ------------------------------------------- 0.84s 2026-04-03 06:48:29.618301 | orchestrator | Get timestamp for report file ------------------------------------------- 0.83s 2026-04-03 06:48:29.618313 | orchestrator | Calculate total number of OSDs in cluster ------------------------------- 0.77s 2026-04-03 06:48:29.618324 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 0.76s 2026-04-03 06:48:29.618335 | orchestrator | Create report output directory ------------------------------------------ 0.72s 2026-04-03 06:48:29.618346 | orchestrator | Set _mon_hostname fact -------------------------------------------------- 0.65s 2026-04-03 06:48:29.618356 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 0.55s 2026-04-03 06:48:29.618367 | orchestrator | Get count of ceph-osd containers that are not running ------------------- 0.55s 2026-04-03 06:48:29.618378 | orchestrator | Pass if count of encrypted OSDs equals count of OSDs -------------------- 0.55s 2026-04-03 06:48:29.618389 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 0.55s 2026-04-03 06:48:29.618400 | orchestrator | Pass test if no sub test failed ----------------------------------------- 0.52s 2026-04-03 06:48:29.618411 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.51s 2026-04-03 06:48:29.618422 | orchestrator | Set test result to passed if all containers are running ----------------- 0.50s 2026-04-03 06:48:29.618433 | orchestrator | Prepare test data ------------------------------------------------------- 0.50s 2026-04-03 06:48:29.618444 | orchestrator | Set test result to failed when count of containers is wrong ------------- 0.49s 2026-04-03 06:48:29.618467 | orchestrator | Parse LVM data as JSON -------------------------------------------------- 0.37s 2026-04-03 06:48:29.919291 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-03 06:48:29.927848 | orchestrator | + set -e 2026-04-03 06:48:29.927929 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 06:48:29.928849 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 06:48:29.928882 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 06:48:29.928893 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 06:48:29.928905 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 06:48:29.929139 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 06:48:29.929156 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 06:48:29.929168 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:48:29.929178 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:48:29.929189 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 06:48:29.929200 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 06:48:29.929367 | orchestrator | ++ export ARA=false 2026-04-03 06:48:29.929383 | orchestrator | ++ ARA=false 2026-04-03 06:48:29.929394 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 06:48:29.929405 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 06:48:29.929416 | orchestrator | ++ export TEMPEST=false 2026-04-03 06:48:29.929427 | orchestrator | ++ TEMPEST=false 2026-04-03 06:48:29.929438 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 06:48:29.929449 | orchestrator | ++ IS_ZUUL=true 2026-04-03 06:48:29.929460 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:48:29.929471 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 06:48:29.929482 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 06:48:29.929493 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 06:48:29.929503 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 06:48:29.929514 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 06:48:29.929556 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 06:48:29.929568 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 06:48:29.929579 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 06:48:29.929590 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 06:48:29.929602 | orchestrator | + source /etc/os-release 2026-04-03 06:48:29.929621 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-03 06:48:29.929633 | orchestrator | ++ NAME=Ubuntu 2026-04-03 06:48:29.929644 | orchestrator | ++ VERSION_ID=24.04 2026-04-03 06:48:29.929655 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-03 06:48:29.929666 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-03 06:48:29.929677 | orchestrator | ++ ID=ubuntu 2026-04-03 06:48:29.929688 | orchestrator | ++ ID_LIKE=debian 2026-04-03 06:48:29.929699 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-03 06:48:29.929710 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-03 06:48:29.929721 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-03 06:48:29.929733 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-03 06:48:29.929745 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-03 06:48:29.929756 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-03 06:48:29.929767 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-03 06:48:29.929797 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-03 06:48:29.929810 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-03 06:48:29.954877 | orchestrator | + sudo apt-get install -y libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-03 06:48:53.799333 | orchestrator | 2026-04-03 06:48:53.799440 | orchestrator | # Status of Elasticsearch 2026-04-03 06:48:53.799457 | orchestrator | 2026-04-03 06:48:53.799469 | orchestrator | + pushd /opt/configuration/contrib 2026-04-03 06:48:53.799481 | orchestrator | + echo 2026-04-03 06:48:53.799492 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-03 06:48:53.799503 | orchestrator | + echo 2026-04-03 06:48:53.799514 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-03 06:48:54.006128 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-03 06:48:54.006223 | orchestrator | 2026-04-03 06:48:54.006240 | orchestrator | # Status of MariaDB 2026-04-03 06:48:54.006293 | orchestrator | 2026-04-03 06:48:54.006313 | orchestrator | + echo 2026-04-03 06:48:54.006333 | orchestrator | + echo '# Status of MariaDB' 2026-04-03 06:48:54.006353 | orchestrator | + echo 2026-04-03 06:48:54.006746 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 06:48:54.053976 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 06:48:54.054123 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 06:48:54.054139 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-03 06:48:54.054153 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-03 06:48:54.118600 | orchestrator | Reading package lists... 2026-04-03 06:48:54.475093 | orchestrator | Building dependency tree... 2026-04-03 06:48:54.475204 | orchestrator | Reading state information... 2026-04-03 06:48:54.853825 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-03 06:48:54.853923 | orchestrator | bc set to manually installed. 2026-04-03 06:48:54.853939 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded. 2026-04-03 06:48:55.538357 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-03 06:48:55.538706 | orchestrator | 2026-04-03 06:48:55.538734 | orchestrator | # Status of Prometheus 2026-04-03 06:48:55.538748 | orchestrator | 2026-04-03 06:48:55.538760 | orchestrator | + echo 2026-04-03 06:48:55.538772 | orchestrator | + echo '# Status of Prometheus' 2026-04-03 06:48:55.538784 | orchestrator | + echo 2026-04-03 06:48:55.538795 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-03 06:48:55.589198 | orchestrator | Unauthorized 2026-04-03 06:48:55.591969 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-03 06:48:55.689110 | orchestrator | Unauthorized 2026-04-03 06:48:55.696415 | orchestrator | 2026-04-03 06:48:55.696485 | orchestrator | # Status of RabbitMQ 2026-04-03 06:48:55.696499 | orchestrator | 2026-04-03 06:48:55.696509 | orchestrator | + echo 2026-04-03 06:48:55.696518 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-03 06:48:55.696561 | orchestrator | + echo 2026-04-03 06:48:55.697943 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 06:48:55.761981 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 06:48:55.762128 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 06:48:55.762147 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-03 06:48:56.213725 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-03 06:48:56.223004 | orchestrator | 2026-04-03 06:48:56.223087 | orchestrator | # Status of Redis 2026-04-03 06:48:56.223108 | orchestrator | 2026-04-03 06:48:56.223126 | orchestrator | + echo 2026-04-03 06:48:56.223143 | orchestrator | + echo '# Status of Redis' 2026-04-03 06:48:56.223161 | orchestrator | + echo 2026-04-03 06:48:56.223180 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-03 06:48:56.227840 | orchestrator | TCP OK - 0.002 second response time on 192.168.16.10 port 6379|time=0.001816s;;;0.000000;10.000000 2026-04-03 06:48:56.227904 | orchestrator | 2026-04-03 06:48:56.227923 | orchestrator | # Create backup of MariaDB database 2026-04-03 06:48:56.227940 | orchestrator | 2026-04-03 06:48:56.227957 | orchestrator | + popd 2026-04-03 06:48:56.227973 | orchestrator | + echo 2026-04-03 06:48:56.227989 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-03 06:48:56.228007 | orchestrator | + echo 2026-04-03 06:48:56.228017 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-03 06:48:58.261850 | orchestrator | 2026-04-03 06:48:58 | INFO  | Task 7acea374-a535-4815-9942-7d7300705a8f (mariadb_backup) was prepared for execution. 2026-04-03 06:48:58.261940 | orchestrator | 2026-04-03 06:48:58 | INFO  | It takes a moment until task 7acea374-a535-4815-9942-7d7300705a8f (mariadb_backup) has been started and output is visible here. 2026-04-03 06:51:56.436112 | orchestrator | 2026-04-03 06:51:56.436233 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 06:51:56.436252 | orchestrator | 2026-04-03 06:51:56.436265 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 06:51:56.436277 | orchestrator | Friday 03 April 2026 06:49:02 +0000 (0:00:00.173) 0:00:00.173 ********** 2026-04-03 06:51:56.436288 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:51:56.436300 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:51:56.436319 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:51:56.436366 | orchestrator | 2026-04-03 06:51:56.436386 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 06:51:56.436467 | orchestrator | Friday 03 April 2026 06:49:02 +0000 (0:00:00.345) 0:00:00.518 ********** 2026-04-03 06:51:56.436487 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-03 06:51:56.436523 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-03 06:51:56.436543 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-03 06:51:56.436562 | orchestrator | 2026-04-03 06:51:56.436643 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-03 06:51:56.436657 | orchestrator | 2026-04-03 06:51:56.436671 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-03 06:51:56.436683 | orchestrator | Friday 03 April 2026 06:49:03 +0000 (0:00:00.565) 0:00:01.084 ********** 2026-04-03 06:51:56.436696 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 06:51:56.436710 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 06:51:56.436722 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 06:51:56.436735 | orchestrator | 2026-04-03 06:51:56.436748 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 06:51:56.436760 | orchestrator | Friday 03 April 2026 06:49:03 +0000 (0:00:00.385) 0:00:01.470 ********** 2026-04-03 06:51:56.436790 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 06:51:56.436805 | orchestrator | 2026-04-03 06:51:56.436818 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-03 06:51:56.436831 | orchestrator | Friday 03 April 2026 06:49:04 +0000 (0:00:00.544) 0:00:02.015 ********** 2026-04-03 06:51:56.436844 | orchestrator | ok: [testbed-node-0] 2026-04-03 06:51:56.436856 | orchestrator | ok: [testbed-node-1] 2026-04-03 06:51:56.436867 | orchestrator | ok: [testbed-node-2] 2026-04-03 06:51:56.436878 | orchestrator | 2026-04-03 06:51:56.436889 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-03 06:51:56.436900 | orchestrator | Friday 03 April 2026 06:49:07 +0000 (0:00:03.222) 0:00:05.238 ********** 2026-04-03 06:51:56.436911 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:51:56.436923 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:51:56.436934 | orchestrator | 2026-04-03 06:51:56.436945 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-03 06:51:56.436956 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-03 06:51:56.436966 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-03 06:51:56.436977 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-03 06:51:56.436988 | orchestrator | mariadb_bootstrap_restart 2026-04-03 06:51:56.436999 | orchestrator | changed: [testbed-node-0] 2026-04-03 06:51:56.437010 | orchestrator | 2026-04-03 06:51:56.437021 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 06:51:56.437032 | orchestrator | skipping: no hosts matched 2026-04-03 06:51:56.437043 | orchestrator | 2026-04-03 06:51:56.437054 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-03 06:51:56.437064 | orchestrator | skipping: no hosts matched 2026-04-03 06:51:56.437075 | orchestrator | 2026-04-03 06:51:56.437086 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-03 06:51:56.437097 | orchestrator | skipping: no hosts matched 2026-04-03 06:51:56.437108 | orchestrator | 2026-04-03 06:51:56.437119 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-03 06:51:56.437130 | orchestrator | 2026-04-03 06:51:56.437140 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-03 06:51:56.437151 | orchestrator | Friday 03 April 2026 06:51:55 +0000 (0:02:47.843) 0:02:53.081 ********** 2026-04-03 06:51:56.437162 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:51:56.437184 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:51:56.437195 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:51:56.437206 | orchestrator | 2026-04-03 06:51:56.437217 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-03 06:51:56.437228 | orchestrator | Friday 03 April 2026 06:51:55 +0000 (0:00:00.308) 0:02:53.389 ********** 2026-04-03 06:51:56.437238 | orchestrator | skipping: [testbed-node-0] 2026-04-03 06:51:56.437249 | orchestrator | skipping: [testbed-node-1] 2026-04-03 06:51:56.437260 | orchestrator | skipping: [testbed-node-2] 2026-04-03 06:51:56.437271 | orchestrator | 2026-04-03 06:51:56.437282 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:51:56.437294 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 06:51:56.437307 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 06:51:56.437318 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 06:51:56.437329 | orchestrator | 2026-04-03 06:51:56.437340 | orchestrator | 2026-04-03 06:51:56.437351 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:51:56.437362 | orchestrator | Friday 03 April 2026 06:51:56 +0000 (0:00:00.398) 0:02:53.788 ********** 2026-04-03 06:51:56.437373 | orchestrator | =============================================================================== 2026-04-03 06:51:56.437403 | orchestrator | mariadb : Taking full database backup via Mariabackup ----------------- 167.84s 2026-04-03 06:51:56.437414 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 3.22s 2026-04-03 06:51:56.437426 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.57s 2026-04-03 06:51:56.437437 | orchestrator | mariadb : include_tasks ------------------------------------------------- 0.54s 2026-04-03 06:51:56.437447 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 0.40s 2026-04-03 06:51:56.437458 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 0.39s 2026-04-03 06:51:56.437469 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.35s 2026-04-03 06:51:56.437480 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 0.31s 2026-04-03 06:51:56.734746 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-03 06:51:56.742941 | orchestrator | + set -e 2026-04-03 06:51:56.743004 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 06:51:56.743692 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 06:51:56.743752 | orchestrator | ++ INTERACTIVE=false 2026-04-03 06:51:56.743766 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 06:51:56.743780 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 06:51:56.743923 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 06:51:56.745529 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:51:56.748746 | orchestrator | 2026-04-03 06:51:56.748845 | orchestrator | # OpenStack endpoints 2026-04-03 06:51:56.748861 | orchestrator | 2026-04-03 06:51:56.748872 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 06:51:56.748883 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 06:51:56.748893 | orchestrator | + export OS_CLOUD=admin 2026-04-03 06:51:56.748903 | orchestrator | + OS_CLOUD=admin 2026-04-03 06:51:56.748913 | orchestrator | + echo 2026-04-03 06:51:56.748923 | orchestrator | + echo '# OpenStack endpoints' 2026-04-03 06:51:56.748933 | orchestrator | + echo 2026-04-03 06:51:56.748943 | orchestrator | + openstack endpoint list 2026-04-03 06:51:59.849881 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 06:51:59.849983 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-03 06:51:59.850085 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 06:51:59.850100 | orchestrator | | 082ee53dd9e54968add4014d233e6c06 | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-03 06:51:59.850112 | orchestrator | | 1b5f1cac262d48f0bd14fd22ee5898a2 | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-03 06:51:59.850123 | orchestrator | | 23134758f33448709a9b2cc57e9d27bc | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-03 06:51:59.850134 | orchestrator | | 323ba5c1a81c4c9ea3dc85f6ffe6d39a | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-03 06:51:59.850145 | orchestrator | | 3a8070fd23c94e1f96cf1b9a38e20b9b | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-03 06:51:59.850157 | orchestrator | | 3e0759293b614755b997159c5cf28e9d | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-03 06:51:59.850168 | orchestrator | | 4937ebcecc6a41c19d61e18b059d3ecf | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-03 06:51:59.850178 | orchestrator | | 50bf04dcd02f4fcdaf4e4d165fd8396f | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-03 06:51:59.850189 | orchestrator | | 5db384999a5b4a3491c708321d85709e | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-03 06:51:59.850217 | orchestrator | | 63dd909081fe4b24a1a17dc1ee0f69de | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-03 06:51:59.850229 | orchestrator | | 7000599b8b4648cca3db59c897c4e5ae | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-03 06:51:59.850240 | orchestrator | | 776a5fbfee3a4995bc60548c8f8287bf | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-03 06:51:59.850251 | orchestrator | | 7a79f4cbe8e34db0a4b336fb6b4a3e8e | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-03 06:51:59.850262 | orchestrator | | 7cdc566ae93e42babbad64c9ffa61f27 | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-03 06:51:59.850273 | orchestrator | | 7d192a0338d24a91936863d1279e8eb3 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-03 06:51:59.850284 | orchestrator | | 7d2f4e9edc9b4fb688591f843de03696 | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-03 06:51:59.850295 | orchestrator | | 7ee7ffd7e732424bad71f96decac54a0 | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-03 06:51:59.850306 | orchestrator | | 84c2945f0c9d4c5599e6648b26454668 | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-03 06:51:59.850317 | orchestrator | | 905f95551e48444bb8f96b75186eea83 | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-03 06:51:59.850328 | orchestrator | | 907de752841f4c969ddd67aba6deabba | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-03 06:51:59.850365 | orchestrator | | 9fee805f0be54dbcbd1d5b36b5cde04a | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-03 06:51:59.850383 | orchestrator | | a485fd156e644eb9aa6b317ff2be0c1d | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-03 06:51:59.850394 | orchestrator | | b0ce7996f1744cd0b9224edd10d22c43 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-03 06:51:59.850405 | orchestrator | | bd51fbb4cfe34ad5b79d29dc93fb9687 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-03 06:51:59.850416 | orchestrator | | c0be902481564a5c8a2aaa56b06d6095 | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-03 06:51:59.850427 | orchestrator | | d56709c96b7e4ca990f7f22892d64e20 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-03 06:51:59.850438 | orchestrator | | d7f31c525541456e859c9a15977384e0 | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-03 06:51:59.850449 | orchestrator | | dff60a77903047d7988618cc52fd9f4f | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-03 06:51:59.850461 | orchestrator | | e90930d768b744199f87e357be5b95b6 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-03 06:51:59.850472 | orchestrator | | efe4ff990c2d4cb299ee6d334420f669 | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-03 06:51:59.850483 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 06:52:00.114238 | orchestrator | 2026-04-03 06:52:00.114330 | orchestrator | # Cinder 2026-04-03 06:52:00.114346 | orchestrator | 2026-04-03 06:52:00.114359 | orchestrator | + echo 2026-04-03 06:52:00.114371 | orchestrator | + echo '# Cinder' 2026-04-03 06:52:00.114382 | orchestrator | + echo 2026-04-03 06:52:00.114394 | orchestrator | + openstack volume service list 2026-04-03 06:52:02.770991 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:02.771133 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-03 06:52:02.771161 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:02.771179 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-03T06:51:56.000000 | 2026-04-03 06:52:02.771222 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-03T06:51:56.000000 | 2026-04-03 06:52:02.771241 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-03T06:51:56.000000 | 2026-04-03 06:52:02.771257 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-03T06:51:55.000000 | 2026-04-03 06:52:02.771268 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-03T06:52:00.000000 | 2026-04-03 06:52:02.771280 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-03T06:52:01.000000 | 2026-04-03 06:52:02.771291 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-03T06:51:53.000000 | 2026-04-03 06:52:02.771303 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-03T06:51:55.000000 | 2026-04-03 06:52:02.771358 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-03T06:51:55.000000 | 2026-04-03 06:52:02.771381 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:03.024111 | orchestrator | 2026-04-03 06:52:03.024216 | orchestrator | # Neutron 2026-04-03 06:52:03.024231 | orchestrator | 2026-04-03 06:52:03.024240 | orchestrator | + echo 2026-04-03 06:52:03.024248 | orchestrator | + echo '# Neutron' 2026-04-03 06:52:03.024258 | orchestrator | + echo 2026-04-03 06:52:03.024267 | orchestrator | + openstack network agent list 2026-04-03 06:52:05.608400 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 06:52:05.608496 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-03 06:52:05.608507 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 06:52:05.608516 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608525 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608549 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608557 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608565 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608615 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-03 06:52:05.608624 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 06:52:05.608632 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 06:52:05.608639 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 06:52:05.608647 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 06:52:05.867511 | orchestrator | + openstack network service provider list 2026-04-03 06:52:08.429108 | orchestrator | +---------------+------+---------+ 2026-04-03 06:52:08.429234 | orchestrator | | Service Type | Name | Default | 2026-04-03 06:52:08.429251 | orchestrator | +---------------+------+---------+ 2026-04-03 06:52:08.429263 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-03 06:52:08.429275 | orchestrator | +---------------+------+---------+ 2026-04-03 06:52:08.704839 | orchestrator | 2026-04-03 06:52:08.704941 | orchestrator | # Nova 2026-04-03 06:52:08.704957 | orchestrator | 2026-04-03 06:52:08.704969 | orchestrator | + echo 2026-04-03 06:52:08.704981 | orchestrator | + echo '# Nova' 2026-04-03 06:52:08.704993 | orchestrator | + echo 2026-04-03 06:52:08.705005 | orchestrator | + openstack compute service list 2026-04-03 06:52:11.838113 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:11.838216 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-03 06:52:11.838231 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:11.838272 | orchestrator | | 153e83d0-197c-424c-aea7-5d9c0095cd3f | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-03T06:52:09.000000 | 2026-04-03 06:52:11.838285 | orchestrator | | 5953b1ef-81e8-4dd9-888e-c8a557ef4ba7 | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-03T06:52:02.000000 | 2026-04-03 06:52:11.838297 | orchestrator | | 07773ac9-d34b-44f3-b811-5df93b96a436 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-03T06:52:03.000000 | 2026-04-03 06:52:11.838308 | orchestrator | | 4034bdb8-9c06-4334-a2fa-0617e91f64f7 | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-03T06:52:04.000000 | 2026-04-03 06:52:11.838319 | orchestrator | | e420fc71-f52d-4617-ab61-d218e5b7f656 | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-03T06:52:05.000000 | 2026-04-03 06:52:11.838330 | orchestrator | | c1656c86-e9c0-4202-861d-cb4bb9e1d6cd | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-03T06:52:05.000000 | 2026-04-03 06:52:11.838341 | orchestrator | | c2381516-3631-4830-abb9-4ca7e0bb6aec | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-03T06:52:07.000000 | 2026-04-03 06:52:11.838352 | orchestrator | | f911c078-882f-4472-b8fa-6bfcd69f3011 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-03T06:52:07.000000 | 2026-04-03 06:52:11.838363 | orchestrator | | e9d6c8da-f400-46bc-a397-63574980d4b9 | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-03T06:52:07.000000 | 2026-04-03 06:52:11.838374 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 06:52:12.106980 | orchestrator | + openstack hypervisor list 2026-04-03 06:52:15.245233 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 06:52:15.245340 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-03 06:52:15.245356 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 06:52:15.245368 | orchestrator | | 0c05a848-94f4-46f4-9bd1-18f873432746 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-03 06:52:15.245379 | orchestrator | | 162dbafe-7b85-4621-bef4-d9ad4a22dc7c | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-03 06:52:15.245390 | orchestrator | | e340cede-51d7-4984-a9e0-2d91e82145f5 | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-03 06:52:15.245402 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 06:52:15.550868 | orchestrator | 2026-04-03 06:52:15.550962 | orchestrator | # Run OpenStack test play 2026-04-03 06:52:15.550978 | orchestrator | 2026-04-03 06:52:15.550994 | orchestrator | + echo 2026-04-03 06:52:15.551007 | orchestrator | + echo '# Run OpenStack test play' 2026-04-03 06:52:15.551019 | orchestrator | + echo 2026-04-03 06:52:15.551031 | orchestrator | + osism apply --environment openstack test 2026-04-03 06:52:17.612094 | orchestrator | 2026-04-03 06:52:17 | INFO  | Trying to run play test in environment openstack 2026-04-03 06:52:27.698239 | orchestrator | 2026-04-03 06:52:27 | INFO  | Task 4511b739-1c45-4583-833f-0c307757194c (test) was prepared for execution. 2026-04-03 06:52:27.698353 | orchestrator | 2026-04-03 06:52:27 | INFO  | It takes a moment until task 4511b739-1c45-4583-833f-0c307757194c (test) has been started and output is visible here. 2026-04-03 06:55:29.455869 | orchestrator | 2026-04-03 06:55:29.455990 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-03 06:55:29.456008 | orchestrator | 2026-04-03 06:55:29.456021 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-03 06:55:29.456033 | orchestrator | Friday 03 April 2026 06:52:31 +0000 (0:00:00.070) 0:00:00.070 ********** 2026-04-03 06:55:29.456044 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456056 | orchestrator | 2026-04-03 06:55:29.456067 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-03 06:55:29.456101 | orchestrator | Friday 03 April 2026 06:52:35 +0000 (0:00:03.603) 0:00:03.674 ********** 2026-04-03 06:55:29.456113 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456124 | orchestrator | 2026-04-03 06:55:29.456135 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-03 06:55:29.456145 | orchestrator | Friday 03 April 2026 06:52:39 +0000 (0:00:04.141) 0:00:07.816 ********** 2026-04-03 06:55:29.456156 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456167 | orchestrator | 2026-04-03 06:55:29.456178 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-03 06:55:29.456189 | orchestrator | Friday 03 April 2026 06:52:46 +0000 (0:00:06.480) 0:00:14.296 ********** 2026-04-03 06:55:29.456199 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456210 | orchestrator | 2026-04-03 06:55:29.456221 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-03 06:55:29.456232 | orchestrator | Friday 03 April 2026 06:52:50 +0000 (0:00:03.963) 0:00:18.260 ********** 2026-04-03 06:55:29.456242 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456253 | orchestrator | 2026-04-03 06:55:29.456264 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-03 06:55:29.456277 | orchestrator | Friday 03 April 2026 06:52:54 +0000 (0:00:04.203) 0:00:22.463 ********** 2026-04-03 06:55:29.456290 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-03 06:55:29.456304 | orchestrator | changed: [localhost] => (item=member) 2026-04-03 06:55:29.456316 | orchestrator | changed: [localhost] => (item=creator) 2026-04-03 06:55:29.456329 | orchestrator | 2026-04-03 06:55:29.456341 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-03 06:55:29.456355 | orchestrator | Friday 03 April 2026 06:53:05 +0000 (0:00:11.309) 0:00:33.773 ********** 2026-04-03 06:55:29.456367 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456379 | orchestrator | 2026-04-03 06:55:29.456393 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-03 06:55:29.456405 | orchestrator | Friday 03 April 2026 06:53:09 +0000 (0:00:04.154) 0:00:37.928 ********** 2026-04-03 06:55:29.456417 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456429 | orchestrator | 2026-04-03 06:55:29.456441 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-03 06:55:29.456454 | orchestrator | Friday 03 April 2026 06:53:14 +0000 (0:00:04.690) 0:00:42.618 ********** 2026-04-03 06:55:29.456466 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456479 | orchestrator | 2026-04-03 06:55:29.456491 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-03 06:55:29.456503 | orchestrator | Friday 03 April 2026 06:53:18 +0000 (0:00:04.071) 0:00:46.690 ********** 2026-04-03 06:55:29.456516 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456528 | orchestrator | 2026-04-03 06:55:29.456539 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-03 06:55:29.456550 | orchestrator | Friday 03 April 2026 06:53:22 +0000 (0:00:03.924) 0:00:50.614 ********** 2026-04-03 06:55:29.456561 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456571 | orchestrator | 2026-04-03 06:55:29.456582 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-03 06:55:29.456593 | orchestrator | Friday 03 April 2026 06:53:26 +0000 (0:00:03.921) 0:00:54.536 ********** 2026-04-03 06:55:29.456604 | orchestrator | changed: [localhost] 2026-04-03 06:55:29.456614 | orchestrator | 2026-04-03 06:55:29.456653 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-03 06:55:29.456664 | orchestrator | Friday 03 April 2026 06:53:30 +0000 (0:00:03.905) 0:00:58.441 ********** 2026-04-03 06:55:29.456675 | orchestrator | changed: [localhost] => (item={'name': 'test-1'}) 2026-04-03 06:55:29.456687 | orchestrator | changed: [localhost] => (item={'name': 'test-2'}) 2026-04-03 06:55:29.456698 | orchestrator | changed: [localhost] => (item={'name': 'test-3'}) 2026-04-03 06:55:29.456709 | orchestrator | 2026-04-03 06:55:29.456721 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-03 06:55:29.456739 | orchestrator | Friday 03 April 2026 06:53:43 +0000 (0:00:13.530) 0:01:11.972 ********** 2026-04-03 06:55:29.456751 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-03 06:55:29.456763 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-03 06:55:29.456774 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-03 06:55:29.456784 | orchestrator | 2026-04-03 06:55:29.456795 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-03 06:55:29.456806 | orchestrator | Friday 03 April 2026 06:53:59 +0000 (0:00:15.438) 0:01:27.411 ********** 2026-04-03 06:55:29.456817 | orchestrator | changed: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-03 06:55:29.456855 | orchestrator | changed: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-03 06:55:29.456867 | orchestrator | changed: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-03 06:55:29.456878 | orchestrator | 2026-04-03 06:55:29.456889 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-03 06:55:29.456900 | orchestrator | 2026-04-03 06:55:29.456910 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-03 06:55:29.456940 | orchestrator | Friday 03 April 2026 06:54:29 +0000 (0:00:29.946) 0:01:57.357 ********** 2026-04-03 06:55:29.456952 | orchestrator | ok: [localhost] 2026-04-03 06:55:29.456963 | orchestrator | 2026-04-03 06:55:29.456975 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-03 06:55:29.456986 | orchestrator | Friday 03 April 2026 06:54:32 +0000 (0:00:03.597) 0:02:00.954 ********** 2026-04-03 06:55:29.456996 | orchestrator | skipping: [localhost] 2026-04-03 06:55:29.457007 | orchestrator | 2026-04-03 06:55:29.457018 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-03 06:55:29.457029 | orchestrator | Friday 03 April 2026 06:54:32 +0000 (0:00:00.050) 0:02:01.005 ********** 2026-04-03 06:55:29.457040 | orchestrator | skipping: [localhost] 2026-04-03 06:55:29.457050 | orchestrator | 2026-04-03 06:55:29.457061 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-03 06:55:29.457072 | orchestrator | Friday 03 April 2026 06:54:32 +0000 (0:00:00.050) 0:02:01.056 ********** 2026-04-03 06:55:29.457083 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-03 06:55:29.457093 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-03 06:55:29.457104 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-03 06:55:29.457115 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-03 06:55:29.457125 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-03 06:55:29.457136 | orchestrator | skipping: [localhost] 2026-04-03 06:55:29.457147 | orchestrator | 2026-04-03 06:55:29.457158 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-03 06:55:29.457169 | orchestrator | Friday 03 April 2026 06:54:33 +0000 (0:00:00.171) 0:02:01.227 ********** 2026-04-03 06:55:29.457179 | orchestrator | skipping: [localhost] 2026-04-03 06:55:29.457190 | orchestrator | 2026-04-03 06:55:29.457201 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-03 06:55:29.457211 | orchestrator | Friday 03 April 2026 06:54:33 +0000 (0:00:00.157) 0:02:01.384 ********** 2026-04-03 06:55:29.457222 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 06:55:29.457233 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 06:55:29.457244 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 06:55:29.457254 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 06:55:29.457272 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 06:55:29.457283 | orchestrator | 2026-04-03 06:55:29.457294 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-03 06:55:29.457304 | orchestrator | Friday 03 April 2026 06:54:38 +0000 (0:00:04.845) 0:02:06.229 ********** 2026-04-03 06:55:29.457315 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-03 06:55:29.457327 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (59 retries left). 2026-04-03 06:55:29.457338 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (58 retries left). 2026-04-03 06:55:29.457349 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (57 retries left). 2026-04-03 06:55:29.457363 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j579377479357.3718', 'results_file': '/ansible/.ansible_async/j579377479357.3718', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:55:29.457376 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j897490683505.3743', 'results_file': '/ansible/.ansible_async/j897490683505.3743', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:55:29.457388 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j771881757244.3768', 'results_file': '/ansible/.ansible_async/j771881757244.3768', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:55:29.457399 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j572586069358.3793', 'results_file': '/ansible/.ansible_async/j572586069358.3793', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:55:29.457473 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j708211345357.3818', 'results_file': '/ansible/.ansible_async/j708211345357.3818', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:55:29.457485 | orchestrator | 2026-04-03 06:55:29.457496 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-03 06:55:29.457508 | orchestrator | Friday 03 April 2026 06:55:24 +0000 (0:00:46.828) 0:02:53.058 ********** 2026-04-03 06:55:29.457519 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 06:55:29.457537 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 06:56:38.365938 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 06:56:38.366119 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 06:56:38.366138 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 06:56:38.366150 | orchestrator | 2026-04-03 06:56:38.366163 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-03 06:56:38.366174 | orchestrator | Friday 03 April 2026 06:55:29 +0000 (0:00:04.544) 0:02:57.602 ********** 2026-04-03 06:56:38.366186 | orchestrator | FAILED - RETRYING: [localhost]: Wait for metadata to be added (30 retries left). 2026-04-03 06:56:38.366200 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j912586815595.3923', 'results_file': '/ansible/.ansible_async/j912586815595.3923', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366215 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j108119610915.3948', 'results_file': '/ansible/.ansible_async/j108119610915.3948', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366248 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j34543966651.3973', 'results_file': '/ansible/.ansible_async/j34543966651.3973', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366261 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j40118434886.3998', 'results_file': '/ansible/.ansible_async/j40118434886.3998', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366288 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j957458214887.4023', 'results_file': '/ansible/.ansible_async/j957458214887.4023', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366300 | orchestrator | 2026-04-03 06:56:38.366312 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-03 06:56:38.366323 | orchestrator | Friday 03 April 2026 06:55:38 +0000 (0:00:09.392) 0:03:06.995 ********** 2026-04-03 06:56:38.366334 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 06:56:38.366346 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 06:56:38.366357 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 06:56:38.366368 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 06:56:38.366379 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 06:56:38.366391 | orchestrator | 2026-04-03 06:56:38.366402 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-03 06:56:38.366413 | orchestrator | Friday 03 April 2026 06:55:43 +0000 (0:00:04.972) 0:03:11.968 ********** 2026-04-03 06:56:38.366424 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-03 06:56:38.366435 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j98429514553.4092', 'results_file': '/ansible/.ansible_async/j98429514553.4092', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366447 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j41667733850.4117', 'results_file': '/ansible/.ansible_async/j41667733850.4117', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366459 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j778504348423.4143', 'results_file': '/ansible/.ansible_async/j778504348423.4143', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366475 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j917568786261.4169', 'results_file': '/ansible/.ansible_async/j917568786261.4169', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366507 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j286942820020.4195', 'results_file': '/ansible/.ansible_async/j286942820020.4195', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 06:56:38.366521 | orchestrator | 2026-04-03 06:56:38.366534 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-03 06:56:38.366547 | orchestrator | Friday 03 April 2026 06:55:54 +0000 (0:00:10.425) 0:03:22.393 ********** 2026-04-03 06:56:38.366569 | orchestrator | changed: [localhost] 2026-04-03 06:56:38.366583 | orchestrator | 2026-04-03 06:56:38.366595 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-03 06:56:38.366608 | orchestrator | Friday 03 April 2026 06:56:00 +0000 (0:00:06.317) 0:03:28.711 ********** 2026-04-03 06:56:38.366621 | orchestrator | changed: [localhost] 2026-04-03 06:56:38.366658 | orchestrator | 2026-04-03 06:56:38.366672 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-03 06:56:38.366684 | orchestrator | Friday 03 April 2026 06:56:14 +0000 (0:00:13.782) 0:03:42.493 ********** 2026-04-03 06:56:38.366698 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 06:56:38.366711 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 06:56:38.366724 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 06:56:38.366736 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 06:56:38.366749 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 06:56:38.366762 | orchestrator | 2026-04-03 06:56:38.366774 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-03 06:56:38.366787 | orchestrator | Friday 03 April 2026 06:56:37 +0000 (0:00:23.658) 0:04:06.152 ********** 2026-04-03 06:56:38.366800 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-03 06:56:38.366813 | orchestrator |  "msg": "test: 192.168.112.134" 2026-04-03 06:56:38.366826 | orchestrator | } 2026-04-03 06:56:38.366839 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-03 06:56:38.366850 | orchestrator |  "msg": "test-1: 192.168.112.152" 2026-04-03 06:56:38.366861 | orchestrator | } 2026-04-03 06:56:38.366872 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-03 06:56:38.366884 | orchestrator |  "msg": "test-2: 192.168.112.123" 2026-04-03 06:56:38.366895 | orchestrator | } 2026-04-03 06:56:38.366906 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-03 06:56:38.366917 | orchestrator |  "msg": "test-3: 192.168.112.194" 2026-04-03 06:56:38.366928 | orchestrator | } 2026-04-03 06:56:38.366939 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-03 06:56:38.366950 | orchestrator |  "msg": "test-4: 192.168.112.177" 2026-04-03 06:56:38.366961 | orchestrator | } 2026-04-03 06:56:38.366972 | orchestrator | 2026-04-03 06:56:38.366983 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 06:56:38.366995 | orchestrator | localhost : ok=26  changed=23  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 06:56:38.367008 | orchestrator | 2026-04-03 06:56:38.367019 | orchestrator | 2026-04-03 06:56:38.367030 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 06:56:38.367041 | orchestrator | Friday 03 April 2026 06:56:38 +0000 (0:00:00.110) 0:04:06.262 ********** 2026-04-03 06:56:38.367053 | orchestrator | =============================================================================== 2026-04-03 06:56:38.367064 | orchestrator | Wait for instance creation to complete --------------------------------- 46.83s 2026-04-03 06:56:38.367075 | orchestrator | Create test routers ---------------------------------------------------- 29.95s 2026-04-03 06:56:38.367086 | orchestrator | Create floating ip addresses ------------------------------------------- 23.66s 2026-04-03 06:56:38.367097 | orchestrator | Create test subnets ---------------------------------------------------- 15.44s 2026-04-03 06:56:38.367108 | orchestrator | Attach test volume ----------------------------------------------------- 13.78s 2026-04-03 06:56:38.367119 | orchestrator | Create test networks --------------------------------------------------- 13.53s 2026-04-03 06:56:38.367130 | orchestrator | Add member roles to user test ------------------------------------------ 11.31s 2026-04-03 06:56:38.367141 | orchestrator | Wait for tags to be added ---------------------------------------------- 10.43s 2026-04-03 06:56:38.367152 | orchestrator | Wait for metadata to be added ------------------------------------------- 9.39s 2026-04-03 06:56:38.367170 | orchestrator | Add manager role to user test-admin ------------------------------------- 6.48s 2026-04-03 06:56:38.367181 | orchestrator | Create test volume ------------------------------------------------------ 6.32s 2026-04-03 06:56:38.367192 | orchestrator | Add tag to instances ---------------------------------------------------- 4.97s 2026-04-03 06:56:38.367203 | orchestrator | Create test instances --------------------------------------------------- 4.85s 2026-04-03 06:56:38.367214 | orchestrator | Create ssh security group ----------------------------------------------- 4.69s 2026-04-03 06:56:38.367226 | orchestrator | Add metadata to instances ----------------------------------------------- 4.55s 2026-04-03 06:56:38.367236 | orchestrator | Create test user -------------------------------------------------------- 4.20s 2026-04-03 06:56:38.367247 | orchestrator | Create test server group ------------------------------------------------ 4.15s 2026-04-03 06:56:38.367258 | orchestrator | Create test-admin user -------------------------------------------------- 4.14s 2026-04-03 06:56:38.367269 | orchestrator | Add rule to ssh security group ------------------------------------------ 4.07s 2026-04-03 06:56:38.367285 | orchestrator | Create test project ----------------------------------------------------- 3.96s 2026-04-03 06:56:38.678096 | orchestrator | + server_list 2026-04-03 06:56:38.678201 | orchestrator | + openstack --os-cloud test server list 2026-04-03 06:56:42.274536 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 06:56:42.274678 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-03 06:56:42.274694 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 06:56:42.274705 | orchestrator | | 7a1dd176-cb9c-4e65-bdba-0c7a9157fa79 | test-4 | ACTIVE | test-3=192.168.112.177, 192.168.202.51 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 06:56:42.274716 | orchestrator | | 35837532-0e52-4430-aca3-5cf4359eef3c | test-3 | ACTIVE | test-2=192.168.112.194, 192.168.201.48 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 06:56:42.274725 | orchestrator | | 111e486f-351d-4ae1-aeda-9a881084f41d | test-1 | ACTIVE | test-1=192.168.112.152, 192.168.200.154 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 06:56:42.274735 | orchestrator | | 3fc0f953-94fe-41fb-b32a-9aa0c02a1c2a | test-2 | ACTIVE | test-2=192.168.112.123, 192.168.201.141 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 06:56:42.274745 | orchestrator | | 5540657c-27fc-4f92-8801-4eef456d6602 | test | ACTIVE | test-1=192.168.112.134, 192.168.200.145 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 06:56:42.274755 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 06:56:42.538595 | orchestrator | + openstack --os-cloud test server show test 2026-04-03 06:56:45.816628 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:45.816788 | orchestrator | | Field | Value | 2026-04-03 06:56:45.816805 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:45.816836 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 06:56:45.816848 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 06:56:45.816859 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 06:56:45.816877 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-03 06:56:45.816889 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 06:56:45.816900 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 06:56:45.816929 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 06:56:45.816941 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 06:56:45.816953 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 06:56:45.816977 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 06:56:45.816989 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 06:56:45.817000 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 06:56:45.817012 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 06:56:45.817027 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 06:56:45.817039 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 06:56:45.817051 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 06:56:45.817069 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 06:56:45.817081 | orchestrator | | accessIPv4 | | 2026-04-03 06:56:45.817093 | orchestrator | | accessIPv6 | | 2026-04-03 06:56:45.817141 | orchestrator | | addresses | test-1=192.168.112.134, 192.168.200.145 | 2026-04-03 06:56:45.817157 | orchestrator | | config_drive | | 2026-04-03 06:56:45.817171 | orchestrator | | created | 2026-04-03T06:54:42Z | 2026-04-03 06:56:45.817184 | orchestrator | | description | None | 2026-04-03 06:56:45.817202 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 06:56:45.817215 | orchestrator | | hostId | 4778386a6db89001da510e3a0d3f27a28c7070f5860caf33764b5c80 | 2026-04-03 06:56:45.817228 | orchestrator | | host_status | None | 2026-04-03 06:56:45.817248 | orchestrator | | id | 5540657c-27fc-4f92-8801-4eef456d6602 | 2026-04-03 06:56:45.817262 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 06:56:45.817282 | orchestrator | | key_name | test | 2026-04-03 06:56:45.817296 | orchestrator | | locked | False | 2026-04-03 06:56:45.817309 | orchestrator | | locked_reason | None | 2026-04-03 06:56:45.817322 | orchestrator | | name | test | 2026-04-03 06:56:45.817335 | orchestrator | | pinned_availability_zone | None | 2026-04-03 06:56:45.817348 | orchestrator | | progress | 0 | 2026-04-03 06:56:45.817368 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 06:56:45.817382 | orchestrator | | properties | hostname='test' | 2026-04-03 06:56:45.817402 | orchestrator | | security_groups | name='icmp' | 2026-04-03 06:56:45.817421 | orchestrator | | | name='ssh' | 2026-04-03 06:56:45.817434 | orchestrator | | server_groups | None | 2026-04-03 06:56:45.817448 | orchestrator | | status | ACTIVE | 2026-04-03 06:56:45.817461 | orchestrator | | tags | test | 2026-04-03 06:56:45.817474 | orchestrator | | trusted_image_certificates | None | 2026-04-03 06:56:45.817487 | orchestrator | | updated | 2026-04-03T06:55:30Z | 2026-04-03 06:56:45.817510 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 06:56:45.817523 | orchestrator | | volumes_attached | delete_on_termination='True', id='203666d4-75b6-44de-b3ce-ab6b91549d72' | 2026-04-03 06:56:45.817535 | orchestrator | | | delete_on_termination='False', id='6dac785b-3487-490f-8752-db8f1a1b6012' | 2026-04-03 06:56:45.819696 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:46.079947 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-03 06:56:49.057890 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:49.057977 | orchestrator | | Field | Value | 2026-04-03 06:56:49.057990 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:49.057999 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 06:56:49.058008 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 06:56:49.058080 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 06:56:49.058090 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-03 06:56:49.058099 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 06:56:49.058126 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 06:56:49.058151 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 06:56:49.058160 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 06:56:49.058168 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 06:56:49.058176 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 06:56:49.058185 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 06:56:49.058193 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 06:56:49.058205 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 06:56:49.058213 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 06:56:49.058222 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 06:56:49.058236 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:09.000000 | 2026-04-03 06:56:49.058250 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 06:56:49.058259 | orchestrator | | accessIPv4 | | 2026-04-03 06:56:49.058267 | orchestrator | | accessIPv6 | | 2026-04-03 06:56:49.058275 | orchestrator | | addresses | test-1=192.168.112.152, 192.168.200.154 | 2026-04-03 06:56:49.058284 | orchestrator | | config_drive | | 2026-04-03 06:56:49.058292 | orchestrator | | created | 2026-04-03T06:54:43Z | 2026-04-03 06:56:49.058304 | orchestrator | | description | None | 2026-04-03 06:56:49.058312 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 06:56:49.058326 | orchestrator | | hostId | 4778386a6db89001da510e3a0d3f27a28c7070f5860caf33764b5c80 | 2026-04-03 06:56:49.058334 | orchestrator | | host_status | None | 2026-04-03 06:56:49.058347 | orchestrator | | id | 111e486f-351d-4ae1-aeda-9a881084f41d | 2026-04-03 06:56:49.058356 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 06:56:49.058364 | orchestrator | | key_name | test | 2026-04-03 06:56:49.058372 | orchestrator | | locked | False | 2026-04-03 06:56:49.058381 | orchestrator | | locked_reason | None | 2026-04-03 06:56:49.058389 | orchestrator | | name | test-1 | 2026-04-03 06:56:49.058401 | orchestrator | | pinned_availability_zone | None | 2026-04-03 06:56:49.058415 | orchestrator | | progress | 0 | 2026-04-03 06:56:49.058423 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 06:56:49.058431 | orchestrator | | properties | hostname='test-1' | 2026-04-03 06:56:49.058446 | orchestrator | | security_groups | name='icmp' | 2026-04-03 06:56:49.058456 | orchestrator | | | name='ssh' | 2026-04-03 06:56:49.058465 | orchestrator | | server_groups | None | 2026-04-03 06:56:49.058475 | orchestrator | | status | ACTIVE | 2026-04-03 06:56:49.058485 | orchestrator | | tags | test | 2026-04-03 06:56:49.058495 | orchestrator | | trusted_image_certificates | None | 2026-04-03 06:56:49.058511 | orchestrator | | updated | 2026-04-03T06:55:31Z | 2026-04-03 06:56:49.058521 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 06:56:49.058531 | orchestrator | | volumes_attached | delete_on_termination='True', id='55623375-d358-4c47-9f49-38b013dbeef0' | 2026-04-03 06:56:49.061117 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:49.334281 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-03 06:56:52.392068 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:52.392197 | orchestrator | | Field | Value | 2026-04-03 06:56:52.392215 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:52.392227 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 06:56:52.392239 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 06:56:52.392250 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 06:56:52.392289 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-03 06:56:52.392301 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 06:56:52.392312 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 06:56:52.392344 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 06:56:52.392357 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 06:56:52.392368 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 06:56:52.392379 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 06:56:52.392390 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 06:56:52.392401 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 06:56:52.392420 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 06:56:52.392436 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 06:56:52.392447 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 06:56:52.392459 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 06:56:52.392477 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 06:56:52.392488 | orchestrator | | accessIPv4 | | 2026-04-03 06:56:52.392500 | orchestrator | | accessIPv6 | | 2026-04-03 06:56:52.392511 | orchestrator | | addresses | test-2=192.168.112.123, 192.168.201.141 | 2026-04-03 06:56:52.392522 | orchestrator | | config_drive | | 2026-04-03 06:56:52.392540 | orchestrator | | created | 2026-04-03T06:54:43Z | 2026-04-03 06:56:52.392551 | orchestrator | | description | None | 2026-04-03 06:56:52.392568 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 06:56:52.392579 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 06:56:52.392591 | orchestrator | | host_status | None | 2026-04-03 06:56:52.392610 | orchestrator | | id | 3fc0f953-94fe-41fb-b32a-9aa0c02a1c2a | 2026-04-03 06:56:52.392625 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 06:56:52.392701 | orchestrator | | key_name | test | 2026-04-03 06:56:52.392717 | orchestrator | | locked | False | 2026-04-03 06:56:52.392738 | orchestrator | | locked_reason | None | 2026-04-03 06:56:52.392752 | orchestrator | | name | test-2 | 2026-04-03 06:56:52.392771 | orchestrator | | pinned_availability_zone | None | 2026-04-03 06:56:52.392785 | orchestrator | | progress | 0 | 2026-04-03 06:56:52.392798 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 06:56:52.392811 | orchestrator | | properties | hostname='test-2' | 2026-04-03 06:56:52.392832 | orchestrator | | security_groups | name='icmp' | 2026-04-03 06:56:52.392846 | orchestrator | | | name='ssh' | 2026-04-03 06:56:52.392859 | orchestrator | | server_groups | None | 2026-04-03 06:56:52.392873 | orchestrator | | status | ACTIVE | 2026-04-03 06:56:52.392893 | orchestrator | | tags | test | 2026-04-03 06:56:52.392907 | orchestrator | | trusted_image_certificates | None | 2026-04-03 06:56:52.392926 | orchestrator | | updated | 2026-04-03T06:55:32Z | 2026-04-03 06:56:52.392940 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 06:56:52.392953 | orchestrator | | volumes_attached | delete_on_termination='True', id='91438361-d7e0-473e-b485-9f527c77ee0b' | 2026-04-03 06:56:52.396274 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:52.675112 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-03 06:56:55.532362 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:55.532468 | orchestrator | | Field | Value | 2026-04-03 06:56:55.532483 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:55.532515 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 06:56:55.532525 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 06:56:55.532534 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 06:56:55.532556 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-03 06:56:55.532566 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 06:56:55.532575 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 06:56:55.532602 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 06:56:55.532612 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 06:56:55.532622 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 06:56:55.532671 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 06:56:55.532682 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 06:56:55.532691 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 06:56:55.532700 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 06:56:55.532710 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 06:56:55.532720 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 06:56:55.532729 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 06:56:55.532745 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 06:56:55.532764 | orchestrator | | accessIPv4 | | 2026-04-03 06:56:55.532786 | orchestrator | | accessIPv6 | | 2026-04-03 06:56:55.532796 | orchestrator | | addresses | test-2=192.168.112.194, 192.168.201.48 | 2026-04-03 06:56:55.533168 | orchestrator | | config_drive | | 2026-04-03 06:56:55.533181 | orchestrator | | created | 2026-04-03T06:54:44Z | 2026-04-03 06:56:55.533192 | orchestrator | | description | None | 2026-04-03 06:56:55.533203 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 06:56:55.533214 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 06:56:55.533225 | orchestrator | | host_status | None | 2026-04-03 06:56:55.533242 | orchestrator | | id | 35837532-0e52-4430-aca3-5cf4359eef3c | 2026-04-03 06:56:55.533259 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 06:56:55.533268 | orchestrator | | key_name | test | 2026-04-03 06:56:55.533277 | orchestrator | | locked | False | 2026-04-03 06:56:55.533291 | orchestrator | | locked_reason | None | 2026-04-03 06:56:55.533300 | orchestrator | | name | test-3 | 2026-04-03 06:56:55.533309 | orchestrator | | pinned_availability_zone | None | 2026-04-03 06:56:55.533319 | orchestrator | | progress | 0 | 2026-04-03 06:56:55.533328 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 06:56:55.533337 | orchestrator | | properties | hostname='test-3' | 2026-04-03 06:56:55.533352 | orchestrator | | security_groups | name='icmp' | 2026-04-03 06:56:55.533366 | orchestrator | | | name='ssh' | 2026-04-03 06:56:55.533376 | orchestrator | | server_groups | None | 2026-04-03 06:56:55.533385 | orchestrator | | status | ACTIVE | 2026-04-03 06:56:55.533398 | orchestrator | | tags | test | 2026-04-03 06:56:55.533407 | orchestrator | | trusted_image_certificates | None | 2026-04-03 06:56:55.533417 | orchestrator | | updated | 2026-04-03T06:55:33Z | 2026-04-03 06:56:55.533426 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 06:56:55.533435 | orchestrator | | volumes_attached | delete_on_termination='True', id='e1f37e6f-ea0c-4f38-bf7d-7a267cd421f5' | 2026-04-03 06:56:55.537560 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:55.782389 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-03 06:56:58.772941 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:58.773048 | orchestrator | | Field | Value | 2026-04-03 06:56:58.773065 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:58.773077 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 06:56:58.773106 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 06:56:58.773118 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 06:56:58.773130 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-03 06:56:58.773141 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 06:56:58.773152 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 06:56:58.773207 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 06:56:58.773220 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 06:56:58.773231 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 06:56:58.773243 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 06:56:58.773254 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 06:56:58.773271 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 06:56:58.773283 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 06:56:58.773294 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 06:56:58.773305 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 06:56:58.773324 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:10.000000 | 2026-04-03 06:56:58.773343 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 06:56:58.773355 | orchestrator | | accessIPv4 | | 2026-04-03 06:56:58.773366 | orchestrator | | accessIPv6 | | 2026-04-03 06:56:58.773378 | orchestrator | | addresses | test-3=192.168.112.177, 192.168.202.51 | 2026-04-03 06:56:58.773389 | orchestrator | | config_drive | | 2026-04-03 06:56:58.773405 | orchestrator | | created | 2026-04-03T06:54:45Z | 2026-04-03 06:56:58.773416 | orchestrator | | description | None | 2026-04-03 06:56:58.773427 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 06:56:58.773445 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 06:56:58.773456 | orchestrator | | host_status | None | 2026-04-03 06:56:58.773474 | orchestrator | | id | 7a1dd176-cb9c-4e65-bdba-0c7a9157fa79 | 2026-04-03 06:56:58.773488 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 06:56:58.773501 | orchestrator | | key_name | test | 2026-04-03 06:56:58.773515 | orchestrator | | locked | False | 2026-04-03 06:56:58.773533 | orchestrator | | locked_reason | None | 2026-04-03 06:56:58.773547 | orchestrator | | name | test-4 | 2026-04-03 06:56:58.773560 | orchestrator | | pinned_availability_zone | None | 2026-04-03 06:56:58.773573 | orchestrator | | progress | 0 | 2026-04-03 06:56:58.773593 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 06:56:58.773607 | orchestrator | | properties | hostname='test-4' | 2026-04-03 06:56:58.773627 | orchestrator | | security_groups | name='icmp' | 2026-04-03 06:56:58.773664 | orchestrator | | | name='ssh' | 2026-04-03 06:56:58.773678 | orchestrator | | server_groups | None | 2026-04-03 06:56:58.773692 | orchestrator | | status | ACTIVE | 2026-04-03 06:56:58.773710 | orchestrator | | tags | test | 2026-04-03 06:56:58.773724 | orchestrator | | trusted_image_certificates | None | 2026-04-03 06:56:58.773738 | orchestrator | | updated | 2026-04-03T06:55:33Z | 2026-04-03 06:56:58.773759 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 06:56:58.773773 | orchestrator | | volumes_attached | delete_on_termination='True', id='5b126404-6e04-46e4-a0da-faa62b4369d1' | 2026-04-03 06:56:58.776842 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 06:56:59.060226 | orchestrator | + server_ping 2026-04-03 06:56:59.062605 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-03 06:56:59.062697 | orchestrator | ++ tr -d '\r' 2026-04-03 06:57:01.921177 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 06:57:01.921277 | orchestrator | + ping -c3 192.168.112.123 2026-04-03 06:57:01.934798 | orchestrator | PING 192.168.112.123 (192.168.112.123) 56(84) bytes of data. 2026-04-03 06:57:01.934888 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=1 ttl=63 time=6.99 ms 2026-04-03 06:57:02.931730 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=2 ttl=63 time=2.33 ms 2026-04-03 06:57:03.933995 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=3 ttl=63 time=2.05 ms 2026-04-03 06:57:03.934189 | orchestrator | 2026-04-03 06:57:03.934209 | orchestrator | --- 192.168.112.123 ping statistics --- 2026-04-03 06:57:03.934222 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-03 06:57:03.934234 | orchestrator | rtt min/avg/max/mdev = 2.045/3.790/6.993/2.267 ms 2026-04-03 06:57:03.934246 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 06:57:03.935022 | orchestrator | + ping -c3 192.168.112.177 2026-04-03 06:57:03.949022 | orchestrator | PING 192.168.112.177 (192.168.112.177) 56(84) bytes of data. 2026-04-03 06:57:03.949090 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=1 ttl=63 time=9.94 ms 2026-04-03 06:57:04.943207 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=2 ttl=63 time=2.71 ms 2026-04-03 06:57:05.944958 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=3 ttl=63 time=1.78 ms 2026-04-03 06:57:05.945057 | orchestrator | 2026-04-03 06:57:05.945074 | orchestrator | --- 192.168.112.177 ping statistics --- 2026-04-03 06:57:05.945086 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-03 06:57:05.945097 | orchestrator | rtt min/avg/max/mdev = 1.775/4.810/9.943/3.649 ms 2026-04-03 06:57:05.945110 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 06:57:05.945121 | orchestrator | + ping -c3 192.168.112.152 2026-04-03 06:57:05.958196 | orchestrator | PING 192.168.112.152 (192.168.112.152) 56(84) bytes of data. 2026-04-03 06:57:05.958276 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=1 ttl=63 time=8.31 ms 2026-04-03 06:57:06.954410 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=2 ttl=63 time=2.72 ms 2026-04-03 06:57:07.956101 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=3 ttl=63 time=1.89 ms 2026-04-03 06:57:07.956199 | orchestrator | 2026-04-03 06:57:07.956216 | orchestrator | --- 192.168.112.152 ping statistics --- 2026-04-03 06:57:07.956254 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-03 06:57:07.956266 | orchestrator | rtt min/avg/max/mdev = 1.889/4.307/8.312/2.851 ms 2026-04-03 06:57:07.956278 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 06:57:07.956298 | orchestrator | + ping -c3 192.168.112.194 2026-04-03 06:57:07.967858 | orchestrator | PING 192.168.112.194 (192.168.112.194) 56(84) bytes of data. 2026-04-03 06:57:07.967936 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=1 ttl=63 time=5.73 ms 2026-04-03 06:57:08.965815 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=2 ttl=63 time=2.40 ms 2026-04-03 06:57:09.966609 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=3 ttl=63 time=1.63 ms 2026-04-03 06:57:09.966776 | orchestrator | 2026-04-03 06:57:09.966795 | orchestrator | --- 192.168.112.194 ping statistics --- 2026-04-03 06:57:09.966808 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-03 06:57:09.966820 | orchestrator | rtt min/avg/max/mdev = 1.626/3.250/5.729/1.780 ms 2026-04-03 06:57:09.966832 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 06:57:09.966844 | orchestrator | + ping -c3 192.168.112.134 2026-04-03 06:57:09.977812 | orchestrator | PING 192.168.112.134 (192.168.112.134) 56(84) bytes of data. 2026-04-03 06:57:09.977873 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=1 ttl=63 time=6.86 ms 2026-04-03 06:57:10.974186 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=2 ttl=63 time=2.32 ms 2026-04-03 06:57:11.974916 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=3 ttl=63 time=1.79 ms 2026-04-03 06:57:11.975027 | orchestrator | 2026-04-03 06:57:11.975044 | orchestrator | --- 192.168.112.134 ping statistics --- 2026-04-03 06:57:11.975057 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2001ms 2026-04-03 06:57:11.975068 | orchestrator | rtt min/avg/max/mdev = 1.787/3.655/6.857/2.274 ms 2026-04-03 06:57:11.975080 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 06:57:12.490712 | orchestrator | ok: Runtime: 0:11:15.713507 2026-04-03 06:57:12.536324 | 2026-04-03 06:57:12.536474 | TASK [Run tempest] 2026-04-03 06:57:13.070082 | orchestrator | skipping: Conditional result was False 2026-04-03 06:57:13.081017 | 2026-04-03 06:57:13.081180 | TASK [Check prometheus alert status] 2026-04-03 06:57:13.616426 | orchestrator | skipping: Conditional result was False 2026-04-03 06:57:13.631729 | 2026-04-03 06:57:13.631983 | PLAY [Upgrade testbed] 2026-04-03 06:57:13.649070 | 2026-04-03 06:57:13.649278 | TASK [Print next ceph version] 2026-04-03 06:57:13.719185 | orchestrator | ok 2026-04-03 06:57:13.729286 | 2026-04-03 06:57:13.729436 | TASK [Print next openstack version] 2026-04-03 06:57:13.795751 | orchestrator | ok 2026-04-03 06:57:13.810108 | 2026-04-03 06:57:13.810288 | TASK [Print next manager version] 2026-04-03 06:57:13.877252 | orchestrator | ok 2026-04-03 06:57:13.889127 | 2026-04-03 06:57:13.889309 | TASK [Set cloud fact (Zuul deployment)] 2026-04-03 06:57:13.936258 | orchestrator | ok 2026-04-03 06:57:13.949377 | 2026-04-03 06:57:13.949555 | TASK [Set cloud fact (local deployment)] 2026-04-03 06:57:13.987190 | orchestrator | skipping: Conditional result was False 2026-04-03 06:57:14.002225 | 2026-04-03 06:57:14.002356 | TASK [Fetch manager address] 2026-04-03 06:57:14.266372 | orchestrator | ok 2026-04-03 06:57:14.275574 | 2026-04-03 06:57:14.275704 | TASK [Set manager_host address] 2026-04-03 06:57:14.345493 | orchestrator | ok 2026-04-03 06:57:14.356868 | 2026-04-03 06:57:14.357008 | TASK [Run upgrade] 2026-04-03 06:57:15.067435 | orchestrator | + set -e 2026-04-03 06:57:15.067561 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-03 06:57:15.067574 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-03 06:57:15.067580 | orchestrator | + CEPH_VERSION=reef 2026-04-03 06:57:15.067586 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-03 06:57:15.067591 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-03 06:57:15.067597 | orchestrator | + sh -c '/opt/configuration/scripts/upgrade-manager.sh 10.0.0 reef 2024.2 kolla/release' 2026-04-03 06:57:15.073147 | orchestrator | + set -e 2026-04-03 06:57:15.073296 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 06:57:15.073314 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 06:57:15.073327 | orchestrator | ++ INTERACTIVE=false 2026-04-03 06:57:15.073334 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 06:57:15.073343 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 06:57:15.073973 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "org.opencontainers.image.version"}}' osism-ansible 2026-04-03 06:57:15.106354 | orchestrator | + OLD_MANAGER_VERSION=v0.20251130.0 2026-04-03 06:57:15.106514 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-03 06:57:15.145209 | orchestrator | 2026-04-03 06:57:15.145284 | orchestrator | # UPGRADE MANAGER 2026-04-03 06:57:15.145296 | orchestrator | 2026-04-03 06:57:15.145302 | orchestrator | + OLD_OPENSTACK_VERSION=2024.2 2026-04-03 06:57:15.145309 | orchestrator | + echo 2026-04-03 06:57:15.145317 | orchestrator | + echo '# UPGRADE MANAGER' 2026-04-03 06:57:15.145323 | orchestrator | + echo 2026-04-03 06:57:15.145328 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-03 06:57:15.145335 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-03 06:57:15.145340 | orchestrator | + CEPH_VERSION=reef 2026-04-03 06:57:15.145346 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-03 06:57:15.145352 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-03 06:57:15.145357 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 10.0.0 2026-04-03 06:57:15.150455 | orchestrator | + set -e 2026-04-03 06:57:15.150489 | orchestrator | + VERSION=10.0.0 2026-04-03 06:57:15.150496 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 10.0.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:57:15.156096 | orchestrator | + [[ 10.0.0 != \l\a\t\e\s\t ]] 2026-04-03 06:57:15.156159 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:57:15.159027 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:57:15.163734 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-03 06:57:15.169372 | orchestrator | /opt/configuration ~ 2026-04-03 06:57:15.169428 | orchestrator | + set -e 2026-04-03 06:57:15.169437 | orchestrator | + pushd /opt/configuration 2026-04-03 06:57:15.169444 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 06:57:15.169453 | orchestrator | + source /opt/venv/bin/activate 2026-04-03 06:57:15.170471 | orchestrator | ++ deactivate nondestructive 2026-04-03 06:57:15.170499 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:15.170510 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:15.170521 | orchestrator | ++ hash -r 2026-04-03 06:57:15.170533 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:15.170544 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-03 06:57:15.170555 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-03 06:57:15.170566 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-03 06:57:15.170578 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-03 06:57:15.170589 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-03 06:57:15.170599 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-03 06:57:15.170610 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-03 06:57:15.170622 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:15.170633 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:15.170678 | orchestrator | ++ export PATH 2026-04-03 06:57:15.170690 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:15.170701 | orchestrator | ++ '[' -z '' ']' 2026-04-03 06:57:15.170712 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-03 06:57:15.170723 | orchestrator | ++ PS1='(venv) ' 2026-04-03 06:57:15.170734 | orchestrator | ++ export PS1 2026-04-03 06:57:15.170745 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-03 06:57:15.170756 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-03 06:57:15.170766 | orchestrator | ++ hash -r 2026-04-03 06:57:15.170782 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-03 06:57:16.299768 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-03 06:57:16.300042 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-03 06:57:16.301344 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-03 06:57:16.302855 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-03 06:57:16.304112 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.0) 2026-04-03 06:57:16.314586 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.1) 2026-04-03 06:57:16.316174 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-03 06:57:16.317370 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-03 06:57:16.318726 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-03 06:57:16.353621 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-03 06:57:16.355245 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.11) 2026-04-03 06:57:16.357163 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-03 06:57:16.358567 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.2.25) 2026-04-03 06:57:16.371006 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-03 06:57:16.629455 | orchestrator | ++ which gilt 2026-04-03 06:57:16.632072 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-03 06:57:16.632177 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-03 06:57:16.875928 | orchestrator | osism.cfg-generics: 2026-04-03 06:57:16.989930 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-03 06:57:16.990474 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-03 06:57:16.991328 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-03 06:57:16.991456 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-03 06:57:18.085724 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-03 06:57:18.098799 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-03 06:57:18.558570 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-03 06:57:18.622235 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 06:57:18.622311 | orchestrator | + deactivate 2026-04-03 06:57:18.622318 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-03 06:57:18.622332 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:18.622336 | orchestrator | + export PATH 2026-04-03 06:57:18.622341 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-03 06:57:18.622346 | orchestrator | + '[' -n '' ']' 2026-04-03 06:57:18.622350 | orchestrator | + hash -r 2026-04-03 06:57:18.622354 | orchestrator | + '[' -n '' ']' 2026-04-03 06:57:18.622358 | orchestrator | + unset VIRTUAL_ENV 2026-04-03 06:57:18.622362 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-03 06:57:18.622367 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-03 06:57:18.622438 | orchestrator | + unset -f deactivate 2026-04-03 06:57:18.622474 | orchestrator | + popd 2026-04-03 06:57:18.622520 | orchestrator | ~ 2026-04-03 06:57:18.624676 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-03 06:57:18.624726 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-03 06:57:18.629023 | orchestrator | + set -e 2026-04-03 06:57:18.629294 | orchestrator | + NAMESPACE=kolla/release 2026-04-03 06:57:18.629303 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-03 06:57:18.638068 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-03 06:57:18.645267 | orchestrator | /opt/configuration ~ 2026-04-03 06:57:18.645324 | orchestrator | + set -e 2026-04-03 06:57:18.645332 | orchestrator | + pushd /opt/configuration 2026-04-03 06:57:18.645338 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 06:57:18.645344 | orchestrator | + source /opt/venv/bin/activate 2026-04-03 06:57:18.645356 | orchestrator | ++ deactivate nondestructive 2026-04-03 06:57:18.645420 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:18.645499 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:18.645507 | orchestrator | ++ hash -r 2026-04-03 06:57:18.645606 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:18.645613 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-03 06:57:18.645618 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-03 06:57:18.645713 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-03 06:57:18.645900 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-03 06:57:18.645948 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-03 06:57:18.645956 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-03 06:57:18.645966 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-03 06:57:18.645977 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:18.646086 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:18.646146 | orchestrator | ++ export PATH 2026-04-03 06:57:18.646220 | orchestrator | ++ '[' -n '' ']' 2026-04-03 06:57:18.646318 | orchestrator | ++ '[' -z '' ']' 2026-04-03 06:57:18.646327 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-03 06:57:18.646333 | orchestrator | ++ PS1='(venv) ' 2026-04-03 06:57:18.646395 | orchestrator | ++ export PS1 2026-04-03 06:57:18.646403 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-03 06:57:18.646410 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-03 06:57:18.646418 | orchestrator | ++ hash -r 2026-04-03 06:57:18.646551 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-03 06:57:19.150547 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-03 06:57:19.151172 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-03 06:57:19.152767 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-03 06:57:19.153902 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-03 06:57:19.155126 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.0) 2026-04-03 06:57:19.165012 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.1) 2026-04-03 06:57:19.166792 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-03 06:57:19.167688 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-03 06:57:19.169010 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-03 06:57:19.202188 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-03 06:57:19.203447 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.11) 2026-04-03 06:57:19.205274 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-03 06:57:19.206391 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.2.25) 2026-04-03 06:57:19.210315 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-03 06:57:19.429515 | orchestrator | ++ which gilt 2026-04-03 06:57:19.432701 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-03 06:57:19.432736 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-03 06:57:19.594309 | orchestrator | osism.cfg-generics: 2026-04-03 06:57:19.690768 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-03 06:57:19.690884 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-03 06:57:19.691132 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.cfg-generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-03 06:57:19.691268 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-03 06:57:20.349512 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-03 06:57:20.362111 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-03 06:57:20.722104 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-03 06:57:20.778206 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-03 06:57:20.778309 | orchestrator | + deactivate 2026-04-03 06:57:20.778326 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-03 06:57:20.778341 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-03 06:57:20.778352 | orchestrator | + export PATH 2026-04-03 06:57:20.778363 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-03 06:57:20.778382 | orchestrator | + '[' -n '' ']' 2026-04-03 06:57:20.778400 | orchestrator | + hash -r 2026-04-03 06:57:20.778411 | orchestrator | + '[' -n '' ']' 2026-04-03 06:57:20.778422 | orchestrator | + unset VIRTUAL_ENV 2026-04-03 06:57:20.778433 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-03 06:57:20.778445 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-03 06:57:20.778468 | orchestrator | + unset -f deactivate 2026-04-03 06:57:20.778484 | orchestrator | ~ 2026-04-03 06:57:20.778500 | orchestrator | + popd 2026-04-03 06:57:20.780924 | orchestrator | ++ semver v0.20251130.0 6.0.0 2026-04-03 06:57:20.836174 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 06:57:20.836968 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-03 06:57:20.914487 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 06:57:20.914585 | orchestrator | + sed -i '/^om_enable_rabbitmq_high_availability:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-03 06:57:20.919713 | orchestrator | + sed -i '/^om_enable_rabbitmq_quorum_queues:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-03 06:57:20.925332 | orchestrator | +++ semver v0.20251130.0 9.5.0 2026-04-03 06:57:20.988570 | orchestrator | ++ '[' -1 -le 0 ']' 2026-04-03 06:57:20.989478 | orchestrator | +++ semver 10.0.0 10.0.0-0 2026-04-03 06:57:21.076399 | orchestrator | ++ '[' 1 -ge 0 ']' 2026-04-03 06:57:21.076471 | orchestrator | ++ echo true 2026-04-03 06:57:21.076557 | orchestrator | + MANAGER_UPGRADE_CROSSES_10=true 2026-04-03 06:57:21.077964 | orchestrator | +++ semver 2024.2 2024.2 2026-04-03 06:57:21.135416 | orchestrator | ++ '[' 0 -le 0 ']' 2026-04-03 06:57:21.135784 | orchestrator | +++ semver 2024.2 2025.1 2026-04-03 06:57:21.194437 | orchestrator | ++ '[' -1 -ge 0 ']' 2026-04-03 06:57:21.194577 | orchestrator | ++ echo false 2026-04-03 06:57:21.194610 | orchestrator | + OPENSTACK_UPGRADE_CROSSES_2025=false 2026-04-03 06:57:21.194639 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 06:57:21.194719 | orchestrator | + echo 'om_rpc_vhost: openstack' 2026-04-03 06:57:21.194791 | orchestrator | + echo 'om_notify_vhost: openstack' 2026-04-03 06:57:21.194844 | orchestrator | + sed -i 's#manager_listener_broker_vhost: .*#manager_listener_broker_vhost: /openstack#g' /opt/configuration/environments/manager/configuration.yml 2026-04-03 06:57:21.200523 | orchestrator | + echo 'export RABBITMQ3TO4=true' 2026-04-03 06:57:21.200582 | orchestrator | + sudo tee -a /opt/manager-vars.sh 2026-04-03 06:57:21.216785 | orchestrator | export RABBITMQ3TO4=true 2026-04-03 06:57:21.218286 | orchestrator | + osism update manager 2026-04-03 06:57:26.838469 | orchestrator | Collecting uv 2026-04-03 06:57:26.933530 | orchestrator | Downloading uv-0.11.3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) 2026-04-03 06:57:26.949609 | orchestrator | Downloading uv-0.11.3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (24.6 MB) 2026-04-03 06:57:27.750190 | orchestrator | ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.6/24.6 MB 34.6 MB/s eta 0:00:00 2026-04-03 06:57:27.810958 | orchestrator | Installing collected packages: uv 2026-04-03 06:57:28.269761 | orchestrator | Successfully installed uv-0.11.3 2026-04-03 06:57:28.946717 | orchestrator | Resolved 11 packages in 393ms 2026-04-03 06:57:28.972101 | orchestrator | Downloading cryptography (4.3MiB) 2026-04-03 06:57:28.983600 | orchestrator | Downloading netaddr (2.2MiB) 2026-04-03 06:57:28.983712 | orchestrator | Downloading ansible-core (2.1MiB) 2026-04-03 06:57:29.114112 | orchestrator | Downloading ansible (54.5MiB) 2026-04-03 06:57:29.301051 | orchestrator | Downloaded netaddr 2026-04-03 06:57:29.402189 | orchestrator | Downloaded cryptography 2026-04-03 06:57:29.480411 | orchestrator | Downloaded ansible-core 2026-04-03 06:57:35.746871 | orchestrator | Downloaded ansible 2026-04-03 06:57:35.747057 | orchestrator | Prepared 11 packages in 6.80s 2026-04-03 06:57:36.367989 | orchestrator | Installed 11 packages in 619ms 2026-04-03 06:57:36.368112 | orchestrator | + ansible==11.11.0 2026-04-03 06:57:36.368137 | orchestrator | + ansible-core==2.18.15 2026-04-03 06:57:36.368158 | orchestrator | + cffi==2.0.0 2026-04-03 06:57:36.368180 | orchestrator | + cryptography==46.0.6 2026-04-03 06:57:36.368200 | orchestrator | + jinja2==3.1.6 2026-04-03 06:57:36.368219 | orchestrator | + markupsafe==3.0.3 2026-04-03 06:57:36.368239 | orchestrator | + netaddr==1.3.0 2026-04-03 06:57:36.368258 | orchestrator | + packaging==26.0 2026-04-03 06:57:36.368277 | orchestrator | + pycparser==3.0 2026-04-03 06:57:36.368294 | orchestrator | + pyyaml==6.0.3 2026-04-03 06:57:36.368322 | orchestrator | + resolvelib==1.0.1 2026-04-03 06:57:37.491266 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-1997083b2xgs0a/tmp37igw_sm/ansible-collection-servicestlg2bvaj'... 2026-04-03 06:57:38.984068 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-03 06:57:38.984168 | orchestrator | Already on 'main' 2026-04-03 06:57:39.451907 | orchestrator | Starting galaxy collection install process 2026-04-03 06:57:39.452013 | orchestrator | Process install dependency map 2026-04-03 06:57:39.452030 | orchestrator | Starting collection install process 2026-04-03 06:57:39.452043 | orchestrator | Installing 'osism.services:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/services' 2026-04-03 06:57:39.452056 | orchestrator | Created collection for osism.services:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/services 2026-04-03 06:57:39.452068 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-03 06:57:39.968179 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-199745q_8zs41s/tmpy5rv1xdp/ansible-playbooks-manager3qeha5gs'... 2026-04-03 06:57:40.602561 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-03 06:57:40.602727 | orchestrator | Already on 'main' 2026-04-03 06:57:40.862065 | orchestrator | Starting galaxy collection install process 2026-04-03 06:57:40.862165 | orchestrator | Process install dependency map 2026-04-03 06:57:40.862180 | orchestrator | Starting collection install process 2026-04-03 06:57:40.862193 | orchestrator | Installing 'osism.manager:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/manager' 2026-04-03 06:57:40.862206 | orchestrator | Created collection for osism.manager:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/manager 2026-04-03 06:57:40.862217 | orchestrator | osism.manager:999.0.0 was installed successfully 2026-04-03 06:57:41.460083 | orchestrator | [WARNING]: Invalid characters were found in group names but not replaced, use 2026-04-03 06:57:41.460201 | orchestrator | -vvvv to see details 2026-04-03 06:57:41.886306 | orchestrator | 2026-04-03 06:57:41.886409 | orchestrator | PLAY [Apply role manager] ****************************************************** 2026-04-03 06:57:41.886427 | orchestrator | 2026-04-03 06:57:41.886461 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-03 06:57:45.826398 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:45.826507 | orchestrator | 2026-04-03 06:57:45.826523 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-03 06:57:45.894210 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 06:57:45.894310 | orchestrator | 2026-04-03 06:57:45.894327 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-03 06:57:47.675469 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:47.675584 | orchestrator | 2026-04-03 06:57:47.675602 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-03 06:57:47.727704 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:47.727809 | orchestrator | 2026-04-03 06:57:47.727827 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-03 06:57:47.793211 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-03 06:57:47.793300 | orchestrator | 2026-04-03 06:57:47.793316 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-03 06:57:52.010509 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible) 2026-04-03 06:57:52.010621 | orchestrator | ok: [testbed-manager] => (item=/opt/archive) 2026-04-03 06:57:52.010719 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-03 06:57:52.010751 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/data) 2026-04-03 06:57:52.010763 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-03 06:57:52.010774 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-03 06:57:52.010785 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-03 06:57:52.010796 | orchestrator | ok: [testbed-manager] => (item=/opt/state) 2026-04-03 06:57:52.010807 | orchestrator | 2026-04-03 06:57:52.010820 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-03 06:57:53.094847 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:53.094925 | orchestrator | 2026-04-03 06:57:53.094936 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-03 06:57:54.036478 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:54.036585 | orchestrator | 2026-04-03 06:57:54.036602 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-03 06:57:54.141439 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-03 06:57:54.141538 | orchestrator | 2026-04-03 06:57:54.141555 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-03 06:57:55.923149 | orchestrator | ok: [testbed-manager] => (item=ara) 2026-04-03 06:57:55.923233 | orchestrator | ok: [testbed-manager] => (item=ara-server) 2026-04-03 06:57:55.923245 | orchestrator | 2026-04-03 06:57:55.923255 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-03 06:57:56.880205 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:56.880317 | orchestrator | 2026-04-03 06:57:56.880335 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-03 06:57:56.940095 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:57:56.940218 | orchestrator | 2026-04-03 06:57:56.940246 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-03 06:57:57.024089 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-03 06:57:57.024206 | orchestrator | 2026-04-03 06:57:57.024222 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-03 06:57:58.000135 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:58.000221 | orchestrator | 2026-04-03 06:57:58.000233 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-03 06:57:58.073565 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-03 06:57:58.073635 | orchestrator | 2026-04-03 06:57:58.073673 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-03 06:57:59.992399 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-03 06:57:59.992501 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-03 06:57:59.992518 | orchestrator | ok: [testbed-manager] 2026-04-03 06:57:59.992532 | orchestrator | 2026-04-03 06:57:59.992543 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-03 06:58:00.925770 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:00.925873 | orchestrator | 2026-04-03 06:58:00.925891 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-03 06:58:00.994295 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:58:00.994392 | orchestrator | 2026-04-03 06:58:00.994409 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-03 06:58:01.105759 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-03 06:58:01.105860 | orchestrator | 2026-04-03 06:58:01.105876 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-03 06:58:01.810296 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:01.810399 | orchestrator | 2026-04-03 06:58:01.810415 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-03 06:58:02.363177 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:02.363277 | orchestrator | 2026-04-03 06:58:02.363314 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-03 06:58:04.219412 | orchestrator | ok: [testbed-manager] => (item=conductor) 2026-04-03 06:58:04.219526 | orchestrator | ok: [testbed-manager] => (item=openstack) 2026-04-03 06:58:04.219541 | orchestrator | 2026-04-03 06:58:04.219555 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-03 06:58:05.377978 | orchestrator | changed: [testbed-manager] 2026-04-03 06:58:05.378165 | orchestrator | 2026-04-03 06:58:05.378197 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-03 06:58:05.903031 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:05.903096 | orchestrator | 2026-04-03 06:58:05.903102 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-03 06:58:06.464957 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:06.465067 | orchestrator | 2026-04-03 06:58:06.465092 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-03 06:58:06.520516 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:58:06.520692 | orchestrator | 2026-04-03 06:58:06.520722 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-03 06:58:06.593692 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-03 06:58:06.593803 | orchestrator | 2026-04-03 06:58:06.593821 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-03 06:58:06.652717 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:06.652799 | orchestrator | 2026-04-03 06:58:06.652810 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-03 06:58:09.544744 | orchestrator | ok: [testbed-manager] => (item=osism) 2026-04-03 06:58:09.544896 | orchestrator | ok: [testbed-manager] => (item=osism-update-docker) 2026-04-03 06:58:09.544915 | orchestrator | ok: [testbed-manager] => (item=osism-update-manager) 2026-04-03 06:58:09.544928 | orchestrator | 2026-04-03 06:58:09.544942 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-03 06:58:10.540090 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:10.540189 | orchestrator | 2026-04-03 06:58:10.540206 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-03 06:58:11.496344 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:11.496432 | orchestrator | 2026-04-03 06:58:11.496445 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-03 06:58:12.484069 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:12.484159 | orchestrator | 2026-04-03 06:58:12.484169 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-03 06:58:12.553777 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-03 06:58:12.553870 | orchestrator | 2026-04-03 06:58:12.553880 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-03 06:58:12.613211 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:12.613305 | orchestrator | 2026-04-03 06:58:12.613322 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-03 06:58:13.644745 | orchestrator | ok: [testbed-manager] => (item=osism-include) 2026-04-03 06:58:13.644816 | orchestrator | 2026-04-03 06:58:13.644823 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-03 06:58:13.723757 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-03 06:58:13.723847 | orchestrator | 2026-04-03 06:58:13.723861 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-03 06:58:14.768791 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:14.768895 | orchestrator | 2026-04-03 06:58:14.768912 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-03 06:58:15.894334 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:15.894440 | orchestrator | 2026-04-03 06:58:15.894457 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-03 06:58:15.978867 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:58:15.978962 | orchestrator | 2026-04-03 06:58:15.978976 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-03 06:58:16.051812 | orchestrator | ok: [testbed-manager] 2026-04-03 06:58:16.051940 | orchestrator | 2026-04-03 06:58:16.051969 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-03 06:58:17.423995 | orchestrator | changed: [testbed-manager] 2026-04-03 06:58:17.424110 | orchestrator | 2026-04-03 06:58:17.424126 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-03 06:59:28.595469 | orchestrator | changed: [testbed-manager] 2026-04-03 06:59:28.595585 | orchestrator | 2026-04-03 06:59:28.595604 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-03 06:59:29.852966 | orchestrator | ok: [testbed-manager] 2026-04-03 06:59:29.853064 | orchestrator | 2026-04-03 06:59:29.853080 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-03 06:59:29.921519 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:59:29.921613 | orchestrator | 2026-04-03 06:59:29.921670 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-03 06:59:31.789876 | orchestrator | ok: [testbed-manager] 2026-04-03 06:59:31.790004 | orchestrator | 2026-04-03 06:59:31.790075 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-03 06:59:31.850279 | orchestrator | skipping: [testbed-manager] 2026-04-03 06:59:31.850369 | orchestrator | 2026-04-03 06:59:31.850384 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-03 06:59:31.850396 | orchestrator | 2026-04-03 06:59:31.850408 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-03 06:59:50.165110 | orchestrator | changed: [testbed-manager] 2026-04-03 06:59:50.165212 | orchestrator | 2026-04-03 06:59:50.165229 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-03 07:00:50.228319 | orchestrator | Pausing for 60 seconds 2026-04-03 07:00:50.228397 | orchestrator | changed: [testbed-manager] 2026-04-03 07:00:50.228403 | orchestrator | 2026-04-03 07:00:50.228409 | orchestrator | RUNNING HANDLER [osism.services.manager : Register that manager service was restarted] *** 2026-04-03 07:00:50.275691 | orchestrator | ok: [testbed-manager] 2026-04-03 07:00:50.275822 | orchestrator | 2026-04-03 07:00:50.275849 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-03 07:00:53.560950 | orchestrator | changed: [testbed-manager] 2026-04-03 07:00:53.561056 | orchestrator | 2026-04-03 07:00:53.561073 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-03 07:01:56.320860 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-03 07:01:56.320977 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-03 07:01:56.320993 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-03 07:01:56.321006 | orchestrator | changed: [testbed-manager] 2026-04-03 07:01:56.321020 | orchestrator | 2026-04-03 07:01:56.321032 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-03 07:02:02.609354 | orchestrator | changed: [testbed-manager] 2026-04-03 07:02:02.609465 | orchestrator | 2026-04-03 07:02:02.609483 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-03 07:02:02.707929 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-03 07:02:02.708044 | orchestrator | 2026-04-03 07:02:02.708059 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-03 07:02:02.708072 | orchestrator | 2026-04-03 07:02:02.708083 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-03 07:02:02.765113 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:02:02.765204 | orchestrator | 2026-04-03 07:02:02.765218 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-03 07:02:02.832088 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-03 07:02:02.832207 | orchestrator | 2026-04-03 07:02:02.832232 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-03 07:02:03.930422 | orchestrator | changed: [testbed-manager] 2026-04-03 07:02:03.930571 | orchestrator | 2026-04-03 07:02:03.930589 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-03 07:02:07.484447 | orchestrator | ok: [testbed-manager] 2026-04-03 07:02:07.484547 | orchestrator | 2026-04-03 07:02:07.484564 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-03 07:02:07.569954 | orchestrator | ok: [testbed-manager] => { 2026-04-03 07:02:07.570071 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-03 07:02:07.570082 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-03 07:02:07.570090 | orchestrator | "Checking running containers against expected versions...", 2026-04-03 07:02:07.570098 | orchestrator | "", 2026-04-03 07:02:07.570105 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-03 07:02:07.570112 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-03 07:02:07.570120 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570127 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-03 07:02:07.570134 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570140 | orchestrator | "", 2026-04-03 07:02:07.570148 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-03 07:02:07.570155 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-03 07:02:07.570161 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570168 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-03 07:02:07.570175 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570182 | orchestrator | "", 2026-04-03 07:02:07.570188 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-03 07:02:07.570195 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-03 07:02:07.570202 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570209 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-03 07:02:07.570215 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570222 | orchestrator | "", 2026-04-03 07:02:07.570229 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-03 07:02:07.570236 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-03 07:02:07.570242 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570249 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-03 07:02:07.570256 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570262 | orchestrator | "", 2026-04-03 07:02:07.570270 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-03 07:02:07.570277 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-03 07:02:07.570283 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570290 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-03 07:02:07.570297 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570303 | orchestrator | "", 2026-04-03 07:02:07.570310 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-03 07:02:07.570317 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570348 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570356 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570362 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570369 | orchestrator | "", 2026-04-03 07:02:07.570376 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-03 07:02:07.570382 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-03 07:02:07.570389 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570395 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-03 07:02:07.570402 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570409 | orchestrator | "", 2026-04-03 07:02:07.570415 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-03 07:02:07.570422 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-03 07:02:07.570429 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570435 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-03 07:02:07.570442 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570449 | orchestrator | "", 2026-04-03 07:02:07.570455 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-03 07:02:07.570462 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-03 07:02:07.570468 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570475 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-03 07:02:07.570482 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570488 | orchestrator | "", 2026-04-03 07:02:07.570498 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-03 07:02:07.570505 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-03 07:02:07.570514 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570523 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-03 07:02:07.570530 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570538 | orchestrator | "", 2026-04-03 07:02:07.570547 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-03 07:02:07.570555 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570563 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570572 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570580 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570588 | orchestrator | "", 2026-04-03 07:02:07.570596 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-03 07:02:07.570604 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570632 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570642 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570649 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570657 | orchestrator | "", 2026-04-03 07:02:07.570666 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-03 07:02:07.570674 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570682 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570691 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570699 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570707 | orchestrator | "", 2026-04-03 07:02:07.570715 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-03 07:02:07.570722 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570731 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570739 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570762 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570770 | orchestrator | "", 2026-04-03 07:02:07.570778 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-03 07:02:07.570786 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570795 | orchestrator | " Enabled: true", 2026-04-03 07:02:07.570809 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-03 07:02:07.570817 | orchestrator | " Status: ✅ MATCH", 2026-04-03 07:02:07.570825 | orchestrator | "", 2026-04-03 07:02:07.570833 | orchestrator | "=== Summary ===", 2026-04-03 07:02:07.570842 | orchestrator | "Errors (version mismatches): 0", 2026-04-03 07:02:07.570850 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-03 07:02:07.570859 | orchestrator | "", 2026-04-03 07:02:07.570868 | orchestrator | "✅ All running containers match expected versions!" 2026-04-03 07:02:07.570874 | orchestrator | ] 2026-04-03 07:02:07.570881 | orchestrator | } 2026-04-03 07:02:07.570888 | orchestrator | 2026-04-03 07:02:07.570896 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-03 07:02:07.643109 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:02:07.643212 | orchestrator | 2026-04-03 07:02:07.643225 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:02:07.643236 | orchestrator | testbed-manager : ok=51 changed=9 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-03 07:02:07.643244 | orchestrator | 2026-04-03 07:02:20.819683 | orchestrator | 2026-04-03 07:02:20 | INFO  | Task ef952d06-98af-4857-9cf4-d4f68c5bc31e (sync inventory) is running in background. Output coming soon. 2026-04-03 07:02:52.959041 | orchestrator | 2026-04-03 07:02:22 | INFO  | Starting group_vars file reorganization 2026-04-03 07:02:52.959172 | orchestrator | 2026-04-03 07:02:22 | INFO  | Moved 0 file(s) to their respective directories 2026-04-03 07:02:52.959188 | orchestrator | 2026-04-03 07:02:22 | INFO  | Group_vars file reorganization completed 2026-04-03 07:02:52.959198 | orchestrator | 2026-04-03 07:02:25 | INFO  | Starting variable preparation from inventory 2026-04-03 07:02:52.959207 | orchestrator | 2026-04-03 07:02:28 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-03 07:02:52.959217 | orchestrator | 2026-04-03 07:02:28 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-03 07:02:52.959225 | orchestrator | 2026-04-03 07:02:28 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-03 07:02:52.959234 | orchestrator | 2026-04-03 07:02:28 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-03 07:02:52.959243 | orchestrator | 2026-04-03 07:02:28 | INFO  | Variable preparation completed 2026-04-03 07:02:52.959252 | orchestrator | 2026-04-03 07:02:29 | INFO  | Starting inventory overwrite handling 2026-04-03 07:02:52.959260 | orchestrator | 2026-04-03 07:02:29 | INFO  | Handling group overwrites in 99-overwrite 2026-04-03 07:02:52.959269 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removing group frr:children from 60-generic 2026-04-03 07:02:52.959277 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-03 07:02:52.959286 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-03 07:02:52.959295 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-03 07:02:52.959303 | orchestrator | 2026-04-03 07:02:29 | INFO  | Handling group overwrites in 20-roles 2026-04-03 07:02:52.959312 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-03 07:02:52.959321 | orchestrator | 2026-04-03 07:02:29 | INFO  | Removed 5 group(s) in total 2026-04-03 07:02:52.959330 | orchestrator | 2026-04-03 07:02:29 | INFO  | Inventory overwrite handling completed 2026-04-03 07:02:52.959339 | orchestrator | 2026-04-03 07:02:31 | INFO  | Starting merge of inventory files 2026-04-03 07:02:52.959347 | orchestrator | 2026-04-03 07:02:31 | INFO  | Inventory files merged successfully 2026-04-03 07:02:52.959356 | orchestrator | 2026-04-03 07:02:36 | INFO  | Generating minified hosts file 2026-04-03 07:02:52.959388 | orchestrator | 2026-04-03 07:02:38 | INFO  | Successfully wrote minified hosts file to /inventory.merge/hosts-minified.yml 2026-04-03 07:02:52.959399 | orchestrator | 2026-04-03 07:02:38 | INFO  | Successfully wrote fast inventory to /inventory.merge/fast/hosts.json 2026-04-03 07:02:52.959407 | orchestrator | 2026-04-03 07:02:39 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-03 07:02:52.959416 | orchestrator | 2026-04-03 07:02:51 | INFO  | Successfully wrote ClusterShell configuration 2026-04-03 07:02:53.176224 | orchestrator | + [[ '' == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 07:02:53.176314 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-03 07:02:53.176328 | orchestrator | + local max_attempts=60 2026-04-03 07:02:53.176341 | orchestrator | + local name=kolla-ansible 2026-04-03 07:02:53.176351 | orchestrator | + local attempt_num=1 2026-04-03 07:02:53.176844 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-03 07:02:53.223393 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 07:02:53.223477 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-03 07:02:53.223492 | orchestrator | + local max_attempts=60 2026-04-03 07:02:53.223516 | orchestrator | + local name=osism-ansible 2026-04-03 07:02:53.223535 | orchestrator | + local attempt_num=1 2026-04-03 07:02:53.224374 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-03 07:02:53.261930 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-03 07:02:53.262007 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-03 07:02:53.421998 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-03 07:02:53.422118 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" ceph-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-03 07:02:53.422130 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" kolla-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-03 07:02:53.422139 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" api 3 minutes ago Up 3 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-03 07:02:53.422163 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 2 hours ago Up 2 minutes (healthy) 8000/tcp 2026-04-03 07:02:53.422171 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" beat 3 minutes ago Up 3 minutes (healthy) 2026-04-03 07:02:53.422179 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" flower 3 minutes ago Up 3 minutes (healthy) 2026-04-03 07:02:53.422187 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" inventory_reconciler 3 minutes ago Up 2 minutes (healthy) 2026-04-03 07:02:53.422195 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" listener 3 minutes ago Restarting (0) 41 seconds ago 2026-04-03 07:02:53.422202 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 2 hours ago Up 3 minutes (healthy) 3306/tcp 2026-04-03 07:02:53.422210 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" openstack 3 minutes ago Up 3 minutes (healthy) 2026-04-03 07:02:53.422240 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 2 hours ago Up 3 minutes (healthy) 6379/tcp 2026-04-03 07:02:53.422248 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" osism-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-03 07:02:53.422255 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" frontend 3 minutes ago Up 3 minutes 192.168.16.5:3000->3000/tcp 2026-04-03 07:02:53.422263 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" osism-kubernetes 3 minutes ago Up 2 minutes (healthy) 2026-04-03 07:02:53.422271 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" osismclient 3 minutes ago Up 3 minutes (healthy) 2026-04-03 07:02:53.428651 | orchestrator | + [[ '' == \t\r\u\e ]] 2026-04-03 07:02:53.428704 | orchestrator | + [[ '' == \f\a\l\s\e ]] 2026-04-03 07:02:53.428716 | orchestrator | + osism apply facts 2026-04-03 07:03:04.874154 | orchestrator | 2026-04-03 07:03:04 | INFO  | Prepare task for execution of facts. 2026-04-03 07:03:04.956585 | orchestrator | 2026-04-03 07:03:04 | INFO  | Task 5983285c-e40d-4982-a0b9-4d56ba2d979c (facts) was prepared for execution. 2026-04-03 07:03:04.956782 | orchestrator | 2026-04-03 07:03:04 | INFO  | It takes a moment until task 5983285c-e40d-4982-a0b9-4d56ba2d979c (facts) has been started and output is visible here. 2026-04-03 07:03:28.631094 | orchestrator | 2026-04-03 07:03:28.631188 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-03 07:03:28.631199 | orchestrator | 2026-04-03 07:03:28.631208 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 07:03:28.631216 | orchestrator | Friday 03 April 2026 07:03:10 +0000 (0:00:02.008) 0:00:02.008 ********** 2026-04-03 07:03:28.631224 | orchestrator | ok: [testbed-manager] 2026-04-03 07:03:28.631232 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:03:28.631240 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:03:28.631247 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:03:28.631254 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:03:28.631261 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:03:28.631268 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:03:28.631275 | orchestrator | 2026-04-03 07:03:28.631282 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 07:03:28.631290 | orchestrator | Friday 03 April 2026 07:03:14 +0000 (0:00:03.991) 0:00:05.999 ********** 2026-04-03 07:03:28.631297 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:03:28.631305 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:03:28.631312 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:03:28.631319 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:03:28.631326 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:03:28.631333 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:03:28.631340 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:03:28.631347 | orchestrator | 2026-04-03 07:03:28.631355 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 07:03:28.631362 | orchestrator | 2026-04-03 07:03:28.631369 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 07:03:28.631377 | orchestrator | Friday 03 April 2026 07:03:17 +0000 (0:00:03.268) 0:00:09.267 ********** 2026-04-03 07:03:28.631384 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:03:28.631391 | orchestrator | ok: [testbed-manager] 2026-04-03 07:03:28.631399 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:03:28.631406 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:03:28.631413 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:03:28.631420 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:03:28.631448 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:03:28.631456 | orchestrator | 2026-04-03 07:03:28.631463 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 07:03:28.631470 | orchestrator | 2026-04-03 07:03:28.631477 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 07:03:28.631484 | orchestrator | Friday 03 April 2026 07:03:25 +0000 (0:00:07.392) 0:00:16.659 ********** 2026-04-03 07:03:28.631492 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:03:28.631499 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:03:28.631506 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:03:28.631514 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:03:28.631521 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:03:28.631528 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:03:28.631535 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:03:28.631542 | orchestrator | 2026-04-03 07:03:28.631549 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:03:28.631557 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631565 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631573 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631580 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631587 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631595 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631602 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 07:03:28.631656 | orchestrator | 2026-04-03 07:03:28.631666 | orchestrator | 2026-04-03 07:03:28.631676 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:03:28.631685 | orchestrator | Friday 03 April 2026 07:03:28 +0000 (0:00:03.174) 0:00:19.834 ********** 2026-04-03 07:03:28.631694 | orchestrator | =============================================================================== 2026-04-03 07:03:28.631702 | orchestrator | Gathers facts about hosts ----------------------------------------------- 7.39s 2026-04-03 07:03:28.631710 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 3.99s 2026-04-03 07:03:28.631719 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 3.27s 2026-04-03 07:03:28.631727 | orchestrator | Gather facts for all hosts ---------------------------------------------- 3.17s 2026-04-03 07:03:28.836484 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-03 07:03:28.918847 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 07:03:28.919490 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-03 07:03:28.962494 | orchestrator | + OPENSTACK_VERSION=2025.1 2026-04-03 07:03:28.962605 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release/2025.1 2026-04-03 07:03:28.969756 | orchestrator | + set -e 2026-04-03 07:03:28.969807 | orchestrator | + NAMESPACE=kolla/release/2025.1 2026-04-03 07:03:28.969814 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release/2025.1#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-03 07:03:28.981109 | orchestrator | + sh -c /opt/configuration/scripts/upgrade-services.sh 2026-04-03 07:03:28.989640 | orchestrator | 2026-04-03 07:03:28.989673 | orchestrator | # UPGRADE SERVICES 2026-04-03 07:03:28.989681 | orchestrator | 2026-04-03 07:03:28.989689 | orchestrator | + set -e 2026-04-03 07:03:28.989697 | orchestrator | + echo 2026-04-03 07:03:28.989705 | orchestrator | + echo '# UPGRADE SERVICES' 2026-04-03 07:03:28.989733 | orchestrator | + echo 2026-04-03 07:03:28.989740 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 07:03:28.990650 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 07:03:28.990674 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 07:03:28.990682 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 07:03:28.990689 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 07:03:28.990696 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 07:03:28.990705 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 07:03:28.990781 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 07:03:28.990790 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 07:03:28.990906 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 07:03:28.990917 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 07:03:28.990935 | orchestrator | ++ export ARA=false 2026-04-03 07:03:28.990943 | orchestrator | ++ ARA=false 2026-04-03 07:03:28.990951 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 07:03:28.990958 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 07:03:28.990966 | orchestrator | ++ export TEMPEST=false 2026-04-03 07:03:28.990973 | orchestrator | ++ TEMPEST=false 2026-04-03 07:03:28.990981 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 07:03:28.990988 | orchestrator | ++ IS_ZUUL=true 2026-04-03 07:03:28.990996 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 07:03:28.991003 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 07:03:28.991011 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 07:03:28.991018 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 07:03:28.991033 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 07:03:28.991041 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 07:03:28.991049 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 07:03:28.991057 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 07:03:28.991113 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 07:03:28.991123 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 07:03:28.991192 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-03 07:03:28.991203 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-03 07:03:28.991264 | orchestrator | + SKIP_OPENSTACK_UPGRADE=false 2026-04-03 07:03:28.991392 | orchestrator | + SKIP_CEPH_UPGRADE=false 2026-04-03 07:03:28.991405 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-03 07:03:29.001339 | orchestrator | + set -e 2026-04-03 07:03:29.001410 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 07:03:29.002369 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 07:03:29.002468 | orchestrator | ++ INTERACTIVE=false 2026-04-03 07:03:29.002483 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 07:03:29.002508 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 07:03:29.002519 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 07:03:29.002530 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 07:03:29.002541 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 07:03:29.002552 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 07:03:29.002572 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 07:03:29.002584 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 07:03:29.002597 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 07:03:29.002643 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 07:03:29.002656 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 07:03:29.002667 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 07:03:29.002693 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 07:03:29.002704 | orchestrator | ++ export ARA=false 2026-04-03 07:03:29.002716 | orchestrator | ++ ARA=false 2026-04-03 07:03:29.002727 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 07:03:29.002738 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 07:03:29.002748 | orchestrator | ++ export TEMPEST=false 2026-04-03 07:03:29.003017 | orchestrator | 2026-04-03 07:03:29.003044 | orchestrator | # PULL IMAGES 2026-04-03 07:03:29.003056 | orchestrator | 2026-04-03 07:03:29.003067 | orchestrator | ++ TEMPEST=false 2026-04-03 07:03:29.003077 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 07:03:29.003089 | orchestrator | ++ IS_ZUUL=true 2026-04-03 07:03:29.003100 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 07:03:29.003111 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 07:03:29.003122 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 07:03:29.003133 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 07:03:29.003144 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 07:03:29.003154 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 07:03:29.003165 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 07:03:29.003176 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 07:03:29.003187 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 07:03:29.003197 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 07:03:29.003234 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-03 07:03:29.003246 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-03 07:03:29.003257 | orchestrator | + echo 2026-04-03 07:03:29.003268 | orchestrator | + echo '# PULL IMAGES' 2026-04-03 07:03:29.003278 | orchestrator | + echo 2026-04-03 07:03:29.004390 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-03 07:03:29.071157 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 07:03:29.071242 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-03 07:03:30.389272 | orchestrator | 2026-04-03 07:03:30 | INFO  | Trying to run play pull-images in environment custom 2026-04-03 07:03:40.433253 | orchestrator | 2026-04-03 07:03:40 | INFO  | Prepare task for execution of pull-images. 2026-04-03 07:03:40.516364 | orchestrator | 2026-04-03 07:03:40 | INFO  | Task 916ab924-417c-4210-8a6e-4a5b8b80fbcd (pull-images) was prepared for execution. 2026-04-03 07:03:40.516461 | orchestrator | 2026-04-03 07:03:40 | INFO  | Task 916ab924-417c-4210-8a6e-4a5b8b80fbcd is running in background. No more output. Check ARA for logs. 2026-04-03 07:03:40.710946 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/500-kubernetes.sh 2026-04-03 07:03:40.717443 | orchestrator | + set -e 2026-04-03 07:03:40.717520 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 07:03:40.717535 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 07:03:40.717549 | orchestrator | ++ INTERACTIVE=false 2026-04-03 07:03:40.717559 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 07:03:40.717570 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 07:03:40.717581 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 07:03:40.719125 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 07:03:40.730927 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 07:03:40.730988 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 07:03:40.732256 | orchestrator | ++ semver 10.0.0 8.0.3 2026-04-03 07:03:40.791106 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 07:03:40.791200 | orchestrator | + osism apply frr 2026-04-03 07:03:52.236859 | orchestrator | 2026-04-03 07:03:52 | INFO  | Prepare task for execution of frr. 2026-04-03 07:03:52.358960 | orchestrator | 2026-04-03 07:03:52 | INFO  | Task 351365f9-0df2-4f5b-9451-d15fe9481916 (frr) was prepared for execution. 2026-04-03 07:03:52.359059 | orchestrator | 2026-04-03 07:03:52 | INFO  | It takes a moment until task 351365f9-0df2-4f5b-9451-d15fe9481916 (frr) has been started and output is visible here. 2026-04-03 07:04:28.618342 | orchestrator | 2026-04-03 07:04:28.618469 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-03 07:04:28.618490 | orchestrator | 2026-04-03 07:04:28.618504 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-03 07:04:28.618519 | orchestrator | Friday 03 April 2026 07:03:59 +0000 (0:00:03.843) 0:00:03.843 ********** 2026-04-03 07:04:28.618532 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 07:04:28.618546 | orchestrator | 2026-04-03 07:04:28.618559 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-03 07:04:28.618572 | orchestrator | Friday 03 April 2026 07:04:02 +0000 (0:00:02.940) 0:00:06.783 ********** 2026-04-03 07:04:28.618586 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.618601 | orchestrator | 2026-04-03 07:04:28.618693 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-03 07:04:28.618710 | orchestrator | Friday 03 April 2026 07:04:05 +0000 (0:00:02.592) 0:00:09.376 ********** 2026-04-03 07:04:28.618723 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.618737 | orchestrator | 2026-04-03 07:04:28.618765 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-03 07:04:28.618780 | orchestrator | Friday 03 April 2026 07:04:08 +0000 (0:00:02.832) 0:00:12.208 ********** 2026-04-03 07:04:28.618794 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.618807 | orchestrator | 2026-04-03 07:04:28.618821 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-03 07:04:28.618834 | orchestrator | Friday 03 April 2026 07:04:10 +0000 (0:00:01.951) 0:00:14.160 ********** 2026-04-03 07:04:28.618871 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.618885 | orchestrator | 2026-04-03 07:04:28.618899 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-03 07:04:28.618912 | orchestrator | Friday 03 April 2026 07:04:12 +0000 (0:00:01.933) 0:00:16.093 ********** 2026-04-03 07:04:28.618925 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.618938 | orchestrator | 2026-04-03 07:04:28.618951 | orchestrator | TASK [osism.services.frr : Write frr_config_template to temporary file] ******** 2026-04-03 07:04:28.618972 | orchestrator | Friday 03 April 2026 07:04:14 +0000 (0:00:02.545) 0:00:18.638 ********** 2026-04-03 07:04:28.618985 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:04:28.618999 | orchestrator | 2026-04-03 07:04:28.619015 | orchestrator | TASK [osism.services.frr : Render frr.conf from frr_config_template variable] *** 2026-04-03 07:04:28.619029 | orchestrator | Friday 03 April 2026 07:04:15 +0000 (0:00:01.212) 0:00:19.851 ********** 2026-04-03 07:04:28.619042 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:04:28.619055 | orchestrator | 2026-04-03 07:04:28.619069 | orchestrator | TASK [osism.services.frr : Remove temporary frr_config_template file] ********** 2026-04-03 07:04:28.619081 | orchestrator | Friday 03 April 2026 07:04:17 +0000 (0:00:01.193) 0:00:21.045 ********** 2026-04-03 07:04:28.619095 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:04:28.619108 | orchestrator | 2026-04-03 07:04:28.619121 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-03 07:04:28.619136 | orchestrator | Friday 03 April 2026 07:04:18 +0000 (0:00:01.172) 0:00:22.217 ********** 2026-04-03 07:04:28.619150 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:04:28.619163 | orchestrator | 2026-04-03 07:04:28.619177 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-03 07:04:28.619190 | orchestrator | Friday 03 April 2026 07:04:19 +0000 (0:00:01.115) 0:00:23.333 ********** 2026-04-03 07:04:28.619203 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:04:28.619217 | orchestrator | 2026-04-03 07:04:28.619231 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-03 07:04:28.619244 | orchestrator | Friday 03 April 2026 07:04:20 +0000 (0:00:01.154) 0:00:24.487 ********** 2026-04-03 07:04:28.619257 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.619269 | orchestrator | 2026-04-03 07:04:28.619282 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-03 07:04:28.619294 | orchestrator | Friday 03 April 2026 07:04:22 +0000 (0:00:01.911) 0:00:26.399 ********** 2026-04-03 07:04:28.619307 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-03 07:04:28.619321 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-03 07:04:28.619335 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-03 07:04:28.619416 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-03 07:04:28.619431 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-03 07:04:28.619444 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-03 07:04:28.619457 | orchestrator | 2026-04-03 07:04:28.619469 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-03 07:04:28.619482 | orchestrator | Friday 03 April 2026 07:04:25 +0000 (0:00:03.311) 0:00:29.711 ********** 2026-04-03 07:04:28.619496 | orchestrator | ok: [testbed-manager] 2026-04-03 07:04:28.619510 | orchestrator | 2026-04-03 07:04:28.619525 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:04:28.619540 | orchestrator | testbed-manager : ok=9  changed=0 unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 07:04:28.619556 | orchestrator | 2026-04-03 07:04:28.619569 | orchestrator | 2026-04-03 07:04:28.619598 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:04:28.619640 | orchestrator | Friday 03 April 2026 07:04:28 +0000 (0:00:02.481) 0:00:32.193 ********** 2026-04-03 07:04:28.619653 | orchestrator | =============================================================================== 2026-04-03 07:04:28.619691 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 3.31s 2026-04-03 07:04:28.619706 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 2.94s 2026-04-03 07:04:28.619720 | orchestrator | osism.services.frr : Install frr package -------------------------------- 2.83s 2026-04-03 07:04:28.619734 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 2.59s 2026-04-03 07:04:28.619749 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 2.54s 2026-04-03 07:04:28.619762 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 2.48s 2026-04-03 07:04:28.619775 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 1.95s 2026-04-03 07:04:28.619787 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 1.93s 2026-04-03 07:04:28.619799 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 1.91s 2026-04-03 07:04:28.619812 | orchestrator | osism.services.frr : Write frr_config_template to temporary file -------- 1.21s 2026-04-03 07:04:28.619825 | orchestrator | osism.services.frr : Render frr.conf from frr_config_template variable --- 1.19s 2026-04-03 07:04:28.619837 | orchestrator | osism.services.frr : Remove temporary frr_config_template file ---------- 1.17s 2026-04-03 07:04:28.619851 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 1.15s 2026-04-03 07:04:28.619864 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 1.12s 2026-04-03 07:04:28.809835 | orchestrator | + osism apply kubernetes 2026-04-03 07:04:30.123416 | orchestrator | 2026-04-03 07:04:30 | INFO  | Prepare task for execution of kubernetes. 2026-04-03 07:04:30.191919 | orchestrator | 2026-04-03 07:04:30 | INFO  | Task d23b9e09-6b4e-48ca-aae2-32516cc505ea (kubernetes) was prepared for execution. 2026-04-03 07:04:30.192011 | orchestrator | 2026-04-03 07:04:30 | INFO  | It takes a moment until task d23b9e09-6b4e-48ca-aae2-32516cc505ea (kubernetes) has been started and output is visible here. 2026-04-03 07:05:12.722108 | orchestrator | 2026-04-03 07:05:12.722259 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-03 07:05:12.722278 | orchestrator | 2026-04-03 07:05:12.722291 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-03 07:05:12.722304 | orchestrator | Friday 03 April 2026 07:04:36 +0000 (0:00:02.241) 0:00:02.241 ********** 2026-04-03 07:05:12.722315 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.722327 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.722339 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.722350 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.722361 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.722372 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.722383 | orchestrator | 2026-04-03 07:05:12.722407 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-03 07:05:12.722419 | orchestrator | Friday 03 April 2026 07:04:40 +0000 (0:00:04.220) 0:00:06.462 ********** 2026-04-03 07:05:12.722430 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.722441 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.722452 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.722463 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.722474 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.722485 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.722496 | orchestrator | 2026-04-03 07:05:12.722507 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-03 07:05:12.722518 | orchestrator | Friday 03 April 2026 07:04:42 +0000 (0:00:01.960) 0:00:08.423 ********** 2026-04-03 07:05:12.722550 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.722564 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.722578 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.722591 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.722603 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.722653 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.722672 | orchestrator | 2026-04-03 07:05:12.722691 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-03 07:05:12.722709 | orchestrator | Friday 03 April 2026 07:04:44 +0000 (0:00:01.996) 0:00:10.420 ********** 2026-04-03 07:05:12.722727 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.722746 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.722765 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.722782 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.722800 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.722818 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.722837 | orchestrator | 2026-04-03 07:05:12.722855 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-03 07:05:12.722873 | orchestrator | Friday 03 April 2026 07:04:46 +0000 (0:00:02.699) 0:00:13.120 ********** 2026-04-03 07:05:12.722890 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.722907 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.722926 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.722944 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.722962 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.722980 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.722999 | orchestrator | 2026-04-03 07:05:12.723020 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-03 07:05:12.723040 | orchestrator | Friday 03 April 2026 07:04:49 +0000 (0:00:02.230) 0:00:15.350 ********** 2026-04-03 07:05:12.723058 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.723076 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.723096 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.723135 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.723148 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.723159 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.723169 | orchestrator | 2026-04-03 07:05:12.723180 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-03 07:05:12.723191 | orchestrator | Friday 03 April 2026 07:04:51 +0000 (0:00:02.367) 0:00:17.718 ********** 2026-04-03 07:05:12.723202 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.723214 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.723224 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.723289 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.723301 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.723312 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.723323 | orchestrator | 2026-04-03 07:05:12.723334 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-03 07:05:12.723345 | orchestrator | Friday 03 April 2026 07:04:53 +0000 (0:00:02.161) 0:00:19.880 ********** 2026-04-03 07:05:12.723356 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.723366 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.723377 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.723388 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.723399 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.723409 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.723420 | orchestrator | 2026-04-03 07:05:12.723431 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-03 07:05:12.723442 | orchestrator | Friday 03 April 2026 07:04:55 +0000 (0:00:02.226) 0:00:22.106 ********** 2026-04-03 07:05:12.723452 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723463 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723474 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.723498 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723510 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723520 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.723531 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723542 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723552 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.723563 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723574 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723585 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.723642 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723655 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723666 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.723677 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 07:05:12.723688 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 07:05:12.723699 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.723710 | orchestrator | 2026-04-03 07:05:12.723721 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-03 07:05:12.723731 | orchestrator | Friday 03 April 2026 07:04:58 +0000 (0:00:02.108) 0:00:24.215 ********** 2026-04-03 07:05:12.723742 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.723753 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.723764 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.723774 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.723785 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.723796 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.723807 | orchestrator | 2026-04-03 07:05:12.723818 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-03 07:05:12.723830 | orchestrator | Friday 03 April 2026 07:05:00 +0000 (0:00:02.226) 0:00:26.441 ********** 2026-04-03 07:05:12.723841 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.723851 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.723862 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.723879 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.723897 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.723918 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.723936 | orchestrator | 2026-04-03 07:05:12.723955 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-03 07:05:12.723968 | orchestrator | Friday 03 April 2026 07:05:02 +0000 (0:00:01.999) 0:00:28.441 ********** 2026-04-03 07:05:12.723979 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:05:12.723990 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:05:12.724001 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:05:12.724012 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:05:12.724022 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:05:12.724033 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:05:12.724044 | orchestrator | 2026-04-03 07:05:12.724055 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-03 07:05:12.724066 | orchestrator | Friday 03 April 2026 07:05:04 +0000 (0:00:02.647) 0:00:31.088 ********** 2026-04-03 07:05:12.724077 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.724088 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.724099 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.724115 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.724126 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.724137 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.724147 | orchestrator | 2026-04-03 07:05:12.724158 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-03 07:05:12.724177 | orchestrator | Friday 03 April 2026 07:05:06 +0000 (0:00:01.769) 0:00:32.858 ********** 2026-04-03 07:05:12.724188 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.724199 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.724210 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.724220 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.724231 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.724251 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.724262 | orchestrator | 2026-04-03 07:05:12.724273 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-03 07:05:12.724286 | orchestrator | Friday 03 April 2026 07:05:08 +0000 (0:00:01.881) 0:00:34.739 ********** 2026-04-03 07:05:12.724297 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.724307 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.724318 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.724329 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.724340 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.724350 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.724361 | orchestrator | 2026-04-03 07:05:12.724372 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-03 07:05:12.724383 | orchestrator | Friday 03 April 2026 07:05:10 +0000 (0:00:01.786) 0:00:36.526 ********** 2026-04-03 07:05:12.724394 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-03 07:05:12.724405 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-03 07:05:12.724416 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.724427 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-03 07:05:12.724437 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-03 07:05:12.724448 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.724459 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-03 07:05:12.724470 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-03 07:05:12.724480 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:05:12.724491 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-03 07:05:12.724502 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-03 07:05:12.724513 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:05:12.724524 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-03 07:05:12.724540 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-03 07:05:12.724558 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:05:12.724576 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-03 07:05:12.724595 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-03 07:05:12.724639 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:05:12.724655 | orchestrator | 2026-04-03 07:05:12.724666 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-03 07:05:12.724677 | orchestrator | Friday 03 April 2026 07:05:12 +0000 (0:00:01.789) 0:00:38.316 ********** 2026-04-03 07:05:12.724694 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:05:12.724706 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:05:12.724726 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:06:49.204790 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.204866 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.204872 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.204885 | orchestrator | 2026-04-03 07:06:49.204892 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-03 07:06:49.204897 | orchestrator | Friday 03 April 2026 07:05:14 +0000 (0:00:01.945) 0:00:40.262 ********** 2026-04-03 07:06:49.204908 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:06:49.204912 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:06:49.204916 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:06:49.204931 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.204936 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.204939 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.204943 | orchestrator | 2026-04-03 07:06:49.204947 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-03 07:06:49.204951 | orchestrator | 2026-04-03 07:06:49.204955 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-03 07:06:49.204960 | orchestrator | Friday 03 April 2026 07:05:17 +0000 (0:00:02.940) 0:00:43.202 ********** 2026-04-03 07:06:49.204964 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.204969 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.204972 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.204976 | orchestrator | 2026-04-03 07:06:49.204980 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-03 07:06:49.204984 | orchestrator | Friday 03 April 2026 07:05:20 +0000 (0:00:03.589) 0:00:46.792 ********** 2026-04-03 07:06:49.204987 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.204991 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.204995 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.204998 | orchestrator | 2026-04-03 07:06:49.205002 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-03 07:06:49.205006 | orchestrator | Friday 03 April 2026 07:05:23 +0000 (0:00:02.618) 0:00:49.411 ********** 2026-04-03 07:06:49.205010 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:06:49.205014 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:06:49.205018 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:06:49.205022 | orchestrator | 2026-04-03 07:06:49.205026 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-03 07:06:49.205029 | orchestrator | Friday 03 April 2026 07:05:25 +0000 (0:00:02.122) 0:00:51.533 ********** 2026-04-03 07:06:49.205033 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205037 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205040 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205044 | orchestrator | 2026-04-03 07:06:49.205048 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-03 07:06:49.205052 | orchestrator | Friday 03 April 2026 07:05:27 +0000 (0:00:01.678) 0:00:53.212 ********** 2026-04-03 07:06:49.205055 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.205059 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205063 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205067 | orchestrator | 2026-04-03 07:06:49.205070 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-03 07:06:49.205074 | orchestrator | Friday 03 April 2026 07:05:28 +0000 (0:00:01.391) 0:00:54.603 ********** 2026-04-03 07:06:49.205078 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205082 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205085 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205089 | orchestrator | 2026-04-03 07:06:49.205093 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-03 07:06:49.205096 | orchestrator | Friday 03 April 2026 07:05:30 +0000 (0:00:01.972) 0:00:56.576 ********** 2026-04-03 07:06:49.205100 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205104 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205108 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205112 | orchestrator | 2026-04-03 07:06:49.205115 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-03 07:06:49.205119 | orchestrator | Friday 03 April 2026 07:05:32 +0000 (0:00:02.185) 0:00:58.762 ********** 2026-04-03 07:06:49.205123 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:06:49.205127 | orchestrator | 2026-04-03 07:06:49.205130 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-03 07:06:49.205134 | orchestrator | Friday 03 April 2026 07:05:34 +0000 (0:00:01.800) 0:01:00.562 ********** 2026-04-03 07:06:49.205141 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205144 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205148 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205152 | orchestrator | 2026-04-03 07:06:49.205156 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-03 07:06:49.205159 | orchestrator | Friday 03 April 2026 07:05:37 +0000 (0:00:02.690) 0:01:03.253 ********** 2026-04-03 07:06:49.205163 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205167 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205171 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205174 | orchestrator | 2026-04-03 07:06:49.205178 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-03 07:06:49.205182 | orchestrator | Friday 03 April 2026 07:05:38 +0000 (0:00:01.607) 0:01:04.860 ********** 2026-04-03 07:06:49.205185 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205189 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205193 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:06:49.205197 | orchestrator | 2026-04-03 07:06:49.205200 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-03 07:06:49.205204 | orchestrator | Friday 03 April 2026 07:05:40 +0000 (0:00:01.911) 0:01:06.772 ********** 2026-04-03 07:06:49.205208 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205212 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205216 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:06:49.205219 | orchestrator | 2026-04-03 07:06:49.205223 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-03 07:06:49.205227 | orchestrator | Friday 03 April 2026 07:05:42 +0000 (0:00:02.374) 0:01:09.147 ********** 2026-04-03 07:06:49.205231 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.205235 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205247 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205251 | orchestrator | 2026-04-03 07:06:49.205254 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-03 07:06:49.205258 | orchestrator | Friday 03 April 2026 07:05:44 +0000 (0:00:01.462) 0:01:10.610 ********** 2026-04-03 07:06:49.205262 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.205266 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205269 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205273 | orchestrator | 2026-04-03 07:06:49.205277 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-03 07:06:49.205281 | orchestrator | Friday 03 April 2026 07:05:45 +0000 (0:00:01.430) 0:01:12.040 ********** 2026-04-03 07:06:49.205284 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:06:49.205288 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:06:49.205292 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:06:49.205295 | orchestrator | 2026-04-03 07:06:49.205299 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-03 07:06:49.205310 | orchestrator | Friday 03 April 2026 07:05:48 +0000 (0:00:02.394) 0:01:14.434 ********** 2026-04-03 07:06:49.205314 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205318 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205322 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205325 | orchestrator | 2026-04-03 07:06:49.205329 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-03 07:06:49.205333 | orchestrator | Friday 03 April 2026 07:05:50 +0000 (0:00:02.085) 0:01:16.519 ********** 2026-04-03 07:06:49.205337 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205340 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205344 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205348 | orchestrator | 2026-04-03 07:06:49.205352 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-03 07:06:49.205356 | orchestrator | Friday 03 April 2026 07:05:51 +0000 (0:00:01.401) 0:01:17.921 ********** 2026-04-03 07:06:49.205360 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 07:06:49.205367 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 07:06:49.205372 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-03 07:06:49.205376 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 07:06:49.205381 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 07:06:49.205385 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-03 07:06:49.205389 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 07:06:49.205394 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 07:06:49.205398 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-03 07:06:49.205402 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 07:06:49.205407 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 07:06:49.205411 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-03 07:06:49.205415 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 07:06:49.205420 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 07:06:49.205425 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-03 07:06:49.205429 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:06:49.205434 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:06:49.205438 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:06:49.205443 | orchestrator | 2026-04-03 07:06:49.205447 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-03 07:06:49.205452 | orchestrator | Friday 03 April 2026 07:06:46 +0000 (0:00:54.709) 0:02:12.630 ********** 2026-04-03 07:06:49.205456 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:06:49.205460 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:06:49.205465 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:06:49.205470 | orchestrator | 2026-04-03 07:06:49.205474 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-03 07:06:49.205479 | orchestrator | Friday 03 April 2026 07:06:47 +0000 (0:00:01.429) 0:02:14.060 ********** 2026-04-03 07:06:49.205483 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:06:49.205489 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:06:49.205494 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:06:49.205498 | orchestrator | 2026-04-03 07:06:49.205505 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-03 07:07:57.036213 | orchestrator | Friday 03 April 2026 07:06:50 +0000 (0:00:02.311) 0:02:16.371 ********** 2026-04-03 07:07:57.036353 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.036376 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.036392 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.036409 | orchestrator | 2026-04-03 07:07:57.036428 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-03 07:07:57.036472 | orchestrator | Friday 03 April 2026 07:06:52 +0000 (0:00:02.311) 0:02:18.683 ********** 2026-04-03 07:07:57.036489 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:07:57.036506 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:07:57.036521 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:07:57.036537 | orchestrator | 2026-04-03 07:07:57.036555 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-03 07:07:57.036573 | orchestrator | Friday 03 April 2026 07:07:19 +0000 (0:00:27.082) 0:02:45.765 ********** 2026-04-03 07:07:57.036590 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.036607 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.036701 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.036720 | orchestrator | 2026-04-03 07:07:57.036740 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-03 07:07:57.036759 | orchestrator | Friday 03 April 2026 07:07:21 +0000 (0:00:01.800) 0:02:47.566 ********** 2026-04-03 07:07:57.036779 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.036797 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.036817 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.036834 | orchestrator | 2026-04-03 07:07:57.036853 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-03 07:07:57.036872 | orchestrator | Friday 03 April 2026 07:07:23 +0000 (0:00:01.795) 0:02:49.362 ********** 2026-04-03 07:07:57.036893 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:07:57.036914 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:07:57.036932 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:07:57.036951 | orchestrator | 2026-04-03 07:07:57.036972 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-03 07:07:57.036991 | orchestrator | Friday 03 April 2026 07:07:25 +0000 (0:00:01.854) 0:02:51.216 ********** 2026-04-03 07:07:57.037011 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.037032 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.037050 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.037070 | orchestrator | 2026-04-03 07:07:57.037088 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-03 07:07:57.037106 | orchestrator | Friday 03 April 2026 07:07:26 +0000 (0:00:01.633) 0:02:52.850 ********** 2026-04-03 07:07:57.037123 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.037141 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.037158 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.037175 | orchestrator | 2026-04-03 07:07:57.037193 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-03 07:07:57.037211 | orchestrator | Friday 03 April 2026 07:07:28 +0000 (0:00:01.557) 0:02:54.408 ********** 2026-04-03 07:07:57.037228 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:07:57.037246 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:07:57.037264 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:07:57.037280 | orchestrator | 2026-04-03 07:07:57.037298 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-03 07:07:57.037316 | orchestrator | Friday 03 April 2026 07:07:29 +0000 (0:00:01.669) 0:02:56.078 ********** 2026-04-03 07:07:57.037334 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.037352 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.037369 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.037386 | orchestrator | 2026-04-03 07:07:57.037404 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-03 07:07:57.037421 | orchestrator | Friday 03 April 2026 07:07:31 +0000 (0:00:01.677) 0:02:57.755 ********** 2026-04-03 07:07:57.037439 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:07:57.037457 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:07:57.037474 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:07:57.037490 | orchestrator | 2026-04-03 07:07:57.037507 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-03 07:07:57.037523 | orchestrator | Friday 03 April 2026 07:07:33 +0000 (0:00:01.803) 0:02:59.558 ********** 2026-04-03 07:07:57.037557 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:07:57.037574 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:07:57.037591 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:07:57.037606 | orchestrator | 2026-04-03 07:07:57.037646 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-03 07:07:57.037663 | orchestrator | Friday 03 April 2026 07:07:35 +0000 (0:00:02.149) 0:03:01.708 ********** 2026-04-03 07:07:57.037680 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:07:57.037696 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:07:57.037712 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:07:57.037727 | orchestrator | 2026-04-03 07:07:57.037743 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-03 07:07:57.037759 | orchestrator | Friday 03 April 2026 07:07:36 +0000 (0:00:01.311) 0:03:03.019 ********** 2026-04-03 07:07:57.037776 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:07:57.037793 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:07:57.037810 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:07:57.037827 | orchestrator | 2026-04-03 07:07:57.037844 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-03 07:07:57.037860 | orchestrator | Friday 03 April 2026 07:07:38 +0000 (0:00:01.357) 0:03:04.376 ********** 2026-04-03 07:07:57.037878 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.037895 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.037912 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.037927 | orchestrator | 2026-04-03 07:07:57.037942 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-03 07:07:57.037957 | orchestrator | Friday 03 April 2026 07:07:39 +0000 (0:00:01.657) 0:03:06.034 ********** 2026-04-03 07:07:57.037971 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:07:57.037987 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:07:57.038004 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:07:57.038104 | orchestrator | 2026-04-03 07:07:57.038155 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-03 07:07:57.038192 | orchestrator | Friday 03 April 2026 07:07:41 +0000 (0:00:01.683) 0:03:07.718 ********** 2026-04-03 07:07:57.038202 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 07:07:57.038213 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 07:07:57.038223 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-03 07:07:57.038232 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 07:07:57.038242 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 07:07:57.038251 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-03 07:07:57.038261 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 07:07:57.038271 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 07:07:57.038281 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-03 07:07:57.038290 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-03 07:07:57.038300 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 07:07:57.038309 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 07:07:57.038319 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-03 07:07:57.038328 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 07:07:57.038350 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 07:07:57.038360 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-03 07:07:57.038369 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 07:07:57.038379 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 07:07:57.038388 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-03 07:07:57.038398 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-03 07:07:57.038407 | orchestrator | 2026-04-03 07:07:57.038417 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-03 07:07:57.038426 | orchestrator | 2026-04-03 07:07:57.038436 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-03 07:07:57.038446 | orchestrator | Friday 03 April 2026 07:07:45 +0000 (0:00:04.427) 0:03:12.146 ********** 2026-04-03 07:07:57.038455 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:07:57.038464 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:07:57.038474 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:07:57.038483 | orchestrator | 2026-04-03 07:07:57.038493 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-03 07:07:57.038502 | orchestrator | Friday 03 April 2026 07:07:47 +0000 (0:00:01.557) 0:03:13.703 ********** 2026-04-03 07:07:57.038512 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:07:57.038521 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:07:57.038531 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:07:57.038540 | orchestrator | 2026-04-03 07:07:57.038550 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-03 07:07:57.038559 | orchestrator | Friday 03 April 2026 07:07:49 +0000 (0:00:01.729) 0:03:15.433 ********** 2026-04-03 07:07:57.038569 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:07:57.038578 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:07:57.038587 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:07:57.038597 | orchestrator | 2026-04-03 07:07:57.038606 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-03 07:07:57.038616 | orchestrator | Friday 03 April 2026 07:07:50 +0000 (0:00:01.404) 0:03:16.837 ********** 2026-04-03 07:07:57.038680 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:07:57.038690 | orchestrator | 2026-04-03 07:07:57.038700 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-03 07:07:57.038710 | orchestrator | Friday 03 April 2026 07:07:52 +0000 (0:00:01.888) 0:03:18.725 ********** 2026-04-03 07:07:57.038719 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:07:57.038729 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:07:57.038739 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:07:57.038748 | orchestrator | 2026-04-03 07:07:57.038758 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-03 07:07:57.038767 | orchestrator | Friday 03 April 2026 07:07:54 +0000 (0:00:01.471) 0:03:20.197 ********** 2026-04-03 07:07:57.038777 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:07:57.038786 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:07:57.038796 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:07:57.038805 | orchestrator | 2026-04-03 07:07:57.038815 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-03 07:07:57.038824 | orchestrator | Friday 03 April 2026 07:07:55 +0000 (0:00:01.631) 0:03:21.829 ********** 2026-04-03 07:07:57.038834 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:07:57.038843 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:07:57.038859 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:07:57.038868 | orchestrator | 2026-04-03 07:07:57.038878 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-03 07:07:57.038901 | orchestrator | Friday 03 April 2026 07:07:57 +0000 (0:00:01.343) 0:03:23.173 ********** 2026-04-03 07:09:09.485923 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:09:09.486128 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:09:09.486143 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:09:09.486154 | orchestrator | 2026-04-03 07:09:09.486166 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-03 07:09:09.486178 | orchestrator | Friday 03 April 2026 07:07:58 +0000 (0:00:01.746) 0:03:24.919 ********** 2026-04-03 07:09:09.486188 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:09:09.486198 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:09:09.486208 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:09:09.486217 | orchestrator | 2026-04-03 07:09:09.486227 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-03 07:09:09.486237 | orchestrator | Friday 03 April 2026 07:08:00 +0000 (0:00:02.163) 0:03:27.083 ********** 2026-04-03 07:09:09.486247 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:09:09.486257 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:09:09.486266 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:09:09.486276 | orchestrator | 2026-04-03 07:09:09.486285 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-03 07:09:09.486295 | orchestrator | Friday 03 April 2026 07:08:03 +0000 (0:00:02.355) 0:03:29.438 ********** 2026-04-03 07:09:09.486305 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:09:09.486316 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:09:09.486326 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:09:09.486335 | orchestrator | 2026-04-03 07:09:09.486345 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-03 07:09:09.486354 | orchestrator | 2026-04-03 07:09:09.486364 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-03 07:09:09.486373 | orchestrator | Friday 03 April 2026 07:08:11 +0000 (0:00:08.146) 0:03:37.585 ********** 2026-04-03 07:09:09.486383 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486393 | orchestrator | 2026-04-03 07:09:09.486403 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-03 07:09:09.486413 | orchestrator | Friday 03 April 2026 07:08:13 +0000 (0:00:02.168) 0:03:39.753 ********** 2026-04-03 07:09:09.486425 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486438 | orchestrator | 2026-04-03 07:09:09.486450 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-03 07:09:09.486461 | orchestrator | Friday 03 April 2026 07:08:15 +0000 (0:00:01.434) 0:03:41.188 ********** 2026-04-03 07:09:09.486473 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-03 07:09:09.486485 | orchestrator | 2026-04-03 07:09:09.486497 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-03 07:09:09.486509 | orchestrator | Friday 03 April 2026 07:08:16 +0000 (0:00:01.626) 0:03:42.814 ********** 2026-04-03 07:09:09.486521 | orchestrator | changed: [testbed-manager] 2026-04-03 07:09:09.486530 | orchestrator | 2026-04-03 07:09:09.486540 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-03 07:09:09.486550 | orchestrator | Friday 03 April 2026 07:08:18 +0000 (0:00:01.969) 0:03:44.784 ********** 2026-04-03 07:09:09.486559 | orchestrator | changed: [testbed-manager] 2026-04-03 07:09:09.486569 | orchestrator | 2026-04-03 07:09:09.486579 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-03 07:09:09.486589 | orchestrator | Friday 03 April 2026 07:08:20 +0000 (0:00:01.571) 0:03:46.355 ********** 2026-04-03 07:09:09.486599 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-03 07:09:09.486608 | orchestrator | 2026-04-03 07:09:09.486618 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-03 07:09:09.486651 | orchestrator | Friday 03 April 2026 07:08:23 +0000 (0:00:03.113) 0:03:49.469 ********** 2026-04-03 07:09:09.486661 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-03 07:09:09.486670 | orchestrator | 2026-04-03 07:09:09.486680 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-03 07:09:09.486714 | orchestrator | Friday 03 April 2026 07:08:25 +0000 (0:00:02.147) 0:03:51.616 ********** 2026-04-03 07:09:09.486725 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486734 | orchestrator | 2026-04-03 07:09:09.486744 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-03 07:09:09.486753 | orchestrator | Friday 03 April 2026 07:08:26 +0000 (0:00:01.427) 0:03:53.044 ********** 2026-04-03 07:09:09.486762 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486772 | orchestrator | 2026-04-03 07:09:09.486781 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-03 07:09:09.486790 | orchestrator | 2026-04-03 07:09:09.486801 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-03 07:09:09.486810 | orchestrator | Friday 03 April 2026 07:08:28 +0000 (0:00:01.751) 0:03:54.795 ********** 2026-04-03 07:09:09.486820 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486829 | orchestrator | 2026-04-03 07:09:09.486839 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-03 07:09:09.486848 | orchestrator | Friday 03 April 2026 07:08:29 +0000 (0:00:01.192) 0:03:55.988 ********** 2026-04-03 07:09:09.486857 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 07:09:09.486868 | orchestrator | 2026-04-03 07:09:09.486877 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-03 07:09:09.486887 | orchestrator | Friday 03 April 2026 07:08:31 +0000 (0:00:01.585) 0:03:57.574 ********** 2026-04-03 07:09:09.486896 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486905 | orchestrator | 2026-04-03 07:09:09.486915 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-03 07:09:09.486924 | orchestrator | Friday 03 April 2026 07:08:33 +0000 (0:00:01.801) 0:03:59.376 ********** 2026-04-03 07:09:09.486933 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486943 | orchestrator | 2026-04-03 07:09:09.486952 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-03 07:09:09.486962 | orchestrator | Friday 03 April 2026 07:08:35 +0000 (0:00:02.754) 0:04:02.131 ********** 2026-04-03 07:09:09.486971 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.486981 | orchestrator | 2026-04-03 07:09:09.486990 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-03 07:09:09.487021 | orchestrator | Friday 03 April 2026 07:08:37 +0000 (0:00:01.450) 0:04:03.581 ********** 2026-04-03 07:09:09.487031 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.487040 | orchestrator | 2026-04-03 07:09:09.487069 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-03 07:09:09.487080 | orchestrator | Friday 03 April 2026 07:08:38 +0000 (0:00:01.475) 0:04:05.057 ********** 2026-04-03 07:09:09.487089 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.487099 | orchestrator | 2026-04-03 07:09:09.487108 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-03 07:09:09.487118 | orchestrator | Friday 03 April 2026 07:08:40 +0000 (0:00:01.639) 0:04:06.696 ********** 2026-04-03 07:09:09.487127 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.487137 | orchestrator | 2026-04-03 07:09:09.487146 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-03 07:09:09.487156 | orchestrator | Friday 03 April 2026 07:08:42 +0000 (0:00:02.445) 0:04:09.142 ********** 2026-04-03 07:09:09.487165 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:09.487175 | orchestrator | 2026-04-03 07:09:09.487184 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-03 07:09:09.487194 | orchestrator | 2026-04-03 07:09:09.487203 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-03 07:09:09.487213 | orchestrator | Friday 03 April 2026 07:08:44 +0000 (0:00:01.949) 0:04:11.092 ********** 2026-04-03 07:09:09.487222 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:09:09.487232 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:09:09.487249 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:09:09.487258 | orchestrator | 2026-04-03 07:09:09.487268 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-03 07:09:09.487277 | orchestrator | Friday 03 April 2026 07:08:46 +0000 (0:00:01.461) 0:04:12.553 ********** 2026-04-03 07:09:09.487287 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:09.487297 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:09:09.487306 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:09:09.487315 | orchestrator | 2026-04-03 07:09:09.487325 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-03 07:09:09.487334 | orchestrator | Friday 03 April 2026 07:08:47 +0000 (0:00:01.393) 0:04:13.947 ********** 2026-04-03 07:09:09.487344 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:09:09.487354 | orchestrator | 2026-04-03 07:09:09.487363 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-03 07:09:09.487373 | orchestrator | Friday 03 April 2026 07:08:49 +0000 (0:00:01.906) 0:04:15.854 ********** 2026-04-03 07:09:09.487382 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487392 | orchestrator | 2026-04-03 07:09:09.487401 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-03 07:09:09.487411 | orchestrator | Friday 03 April 2026 07:08:51 +0000 (0:00:01.987) 0:04:17.841 ********** 2026-04-03 07:09:09.487420 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487430 | orchestrator | 2026-04-03 07:09:09.487439 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-03 07:09:09.487449 | orchestrator | Friday 03 April 2026 07:08:53 +0000 (0:00:01.867) 0:04:19.710 ********** 2026-04-03 07:09:09.487458 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:09.487468 | orchestrator | 2026-04-03 07:09:09.487477 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-03 07:09:09.487486 | orchestrator | Friday 03 April 2026 07:08:54 +0000 (0:00:01.253) 0:04:20.963 ********** 2026-04-03 07:09:09.487496 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487505 | orchestrator | 2026-04-03 07:09:09.487515 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-03 07:09:09.487524 | orchestrator | Friday 03 April 2026 07:08:56 +0000 (0:00:02.085) 0:04:23.049 ********** 2026-04-03 07:09:09.487534 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487543 | orchestrator | 2026-04-03 07:09:09.487553 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-03 07:09:09.487563 | orchestrator | Friday 03 April 2026 07:08:59 +0000 (0:00:02.186) 0:04:25.236 ********** 2026-04-03 07:09:09.487572 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487581 | orchestrator | 2026-04-03 07:09:09.487591 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-03 07:09:09.487600 | orchestrator | Friday 03 April 2026 07:09:00 +0000 (0:00:01.144) 0:04:26.380 ********** 2026-04-03 07:09:09.487610 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:09.487619 | orchestrator | 2026-04-03 07:09:09.487648 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-03 07:09:09.487658 | orchestrator | Friday 03 April 2026 07:09:01 +0000 (0:00:01.138) 0:04:27.519 ********** 2026-04-03 07:09:09.487667 | orchestrator | ok: [testbed-node-0 -> localhost] => { 2026-04-03 07:09:09.487677 | orchestrator |  "msg": "Installed Cilium version: 1.18.2, Target Cilium version: v1.18.2, Update needed: False\n" 2026-04-03 07:09:09.487688 | orchestrator | } 2026-04-03 07:09:09.487698 | orchestrator | 2026-04-03 07:09:09.487708 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-03 07:09:09.487718 | orchestrator | Friday 03 April 2026 07:09:02 +0000 (0:00:01.181) 0:04:28.701 ********** 2026-04-03 07:09:09.487727 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:09.487736 | orchestrator | 2026-04-03 07:09:09.487746 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-03 07:09:09.487762 | orchestrator | Friday 03 April 2026 07:09:03 +0000 (0:00:01.149) 0:04:29.851 ********** 2026-04-03 07:09:09.487772 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-03 07:09:09.487782 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-03 07:09:09.487797 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-03 07:09:09.487807 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-03 07:09:09.487817 | orchestrator | 2026-04-03 07:09:09.487827 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-03 07:09:09.487843 | orchestrator | Friday 03 April 2026 07:09:09 +0000 (0:00:05.771) 0:04:35.623 ********** 2026-04-03 07:09:51.824473 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 07:09:51.824592 | orchestrator | 2026-04-03 07:09:51.824609 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-03 07:09:51.824623 | orchestrator | Friday 03 April 2026 07:09:11 +0000 (0:00:02.431) 0:04:38.054 ********** 2026-04-03 07:09:51.824688 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 07:09:51.824700 | orchestrator | 2026-04-03 07:09:51.824711 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-03 07:09:51.824723 | orchestrator | Friday 03 April 2026 07:09:14 +0000 (0:00:02.661) 0:04:40.715 ********** 2026-04-03 07:09:51.824734 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-03 07:09:51.824745 | orchestrator | 2026-04-03 07:09:51.824756 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-03 07:09:51.824768 | orchestrator | Friday 03 April 2026 07:09:19 +0000 (0:00:04.434) 0:04:45.150 ********** 2026-04-03 07:09:51.824779 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:51.824790 | orchestrator | 2026-04-03 07:09:51.824802 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-03 07:09:51.824813 | orchestrator | Friday 03 April 2026 07:09:20 +0000 (0:00:01.175) 0:04:46.326 ********** 2026-04-03 07:09:51.824824 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-03 07:09:51.824836 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-03 07:09:51.824847 | orchestrator | 2026-04-03 07:09:51.824858 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-03 07:09:51.824869 | orchestrator | Friday 03 April 2026 07:09:23 +0000 (0:00:03.066) 0:04:49.393 ********** 2026-04-03 07:09:51.824880 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:51.824891 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:09:51.824902 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:09:51.824913 | orchestrator | 2026-04-03 07:09:51.824924 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-03 07:09:51.824934 | orchestrator | Friday 03 April 2026 07:09:24 +0000 (0:00:01.446) 0:04:50.840 ********** 2026-04-03 07:09:51.824946 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:09:51.824957 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:09:51.824968 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:09:51.824979 | orchestrator | 2026-04-03 07:09:51.824989 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-03 07:09:51.825000 | orchestrator | 2026-04-03 07:09:51.825013 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-03 07:09:51.825026 | orchestrator | Friday 03 April 2026 07:09:27 +0000 (0:00:02.392) 0:04:53.233 ********** 2026-04-03 07:09:51.825040 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:51.825053 | orchestrator | 2026-04-03 07:09:51.825067 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-03 07:09:51.825080 | orchestrator | Friday 03 April 2026 07:09:28 +0000 (0:00:01.165) 0:04:54.398 ********** 2026-04-03 07:09:51.825093 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-03 07:09:51.825129 | orchestrator | 2026-04-03 07:09:51.825143 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-03 07:09:51.825156 | orchestrator | Friday 03 April 2026 07:09:29 +0000 (0:00:01.444) 0:04:55.843 ********** 2026-04-03 07:09:51.825169 | orchestrator | ok: [testbed-manager] 2026-04-03 07:09:51.825183 | orchestrator | 2026-04-03 07:09:51.825196 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-03 07:09:51.825210 | orchestrator | 2026-04-03 07:09:51.825223 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-03 07:09:51.825236 | orchestrator | Friday 03 April 2026 07:09:35 +0000 (0:00:05.830) 0:05:01.673 ********** 2026-04-03 07:09:51.825249 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:09:51.825262 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:09:51.825275 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:09:51.825288 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:09:51.825301 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:09:51.825313 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:09:51.825326 | orchestrator | 2026-04-03 07:09:51.825340 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-03 07:09:51.825354 | orchestrator | Friday 03 April 2026 07:09:37 +0000 (0:00:01.727) 0:05:03.401 ********** 2026-04-03 07:09:51.825367 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 07:09:51.825380 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 07:09:51.825391 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-03 07:09:51.825402 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 07:09:51.825412 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 07:09:51.825423 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-03 07:09:51.825434 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 07:09:51.825444 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 07:09:51.825455 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-03 07:09:51.825467 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 07:09:51.825477 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 07:09:51.825488 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-03 07:09:51.825516 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 07:09:51.825528 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 07:09:51.825538 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-03 07:09:51.825549 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 07:09:51.825560 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 07:09:51.825570 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-03 07:09:51.825581 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 07:09:51.825591 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 07:09:51.825602 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-03 07:09:51.825613 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 07:09:51.825623 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 07:09:51.825670 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-03 07:09:51.825690 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 07:09:51.825711 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 07:09:51.825753 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-03 07:09:51.825774 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 07:09:51.825791 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 07:09:51.825808 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-03 07:09:51.825826 | orchestrator | 2026-04-03 07:09:51.825844 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-03 07:09:51.825863 | orchestrator | Friday 03 April 2026 07:09:47 +0000 (0:00:10.135) 0:05:13.536 ********** 2026-04-03 07:09:51.825881 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:09:51.825900 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:09:51.825919 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:09:51.825939 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:51.825958 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:09:51.825978 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:09:51.825995 | orchestrator | 2026-04-03 07:09:51.826089 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-03 07:09:51.826113 | orchestrator | Friday 03 April 2026 07:09:49 +0000 (0:00:01.788) 0:05:15.325 ********** 2026-04-03 07:09:51.826131 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:09:51.826150 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:09:51.826168 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:09:51.826187 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:09:51.826206 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:09:51.826225 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:09:51.826245 | orchestrator | 2026-04-03 07:09:51.826262 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:09:51.826281 | orchestrator | testbed-manager : ok=21  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 07:09:51.826301 | orchestrator | testbed-node-0 : ok=53  changed=14  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 07:09:51.826319 | orchestrator | testbed-node-1 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 07:09:51.826337 | orchestrator | testbed-node-2 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 07:09:51.826356 | orchestrator | testbed-node-3 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 07:09:51.826373 | orchestrator | testbed-node-4 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 07:09:51.826391 | orchestrator | testbed-node-5 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 07:09:51.826407 | orchestrator | 2026-04-03 07:09:51.826425 | orchestrator | 2026-04-03 07:09:51.826442 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:09:51.826459 | orchestrator | Friday 03 April 2026 07:09:51 +0000 (0:00:02.626) 0:05:17.952 ********** 2026-04-03 07:09:51.826476 | orchestrator | =============================================================================== 2026-04-03 07:09:51.826508 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 54.71s 2026-04-03 07:09:51.826546 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 27.08s 2026-04-03 07:09:51.826565 | orchestrator | Manage labels ---------------------------------------------------------- 10.14s 2026-04-03 07:09:51.826603 | orchestrator | k3s_agent : Manage k3s service ------------------------------------------ 8.15s 2026-04-03 07:09:52.137975 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.83s 2026-04-03 07:09:52.138102 | orchestrator | k3s_server_post : Wait for Cilium resources ----------------------------- 5.77s 2026-04-03 07:09:52.138113 | orchestrator | k3s_server_post : Apply BGP manifests ----------------------------------- 4.43s 2026-04-03 07:09:52.138122 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 4.43s 2026-04-03 07:09:52.138131 | orchestrator | k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites --- 4.22s 2026-04-03 07:09:52.138139 | orchestrator | k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers --- 3.59s 2026-04-03 07:09:52.138147 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 3.11s 2026-04-03 07:09:52.138154 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 3.07s 2026-04-03 07:09:52.138161 | orchestrator | k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured --- 2.94s 2026-04-03 07:09:52.138169 | orchestrator | kubectl : Install apt-transport-https package --------------------------- 2.76s 2026-04-03 07:09:52.138176 | orchestrator | k3s_prereq : Enable IPv4 forwarding ------------------------------------- 2.70s 2026-04-03 07:09:52.138183 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 2.69s 2026-04-03 07:09:52.138190 | orchestrator | k3s_server_post : Copy BGP manifests to first master -------------------- 2.66s 2026-04-03 07:09:52.138198 | orchestrator | k3s_download : Download k3s binary x64 ---------------------------------- 2.65s 2026-04-03 07:09:52.138205 | orchestrator | Manage taints ----------------------------------------------------------- 2.63s 2026-04-03 07:09:52.138212 | orchestrator | k3s_server : Stop k3s-init ---------------------------------------------- 2.62s 2026-04-03 07:09:52.327045 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-03 07:09:52.327121 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/200-infrastructure.sh 2026-04-03 07:09:52.332977 | orchestrator | + set -e 2026-04-03 07:09:52.332998 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 07:09:52.333005 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 07:09:52.333013 | orchestrator | ++ INTERACTIVE=false 2026-04-03 07:09:52.333019 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 07:09:52.333026 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 07:09:52.333032 | orchestrator | + osism apply openstackclient 2026-04-03 07:10:03.903724 | orchestrator | 2026-04-03 07:10:03 | INFO  | Prepare task for execution of openstackclient. 2026-04-03 07:10:03.988594 | orchestrator | 2026-04-03 07:10:03 | INFO  | Task 8d3d493a-020b-40d7-af63-5daa286c54d2 (openstackclient) was prepared for execution. 2026-04-03 07:10:03.988780 | orchestrator | 2026-04-03 07:10:03 | INFO  | It takes a moment until task 8d3d493a-020b-40d7-af63-5daa286c54d2 (openstackclient) has been started and output is visible here. 2026-04-03 07:10:37.876125 | orchestrator | 2026-04-03 07:10:37.876242 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-03 07:10:37.876260 | orchestrator | 2026-04-03 07:10:37.876273 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-03 07:10:37.876285 | orchestrator | Friday 03 April 2026 07:10:09 +0000 (0:00:01.742) 0:00:01.742 ********** 2026-04-03 07:10:37.876297 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-03 07:10:37.876309 | orchestrator | 2026-04-03 07:10:37.876320 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-03 07:10:37.876331 | orchestrator | Friday 03 April 2026 07:10:10 +0000 (0:00:01.766) 0:00:03.509 ********** 2026-04-03 07:10:37.876365 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-03 07:10:37.876379 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-03 07:10:37.876390 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-03 07:10:37.876401 | orchestrator | 2026-04-03 07:10:37.876412 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-03 07:10:37.876423 | orchestrator | Friday 03 April 2026 07:10:13 +0000 (0:00:02.351) 0:00:05.860 ********** 2026-04-03 07:10:37.876433 | orchestrator | changed: [testbed-manager] 2026-04-03 07:10:37.876444 | orchestrator | 2026-04-03 07:10:37.876455 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-03 07:10:37.876466 | orchestrator | Friday 03 April 2026 07:10:15 +0000 (0:00:02.253) 0:00:08.113 ********** 2026-04-03 07:10:37.876477 | orchestrator | ok: [testbed-manager] 2026-04-03 07:10:37.876488 | orchestrator | 2026-04-03 07:10:37.876499 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-03 07:10:37.876510 | orchestrator | Friday 03 April 2026 07:10:17 +0000 (0:00:02.013) 0:00:10.126 ********** 2026-04-03 07:10:37.876521 | orchestrator | ok: [testbed-manager] 2026-04-03 07:10:37.876531 | orchestrator | 2026-04-03 07:10:37.876542 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-03 07:10:37.876553 | orchestrator | Friday 03 April 2026 07:10:19 +0000 (0:00:01.920) 0:00:12.047 ********** 2026-04-03 07:10:37.876564 | orchestrator | ok: [testbed-manager] 2026-04-03 07:10:37.876574 | orchestrator | 2026-04-03 07:10:37.876585 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-03 07:10:37.876596 | orchestrator | Friday 03 April 2026 07:10:21 +0000 (0:00:01.523) 0:00:13.571 ********** 2026-04-03 07:10:37.876607 | orchestrator | changed: [testbed-manager] 2026-04-03 07:10:37.876617 | orchestrator | 2026-04-03 07:10:37.876628 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-03 07:10:37.876692 | orchestrator | Friday 03 April 2026 07:10:32 +0000 (0:00:11.171) 0:00:24.743 ********** 2026-04-03 07:10:37.876705 | orchestrator | changed: [testbed-manager] 2026-04-03 07:10:37.876718 | orchestrator | 2026-04-03 07:10:37.876731 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-03 07:10:37.876745 | orchestrator | Friday 03 April 2026 07:10:33 +0000 (0:00:01.778) 0:00:26.521 ********** 2026-04-03 07:10:37.876757 | orchestrator | changed: [testbed-manager] 2026-04-03 07:10:37.876770 | orchestrator | 2026-04-03 07:10:37.876783 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-03 07:10:37.876796 | orchestrator | Friday 03 April 2026 07:10:35 +0000 (0:00:01.636) 0:00:28.157 ********** 2026-04-03 07:10:37.876808 | orchestrator | ok: [testbed-manager] 2026-04-03 07:10:37.876820 | orchestrator | 2026-04-03 07:10:37.876833 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:10:37.876847 | orchestrator | testbed-manager : ok=10  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 07:10:37.876861 | orchestrator | 2026-04-03 07:10:37.876873 | orchestrator | 2026-04-03 07:10:37.876885 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:10:37.876895 | orchestrator | Friday 03 April 2026 07:10:37 +0000 (0:00:01.900) 0:00:30.058 ********** 2026-04-03 07:10:37.876907 | orchestrator | =============================================================================== 2026-04-03 07:10:37.876918 | orchestrator | osism.services.openstackclient : Restart openstackclient service ------- 11.17s 2026-04-03 07:10:37.876928 | orchestrator | osism.services.openstackclient : Create required directories ------------ 2.35s 2026-04-03 07:10:37.876939 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 2.25s 2026-04-03 07:10:37.876949 | orchestrator | osism.services.openstackclient : Manage openstackclient service --------- 2.01s 2026-04-03 07:10:37.876960 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 1.92s 2026-04-03 07:10:37.876979 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 1.90s 2026-04-03 07:10:37.876990 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 1.78s 2026-04-03 07:10:37.877001 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 1.77s 2026-04-03 07:10:37.877011 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 1.64s 2026-04-03 07:10:37.877022 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 1.52s 2026-04-03 07:10:38.077468 | orchestrator | + osism apply -a upgrade common 2026-04-03 07:10:39.348108 | orchestrator | 2026-04-03 07:10:39 | INFO  | Prepare task for execution of common. 2026-04-03 07:10:39.415487 | orchestrator | 2026-04-03 07:10:39 | INFO  | Task a6f09329-3085-4674-88e8-9b10daf8ece8 (common) was prepared for execution. 2026-04-03 07:10:39.415603 | orchestrator | 2026-04-03 07:10:39 | INFO  | It takes a moment until task a6f09329-3085-4674-88e8-9b10daf8ece8 (common) has been started and output is visible here. 2026-04-03 07:10:58.733208 | orchestrator | 2026-04-03 07:10:58.733319 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-03 07:10:58.733341 | orchestrator | 2026-04-03 07:10:58.733359 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-03 07:10:58.733374 | orchestrator | Friday 03 April 2026 07:10:45 +0000 (0:00:02.425) 0:00:02.425 ********** 2026-04-03 07:10:58.733389 | orchestrator | included: /ansible/roles/common/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:10:58.733406 | orchestrator | 2026-04-03 07:10:58.733422 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-03 07:10:58.733437 | orchestrator | Friday 03 April 2026 07:10:48 +0000 (0:00:03.204) 0:00:05.629 ********** 2026-04-03 07:10:58.733454 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733471 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733486 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733495 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733504 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733513 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733523 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733531 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733540 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733549 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733558 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733585 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733594 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733607 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733616 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733624 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733687 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-03 07:10:58.733699 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733708 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-03 07:10:58.733738 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733749 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-03 07:10:58.733759 | orchestrator | 2026-04-03 07:10:58.733769 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-03 07:10:58.733779 | orchestrator | Friday 03 April 2026 07:10:53 +0000 (0:00:04.869) 0:00:10.499 ********** 2026-04-03 07:10:58.733790 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:10:58.733801 | orchestrator | 2026-04-03 07:10:58.733811 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-03 07:10:58.733822 | orchestrator | Friday 03 April 2026 07:10:56 +0000 (0:00:02.961) 0:00:13.460 ********** 2026-04-03 07:10:58.733842 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:10:58.733859 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:10:58.733895 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:10:58.733910 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:10:58.733923 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:10:58.733942 | orchestrator | ok: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:10:58.733963 | orchestrator | ok: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:10:58.733976 | orchestrator | ok: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:10:58.733990 | orchestrator | ok: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:10:58.734011 | orchestrator | ok: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170672 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170793 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170810 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170847 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170860 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170872 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:03.170886 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:03.170898 | orchestrator | ok: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.170933 | orchestrator | ok: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.171140 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.171167 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:03.171182 | orchestrator | 2026-04-03 07:11:03.171197 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-03 07:11:03.171212 | orchestrator | Friday 03 April 2026 07:11:02 +0000 (0:00:06.367) 0:00:19.828 ********** 2026-04-03 07:11:03.171227 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:03.171244 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:03.171259 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:03.171272 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:03.171307 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.221842 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.222078 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.222860 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:11:04.222906 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.222929 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.222948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:11:04.222969 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:04.222990 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:11:04.223009 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:04.223027 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223112 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223151 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:04.223171 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223190 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:11:04.223206 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223224 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:11:04.223242 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223261 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:04.223278 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:04.223296 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:11:04.223323 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639517 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639614 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:11:06.639631 | orchestrator | 2026-04-03 07:11:06.639699 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-03 07:11:06.639712 | orchestrator | Friday 03 April 2026 07:11:05 +0000 (0:00:02.740) 0:00:22.569 ********** 2026-04-03 07:11:06.639727 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:06.639789 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:06.639803 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639826 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:06.639865 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639896 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639908 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:11:06.639920 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639932 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639944 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:06.639955 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:11:06.639966 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.639978 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:06.639996 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:11:06.640008 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:06.640019 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:11:06.640044 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099456 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099572 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:11:19.099591 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:19.099606 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:11:19.099618 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099630 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099713 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099726 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:11:19.099752 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:19.099764 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:11:19.099775 | orchestrator | 2026-04-03 07:11:19.099788 | orchestrator | TASK [common : Ensure /var/log/journal exists on EL10 systems] ***************** 2026-04-03 07:11:19.099800 | orchestrator | Friday 03 April 2026 07:11:08 +0000 (0:00:03.210) 0:00:25.779 ********** 2026-04-03 07:11:19.099811 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:11:19.099822 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:11:19.099832 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:11:19.099860 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:11:19.099871 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:11:19.099882 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:11:19.099893 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:11:19.099903 | orchestrator | 2026-04-03 07:11:19.099914 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-03 07:11:19.099925 | orchestrator | Friday 03 April 2026 07:11:10 +0000 (0:00:01.932) 0:00:27.712 ********** 2026-04-03 07:11:19.099936 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:11:19.099947 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:11:19.099958 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:11:19.099968 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:11:19.099979 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:11:19.099992 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:11:19.100005 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:11:19.100017 | orchestrator | 2026-04-03 07:11:19.100031 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-03 07:11:19.100043 | orchestrator | Friday 03 April 2026 07:11:12 +0000 (0:00:02.035) 0:00:29.747 ********** 2026-04-03 07:11:19.100055 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:11:19.100068 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:11:19.100080 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:11:19.100092 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:11:19.100104 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:11:19.100117 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:11:19.100130 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:11:19.100142 | orchestrator | 2026-04-03 07:11:19.100155 | orchestrator | TASK [common : Copying over kolla.target] ************************************** 2026-04-03 07:11:19.100168 | orchestrator | Friday 03 April 2026 07:11:14 +0000 (0:00:02.061) 0:00:31.809 ********** 2026-04-03 07:11:19.100182 | orchestrator | changed: [testbed-manager] 2026-04-03 07:11:19.100194 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:11:19.100207 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:11:19.100219 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:11:19.100232 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:11:19.100244 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:11:19.100265 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:11:19.100278 | orchestrator | 2026-04-03 07:11:19.100290 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-03 07:11:19.100303 | orchestrator | Friday 03 April 2026 07:11:17 +0000 (0:00:02.977) 0:00:34.787 ********** 2026-04-03 07:11:19.100317 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:19.100331 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:19.100344 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:19.100358 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:19.100386 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:23.873181 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873292 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873334 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873347 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873359 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873387 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873402 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873431 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873443 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873461 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873474 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:23.873486 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:23.873498 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873531 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873543 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:23.873562 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:45.894917 | orchestrator | 2026-04-03 07:11:45.895017 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-03 07:11:45.895030 | orchestrator | Friday 03 April 2026 07:11:24 +0000 (0:00:07.338) 0:00:42.125 ********** 2026-04-03 07:11:45.895038 | orchestrator | [WARNING]: Skipped 2026-04-03 07:11:45.895046 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-03 07:11:45.895054 | orchestrator | to this access issue: 2026-04-03 07:11:45.895061 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-03 07:11:45.895067 | orchestrator | directory 2026-04-03 07:11:45.895074 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 07:11:45.895082 | orchestrator | 2026-04-03 07:11:45.895089 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-03 07:11:45.895096 | orchestrator | Friday 03 April 2026 07:11:27 +0000 (0:00:02.432) 0:00:44.558 ********** 2026-04-03 07:11:45.895102 | orchestrator | [WARNING]: Skipped 2026-04-03 07:11:45.895109 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-03 07:11:45.895114 | orchestrator | to this access issue: 2026-04-03 07:11:45.895120 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-03 07:11:45.895126 | orchestrator | directory 2026-04-03 07:11:45.895131 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 07:11:45.895137 | orchestrator | 2026-04-03 07:11:45.895143 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-03 07:11:45.895148 | orchestrator | Friday 03 April 2026 07:11:29 +0000 (0:00:01.917) 0:00:46.475 ********** 2026-04-03 07:11:45.895154 | orchestrator | [WARNING]: Skipped 2026-04-03 07:11:45.895160 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-03 07:11:45.895165 | orchestrator | to this access issue: 2026-04-03 07:11:45.895171 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-03 07:11:45.895176 | orchestrator | directory 2026-04-03 07:11:45.895182 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 07:11:45.895188 | orchestrator | 2026-04-03 07:11:45.895193 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-03 07:11:45.895199 | orchestrator | Friday 03 April 2026 07:11:31 +0000 (0:00:02.268) 0:00:48.744 ********** 2026-04-03 07:11:45.895205 | orchestrator | [WARNING]: Skipped 2026-04-03 07:11:45.895211 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-03 07:11:45.895216 | orchestrator | to this access issue: 2026-04-03 07:11:45.895222 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-03 07:11:45.895227 | orchestrator | directory 2026-04-03 07:11:45.895233 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 07:11:45.895238 | orchestrator | 2026-04-03 07:11:45.895243 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-03 07:11:45.895249 | orchestrator | Friday 03 April 2026 07:11:33 +0000 (0:00:01.928) 0:00:50.672 ********** 2026-04-03 07:11:45.895255 | orchestrator | changed: [testbed-manager] 2026-04-03 07:11:45.895261 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:11:45.895267 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:11:45.895274 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:11:45.895280 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:11:45.895286 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:11:45.895292 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:11:45.895298 | orchestrator | 2026-04-03 07:11:45.895304 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-03 07:11:45.895311 | orchestrator | Friday 03 April 2026 07:11:38 +0000 (0:00:04.644) 0:00:55.317 ********** 2026-04-03 07:11:45.895318 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895326 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895355 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895361 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895368 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895387 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895394 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-03 07:11:45.895401 | orchestrator | 2026-04-03 07:11:45.895407 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-03 07:11:45.895413 | orchestrator | Friday 03 April 2026 07:11:41 +0000 (0:00:03.694) 0:00:59.011 ********** 2026-04-03 07:11:45.895419 | orchestrator | ok: [testbed-manager] 2026-04-03 07:11:45.895425 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:11:45.895431 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:11:45.895437 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:11:45.895443 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:11:45.895448 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:11:45.895454 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:11:45.895460 | orchestrator | 2026-04-03 07:11:45.895467 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-03 07:11:45.895475 | orchestrator | Friday 03 April 2026 07:11:45 +0000 (0:00:03.217) 0:01:02.229 ********** 2026-04-03 07:11:45.895501 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:45.895511 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:45.895518 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:45.895525 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:45.895538 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:45.895546 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:45.895552 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:45.895576 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:53.810247 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810338 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:53.810350 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:53.810376 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810384 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810404 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810411 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810418 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:53.810439 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:53.810447 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:53.810454 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:11:53.810466 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810473 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:53.810481 | orchestrator | 2026-04-03 07:11:53.810489 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-03 07:11:53.810497 | orchestrator | Friday 03 April 2026 07:11:48 +0000 (0:00:02.962) 0:01:05.192 ********** 2026-04-03 07:11:53.810504 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810515 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810523 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810529 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810536 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810543 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810550 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-03 07:11:53.810557 | orchestrator | 2026-04-03 07:11:53.810564 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-03 07:11:53.810571 | orchestrator | Friday 03 April 2026 07:11:51 +0000 (0:00:03.528) 0:01:08.720 ********** 2026-04-03 07:11:53.810578 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810584 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810594 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810602 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810608 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810615 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810622 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-03 07:11:53.810629 | orchestrator | 2026-04-03 07:11:53.810686 | orchestrator | TASK [service-check-containers : common | Check containers] ******************** 2026-04-03 07:11:58.143084 | orchestrator | Friday 03 April 2026 07:11:55 +0000 (0:00:03.691) 0:01:12.412 ********** 2026-04-03 07:11:58.143174 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:58.143206 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:58.143214 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:58.143221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:58.143241 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:11:58.143248 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143256 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143276 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143289 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143296 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143304 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143313 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143320 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143327 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143334 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:11:58.143345 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:12:03.049159 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-03 07:12:03.049261 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:12:03.049277 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:12:03.049314 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:12:03.049329 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:12:03.049341 | orchestrator | 2026-04-03 07:12:03.049354 | orchestrator | TASK [service-check-containers : common | Notify handlers to restart containers] *** 2026-04-03 07:12:03.049366 | orchestrator | Friday 03 April 2026 07:12:00 +0000 (0:00:05.488) 0:01:17.900 ********** 2026-04-03 07:12:03.049379 | orchestrator | changed: [testbed-manager] => { 2026-04-03 07:12:03.049391 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049402 | orchestrator | } 2026-04-03 07:12:03.049413 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:12:03.049424 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049434 | orchestrator | } 2026-04-03 07:12:03.049445 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:12:03.049455 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049489 | orchestrator | } 2026-04-03 07:12:03.049500 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:12:03.049511 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049522 | orchestrator | } 2026-04-03 07:12:03.049532 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 07:12:03.049543 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049554 | orchestrator | } 2026-04-03 07:12:03.049564 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 07:12:03.049575 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049585 | orchestrator | } 2026-04-03 07:12:03.049596 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 07:12:03.049606 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:12:03.049617 | orchestrator | } 2026-04-03 07:12:03.049627 | orchestrator | 2026-04-03 07:12:03.049638 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:12:03.049688 | orchestrator | Friday 03 April 2026 07:12:02 +0000 (0:00:01.939) 0:01:19.840 ********** 2026-04-03 07:12:03.049735 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:03.049756 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:03.049770 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:03.049784 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:12:03.049799 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:03.049820 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:03.049834 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:03.049856 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:12:03.049870 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:03.049892 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640181 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:12:08.640200 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:08.640215 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640227 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640238 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:12:08.640267 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:08.640302 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640315 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640326 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:12:08.640356 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:08.640368 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640379 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640391 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:12:08.640402 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-03 07:12:08.640427 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640439 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:12:08.640450 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:12:08.640461 | orchestrator | 2026-04-03 07:12:08.640474 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640486 | orchestrator | Friday 03 April 2026 07:12:05 +0000 (0:00:03.159) 0:01:22.999 ********** 2026-04-03 07:12:08.640497 | orchestrator | 2026-04-03 07:12:08.640508 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640518 | orchestrator | Friday 03 April 2026 07:12:06 +0000 (0:00:00.457) 0:01:23.456 ********** 2026-04-03 07:12:08.640529 | orchestrator | 2026-04-03 07:12:08.640540 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640550 | orchestrator | Friday 03 April 2026 07:12:06 +0000 (0:00:00.449) 0:01:23.905 ********** 2026-04-03 07:12:08.640561 | orchestrator | 2026-04-03 07:12:08.640572 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640583 | orchestrator | Friday 03 April 2026 07:12:07 +0000 (0:00:00.454) 0:01:24.361 ********** 2026-04-03 07:12:08.640593 | orchestrator | 2026-04-03 07:12:08.640607 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640620 | orchestrator | Friday 03 April 2026 07:12:07 +0000 (0:00:00.502) 0:01:24.863 ********** 2026-04-03 07:12:08.640634 | orchestrator | 2026-04-03 07:12:08.640673 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640687 | orchestrator | Friday 03 April 2026 07:12:08 +0000 (0:00:00.495) 0:01:25.358 ********** 2026-04-03 07:12:08.640700 | orchestrator | 2026-04-03 07:12:08.640714 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-03 07:12:08.640734 | orchestrator | Friday 03 April 2026 07:12:08 +0000 (0:00:00.433) 0:01:25.792 ********** 2026-04-03 07:14:48.661703 | orchestrator | 2026-04-03 07:14:48.661806 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-03 07:14:48.661819 | orchestrator | Friday 03 April 2026 07:12:09 +0000 (0:00:00.854) 0:01:26.647 ********** 2026-04-03 07:14:48.661828 | orchestrator | changed: [testbed-manager] 2026-04-03 07:14:48.661837 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:14:48.661845 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:14:48.661853 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:14:48.661861 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:14:48.661869 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:14:48.661877 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:14:48.661885 | orchestrator | 2026-04-03 07:14:48.661894 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-03 07:14:48.661902 | orchestrator | Friday 03 April 2026 07:13:20 +0000 (0:01:11.487) 0:02:38.135 ********** 2026-04-03 07:14:48.661910 | orchestrator | changed: [testbed-manager] 2026-04-03 07:14:48.661918 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:14:48.661926 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:14:48.661951 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:14:48.661960 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:14:48.661967 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:14:48.661975 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:14:48.661983 | orchestrator | 2026-04-03 07:14:48.661991 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-03 07:14:48.661999 | orchestrator | Friday 03 April 2026 07:14:25 +0000 (0:01:04.553) 0:03:42.688 ********** 2026-04-03 07:14:48.662006 | orchestrator | ok: [testbed-manager] 2026-04-03 07:14:48.662064 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:14:48.662075 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:14:48.662083 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:14:48.662091 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:14:48.662107 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:14:48.662114 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:14:48.662122 | orchestrator | 2026-04-03 07:14:48.662130 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-03 07:14:48.662138 | orchestrator | Friday 03 April 2026 07:14:28 +0000 (0:00:03.453) 0:03:46.142 ********** 2026-04-03 07:14:48.662145 | orchestrator | changed: [testbed-manager] 2026-04-03 07:14:48.662153 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:14:48.662161 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:14:48.662168 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:14:48.662176 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:14:48.662184 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:14:48.662192 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:14:48.662199 | orchestrator | 2026-04-03 07:14:48.662207 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:14:48.662216 | orchestrator | testbed-manager : ok=22  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662226 | orchestrator | testbed-node-0 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662246 | orchestrator | testbed-node-1 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662255 | orchestrator | testbed-node-2 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662268 | orchestrator | testbed-node-3 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662281 | orchestrator | testbed-node-4 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662293 | orchestrator | testbed-node-5 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:14:48.662306 | orchestrator | 2026-04-03 07:14:48.662318 | orchestrator | 2026-04-03 07:14:48.662331 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:14:48.662343 | orchestrator | Friday 03 April 2026 07:14:48 +0000 (0:00:19.213) 0:04:05.356 ********** 2026-04-03 07:14:48.662357 | orchestrator | =============================================================================== 2026-04-03 07:14:48.662369 | orchestrator | common : Restart fluentd container ------------------------------------- 71.49s 2026-04-03 07:14:48.662381 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 64.55s 2026-04-03 07:14:48.662394 | orchestrator | common : Restart cron container ---------------------------------------- 19.21s 2026-04-03 07:14:48.662408 | orchestrator | common : Copying over config.json files for services -------------------- 7.34s 2026-04-03 07:14:48.662419 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 6.37s 2026-04-03 07:14:48.662444 | orchestrator | service-check-containers : common | Check containers -------------------- 5.49s 2026-04-03 07:14:48.662458 | orchestrator | common : Ensuring config directories exist ------------------------------ 4.87s 2026-04-03 07:14:48.662472 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 4.64s 2026-04-03 07:14:48.662486 | orchestrator | common : Copying over cron logrotate config file ------------------------ 3.70s 2026-04-03 07:14:48.662499 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 3.69s 2026-04-03 07:14:48.662513 | orchestrator | common : Flush handlers ------------------------------------------------- 3.65s 2026-04-03 07:14:48.662526 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 3.53s 2026-04-03 07:14:48.662561 | orchestrator | common : Initializing toolbox container using normal user --------------- 3.45s 2026-04-03 07:14:48.662576 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 3.22s 2026-04-03 07:14:48.662590 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 3.21s 2026-04-03 07:14:48.662603 | orchestrator | common : include_tasks -------------------------------------------------- 3.20s 2026-04-03 07:14:48.662614 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.16s 2026-04-03 07:14:48.662625 | orchestrator | common : Copying over kolla.target -------------------------------------- 2.98s 2026-04-03 07:14:48.662637 | orchestrator | common : Ensuring config directories have correct owner and permission --- 2.96s 2026-04-03 07:14:48.662651 | orchestrator | common : include_tasks -------------------------------------------------- 2.96s 2026-04-03 07:14:48.855279 | orchestrator | + osism apply -a upgrade loadbalancer 2026-04-03 07:14:50.143408 | orchestrator | 2026-04-03 07:14:50 | INFO  | Prepare task for execution of loadbalancer. 2026-04-03 07:14:50.211609 | orchestrator | 2026-04-03 07:14:50 | INFO  | Task 761dd823-94ca-4fe3-9b1e-bb393d46e550 (loadbalancer) was prepared for execution. 2026-04-03 07:14:50.211758 | orchestrator | 2026-04-03 07:14:50 | INFO  | It takes a moment until task 761dd823-94ca-4fe3-9b1e-bb393d46e550 (loadbalancer) has been started and output is visible here. 2026-04-03 07:15:22.615267 | orchestrator | 2026-04-03 07:15:22.615376 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:15:22.615393 | orchestrator | 2026-04-03 07:15:22.615406 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:15:22.615418 | orchestrator | Friday 03 April 2026 07:14:55 +0000 (0:00:01.557) 0:00:01.557 ********** 2026-04-03 07:15:22.615429 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:22.615441 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:22.615452 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:22.615463 | orchestrator | 2026-04-03 07:15:22.615474 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:15:22.615485 | orchestrator | Friday 03 April 2026 07:14:57 +0000 (0:00:02.332) 0:00:03.891 ********** 2026-04-03 07:15:22.615496 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-03 07:15:22.615507 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-03 07:15:22.615518 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-03 07:15:22.615529 | orchestrator | 2026-04-03 07:15:22.615540 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-03 07:15:22.615551 | orchestrator | 2026-04-03 07:15:22.615562 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-03 07:15:22.615573 | orchestrator | Friday 03 April 2026 07:14:59 +0000 (0:00:02.350) 0:00:06.241 ********** 2026-04-03 07:15:22.615585 | orchestrator | included: /ansible/roles/loadbalancer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:15:22.615596 | orchestrator | 2026-04-03 07:15:22.615608 | orchestrator | TASK [loadbalancer : Stop and remove containers for haproxy exporter containers] *** 2026-04-03 07:15:22.615619 | orchestrator | Friday 03 April 2026 07:15:02 +0000 (0:00:02.438) 0:00:08.679 ********** 2026-04-03 07:15:22.615652 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:22.615664 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:22.615736 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:22.615747 | orchestrator | 2026-04-03 07:15:22.615758 | orchestrator | TASK [loadbalancer : Removing config for haproxy exporter] ********************* 2026-04-03 07:15:22.615769 | orchestrator | Friday 03 April 2026 07:15:04 +0000 (0:00:02.208) 0:00:10.887 ********** 2026-04-03 07:15:22.615779 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:22.615790 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:22.615801 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:22.615814 | orchestrator | 2026-04-03 07:15:22.615827 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-03 07:15:22.615840 | orchestrator | Friday 03 April 2026 07:15:06 +0000 (0:00:02.083) 0:00:12.970 ********** 2026-04-03 07:15:22.615853 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:22.615865 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:22.615878 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:22.615890 | orchestrator | 2026-04-03 07:15:22.615904 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-03 07:15:22.615916 | orchestrator | Friday 03 April 2026 07:15:08 +0000 (0:00:01.611) 0:00:14.582 ********** 2026-04-03 07:15:22.615930 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:15:22.615942 | orchestrator | 2026-04-03 07:15:22.615973 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-03 07:15:22.615986 | orchestrator | Friday 03 April 2026 07:15:09 +0000 (0:00:01.646) 0:00:16.228 ********** 2026-04-03 07:15:22.615999 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:22.616011 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:22.616024 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:22.616036 | orchestrator | 2026-04-03 07:15:22.616050 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-03 07:15:22.616063 | orchestrator | Friday 03 April 2026 07:15:11 +0000 (0:00:01.613) 0:00:17.841 ********** 2026-04-03 07:15:22.616076 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616089 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616099 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616110 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616121 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616131 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-03 07:15:22.616142 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 07:15:22.616154 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 07:15:22.616165 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 07:15:22.616176 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 07:15:22.616187 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-03 07:15:22.616198 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-03 07:15:22.616209 | orchestrator | 2026-04-03 07:15:22.616219 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 07:15:22.616230 | orchestrator | Friday 03 April 2026 07:15:15 +0000 (0:00:04.195) 0:00:22.037 ********** 2026-04-03 07:15:22.616241 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-03 07:15:22.616253 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-03 07:15:22.616264 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-03 07:15:22.616275 | orchestrator | 2026-04-03 07:15:22.616303 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 07:15:22.616332 | orchestrator | Friday 03 April 2026 07:15:17 +0000 (0:00:01.663) 0:00:23.701 ********** 2026-04-03 07:15:22.616344 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-03 07:15:22.616355 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-03 07:15:22.616366 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-03 07:15:22.616376 | orchestrator | 2026-04-03 07:15:22.616387 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 07:15:22.616398 | orchestrator | Friday 03 April 2026 07:15:19 +0000 (0:00:02.172) 0:00:25.873 ********** 2026-04-03 07:15:22.616409 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-03 07:15:22.616420 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:15:22.616430 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-03 07:15:22.616441 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:15:22.616452 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-03 07:15:22.616463 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:15:22.616474 | orchestrator | 2026-04-03 07:15:22.616485 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-03 07:15:22.616496 | orchestrator | Friday 03 April 2026 07:15:21 +0000 (0:00:01.954) 0:00:27.828 ********** 2026-04-03 07:15:22.616515 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:22.616532 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:22.616545 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:22.616556 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:22.616575 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:22.616594 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:34.067318 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:34.067434 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:34.067452 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:34.067465 | orchestrator | 2026-04-03 07:15:34.067479 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-03 07:15:34.067491 | orchestrator | Friday 03 April 2026 07:15:24 +0000 (0:00:02.743) 0:00:30.572 ********** 2026-04-03 07:15:34.067503 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:34.067515 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:34.067527 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:34.067538 | orchestrator | 2026-04-03 07:15:34.067549 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-03 07:15:34.067560 | orchestrator | Friday 03 April 2026 07:15:26 +0000 (0:00:02.286) 0:00:32.858 ********** 2026-04-03 07:15:34.067571 | orchestrator | ok: [testbed-node-0] => (item=users) 2026-04-03 07:15:34.067583 | orchestrator | ok: [testbed-node-1] => (item=users) 2026-04-03 07:15:34.067594 | orchestrator | ok: [testbed-node-2] => (item=users) 2026-04-03 07:15:34.067605 | orchestrator | ok: [testbed-node-0] => (item=rules) 2026-04-03 07:15:34.067615 | orchestrator | ok: [testbed-node-1] => (item=rules) 2026-04-03 07:15:34.067649 | orchestrator | ok: [testbed-node-2] => (item=rules) 2026-04-03 07:15:34.067660 | orchestrator | 2026-04-03 07:15:34.067722 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-03 07:15:34.067735 | orchestrator | Friday 03 April 2026 07:15:28 +0000 (0:00:02.539) 0:00:35.398 ********** 2026-04-03 07:15:34.067746 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:34.067757 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:34.067767 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:34.067778 | orchestrator | 2026-04-03 07:15:34.067789 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-03 07:15:34.067802 | orchestrator | Friday 03 April 2026 07:15:30 +0000 (0:00:01.958) 0:00:37.356 ********** 2026-04-03 07:15:34.067816 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:15:34.067828 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:15:34.067842 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:15:34.067854 | orchestrator | 2026-04-03 07:15:34.067868 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-03 07:15:34.067881 | orchestrator | Friday 03 April 2026 07:15:33 +0000 (0:00:02.381) 0:00:39.738 ********** 2026-04-03 07:15:34.067895 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 07:15:34.067929 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:15:34.067952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:34.067967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:34.067982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:15:34.067997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 07:15:34.068020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:15:34.068033 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:34.068045 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:34.068056 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:15:34.068081 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 07:15:38.835953 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:15:38.836065 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:38.836124 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:38.836144 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:15:38.836157 | orchestrator | 2026-04-03 07:15:38.836170 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-03 07:15:38.836183 | orchestrator | Friday 03 April 2026 07:15:35 +0000 (0:00:01.904) 0:00:41.643 ********** 2026-04-03 07:15:38.836194 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:38.836206 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:38.836232 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:38.836264 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:38.836285 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:38.836297 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:38.836308 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:38.836319 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:38.836330 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:38.836356 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:52.455746 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:15:52.455858 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49', '__omit_place_holder__5a9f31b5c5c06cd5415951604ea419f1781b3a49'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-03 07:15:52.455876 | orchestrator | 2026-04-03 07:15:52.455890 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-03 07:15:52.455903 | orchestrator | Friday 03 April 2026 07:15:39 +0000 (0:00:04.779) 0:00:46.422 ********** 2026-04-03 07:15:52.455915 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:52.455928 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:52.455939 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:15:52.455957 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:52.456011 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:52.456024 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:15:52.456035 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:52.456047 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:52.456058 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:15:52.456069 | orchestrator | 2026-04-03 07:15:52.456081 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-03 07:15:52.456091 | orchestrator | Friday 03 April 2026 07:15:44 +0000 (0:00:04.661) 0:00:51.084 ********** 2026-04-03 07:15:52.456102 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 07:15:52.456114 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 07:15:52.456125 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-03 07:15:52.456136 | orchestrator | 2026-04-03 07:15:52.456147 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-03 07:15:52.456158 | orchestrator | Friday 03 April 2026 07:15:47 +0000 (0:00:03.025) 0:00:54.109 ********** 2026-04-03 07:15:52.456181 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 07:15:52.456193 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 07:15:52.456207 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-03 07:15:52.456220 | orchestrator | 2026-04-03 07:15:52.456233 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-03 07:15:52.456245 | orchestrator | Friday 03 April 2026 07:15:51 +0000 (0:00:04.279) 0:00:58.389 ********** 2026-04-03 07:15:52.456258 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:15:52.456272 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:15:52.456292 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:13.466924 | orchestrator | 2026-04-03 07:16:13.467054 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-03 07:16:13.467072 | orchestrator | Friday 03 April 2026 07:15:53 +0000 (0:00:01.648) 0:01:00.037 ********** 2026-04-03 07:16:13.467083 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 07:16:13.467095 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 07:16:13.467106 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-03 07:16:13.467117 | orchestrator | 2026-04-03 07:16:13.467128 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-03 07:16:13.467139 | orchestrator | Friday 03 April 2026 07:15:56 +0000 (0:00:03.218) 0:01:03.256 ********** 2026-04-03 07:16:13.467150 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 07:16:13.467161 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 07:16:13.467172 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-03 07:16:13.467183 | orchestrator | 2026-04-03 07:16:13.467194 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-03 07:16:13.467204 | orchestrator | Friday 03 April 2026 07:15:59 +0000 (0:00:03.018) 0:01:06.274 ********** 2026-04-03 07:16:13.467215 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:16:13.467226 | orchestrator | 2026-04-03 07:16:13.467237 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-03 07:16:13.467247 | orchestrator | Friday 03 April 2026 07:16:01 +0000 (0:00:01.764) 0:01:08.038 ********** 2026-04-03 07:16:13.467259 | orchestrator | ok: [testbed-node-0] => (item=haproxy.pem) 2026-04-03 07:16:13.467270 | orchestrator | ok: [testbed-node-1] => (item=haproxy.pem) 2026-04-03 07:16:13.467281 | orchestrator | ok: [testbed-node-2] => (item=haproxy.pem) 2026-04-03 07:16:13.467291 | orchestrator | 2026-04-03 07:16:13.467302 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-03 07:16:13.467313 | orchestrator | Friday 03 April 2026 07:16:04 +0000 (0:00:02.680) 0:01:10.719 ********** 2026-04-03 07:16:13.467324 | orchestrator | ok: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-03 07:16:13.467335 | orchestrator | ok: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-03 07:16:13.467345 | orchestrator | ok: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-03 07:16:13.467356 | orchestrator | 2026-04-03 07:16:13.467367 | orchestrator | TASK [loadbalancer : Copying over proxysql-cert.pem] *************************** 2026-04-03 07:16:13.467378 | orchestrator | Friday 03 April 2026 07:16:07 +0000 (0:00:02.914) 0:01:13.634 ********** 2026-04-03 07:16:13.467389 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:13.467425 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:13.467438 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:13.467451 | orchestrator | 2026-04-03 07:16:13.467464 | orchestrator | TASK [loadbalancer : Copying over proxysql-key.pem] **************************** 2026-04-03 07:16:13.467477 | orchestrator | Friday 03 April 2026 07:16:08 +0000 (0:00:01.357) 0:01:14.991 ********** 2026-04-03 07:16:13.467490 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:13.467502 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:13.467515 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:13.467527 | orchestrator | 2026-04-03 07:16:13.467539 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-03 07:16:13.467552 | orchestrator | Friday 03 April 2026 07:16:10 +0000 (0:00:01.744) 0:01:16.735 ********** 2026-04-03 07:16:13.467569 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467602 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467636 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467650 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467663 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467729 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:13.467754 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:13.467780 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:13.467803 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:17.076544 | orchestrator | 2026-04-03 07:16:17.076643 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-03 07:16:17.076662 | orchestrator | Friday 03 April 2026 07:16:14 +0000 (0:00:04.287) 0:01:21.023 ********** 2026-04-03 07:16:17.076739 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 07:16:17.076757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:17.076796 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:17.076810 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:17.076823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 07:16:17.076834 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:17.076860 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:17.076872 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:17.076902 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 07:16:17.076914 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:17.076926 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:17.076945 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:17.076970 | orchestrator | 2026-04-03 07:16:17.076982 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-03 07:16:17.076994 | orchestrator | Friday 03 April 2026 07:16:16 +0000 (0:00:02.043) 0:01:23.066 ********** 2026-04-03 07:16:17.077005 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 07:16:17.077016 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:17.077028 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:17.077039 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:17.077060 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 07:16:27.837529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:27.837661 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:27.837750 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:27.837768 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 07:16:27.837780 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:27.838306 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:27.838332 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:27.838346 | orchestrator | 2026-04-03 07:16:27.838362 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-03 07:16:27.838376 | orchestrator | Friday 03 April 2026 07:16:18 +0000 (0:00:01.647) 0:01:24.714 ********** 2026-04-03 07:16:27.838389 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 07:16:27.838402 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 07:16:27.838415 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-03 07:16:27.838428 | orchestrator | 2026-04-03 07:16:27.838440 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-03 07:16:27.838450 | orchestrator | Friday 03 April 2026 07:16:20 +0000 (0:00:02.699) 0:01:27.414 ********** 2026-04-03 07:16:27.838461 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 07:16:27.838472 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 07:16:27.838483 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-03 07:16:27.838494 | orchestrator | 2026-04-03 07:16:27.838524 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-03 07:16:27.838548 | orchestrator | Friday 03 April 2026 07:16:23 +0000 (0:00:02.525) 0:01:29.939 ********** 2026-04-03 07:16:27.838559 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 07:16:27.838570 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 07:16:27.838580 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 07:16:27.838591 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:27.838602 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 07:16:27.838613 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 07:16:27.838623 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:27.838634 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 07:16:27.838644 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:27.838655 | orchestrator | 2026-04-03 07:16:27.838666 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-03 07:16:27.838716 | orchestrator | Friday 03 April 2026 07:16:25 +0000 (0:00:02.299) 0:01:32.238 ********** 2026-04-03 07:16:27.838740 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:27.838762 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:27.838787 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:16:27.838800 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:27.838830 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:31.869996 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:16:31.870156 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:31.870173 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:31.870185 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:16:31.870197 | orchestrator | 2026-04-03 07:16:31.870210 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-03 07:16:31.870222 | orchestrator | Friday 03 April 2026 07:16:29 +0000 (0:00:03.982) 0:01:36.221 ********** 2026-04-03 07:16:31.870234 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:16:31.870245 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:16:31.870256 | orchestrator | } 2026-04-03 07:16:31.870267 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:16:31.870278 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:16:31.870289 | orchestrator | } 2026-04-03 07:16:31.870299 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:16:31.870310 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:16:31.870320 | orchestrator | } 2026-04-03 07:16:31.870331 | orchestrator | 2026-04-03 07:16:31.870359 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:16:31.870391 | orchestrator | Friday 03 April 2026 07:16:31 +0000 (0:00:01.567) 0:01:37.789 ********** 2026-04-03 07:16:31.870403 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 07:16:31.870434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:31.870447 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:31.870458 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:31.870469 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 07:16:31.870481 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:31.870492 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:31.870503 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:31.870527 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 07:16:31.870541 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:16:31.870563 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:16:38.702316 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:38.702417 | orchestrator | 2026-04-03 07:16:38.702434 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-03 07:16:38.702447 | orchestrator | Friday 03 April 2026 07:16:33 +0000 (0:00:01.861) 0:01:39.650 ********** 2026-04-03 07:16:38.702458 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:16:38.702469 | orchestrator | 2026-04-03 07:16:38.702480 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-03 07:16:38.702491 | orchestrator | Friday 03 April 2026 07:16:35 +0000 (0:00:01.973) 0:01:41.624 ********** 2026-04-03 07:16:38.702507 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:38.702523 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:38.702573 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:38.702589 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:38.702618 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:38.702632 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:38.702643 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:38.702655 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:38.702749 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:38.702763 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:38.702783 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642011 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642180 | orchestrator | 2026-04-03 07:16:40.642197 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-03 07:16:40.642211 | orchestrator | Friday 03 April 2026 07:16:39 +0000 (0:00:04.648) 0:01:46.272 ********** 2026-04-03 07:16:40.642224 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:40.642279 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:40.642293 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642305 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642316 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:40.642347 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:40.642360 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:40.642379 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642390 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:40.642401 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:40.642412 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:40.642424 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 07:16:40.642521 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.244191 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.244335 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:54.244355 | orchestrator | 2026-04-03 07:16:54.244368 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-03 07:16:54.244380 | orchestrator | Friday 03 April 2026 07:16:41 +0000 (0:00:01.920) 0:01:48.193 ********** 2026-04-03 07:16:54.244393 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244420 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:54.244431 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244442 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244466 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:54.244486 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244504 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:16:54.244522 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:16:54.244539 | orchestrator | 2026-04-03 07:16:54.244558 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-03 07:16:54.244576 | orchestrator | Friday 03 April 2026 07:16:43 +0000 (0:00:02.170) 0:01:50.364 ********** 2026-04-03 07:16:54.244594 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:16:54.244613 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:16:54.244631 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:16:54.244649 | orchestrator | 2026-04-03 07:16:54.244667 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-03 07:16:54.244743 | orchestrator | Friday 03 April 2026 07:16:46 +0000 (0:00:02.383) 0:01:52.747 ********** 2026-04-03 07:16:54.244765 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:16:54.244787 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:16:54.244807 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:16:54.244826 | orchestrator | 2026-04-03 07:16:54.244849 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-03 07:16:54.244871 | orchestrator | Friday 03 April 2026 07:16:49 +0000 (0:00:02.854) 0:01:55.602 ********** 2026-04-03 07:16:54.244893 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:16:54.244907 | orchestrator | 2026-04-03 07:16:54.244919 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-03 07:16:54.244932 | orchestrator | Friday 03 April 2026 07:16:50 +0000 (0:00:01.648) 0:01:57.251 ********** 2026-04-03 07:16:54.244973 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:54.245005 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.245028 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:54.245043 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.245056 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.245068 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:16:54.245096 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:16:56.325344 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325443 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325456 | orchestrator | 2026-04-03 07:16:56.325465 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-03 07:16:56.325474 | orchestrator | Friday 03 April 2026 07:16:55 +0000 (0:00:04.681) 0:02:01.932 ********** 2026-04-03 07:16:56.325484 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:56.325509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325517 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325525 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:16:56.325548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:56.325561 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325569 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325582 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:16:56.325590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:16:56.325598 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 07:16:56.325610 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:12.957910 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:12.958007 | orchestrator | 2026-04-03 07:17:12.958072 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-03 07:17:12.958082 | orchestrator | Friday 03 April 2026 07:16:57 +0000 (0:00:01.926) 0:02:03.859 ********** 2026-04-03 07:17:12.958104 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958116 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958124 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:12.958130 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958137 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958163 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:12.958170 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958177 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:12.958191 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:12.958199 | orchestrator | 2026-04-03 07:17:12.958205 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-03 07:17:12.958212 | orchestrator | Friday 03 April 2026 07:16:59 +0000 (0:00:01.688) 0:02:05.548 ********** 2026-04-03 07:17:12.958218 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:17:12.958226 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:17:12.958232 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:17:12.958238 | orchestrator | 2026-04-03 07:17:12.958244 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-03 07:17:12.958250 | orchestrator | Friday 03 April 2026 07:17:01 +0000 (0:00:02.250) 0:02:07.798 ********** 2026-04-03 07:17:12.958257 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:17:12.958263 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:17:12.958269 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:17:12.958275 | orchestrator | 2026-04-03 07:17:12.958281 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-03 07:17:12.958287 | orchestrator | Friday 03 April 2026 07:17:04 +0000 (0:00:02.901) 0:02:10.700 ********** 2026-04-03 07:17:12.958293 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:12.958299 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:12.958305 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:12.958311 | orchestrator | 2026-04-03 07:17:12.958317 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-03 07:17:12.958323 | orchestrator | Friday 03 April 2026 07:17:06 +0000 (0:00:01.811) 0:02:12.511 ********** 2026-04-03 07:17:12.958331 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:17:12.958337 | orchestrator | 2026-04-03 07:17:12.958343 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-03 07:17:12.958350 | orchestrator | Friday 03 April 2026 07:17:07 +0000 (0:00:01.540) 0:02:14.052 ********** 2026-04-03 07:17:12.958360 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 07:17:12.958395 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 07:17:12.958411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-03 07:17:12.958419 | orchestrator | 2026-04-03 07:17:12.958426 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-03 07:17:12.958434 | orchestrator | Friday 03 April 2026 07:17:11 +0000 (0:00:03.891) 0:02:17.944 ********** 2026-04-03 07:17:12.958441 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 07:17:12.958449 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:12.958457 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 07:17:12.958465 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:12.958478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-03 07:17:25.646856 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:25.646953 | orchestrator | 2026-04-03 07:17:25.646967 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-03 07:17:25.646978 | orchestrator | Friday 03 April 2026 07:17:14 +0000 (0:00:02.566) 0:02:20.510 ********** 2026-04-03 07:17:25.647003 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647017 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647028 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:25.647037 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647055 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:25.647064 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647073 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-03 07:17:25.647082 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:25.647091 | orchestrator | 2026-04-03 07:17:25.647100 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-03 07:17:25.647109 | orchestrator | Friday 03 April 2026 07:17:16 +0000 (0:00:02.686) 0:02:23.196 ********** 2026-04-03 07:17:25.647117 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:25.647126 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:25.647134 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:25.647143 | orchestrator | 2026-04-03 07:17:25.647152 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-03 07:17:25.647161 | orchestrator | Friday 03 April 2026 07:17:18 +0000 (0:00:01.747) 0:02:24.945 ********** 2026-04-03 07:17:25.647169 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:25.647178 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:25.647205 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:25.647214 | orchestrator | 2026-04-03 07:17:25.647223 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-03 07:17:25.647232 | orchestrator | Friday 03 April 2026 07:17:20 +0000 (0:00:02.054) 0:02:26.999 ********** 2026-04-03 07:17:25.647241 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:17:25.647249 | orchestrator | 2026-04-03 07:17:25.647258 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-03 07:17:25.647266 | orchestrator | Friday 03 April 2026 07:17:22 +0000 (0:00:01.648) 0:02:28.648 ********** 2026-04-03 07:17:25.647298 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:25.647312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:25.647323 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:25.647335 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:25.647354 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:25.647407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579410 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579577 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579611 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:27.579678 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579793 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579807 | orchestrator | 2026-04-03 07:17:27.579821 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-03 07:17:27.579834 | orchestrator | Friday 03 April 2026 07:17:27 +0000 (0:00:04.880) 0:02:33.529 ********** 2026-04-03 07:17:27.579848 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:17:27.579863 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579887 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:27.579914 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:27.579946 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:17:37.735352 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735487 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735531 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735544 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:37.735576 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:17:37.735590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735620 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735631 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 07:17:37.735648 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:37.735659 | orchestrator | 2026-04-03 07:17:37.735671 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-03 07:17:37.735682 | orchestrator | Friday 03 April 2026 07:17:28 +0000 (0:00:01.753) 0:02:35.283 ********** 2026-04-03 07:17:37.735719 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735732 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735744 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:37.735754 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735764 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735774 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:37.735784 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735794 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:17:37.735804 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:37.735814 | orchestrator | 2026-04-03 07:17:37.735830 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-03 07:17:37.735840 | orchestrator | Friday 03 April 2026 07:17:30 +0000 (0:00:01.826) 0:02:37.109 ********** 2026-04-03 07:17:37.735850 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:17:37.735862 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:17:37.735874 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:17:37.735885 | orchestrator | 2026-04-03 07:17:37.735896 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-03 07:17:37.735908 | orchestrator | Friday 03 April 2026 07:17:33 +0000 (0:00:02.502) 0:02:39.612 ********** 2026-04-03 07:17:37.735920 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:17:37.735931 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:17:37.735943 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:17:37.735953 | orchestrator | 2026-04-03 07:17:37.735965 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-03 07:17:37.735976 | orchestrator | Friday 03 April 2026 07:17:36 +0000 (0:00:02.913) 0:02:42.526 ********** 2026-04-03 07:17:37.735988 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:37.735999 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:37.736010 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:37.736021 | orchestrator | 2026-04-03 07:17:37.736032 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-03 07:17:37.736044 | orchestrator | Friday 03 April 2026 07:17:37 +0000 (0:00:01.428) 0:02:43.954 ********** 2026-04-03 07:17:37.736055 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:37.736066 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:37.736092 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:17:44.208133 | orchestrator | 2026-04-03 07:17:44.208231 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-03 07:17:44.208244 | orchestrator | Friday 03 April 2026 07:17:38 +0000 (0:00:01.349) 0:02:45.304 ********** 2026-04-03 07:17:44.208252 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:17:44.208260 | orchestrator | 2026-04-03 07:17:44.208269 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-03 07:17:44.208277 | orchestrator | Friday 03 April 2026 07:17:40 +0000 (0:00:01.781) 0:02:47.086 ********** 2026-04-03 07:17:44.208290 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:44.208305 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:17:44.208314 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208337 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:44.208381 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:17:44.208399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208407 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208429 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208461 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:17:44.208482 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132656 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132819 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132837 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:17:46.132870 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:17:46.132907 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132937 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132949 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132961 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132972 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.132985 | orchestrator | 2026-04-03 07:17:46.132998 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-03 07:17:46.133010 | orchestrator | Friday 03 April 2026 07:17:45 +0000 (0:00:04.903) 0:02:51.989 ********** 2026-04-03 07:17:46.133028 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:17:46.133049 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:17:46.133068 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.624792 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.624891 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.624907 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.624944 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.624957 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:17:46.624971 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:17:46.625003 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:17:46.625063 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.625077 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.625094 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.625114 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.625126 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:17:46.625137 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:17:46.625157 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:18:02.620780 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 07:18:02.620930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 07:18:02.621001 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 07:18:02.621020 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 07:18:02.621037 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:18:02.621055 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-03 07:18:02.621072 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:02.621091 | orchestrator | 2026-04-03 07:18:02.621110 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-03 07:18:02.621129 | orchestrator | Friday 03 April 2026 07:17:47 +0000 (0:00:02.298) 0:02:54.287 ********** 2026-04-03 07:18:02.621168 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621189 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621208 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:02.621226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621244 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621271 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:02.621289 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621307 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:02.621325 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:02.621341 | orchestrator | 2026-04-03 07:18:02.621359 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-03 07:18:02.621376 | orchestrator | Friday 03 April 2026 07:17:49 +0000 (0:00:01.858) 0:02:56.146 ********** 2026-04-03 07:18:02.621394 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:02.621412 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:02.621430 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:02.621448 | orchestrator | 2026-04-03 07:18:02.621473 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-03 07:18:02.621491 | orchestrator | Friday 03 April 2026 07:17:51 +0000 (0:00:02.203) 0:02:58.350 ********** 2026-04-03 07:18:02.621508 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:02.621525 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:02.621543 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:02.621560 | orchestrator | 2026-04-03 07:18:02.621578 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-03 07:18:02.621595 | orchestrator | Friday 03 April 2026 07:17:54 +0000 (0:00:02.873) 0:03:01.223 ********** 2026-04-03 07:18:02.621612 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:02.621629 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:02.621646 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:02.621663 | orchestrator | 2026-04-03 07:18:02.621679 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-03 07:18:02.621729 | orchestrator | Friday 03 April 2026 07:17:56 +0000 (0:00:01.823) 0:03:03.047 ********** 2026-04-03 07:18:02.621745 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:18:02.621761 | orchestrator | 2026-04-03 07:18:02.621776 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-03 07:18:02.621792 | orchestrator | Friday 03 April 2026 07:17:58 +0000 (0:00:01.636) 0:03:04.683 ********** 2026-04-03 07:18:02.621825 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 07:18:02.853125 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:02.853226 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 07:18:02.853279 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 07:18:02.853300 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:02.853322 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:07.305047 | orchestrator | 2026-04-03 07:18:07.305148 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-03 07:18:07.305164 | orchestrator | Friday 03 April 2026 07:18:03 +0000 (0:00:05.753) 0:03:10.437 ********** 2026-04-03 07:18:07.305197 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 07:18:07.305214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:07.305248 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:07.305286 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 07:18:07.305301 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:07.305319 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:07.305345 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 07:18:24.451099 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-03 07:18:24.451204 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:24.451215 | orchestrator | 2026-04-03 07:18:24.451223 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-03 07:18:24.451230 | orchestrator | Friday 03 April 2026 07:18:08 +0000 (0:00:04.442) 0:03:14.879 ********** 2026-04-03 07:18:24.451237 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451255 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451263 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:24.451271 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451298 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451310 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:24.451320 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-03 07:18:24.451348 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:24.451359 | orchestrator | 2026-04-03 07:18:24.451369 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-03 07:18:24.451379 | orchestrator | Friday 03 April 2026 07:18:12 +0000 (0:00:04.449) 0:03:19.329 ********** 2026-04-03 07:18:24.451389 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:24.451400 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:24.451409 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:24.451419 | orchestrator | 2026-04-03 07:18:24.451429 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-03 07:18:24.451438 | orchestrator | Friday 03 April 2026 07:18:15 +0000 (0:00:02.459) 0:03:21.788 ********** 2026-04-03 07:18:24.451448 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:24.451457 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:24.451467 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:24.451477 | orchestrator | 2026-04-03 07:18:24.451487 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-03 07:18:24.451496 | orchestrator | Friday 03 April 2026 07:18:18 +0000 (0:00:02.856) 0:03:24.645 ********** 2026-04-03 07:18:24.451506 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:24.451515 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:24.451525 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:24.451534 | orchestrator | 2026-04-03 07:18:24.451545 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-03 07:18:24.451555 | orchestrator | Friday 03 April 2026 07:18:19 +0000 (0:00:01.315) 0:03:25.960 ********** 2026-04-03 07:18:24.451566 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:18:24.451576 | orchestrator | 2026-04-03 07:18:24.451586 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-03 07:18:24.451596 | orchestrator | Friday 03 April 2026 07:18:21 +0000 (0:00:01.943) 0:03:27.904 ********** 2026-04-03 07:18:24.451615 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:18:24.451631 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:18:41.169682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:18:41.169869 | orchestrator | 2026-04-03 07:18:41.169890 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-03 07:18:41.169904 | orchestrator | Friday 03 April 2026 07:18:25 +0000 (0:00:04.379) 0:03:32.284 ********** 2026-04-03 07:18:41.169918 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:18:41.169931 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:41.169943 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:18:41.169954 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:41.169966 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:18:41.169977 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:41.170011 | orchestrator | 2026-04-03 07:18:41.170085 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-03 07:18:41.170098 | orchestrator | Friday 03 April 2026 07:18:27 +0000 (0:00:01.598) 0:03:33.882 ********** 2026-04-03 07:18:41.170110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170125 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170148 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:41.170189 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170202 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170216 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:41.170270 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170285 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:18:41.170298 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:41.170311 | orchestrator | 2026-04-03 07:18:41.170322 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-03 07:18:41.170333 | orchestrator | Friday 03 April 2026 07:18:29 +0000 (0:00:01.635) 0:03:35.518 ********** 2026-04-03 07:18:41.170344 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:41.170356 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:41.170367 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:41.170377 | orchestrator | 2026-04-03 07:18:41.170388 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-03 07:18:41.170399 | orchestrator | Friday 03 April 2026 07:18:31 +0000 (0:00:02.406) 0:03:37.924 ********** 2026-04-03 07:18:41.170410 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:41.170421 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:41.170431 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:41.170442 | orchestrator | 2026-04-03 07:18:41.170453 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-03 07:18:41.170464 | orchestrator | Friday 03 April 2026 07:18:34 +0000 (0:00:02.893) 0:03:40.817 ********** 2026-04-03 07:18:41.170474 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:41.170485 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:41.170496 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:41.170507 | orchestrator | 2026-04-03 07:18:41.170518 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-03 07:18:41.170528 | orchestrator | Friday 03 April 2026 07:18:35 +0000 (0:00:01.421) 0:03:42.238 ********** 2026-04-03 07:18:41.170539 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:18:41.170550 | orchestrator | 2026-04-03 07:18:41.170561 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-03 07:18:41.170571 | orchestrator | Friday 03 April 2026 07:18:37 +0000 (0:00:01.955) 0:03:44.195 ********** 2026-04-03 07:18:41.170605 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 07:18:43.205420 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 07:18:43.205590 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 07:18:43.205610 | orchestrator | 2026-04-03 07:18:43.205624 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-03 07:18:43.205636 | orchestrator | Friday 03 April 2026 07:18:42 +0000 (0:00:04.664) 0:03:48.859 ********** 2026-04-03 07:18:43.205655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 07:18:43.205676 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:43.205747 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 07:18:53.714397 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:53.714518 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 07:18:53.714563 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:53.714577 | orchestrator | 2026-04-03 07:18:53.714590 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-03 07:18:53.714603 | orchestrator | Friday 03 April 2026 07:18:44 +0000 (0:00:02.062) 0:03:50.922 ********** 2026-04-03 07:18:53.714617 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714649 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714664 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714677 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 07:18:53.714691 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:53.714764 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714790 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714798 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714805 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 07:18:53.714812 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:53.714826 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714834 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714841 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-03 07:18:53.714849 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-03 07:18:53.714856 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-03 07:18:53.714863 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:53.714870 | orchestrator | 2026-04-03 07:18:53.714878 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-03 07:18:53.714886 | orchestrator | Friday 03 April 2026 07:18:46 +0000 (0:00:02.158) 0:03:53.081 ********** 2026-04-03 07:18:53.714893 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:53.714901 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:53.714909 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:53.714916 | orchestrator | 2026-04-03 07:18:53.714924 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-03 07:18:53.714933 | orchestrator | Friday 03 April 2026 07:18:48 +0000 (0:00:02.334) 0:03:55.415 ********** 2026-04-03 07:18:53.714942 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:18:53.714950 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:18:53.714958 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:18:53.714967 | orchestrator | 2026-04-03 07:18:53.714975 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-03 07:18:53.714989 | orchestrator | Friday 03 April 2026 07:18:51 +0000 (0:00:03.001) 0:03:58.417 ********** 2026-04-03 07:18:53.714998 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:18:53.715007 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:18:53.715015 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:18:53.715024 | orchestrator | 2026-04-03 07:18:53.715033 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-03 07:18:53.715042 | orchestrator | Friday 03 April 2026 07:18:53 +0000 (0:00:01.638) 0:04:00.056 ********** 2026-04-03 07:18:53.715056 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:01.923447 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:01.923544 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:01.923558 | orchestrator | 2026-04-03 07:19:01.923570 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-03 07:19:01.923580 | orchestrator | Friday 03 April 2026 07:18:54 +0000 (0:00:01.326) 0:04:01.383 ********** 2026-04-03 07:19:01.923590 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:19:01.923600 | orchestrator | 2026-04-03 07:19:01.923610 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-03 07:19:01.923620 | orchestrator | Friday 03 April 2026 07:18:57 +0000 (0:00:02.093) 0:04:03.476 ********** 2026-04-03 07:19:01.923634 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 07:19:01.923663 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:01.923676 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:01.923687 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 07:19:01.923783 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:01.923803 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:01.923820 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 07:19:01.923832 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:01.923842 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:01.923860 | orchestrator | 2026-04-03 07:19:01.923871 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-03 07:19:01.923883 | orchestrator | Friday 03 April 2026 07:19:01 +0000 (0:00:04.622) 0:04:08.099 ********** 2026-04-03 07:19:01.923902 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 07:19:05.172067 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:05.172189 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:05.172207 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:05.172223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 07:19:05.172259 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:05.172272 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:05.172283 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:05.172313 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 07:19:05.172331 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 07:19:05.172343 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 07:19:05.172361 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:05.172373 | orchestrator | 2026-04-03 07:19:05.172386 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-03 07:19:05.172398 | orchestrator | Friday 03 April 2026 07:19:03 +0000 (0:00:01.662) 0:04:09.762 ********** 2026-04-03 07:19:05.172410 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172437 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:05.172449 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172460 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172471 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:05.172482 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172493 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-03 07:19:05.172504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:05.172515 | orchestrator | 2026-04-03 07:19:05.172526 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-03 07:19:05.172544 | orchestrator | Friday 03 April 2026 07:19:05 +0000 (0:00:01.876) 0:04:11.638 ********** 2026-04-03 07:19:19.115982 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:19.116111 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:19.116134 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:19.116149 | orchestrator | 2026-04-03 07:19:19.116164 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-03 07:19:19.116179 | orchestrator | Friday 03 April 2026 07:19:07 +0000 (0:00:02.217) 0:04:13.855 ********** 2026-04-03 07:19:19.116192 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:19.116206 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:19.116220 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:19.116234 | orchestrator | 2026-04-03 07:19:19.116248 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-03 07:19:19.116262 | orchestrator | Friday 03 April 2026 07:19:10 +0000 (0:00:02.874) 0:04:16.729 ********** 2026-04-03 07:19:19.116275 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:19.116290 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:19.116303 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:19.116317 | orchestrator | 2026-04-03 07:19:19.116330 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-03 07:19:19.116344 | orchestrator | Friday 03 April 2026 07:19:11 +0000 (0:00:01.404) 0:04:18.134 ********** 2026-04-03 07:19:19.116406 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:19:19.116423 | orchestrator | 2026-04-03 07:19:19.116437 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-03 07:19:19.116453 | orchestrator | Friday 03 April 2026 07:19:13 +0000 (0:00:02.119) 0:04:20.254 ********** 2026-04-03 07:19:19.116472 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:19.116493 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:19.116509 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:19.116550 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:19.116587 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:19.116605 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:19.116618 | orchestrator | 2026-04-03 07:19:19.116632 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-03 07:19:19.116648 | orchestrator | Friday 03 April 2026 07:19:18 +0000 (0:00:04.935) 0:04:25.190 ********** 2026-04-03 07:19:19.116662 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:19.116688 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:33.696497 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:33.696621 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:33.696684 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:33.696789 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:33.696853 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:33.696869 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:19:33.696880 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:33.696892 | orchestrator | 2026-04-03 07:19:33.696933 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-03 07:19:33.696946 | orchestrator | Friday 03 April 2026 07:19:20 +0000 (0:00:02.056) 0:04:27.247 ********** 2026-04-03 07:19:33.696978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697005 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697018 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:33.697029 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697047 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697059 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:33.697070 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:33.697092 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:33.697103 | orchestrator | 2026-04-03 07:19:33.697115 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-03 07:19:33.697126 | orchestrator | Friday 03 April 2026 07:19:22 +0000 (0:00:02.064) 0:04:29.312 ********** 2026-04-03 07:19:33.697137 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:33.697149 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:33.697159 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:33.697170 | orchestrator | 2026-04-03 07:19:33.697181 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-03 07:19:33.697192 | orchestrator | Friday 03 April 2026 07:19:25 +0000 (0:00:02.287) 0:04:31.600 ********** 2026-04-03 07:19:33.697203 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:33.697214 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:33.697224 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:33.697235 | orchestrator | 2026-04-03 07:19:33.697246 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-03 07:19:33.697257 | orchestrator | Friday 03 April 2026 07:19:28 +0000 (0:00:02.952) 0:04:34.552 ********** 2026-04-03 07:19:33.697268 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:19:33.697279 | orchestrator | 2026-04-03 07:19:33.697290 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-03 07:19:33.697301 | orchestrator | Friday 03 April 2026 07:19:30 +0000 (0:00:02.141) 0:04:36.694 ********** 2026-04-03 07:19:33.697314 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:33.697342 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:35.559267 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559368 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559382 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559395 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559436 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559468 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:19:35.559481 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559491 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559501 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:35.559518 | orchestrator | 2026-04-03 07:19:35.559530 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-03 07:19:35.559541 | orchestrator | Friday 03 April 2026 07:19:35 +0000 (0:00:04.951) 0:04:41.645 ********** 2026-04-03 07:19:35.559553 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:35.559570 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984342 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984438 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984456 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:37.984472 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:37.984509 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984522 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984570 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984583 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:37.984594 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:19:37.984606 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984617 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984636 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 07:19:37.984647 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:37.984658 | orchestrator | 2026-04-03 07:19:37.984671 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-03 07:19:37.984683 | orchestrator | Friday 03 April 2026 07:19:37 +0000 (0:00:02.014) 0:04:43.660 ********** 2026-04-03 07:19:37.984696 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:37.984776 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:37.984790 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:37.984802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:37.984827 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:54.048829 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:54.048959 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:54.048990 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:19:54.049013 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:54.049034 | orchestrator | 2026-04-03 07:19:54.049057 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-03 07:19:54.049080 | orchestrator | Friday 03 April 2026 07:19:39 +0000 (0:00:02.099) 0:04:45.759 ********** 2026-04-03 07:19:54.049102 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:54.049124 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:54.049144 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:54.049163 | orchestrator | 2026-04-03 07:19:54.049184 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-03 07:19:54.049204 | orchestrator | Friday 03 April 2026 07:19:41 +0000 (0:00:02.236) 0:04:47.996 ********** 2026-04-03 07:19:54.049259 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:19:54.049280 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:19:54.049300 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:19:54.049321 | orchestrator | 2026-04-03 07:19:54.049342 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-03 07:19:54.049364 | orchestrator | Friday 03 April 2026 07:19:44 +0000 (0:00:02.953) 0:04:50.950 ********** 2026-04-03 07:19:54.049384 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:19:54.049403 | orchestrator | 2026-04-03 07:19:54.049424 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-03 07:19:54.049446 | orchestrator | Friday 03 April 2026 07:19:47 +0000 (0:00:02.557) 0:04:53.508 ********** 2026-04-03 07:19:54.049466 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:19:54.049485 | orchestrator | 2026-04-03 07:19:54.049506 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-03 07:19:54.049527 | orchestrator | Friday 03 April 2026 07:19:51 +0000 (0:00:04.387) 0:04:57.895 ********** 2026-04-03 07:19:54.049545 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:54.049599 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:19:54.049613 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:54.049626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:54.049649 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:19:54.049661 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:54.049687 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:57.817949 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:19:57.818124 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:19:57.818147 | orchestrator | 2026-04-03 07:19:57.818160 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-03 07:19:57.818173 | orchestrator | Friday 03 April 2026 07:19:55 +0000 (0:00:03.730) 0:05:01.626 ********** 2026-04-03 07:19:57.818188 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:57.818204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:19:57.818224 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:19:57.818292 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:57.818348 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:19:57.818367 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:19:57.818394 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:19:57.818431 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-03 07:20:14.173188 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:14.173278 | orchestrator | 2026-04-03 07:20:14.173288 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-03 07:20:14.173297 | orchestrator | Friday 03 April 2026 07:19:58 +0000 (0:00:03.719) 0:05:05.345 ********** 2026-04-03 07:20:14.173306 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173317 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173323 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:14.173330 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173343 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:14.173350 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173391 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-03 07:20:14.173398 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:14.173404 | orchestrator | 2026-04-03 07:20:14.173410 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-03 07:20:14.173416 | orchestrator | Friday 03 April 2026 07:20:02 +0000 (0:00:03.734) 0:05:09.080 ********** 2026-04-03 07:20:14.173421 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:20:14.173440 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:20:14.173446 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:20:14.173451 | orchestrator | 2026-04-03 07:20:14.173456 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-03 07:20:14.173462 | orchestrator | Friday 03 April 2026 07:20:05 +0000 (0:00:03.109) 0:05:12.189 ********** 2026-04-03 07:20:14.173467 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:14.173472 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:14.173478 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:14.173483 | orchestrator | 2026-04-03 07:20:14.173488 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-03 07:20:14.173494 | orchestrator | Friday 03 April 2026 07:20:08 +0000 (0:00:02.371) 0:05:14.560 ********** 2026-04-03 07:20:14.173499 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:14.173505 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:14.173510 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:14.173515 | orchestrator | 2026-04-03 07:20:14.173521 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-03 07:20:14.173526 | orchestrator | Friday 03 April 2026 07:20:09 +0000 (0:00:01.349) 0:05:15.910 ********** 2026-04-03 07:20:14.173532 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:20:14.173537 | orchestrator | 2026-04-03 07:20:14.173543 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-03 07:20:14.173548 | orchestrator | Friday 03 April 2026 07:20:11 +0000 (0:00:01.828) 0:05:17.738 ********** 2026-04-03 07:20:14.173556 | orchestrator | ok: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:20:14.173563 | orchestrator | ok: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:20:14.173576 | orchestrator | ok: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:20:14.173582 | orchestrator | 2026-04-03 07:20:14.173588 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-03 07:20:14.173598 | orchestrator | Friday 03 April 2026 07:20:14 +0000 (0:00:02.771) 0:05:20.510 ********** 2026-04-03 07:20:14.173609 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:20:29.634550 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:29.634678 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:20:29.634699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:29.634776 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:20:29.634791 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:29.634803 | orchestrator | 2026-04-03 07:20:29.634816 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-03 07:20:29.634828 | orchestrator | Friday 03 April 2026 07:20:15 +0000 (0:00:01.723) 0:05:22.234 ********** 2026-04-03 07:20:29.634865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 07:20:29.634879 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:29.634900 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 07:20:29.634920 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:29.634942 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-03 07:20:29.634961 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:29.634979 | orchestrator | 2026-04-03 07:20:29.634990 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-03 07:20:29.635001 | orchestrator | Friday 03 April 2026 07:20:17 +0000 (0:00:01.739) 0:05:23.974 ********** 2026-04-03 07:20:29.635012 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:29.635023 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:29.635033 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:29.635044 | orchestrator | 2026-04-03 07:20:29.635055 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-03 07:20:29.635065 | orchestrator | Friday 03 April 2026 07:20:19 +0000 (0:00:01.535) 0:05:25.510 ********** 2026-04-03 07:20:29.635084 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:29.635121 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:29.635142 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:29.635159 | orchestrator | 2026-04-03 07:20:29.635172 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-03 07:20:29.635185 | orchestrator | Friday 03 April 2026 07:20:21 +0000 (0:00:02.269) 0:05:27.780 ********** 2026-04-03 07:20:29.635198 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:29.635210 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:29.635223 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:29.635236 | orchestrator | 2026-04-03 07:20:29.635249 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-03 07:20:29.635261 | orchestrator | Friday 03 April 2026 07:20:22 +0000 (0:00:01.491) 0:05:29.271 ********** 2026-04-03 07:20:29.635274 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:20:29.635293 | orchestrator | 2026-04-03 07:20:29.635312 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-03 07:20:29.635333 | orchestrator | Friday 03 April 2026 07:20:25 +0000 (0:00:02.346) 0:05:31.618 ********** 2026-04-03 07:20:29.635380 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:20:29.635419 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:20:29.635443 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.635468 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.635555 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:29.693581 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:20:29.693694 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:29.693769 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.693784 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:29.693815 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.693837 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:29.693849 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.693867 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:29.693880 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.693900 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.777006 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:29.777108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.777127 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:29.777160 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:29.777175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.777205 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.777240 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:29.777253 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.777264 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:29.777282 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:29.777294 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.777306 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.777362 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.865180 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.865299 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:29.865316 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.865347 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:29.865361 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:29.865413 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:29.865445 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:29.865458 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.865469 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:29.865488 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:29.865508 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:29.865528 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.411777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:32.411882 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.411899 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.411932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:32.411970 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.411984 | orchestrator | 2026-04-03 07:20:32.411997 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-03 07:20:32.412009 | orchestrator | Friday 03 April 2026 07:20:31 +0000 (0:00:05.880) 0:05:37.498 ********** 2026-04-03 07:20:32.412051 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:20:32.412073 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.412101 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:32.412134 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:32.412166 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.550649 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.550797 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.550817 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:32.550849 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.550885 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.550919 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:20:32.550934 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:32.550946 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.550963 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.550984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:32.550996 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:32.551017 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.660211 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:32.660370 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.660397 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.660417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.660436 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:32.660457 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:20:32.660499 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.660522 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.660558 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:32.660570 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-03 07:20:32.660582 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.660600 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-03 07:20:32.819665 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.819814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:32.819831 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.819843 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.819854 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.819865 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.819893 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:32.819929 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.819940 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:32.819952 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:32.819963 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 07:20:32.819974 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:32.819984 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:32.820007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-03 07:20:48.261833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-03 07:20:48.261934 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-03 07:20:48.261951 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-03 07:20:48.262100 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-03 07:20:48.262121 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:48.262133 | orchestrator | 2026-04-03 07:20:48.262144 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-03 07:20:48.262155 | orchestrator | Friday 03 April 2026 07:20:34 +0000 (0:00:03.043) 0:05:40.542 ********** 2026-04-03 07:20:48.262183 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262195 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262206 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:20:48.262215 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262243 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262252 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:20:48.262266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262276 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:20:48.262285 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:20:48.262294 | orchestrator | 2026-04-03 07:20:48.262303 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-03 07:20:48.262313 | orchestrator | Friday 03 April 2026 07:20:36 +0000 (0:00:02.897) 0:05:43.440 ********** 2026-04-03 07:20:48.262322 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:20:48.262332 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:20:48.262341 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:20:48.262350 | orchestrator | 2026-04-03 07:20:48.262361 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-03 07:20:48.262372 | orchestrator | Friday 03 April 2026 07:20:39 +0000 (0:00:02.317) 0:05:45.758 ********** 2026-04-03 07:20:48.262384 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:20:48.262395 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:20:48.262405 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:20:48.262416 | orchestrator | 2026-04-03 07:20:48.262427 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-03 07:20:48.262438 | orchestrator | Friday 03 April 2026 07:20:42 +0000 (0:00:02.979) 0:05:48.737 ********** 2026-04-03 07:20:48.262448 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:20:48.262459 | orchestrator | 2026-04-03 07:20:48.262470 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-03 07:20:48.262481 | orchestrator | Friday 03 April 2026 07:20:44 +0000 (0:00:02.329) 0:05:51.066 ********** 2026-04-03 07:20:48.262493 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:20:48.262513 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:20:48.262537 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:21:04.315597 | orchestrator | 2026-04-03 07:21:04.315707 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-03 07:21:04.315775 | orchestrator | Friday 03 April 2026 07:20:49 +0000 (0:00:04.730) 0:05:55.797 ********** 2026-04-03 07:21:04.315792 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:21:04.315808 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:04.315829 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:21:04.315880 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:04.315904 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:21:04.315926 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:04.315946 | orchestrator | 2026-04-03 07:21:04.315957 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-03 07:21:04.315969 | orchestrator | Friday 03 April 2026 07:20:51 +0000 (0:00:02.020) 0:05:57.818 ********** 2026-04-03 07:21:04.315999 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316065 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:04.316084 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316105 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316125 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:04.316141 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316155 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:21:04.316180 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:04.316193 | orchestrator | 2026-04-03 07:21:04.316206 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-03 07:21:04.316220 | orchestrator | Friday 03 April 2026 07:20:52 +0000 (0:00:01.635) 0:05:59.454 ********** 2026-04-03 07:21:04.316232 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:04.316246 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:04.316258 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:04.316271 | orchestrator | 2026-04-03 07:21:04.316284 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-03 07:21:04.316297 | orchestrator | Friday 03 April 2026 07:20:55 +0000 (0:00:02.336) 0:06:01.790 ********** 2026-04-03 07:21:04.316310 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:04.316322 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:04.316334 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:04.316348 | orchestrator | 2026-04-03 07:21:04.316361 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-03 07:21:04.316374 | orchestrator | Friday 03 April 2026 07:20:58 +0000 (0:00:02.974) 0:06:04.765 ********** 2026-04-03 07:21:04.316387 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:21:04.316399 | orchestrator | 2026-04-03 07:21:04.316412 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-03 07:21:04.316425 | orchestrator | Friday 03 April 2026 07:21:00 +0000 (0:00:02.365) 0:06:07.130 ********** 2026-04-03 07:21:04.316440 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:04.316473 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:07.751801 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:07.751943 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:07.751962 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.751990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.752022 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:07.752043 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.752055 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.752067 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:21:07.752079 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.752095 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:07.752113 | orchestrator | 2026-04-03 07:21:07.752126 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-03 07:21:07.752145 | orchestrator | Friday 03 April 2026 07:21:07 +0000 (0:00:07.085) 0:06:14.216 ********** 2026-04-03 07:21:08.863712 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:08.863865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:08.863885 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:08.863917 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:08.863931 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:08.863964 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:08.863998 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:08.864011 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:08.864023 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:08.864034 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:08.864051 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:08.864080 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:21:29.147492 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 07:21:29.147582 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 07:21:29.147593 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:29.147602 | orchestrator | 2026-04-03 07:21:29.147611 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-03 07:21:29.147620 | orchestrator | Friday 03 April 2026 07:21:10 +0000 (0:00:02.264) 0:06:16.481 ********** 2026-04-03 07:21:29.147627 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147637 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147645 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147667 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147691 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:29.147699 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147706 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147712 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147719 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147781 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:29.147789 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147809 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147816 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147823 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:21:29.147829 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:29.147836 | orchestrator | 2026-04-03 07:21:29.147843 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-03 07:21:29.147850 | orchestrator | Friday 03 April 2026 07:21:11 +0000 (0:00:01.932) 0:06:18.413 ********** 2026-04-03 07:21:29.147856 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:29.147863 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:29.147870 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:29.147876 | orchestrator | 2026-04-03 07:21:29.147883 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-03 07:21:29.147890 | orchestrator | Friday 03 April 2026 07:21:14 +0000 (0:00:02.289) 0:06:20.702 ********** 2026-04-03 07:21:29.147896 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:29.147903 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:29.147910 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:29.147916 | orchestrator | 2026-04-03 07:21:29.147923 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-03 07:21:29.147929 | orchestrator | Friday 03 April 2026 07:21:17 +0000 (0:00:03.324) 0:06:24.027 ********** 2026-04-03 07:21:29.147936 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:21:29.147942 | orchestrator | 2026-04-03 07:21:29.147949 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-03 07:21:29.147961 | orchestrator | Friday 03 April 2026 07:21:20 +0000 (0:00:02.589) 0:06:26.616 ********** 2026-04-03 07:21:29.147968 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-03 07:21:29.147976 | orchestrator | 2026-04-03 07:21:29.147983 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-03 07:21:29.147990 | orchestrator | Friday 03 April 2026 07:21:22 +0000 (0:00:02.384) 0:06:29.001 ********** 2026-04-03 07:21:29.147997 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 07:21:29.148011 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 07:21:29.148019 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-03 07:21:29.148026 | orchestrator | 2026-04-03 07:21:29.148033 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-03 07:21:29.148040 | orchestrator | Friday 03 April 2026 07:21:28 +0000 (0:00:05.487) 0:06:34.488 ********** 2026-04-03 07:21:29.148049 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:29.148062 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:53.805313 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805422 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:53.805434 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805462 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:53.805470 | orchestrator | 2026-04-03 07:21:53.805478 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-03 07:21:53.805486 | orchestrator | Friday 03 April 2026 07:21:30 +0000 (0:00:02.540) 0:06:37.029 ********** 2026-04-03 07:21:53.805495 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805504 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805512 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:53.805519 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805525 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805531 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:53.805551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805558 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-03 07:21:53.805565 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:53.805571 | orchestrator | 2026-04-03 07:21:53.805578 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 07:21:53.805586 | orchestrator | Friday 03 April 2026 07:21:33 +0000 (0:00:02.882) 0:06:39.911 ********** 2026-04-03 07:21:53.805592 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:53.805600 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:53.805607 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:53.805613 | orchestrator | 2026-04-03 07:21:53.805620 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 07:21:53.805627 | orchestrator | Friday 03 April 2026 07:21:36 +0000 (0:00:03.524) 0:06:43.435 ********** 2026-04-03 07:21:53.805633 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:53.805640 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:53.805646 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:53.805653 | orchestrator | 2026-04-03 07:21:53.805659 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-03 07:21:53.805666 | orchestrator | Friday 03 April 2026 07:21:41 +0000 (0:00:04.124) 0:06:47.560 ********** 2026-04-03 07:21:53.805674 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-03 07:21:53.805682 | orchestrator | 2026-04-03 07:21:53.805688 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-03 07:21:53.805696 | orchestrator | Friday 03 April 2026 07:21:42 +0000 (0:00:01.686) 0:06:49.246 ********** 2026-04-03 07:21:53.805718 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805791 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:53.805800 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805807 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:53.805814 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805820 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:53.805826 | orchestrator | 2026-04-03 07:21:53.805833 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-03 07:21:53.805840 | orchestrator | Friday 03 April 2026 07:21:45 +0000 (0:00:02.525) 0:06:51.772 ********** 2026-04-03 07:21:53.805848 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805854 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:53.805868 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805876 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:53.805884 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-03 07:21:53.805892 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:53.805900 | orchestrator | 2026-04-03 07:21:53.805906 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-03 07:21:53.805912 | orchestrator | Friday 03 April 2026 07:21:47 +0000 (0:00:02.411) 0:06:54.184 ********** 2026-04-03 07:21:53.805919 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:21:53.805930 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:21:53.805937 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:21:53.805944 | orchestrator | 2026-04-03 07:21:53.805952 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 07:21:53.805960 | orchestrator | Friday 03 April 2026 07:21:50 +0000 (0:00:02.714) 0:06:56.899 ********** 2026-04-03 07:21:53.805967 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:21:53.805975 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:21:53.805982 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:21:53.805990 | orchestrator | 2026-04-03 07:21:53.805997 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 07:21:53.806004 | orchestrator | Friday 03 April 2026 07:21:53 +0000 (0:00:03.365) 0:07:00.264 ********** 2026-04-03 07:22:21.037651 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:22:21.037802 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:22:21.037818 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:22:21.037828 | orchestrator | 2026-04-03 07:22:21.037840 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-03 07:22:21.037852 | orchestrator | Friday 03 April 2026 07:21:58 +0000 (0:00:04.443) 0:07:04.708 ********** 2026-04-03 07:22:21.037862 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-03 07:22:21.037885 | orchestrator | 2026-04-03 07:22:21.037896 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-03 07:22:21.037917 | orchestrator | Friday 03 April 2026 07:21:59 +0000 (0:00:01.708) 0:07:06.417 ********** 2026-04-03 07:22:21.037930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.037944 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:21.037955 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.037965 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:21.037975 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.037985 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:21.037995 | orchestrator | 2026-04-03 07:22:21.038004 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-03 07:22:21.038084 | orchestrator | Friday 03 April 2026 07:22:02 +0000 (0:00:02.565) 0:07:08.983 ********** 2026-04-03 07:22:21.038097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.038129 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:21.038140 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.038160 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:21.038204 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-03 07:22:21.038227 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:21.038239 | orchestrator | 2026-04-03 07:22:21.038251 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-03 07:22:21.038262 | orchestrator | Friday 03 April 2026 07:22:04 +0000 (0:00:02.488) 0:07:11.471 ********** 2026-04-03 07:22:21.038274 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:21.038286 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:21.038297 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:21.038308 | orchestrator | 2026-04-03 07:22:21.038318 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-03 07:22:21.038328 | orchestrator | Friday 03 April 2026 07:22:07 +0000 (0:00:02.464) 0:07:13.936 ********** 2026-04-03 07:22:21.038337 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:22:21.038347 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:22:21.038357 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:22:21.038366 | orchestrator | 2026-04-03 07:22:21.038376 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-03 07:22:21.038385 | orchestrator | Friday 03 April 2026 07:22:11 +0000 (0:00:03.747) 0:07:17.683 ********** 2026-04-03 07:22:21.038395 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:22:21.038404 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:22:21.038414 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:22:21.038423 | orchestrator | 2026-04-03 07:22:21.038433 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-03 07:22:21.038443 | orchestrator | Friday 03 April 2026 07:22:15 +0000 (0:00:04.168) 0:07:21.851 ********** 2026-04-03 07:22:21.038452 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:22:21.038462 | orchestrator | 2026-04-03 07:22:21.038472 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-03 07:22:21.038487 | orchestrator | Friday 03 April 2026 07:22:17 +0000 (0:00:02.107) 0:07:23.959 ********** 2026-04-03 07:22:21.038507 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 07:22:21.038552 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:21.038579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:21.038608 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.251189 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:23.251267 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 07:22:23.251296 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:23.251314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.251322 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.251328 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:23.251346 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 07:22:23.251352 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:23.251363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.251371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.251377 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:23.251383 | orchestrator | 2026-04-03 07:22:23.251390 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-03 07:22:23.251397 | orchestrator | Friday 03 April 2026 07:22:22 +0000 (0:00:05.300) 0:07:29.260 ********** 2026-04-03 07:22:23.251408 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 07:22:23.442244 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:23.442345 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.442387 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.442402 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 07:22:23.442418 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:23.442430 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:23.442444 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:23.442475 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.442495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:23.442553 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:23.442566 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:23.442583 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 07:22:23.442595 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 07:22:23.442615 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 07:22:40.058502 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 07:22:40.058641 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 07:22:40.058660 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:40.058674 | orchestrator | 2026-04-03 07:22:40.058687 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-03 07:22:40.058700 | orchestrator | Friday 03 April 2026 07:22:24 +0000 (0:00:01.776) 0:07:31.036 ********** 2026-04-03 07:22:40.058712 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058786 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:40.058798 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058809 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058819 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:40.058830 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058841 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-03 07:22:40.058852 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:40.058863 | orchestrator | 2026-04-03 07:22:40.058874 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-03 07:22:40.058885 | orchestrator | Friday 03 April 2026 07:22:26 +0000 (0:00:01.837) 0:07:32.874 ********** 2026-04-03 07:22:40.058896 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:22:40.058908 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:22:40.058919 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:22:40.058929 | orchestrator | 2026-04-03 07:22:40.058940 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-03 07:22:40.058951 | orchestrator | Friday 03 April 2026 07:22:29 +0000 (0:00:02.642) 0:07:35.516 ********** 2026-04-03 07:22:40.058963 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:22:40.058974 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:22:40.058984 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:22:40.058995 | orchestrator | 2026-04-03 07:22:40.059006 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-03 07:22:40.059026 | orchestrator | Friday 03 April 2026 07:22:32 +0000 (0:00:02.955) 0:07:38.472 ********** 2026-04-03 07:22:40.059040 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:22:40.059053 | orchestrator | 2026-04-03 07:22:40.059066 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-03 07:22:40.059079 | orchestrator | Friday 03 April 2026 07:22:34 +0000 (0:00:02.193) 0:07:40.666 ********** 2026-04-03 07:22:40.059112 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:40.059129 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:40.059149 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:40.059165 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:22:40.059198 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:22:43.355790 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:22:43.355897 | orchestrator | 2026-04-03 07:22:43.355916 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-03 07:22:43.355929 | orchestrator | Friday 03 April 2026 07:22:41 +0000 (0:00:07.058) 0:07:47.725 ********** 2026-04-03 07:22:43.355943 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:43.355957 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:22:43.355995 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:43.356029 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:43.356049 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:22:43.356061 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:43.356073 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:43.356093 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:22:43.356105 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:43.356116 | orchestrator | 2026-04-03 07:22:43.356127 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-03 07:22:43.356138 | orchestrator | Friday 03 April 2026 07:22:42 +0000 (0:00:01.671) 0:07:49.396 ********** 2026-04-03 07:22:43.356150 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:22:43.356171 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524478 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524609 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:53.524638 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:22:53.524661 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524705 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524727 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:53.524812 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:22:53.524864 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524885 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-03 07:22:53.524904 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:53.524922 | orchestrator | 2026-04-03 07:22:53.524942 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-03 07:22:53.524962 | orchestrator | Friday 03 April 2026 07:22:45 +0000 (0:00:02.119) 0:07:51.515 ********** 2026-04-03 07:22:53.524981 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:53.525002 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:53.525022 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:53.525041 | orchestrator | 2026-04-03 07:22:53.525059 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-03 07:22:53.525079 | orchestrator | Friday 03 April 2026 07:22:46 +0000 (0:00:01.510) 0:07:53.026 ********** 2026-04-03 07:22:53.525097 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:53.525115 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:53.525137 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:22:53.525158 | orchestrator | 2026-04-03 07:22:53.525180 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-03 07:22:53.525204 | orchestrator | Friday 03 April 2026 07:22:48 +0000 (0:00:02.200) 0:07:55.226 ********** 2026-04-03 07:22:53.525229 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:22:53.525253 | orchestrator | 2026-04-03 07:22:53.525275 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-03 07:22:53.525297 | orchestrator | Friday 03 April 2026 07:22:51 +0000 (0:00:02.561) 0:07:57.788 ********** 2026-04-03 07:22:53.525355 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 07:22:53.525381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:53.525412 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 07:22:53.525445 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:53.525464 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:53.525483 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:53.525502 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:53.525531 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:55.526391 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:55.526543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:55.526564 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 07:22:55.526580 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:55.526592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:55.526603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:55.526635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:55.526663 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:55.526676 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:55.526689 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:22:55.526709 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:22:57.299356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:22:57.299464 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:22:57.299480 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299590 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299605 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.299618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.299632 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.299644 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.299656 | orchestrator | 2026-04-03 07:22:57.299672 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-03 07:22:57.299685 | orchestrator | Friday 03 April 2026 07:22:56 +0000 (0:00:05.500) 0:08:03.289 ********** 2026-04-03 07:22:57.299699 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 07:22:57.299757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:57.610343 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610447 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610485 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.610503 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:57.610518 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:22:57.610598 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610625 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.610637 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 07:22:57.610650 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:22:57.610663 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:57.610682 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610694 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.610719 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.806189 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:57.806296 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:22:57.806313 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.806349 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.806377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.806391 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:22:57.806424 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 07:22:57.806439 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 07:22:57.806451 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.806462 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:22:57.806480 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 07:22:57.806498 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:22:57.806518 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-03 07:23:09.966217 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:23:09.966328 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:23:09.966369 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 07:23:09.966384 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:09.966399 | orchestrator | 2026-04-03 07:23:09.966411 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-03 07:23:09.966424 | orchestrator | Friday 03 April 2026 07:22:58 +0000 (0:00:02.142) 0:08:05.432 ********** 2026-04-03 07:23:09.966437 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966450 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966477 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966491 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966503 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966515 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966527 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:09.966556 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966568 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966587 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:09.966599 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-03 07:23:09.966622 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966633 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-03 07:23:09.966644 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:09.966655 | orchestrator | 2026-04-03 07:23:09.966667 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-03 07:23:09.966678 | orchestrator | Friday 03 April 2026 07:23:01 +0000 (0:00:02.351) 0:08:07.783 ********** 2026-04-03 07:23:09.966688 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:09.966699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:09.966710 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:09.966721 | orchestrator | 2026-04-03 07:23:09.966732 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-03 07:23:09.966768 | orchestrator | Friday 03 April 2026 07:23:02 +0000 (0:00:01.484) 0:08:09.267 ********** 2026-04-03 07:23:09.966781 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:09.966796 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:09.966808 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:09.966822 | orchestrator | 2026-04-03 07:23:09.966834 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-03 07:23:09.966853 | orchestrator | Friday 03 April 2026 07:23:05 +0000 (0:00:02.276) 0:08:11.544 ********** 2026-04-03 07:23:09.966867 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:23:09.966880 | orchestrator | 2026-04-03 07:23:09.966893 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-03 07:23:09.966906 | orchestrator | Friday 03 April 2026 07:23:07 +0000 (0:00:02.603) 0:08:14.148 ********** 2026-04-03 07:23:09.966928 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:23:24.833643 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:23:24.833789 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:23:24.833809 | orchestrator | 2026-04-03 07:23:24.833824 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-03 07:23:24.833837 | orchestrator | Friday 03 April 2026 07:23:11 +0000 (0:00:03.663) 0:08:17.811 ********** 2026-04-03 07:23:24.833865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:23:24.833879 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:24.833911 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:23:24.833946 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:24.833958 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:23:24.833970 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:24.833981 | orchestrator | 2026-04-03 07:23:24.833992 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-03 07:23:24.834003 | orchestrator | Friday 03 April 2026 07:23:12 +0000 (0:00:01.574) 0:08:19.385 ********** 2026-04-03 07:23:24.834069 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 07:23:24.834085 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 07:23:24.834096 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:24.834107 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:24.834118 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-03 07:23:24.834129 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:24.834139 | orchestrator | 2026-04-03 07:23:24.834150 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-03 07:23:24.834161 | orchestrator | Friday 03 April 2026 07:23:14 +0000 (0:00:01.767) 0:08:21.153 ********** 2026-04-03 07:23:24.834182 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:24.834193 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:24.834203 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:24.834214 | orchestrator | 2026-04-03 07:23:24.834226 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-03 07:23:24.834237 | orchestrator | Friday 03 April 2026 07:23:16 +0000 (0:00:01.581) 0:08:22.734 ********** 2026-04-03 07:23:24.834248 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:24.834258 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:24.834273 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:24.834293 | orchestrator | 2026-04-03 07:23:24.834361 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-03 07:23:24.834380 | orchestrator | Friday 03 April 2026 07:23:18 +0000 (0:00:02.217) 0:08:24.951 ********** 2026-04-03 07:23:24.834398 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:23:24.834410 | orchestrator | 2026-04-03 07:23:24.834421 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-03 07:23:24.834443 | orchestrator | Friday 03 April 2026 07:23:21 +0000 (0:00:02.693) 0:08:27.645 ********** 2026-04-03 07:23:24.834455 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 07:23:24.834520 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 07:23:29.752931 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 07:23:29.753046 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:23:29.753085 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:23:29.753116 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 07:23:29.753128 | orchestrator | 2026-04-03 07:23:29.753140 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-03 07:23:29.753151 | orchestrator | Friday 03 April 2026 07:23:29 +0000 (0:00:07.992) 0:08:35.638 ********** 2026-04-03 07:23:29.753189 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 07:23:29.753207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:23:29.753227 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:29.753238 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 07:23:29.753258 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:23:50.157292 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.157402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 07:23:50.157462 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 07:23:50.157477 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.157489 | orchestrator | 2026-04-03 07:23:50.157501 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-03 07:23:50.157513 | orchestrator | Friday 03 April 2026 07:23:31 +0000 (0:00:02.257) 0:08:37.895 ********** 2026-04-03 07:23:50.157525 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157539 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157552 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157575 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.157586 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157598 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157625 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157637 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157648 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.157667 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157678 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-03 07:23:50.157689 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157706 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-03 07:23:50.157717 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.157728 | orchestrator | 2026-04-03 07:23:50.157739 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-03 07:23:50.157781 | orchestrator | Friday 03 April 2026 07:23:33 +0000 (0:00:02.202) 0:08:40.098 ********** 2026-04-03 07:23:50.157793 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:23:50.157804 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:23:50.157814 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:23:50.157825 | orchestrator | 2026-04-03 07:23:50.157838 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-03 07:23:50.157851 | orchestrator | Friday 03 April 2026 07:23:35 +0000 (0:00:02.283) 0:08:42.382 ********** 2026-04-03 07:23:50.157864 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:23:50.157876 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:23:50.157889 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:23:50.157902 | orchestrator | 2026-04-03 07:23:50.157914 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-03 07:23:50.157927 | orchestrator | Friday 03 April 2026 07:23:38 +0000 (0:00:02.979) 0:08:45.362 ********** 2026-04-03 07:23:50.157939 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.157952 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.157964 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.157978 | orchestrator | 2026-04-03 07:23:50.157991 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-03 07:23:50.158005 | orchestrator | Friday 03 April 2026 07:23:40 +0000 (0:00:01.538) 0:08:46.900 ********** 2026-04-03 07:23:50.158055 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.158071 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.158084 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.158097 | orchestrator | 2026-04-03 07:23:50.158109 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-03 07:23:50.158122 | orchestrator | Friday 03 April 2026 07:23:41 +0000 (0:00:01.350) 0:08:48.250 ********** 2026-04-03 07:23:50.158134 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.158147 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.158160 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.158172 | orchestrator | 2026-04-03 07:23:50.158184 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-03 07:23:50.158197 | orchestrator | Friday 03 April 2026 07:23:43 +0000 (0:00:01.373) 0:08:49.623 ********** 2026-04-03 07:23:50.158210 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.158221 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.158232 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.158242 | orchestrator | 2026-04-03 07:23:50.158253 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-03 07:23:50.158272 | orchestrator | Friday 03 April 2026 07:23:44 +0000 (0:00:01.346) 0:08:50.969 ********** 2026-04-03 07:23:50.158283 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:50.158294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:23:50.158305 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:23:50.158315 | orchestrator | 2026-04-03 07:23:50.158327 | orchestrator | TASK [include_role : loadbalancer] ********************************************* 2026-04-03 07:23:50.158338 | orchestrator | Friday 03 April 2026 07:23:46 +0000 (0:00:01.822) 0:08:52.792 ********** 2026-04-03 07:23:50.158349 | orchestrator | included: loadbalancer for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:23:50.158360 | orchestrator | 2026-04-03 07:23:50.158372 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-03 07:23:50.158383 | orchestrator | Friday 03 April 2026 07:23:48 +0000 (0:00:02.327) 0:08:55.119 ********** 2026-04-03 07:23:50.158404 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-03 07:23:54.957956 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-03 07:23:54.958132 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-03 07:23:54.958151 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:23:54.958179 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:23:54.958227 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-03 07:23:54.958242 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:23:54.958273 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:23:54.958289 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-03 07:23:54.958310 | orchestrator | 2026-04-03 07:23:54.958330 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-03 07:23:54.958347 | orchestrator | Friday 03 April 2026 07:23:53 +0000 (0:00:04.420) 0:08:59.540 ********** 2026-04-03 07:23:54.958374 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:23:54.958394 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:23:54.958409 | orchestrator | } 2026-04-03 07:23:54.958427 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:23:54.958444 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:23:54.958462 | orchestrator | } 2026-04-03 07:23:54.958483 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:23:54.958504 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:23:54.958524 | orchestrator | } 2026-04-03 07:23:54.958539 | orchestrator | 2026-04-03 07:23:54.958553 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:23:54.958566 | orchestrator | Friday 03 April 2026 07:23:54 +0000 (0:00:01.425) 0:09:00.965 ********** 2026-04-03 07:23:54.958581 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-03 07:23:54.958605 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:23:54.958619 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:23:54.958632 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:23:54.958646 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-03 07:23:54.958670 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:25:56.663895 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:25:56.663988 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664002 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-03 07:25:56.664024 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-03 07:25:56.664029 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-03 07:25:56.664033 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664037 | orchestrator | 2026-04-03 07:25:56.664042 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-03 07:25:56.664046 | orchestrator | Friday 03 April 2026 07:23:57 +0000 (0:00:02.571) 0:09:03.537 ********** 2026-04-03 07:25:56.664050 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664055 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664059 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664062 | orchestrator | 2026-04-03 07:25:56.664067 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-03 07:25:56.664070 | orchestrator | Friday 03 April 2026 07:23:58 +0000 (0:00:01.745) 0:09:05.283 ********** 2026-04-03 07:25:56.664078 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664082 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664086 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664090 | orchestrator | 2026-04-03 07:25:56.664094 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-03 07:25:56.664097 | orchestrator | Friday 03 April 2026 07:24:00 +0000 (0:00:01.633) 0:09:06.916 ********** 2026-04-03 07:25:56.664101 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664105 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664109 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664113 | orchestrator | 2026-04-03 07:25:56.664117 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-03 07:25:56.664120 | orchestrator | Friday 03 April 2026 07:24:07 +0000 (0:00:07.192) 0:09:14.108 ********** 2026-04-03 07:25:56.664124 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664128 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664131 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664135 | orchestrator | 2026-04-03 07:25:56.664139 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-03 07:25:56.664143 | orchestrator | Friday 03 April 2026 07:24:14 +0000 (0:00:07.242) 0:09:21.351 ********** 2026-04-03 07:25:56.664146 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664150 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664154 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664157 | orchestrator | 2026-04-03 07:25:56.664161 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-03 07:25:56.664165 | orchestrator | Friday 03 April 2026 07:24:21 +0000 (0:00:07.056) 0:09:28.407 ********** 2026-04-03 07:25:56.664169 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664173 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664181 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664184 | orchestrator | 2026-04-03 07:25:56.664198 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-03 07:25:56.664202 | orchestrator | Friday 03 April 2026 07:24:29 +0000 (0:00:07.828) 0:09:36.236 ********** 2026-04-03 07:25:56.664205 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664209 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664213 | orchestrator | 2026-04-03 07:25:56.664217 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-03 07:25:56.664221 | orchestrator | Friday 03 April 2026 07:24:32 +0000 (0:00:02.836) 0:09:39.072 ********** 2026-04-03 07:25:56.664224 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664233 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664236 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664240 | orchestrator | 2026-04-03 07:25:56.664244 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-03 07:25:56.664248 | orchestrator | Friday 03 April 2026 07:24:46 +0000 (0:00:13.647) 0:09:52.720 ********** 2026-04-03 07:25:56.664251 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664255 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664259 | orchestrator | 2026-04-03 07:25:56.664262 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-03 07:25:56.664266 | orchestrator | Friday 03 April 2026 07:24:50 +0000 (0:00:04.689) 0:09:57.409 ********** 2026-04-03 07:25:56.664270 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:25:56.664274 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:25:56.664277 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:25:56.664281 | orchestrator | 2026-04-03 07:25:56.664285 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-03 07:25:56.664288 | orchestrator | Friday 03 April 2026 07:24:58 +0000 (0:00:07.178) 0:10:04.588 ********** 2026-04-03 07:25:56.664292 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664296 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664299 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664303 | orchestrator | 2026-04-03 07:25:56.664307 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-03 07:25:56.664311 | orchestrator | Friday 03 April 2026 07:25:04 +0000 (0:00:06.874) 0:10:11.462 ********** 2026-04-03 07:25:56.664314 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664318 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664322 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664325 | orchestrator | 2026-04-03 07:25:56.664329 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-03 07:25:56.664333 | orchestrator | Friday 03 April 2026 07:25:11 +0000 (0:00:06.893) 0:10:18.355 ********** 2026-04-03 07:25:56.664336 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664340 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664344 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664347 | orchestrator | 2026-04-03 07:25:56.664351 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-03 07:25:56.664355 | orchestrator | Friday 03 April 2026 07:25:18 +0000 (0:00:06.893) 0:10:25.249 ********** 2026-04-03 07:25:56.664359 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664362 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664366 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664370 | orchestrator | 2026-04-03 07:25:56.664373 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master haproxy to start] ************** 2026-04-03 07:25:56.664377 | orchestrator | Friday 03 April 2026 07:25:26 +0000 (0:00:07.358) 0:10:32.608 ********** 2026-04-03 07:25:56.664381 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664385 | orchestrator | 2026-04-03 07:25:56.664388 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-03 07:25:56.664392 | orchestrator | Friday 03 April 2026 07:25:29 +0000 (0:00:03.590) 0:10:36.198 ********** 2026-04-03 07:25:56.664400 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664404 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664409 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664413 | orchestrator | 2026-04-03 07:25:56.664417 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master proxysql to start] ************* 2026-04-03 07:25:56.664421 | orchestrator | Friday 03 April 2026 07:25:42 +0000 (0:00:13.147) 0:10:49.346 ********** 2026-04-03 07:25:56.664426 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664430 | orchestrator | 2026-04-03 07:25:56.664434 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-03 07:25:56.664439 | orchestrator | Friday 03 April 2026 07:25:46 +0000 (0:00:03.612) 0:10:52.959 ********** 2026-04-03 07:25:56.664443 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:25:56.664447 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:25:56.664451 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:25:56.664455 | orchestrator | 2026-04-03 07:25:56.664460 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-03 07:25:56.664464 | orchestrator | Friday 03 April 2026 07:25:53 +0000 (0:00:06.844) 0:10:59.803 ********** 2026-04-03 07:25:56.664469 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664473 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664477 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664482 | orchestrator | 2026-04-03 07:25:56.664486 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-03 07:25:56.664493 | orchestrator | Friday 03 April 2026 07:25:55 +0000 (0:00:02.446) 0:11:02.250 ********** 2026-04-03 07:25:56.664499 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:25:56.664505 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:25:56.664512 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:25:56.664518 | orchestrator | 2026-04-03 07:25:56.664523 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:25:56.664530 | orchestrator | testbed-node-0 : ok=129  changed=30  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-03 07:25:56.664537 | orchestrator | testbed-node-1 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-03 07:25:56.664548 | orchestrator | testbed-node-2 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-03 07:25:58.992545 | orchestrator | 2026-04-03 07:25:58.992644 | orchestrator | 2026-04-03 07:25:58.992659 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:25:58.992673 | orchestrator | Friday 03 April 2026 07:25:58 +0000 (0:00:02.444) 0:11:04.695 ********** 2026-04-03 07:25:58.992684 | orchestrator | =============================================================================== 2026-04-03 07:25:58.992695 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 13.65s 2026-04-03 07:25:58.992706 | orchestrator | loadbalancer : Start master proxysql container ------------------------- 13.15s 2026-04-03 07:25:58.992737 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 7.99s 2026-04-03 07:25:58.992749 | orchestrator | loadbalancer : Start backup haproxy container --------------------------- 7.83s 2026-04-03 07:25:58.992760 | orchestrator | loadbalancer : Start master haproxy container --------------------------- 7.36s 2026-04-03 07:25:58.992825 | orchestrator | loadbalancer : Stop backup haproxy container ---------------------------- 7.24s 2026-04-03 07:25:58.992838 | orchestrator | loadbalancer : Stop backup keepalived container ------------------------- 7.19s 2026-04-03 07:25:58.992848 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 7.18s 2026-04-03 07:25:58.992859 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 7.09s 2026-04-03 07:25:58.992870 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 7.06s 2026-04-03 07:25:58.992881 | orchestrator | loadbalancer : Stop backup proxysql container --------------------------- 7.05s 2026-04-03 07:25:58.992915 | orchestrator | loadbalancer : Stop master proxysql container --------------------------- 6.89s 2026-04-03 07:25:58.992927 | orchestrator | loadbalancer : Stop master keepalived container ------------------------- 6.89s 2026-04-03 07:25:58.992938 | orchestrator | loadbalancer : Stop master haproxy container ---------------------------- 6.87s 2026-04-03 07:25:58.992949 | orchestrator | loadbalancer : Start master keepalived container ------------------------ 6.84s 2026-04-03 07:25:58.992960 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 5.88s 2026-04-03 07:25:58.992970 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 5.75s 2026-04-03 07:25:58.992981 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 5.50s 2026-04-03 07:25:58.992992 | orchestrator | haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config --- 5.49s 2026-04-03 07:25:58.993003 | orchestrator | haproxy-config : Copying over octavia haproxy config -------------------- 5.30s 2026-04-03 07:25:59.206000 | orchestrator | + osism apply -a upgrade opensearch 2026-04-03 07:26:00.555709 | orchestrator | 2026-04-03 07:26:00 | INFO  | Prepare task for execution of opensearch. 2026-04-03 07:26:00.623551 | orchestrator | 2026-04-03 07:26:00 | INFO  | Task 9a0b1bb4-5c44-45e7-ad4b-e508d98ef9d0 (opensearch) was prepared for execution. 2026-04-03 07:26:00.623639 | orchestrator | 2026-04-03 07:26:00 | INFO  | It takes a moment until task 9a0b1bb4-5c44-45e7-ad4b-e508d98ef9d0 (opensearch) has been started and output is visible here. 2026-04-03 07:26:11.837849 | orchestrator | 2026-04-03 07:26:11.837928 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:26:11.837940 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 07:26:11.837950 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 07:26:11.837968 | orchestrator | 2026-04-03 07:26:11.837977 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:26:11.837985 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 07:26:11.837994 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 07:26:11.838011 | orchestrator | Friday 03 April 2026 07:26:05 +0000 (0:00:01.523) 0:00:01.523 ********** 2026-04-03 07:26:11.838057 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:26:11.838067 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:26:11.838076 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:26:11.838084 | orchestrator | 2026-04-03 07:26:11.838093 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:26:11.838101 | orchestrator | Friday 03 April 2026 07:26:06 +0000 (0:00:01.048) 0:00:02.572 ********** 2026-04-03 07:26:11.838110 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-03 07:26:11.838129 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-03 07:26:11.838138 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-03 07:26:11.838146 | orchestrator | 2026-04-03 07:26:11.838155 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-03 07:26:11.838163 | orchestrator | 2026-04-03 07:26:11.838172 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 07:26:11.838180 | orchestrator | Friday 03 April 2026 07:26:07 +0000 (0:00:00.902) 0:00:03.474 ********** 2026-04-03 07:26:11.838189 | orchestrator | included: /ansible/roles/opensearch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:26:11.838197 | orchestrator | 2026-04-03 07:26:11.838206 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-03 07:26:11.838215 | orchestrator | Friday 03 April 2026 07:26:08 +0000 (0:00:01.384) 0:00:04.858 ********** 2026-04-03 07:26:11.838242 | orchestrator | ok: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 07:26:11.838252 | orchestrator | ok: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 07:26:11.838261 | orchestrator | ok: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-03 07:26:11.838269 | orchestrator | 2026-04-03 07:26:11.838278 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-03 07:26:11.838287 | orchestrator | Friday 03 April 2026 07:26:10 +0000 (0:00:01.688) 0:00:06.546 ********** 2026-04-03 07:26:11.838307 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:11.838320 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:11.838344 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:11.838355 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:11.838377 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:11.838395 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:15.661334 | orchestrator | 2026-04-03 07:26:15.661426 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 07:26:15.661440 | orchestrator | Friday 03 April 2026 07:26:11 +0000 (0:00:01.506) 0:00:08.053 ********** 2026-04-03 07:26:15.661450 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:26:15.661459 | orchestrator | 2026-04-03 07:26:15.661469 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-03 07:26:15.661478 | orchestrator | Friday 03 April 2026 07:26:12 +0000 (0:00:00.954) 0:00:09.008 ********** 2026-04-03 07:26:15.661489 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:15.661535 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:15.661546 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:15.661572 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:15.661584 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:15.661607 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:15.661616 | orchestrator | 2026-04-03 07:26:15.661626 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-03 07:26:15.661635 | orchestrator | Friday 03 April 2026 07:26:15 +0000 (0:00:02.268) 0:00:11.277 ********** 2026-04-03 07:26:15.661644 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:15.661662 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:16.926327 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:26:16.926439 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:16.926478 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:16.926495 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:26:16.926508 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:16.926539 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:16.926575 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:26:16.926587 | orchestrator | 2026-04-03 07:26:16.926600 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-03 07:26:16.926613 | orchestrator | Friday 03 April 2026 07:26:16 +0000 (0:00:00.991) 0:00:12.268 ********** 2026-04-03 07:26:16.926630 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:16.926643 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:16.926655 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:26:16.926666 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:16.926687 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:19.703105 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:26:19.703227 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:26:19.703248 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:26:19.703263 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:26:19.703274 | orchestrator | 2026-04-03 07:26:19.703287 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-03 07:26:19.703299 | orchestrator | Friday 03 April 2026 07:26:17 +0000 (0:00:01.239) 0:00:13.508 ********** 2026-04-03 07:26:19.703311 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:19.703365 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:19.703384 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:19.703397 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:19.703410 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:19.703439 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:27.410983 | orchestrator | 2026-04-03 07:26:27.411082 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-03 07:26:27.411096 | orchestrator | Friday 03 April 2026 07:26:19 +0000 (0:00:02.425) 0:00:15.933 ********** 2026-04-03 07:26:27.411102 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:26:27.411110 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:26:27.411117 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:26:27.411124 | orchestrator | 2026-04-03 07:26:27.411145 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-03 07:26:27.411153 | orchestrator | Friday 03 April 2026 07:26:22 +0000 (0:00:02.436) 0:00:18.369 ********** 2026-04-03 07:26:27.411160 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:26:27.411167 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:26:27.411174 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:26:27.411181 | orchestrator | 2026-04-03 07:26:27.411188 | orchestrator | TASK [service-check-containers : opensearch | Check containers] **************** 2026-04-03 07:26:27.411195 | orchestrator | Friday 03 April 2026 07:26:24 +0000 (0:00:02.199) 0:00:20.569 ********** 2026-04-03 07:26:27.411205 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:27.411215 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:27.411239 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 07:26:27.411267 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:27.411275 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:27.411287 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-03 07:26:27.411293 | orchestrator | 2026-04-03 07:26:27.411300 | orchestrator | TASK [service-check-containers : opensearch | Notify handlers to restart containers] *** 2026-04-03 07:26:27.411308 | orchestrator | Friday 03 April 2026 07:26:26 +0000 (0:00:02.212) 0:00:22.782 ********** 2026-04-03 07:26:27.411314 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:26:27.411321 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:26:27.411328 | orchestrator | } 2026-04-03 07:26:27.411335 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:26:27.411341 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:26:27.411348 | orchestrator | } 2026-04-03 07:26:27.411355 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:26:27.411361 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:26:27.411367 | orchestrator | } 2026-04-03 07:26:27.411373 | orchestrator | 2026-04-03 07:26:27.411380 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:26:27.411387 | orchestrator | Friday 03 April 2026 07:26:27 +0000 (0:00:00.376) 0:00:23.159 ********** 2026-04-03 07:26:27.411400 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:29:30.994603 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:29:30.994720 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:29:30.994733 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:29:30.994743 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:29:30.994750 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:29:30.994775 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 07:29:30.994783 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-03 07:29:30.994796 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:29:30.994856 | orchestrator | 2026-04-03 07:29:30.994865 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 07:29:30.994873 | orchestrator | Friday 03 April 2026 07:26:28 +0000 (0:00:01.749) 0:00:24.908 ********** 2026-04-03 07:29:30.994880 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:29:30.994887 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:29:30.994893 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:29:30.994900 | orchestrator | 2026-04-03 07:29:30.994907 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 07:29:30.994914 | orchestrator | Friday 03 April 2026 07:26:29 +0000 (0:00:00.401) 0:00:25.310 ********** 2026-04-03 07:29:30.994920 | orchestrator | 2026-04-03 07:29:30.994927 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 07:29:30.994934 | orchestrator | Friday 03 April 2026 07:26:29 +0000 (0:00:00.073) 0:00:25.383 ********** 2026-04-03 07:29:30.994940 | orchestrator | 2026-04-03 07:29:30.994947 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-03 07:29:30.994954 | orchestrator | Friday 03 April 2026 07:26:29 +0000 (0:00:00.073) 0:00:25.457 ********** 2026-04-03 07:29:30.994961 | orchestrator | 2026-04-03 07:29:30.994967 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-03 07:29:30.994974 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 07:29:30.994981 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 07:29:30.994995 | orchestrator | Friday 03 April 2026 07:26:29 +0000 (0:00:00.072) 0:00:25.530 ********** 2026-04-03 07:29:30.995002 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:29:30.995009 | orchestrator | 2026-04-03 07:29:30.995016 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-03 07:29:30.995022 | orchestrator | Friday 03 April 2026 07:26:31 +0000 (0:00:02.543) 0:00:28.073 ********** 2026-04-03 07:29:30.995029 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:29:30.995036 | orchestrator | 2026-04-03 07:29:30.995042 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-03 07:29:30.995049 | orchestrator | Friday 03 April 2026 07:26:39 +0000 (0:00:07.872) 0:00:35.946 ********** 2026-04-03 07:29:30.995056 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:29:30.995062 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:29:30.995069 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:29:30.995076 | orchestrator | 2026-04-03 07:29:30.995082 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-03 07:29:30.995089 | orchestrator | Friday 03 April 2026 07:27:53 +0000 (0:01:13.319) 0:01:49.265 ********** 2026-04-03 07:29:30.995096 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:29:30.995102 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:29:30.995109 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:29:30.995116 | orchestrator | 2026-04-03 07:29:30.995122 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-03 07:29:30.995129 | orchestrator | Friday 03 April 2026 07:29:25 +0000 (0:01:31.986) 0:03:21.252 ********** 2026-04-03 07:29:30.995142 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:29:30.995151 | orchestrator | 2026-04-03 07:29:30.995159 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-03 07:29:30.995166 | orchestrator | Friday 03 April 2026 07:29:26 +0000 (0:00:01.206) 0:03:22.458 ********** 2026-04-03 07:29:30.995174 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:29:30.995182 | orchestrator | 2026-04-03 07:29:30.995189 | orchestrator | TASK [opensearch : Wait for OpenSearch cluster to become healthy] ************** 2026-04-03 07:29:30.995197 | orchestrator | Friday 03 April 2026 07:29:28 +0000 (0:00:02.387) 0:03:24.846 ********** 2026-04-03 07:29:30.995205 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:29:30.995213 | orchestrator | 2026-04-03 07:29:30.995225 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-03 07:29:35.101533 | orchestrator | Friday 03 April 2026 07:29:30 +0000 (0:00:02.270) 0:03:27.116 ********** 2026-04-03 07:29:35.101603 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:29:35.101610 | orchestrator | 2026-04-03 07:29:35.101615 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-03 07:29:35.101620 | orchestrator | Friday 03 April 2026 07:29:33 +0000 (0:00:02.372) 0:03:29.488 ********** 2026-04-03 07:29:35.101624 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:29:35.101629 | orchestrator | 2026-04-03 07:29:35.101636 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-03 07:29:35.101643 | orchestrator | Friday 03 April 2026 07:29:33 +0000 (0:00:00.220) 0:03:29.709 ********** 2026-04-03 07:29:35.101650 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:29:35.101656 | orchestrator | 2026-04-03 07:29:35.101663 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:29:35.101671 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:29:35.101679 | orchestrator | testbed-node-1 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:29:35.101687 | orchestrator | testbed-node-2 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:29:35.101693 | orchestrator | 2026-04-03 07:29:35.101700 | orchestrator | 2026-04-03 07:29:35.101707 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:29:35.101714 | orchestrator | Friday 03 April 2026 07:29:34 +0000 (0:00:01.135) 0:03:30.845 ********** 2026-04-03 07:29:35.101720 | orchestrator | =============================================================================== 2026-04-03 07:29:35.101727 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 91.99s 2026-04-03 07:29:35.101735 | orchestrator | opensearch : Restart opensearch container ------------------------------ 73.32s 2026-04-03 07:29:35.101786 | orchestrator | opensearch : Perform a flush -------------------------------------------- 7.87s 2026-04-03 07:29:35.101792 | orchestrator | opensearch : Disable shard allocation ----------------------------------- 2.54s 2026-04-03 07:29:35.101796 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 2.44s 2026-04-03 07:29:35.101841 | orchestrator | opensearch : Copying over config.json files for services ---------------- 2.43s 2026-04-03 07:29:35.101847 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 2.39s 2026-04-03 07:29:35.101851 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 2.37s 2026-04-03 07:29:35.101855 | orchestrator | opensearch : Wait for OpenSearch cluster to become healthy -------------- 2.27s 2026-04-03 07:29:35.101859 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 2.27s 2026-04-03 07:29:35.101864 | orchestrator | service-check-containers : opensearch | Check containers ---------------- 2.21s 2026-04-03 07:29:35.101868 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 2.20s 2026-04-03 07:29:35.101888 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.75s 2026-04-03 07:29:35.101892 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 1.69s 2026-04-03 07:29:35.101896 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 1.51s 2026-04-03 07:29:35.101900 | orchestrator | opensearch : include_tasks ---------------------------------------------- 1.38s 2026-04-03 07:29:35.101904 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 1.24s 2026-04-03 07:29:35.101908 | orchestrator | opensearch : include_tasks ---------------------------------------------- 1.21s 2026-04-03 07:29:35.101912 | orchestrator | opensearch : Apply retention policy to existing indices ----------------- 1.14s 2026-04-03 07:29:35.101915 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.05s 2026-04-03 07:29:35.306787 | orchestrator | + osism apply -a upgrade memcached 2026-04-03 07:29:36.593290 | orchestrator | 2026-04-03 07:29:36 | INFO  | Prepare task for execution of memcached. 2026-04-03 07:29:36.657308 | orchestrator | 2026-04-03 07:29:36 | INFO  | Task 417a24da-1dd2-47f8-8e35-4f3f2c2d0f29 (memcached) was prepared for execution. 2026-04-03 07:29:36.657408 | orchestrator | 2026-04-03 07:29:36 | INFO  | It takes a moment until task 417a24da-1dd2-47f8-8e35-4f3f2c2d0f29 (memcached) has been started and output is visible here. 2026-04-03 07:30:10.544490 | orchestrator | 2026-04-03 07:30:10.544567 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:30:10.544579 | orchestrator | 2026-04-03 07:30:10.544588 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:30:10.544596 | orchestrator | Friday 03 April 2026 07:29:41 +0000 (0:00:01.818) 0:00:01.818 ********** 2026-04-03 07:30:10.544603 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:30:10.544611 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:30:10.544618 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:30:10.544625 | orchestrator | 2026-04-03 07:30:10.544632 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:30:10.544639 | orchestrator | Friday 03 April 2026 07:29:43 +0000 (0:00:01.696) 0:00:03.515 ********** 2026-04-03 07:30:10.544647 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-03 07:30:10.544654 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-03 07:30:10.544661 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-03 07:30:10.544668 | orchestrator | 2026-04-03 07:30:10.544687 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-03 07:30:10.544694 | orchestrator | 2026-04-03 07:30:10.544701 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-03 07:30:10.544708 | orchestrator | Friday 03 April 2026 07:29:45 +0000 (0:00:02.296) 0:00:05.811 ********** 2026-04-03 07:30:10.544717 | orchestrator | included: /ansible/roles/memcached/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:30:10.544724 | orchestrator | 2026-04-03 07:30:10.544731 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-03 07:30:10.544738 | orchestrator | Friday 03 April 2026 07:29:49 +0000 (0:00:03.371) 0:00:09.183 ********** 2026-04-03 07:30:10.544745 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-03 07:30:10.544752 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-03 07:30:10.544760 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-03 07:30:10.544767 | orchestrator | 2026-04-03 07:30:10.544774 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-03 07:30:10.544781 | orchestrator | Friday 03 April 2026 07:29:51 +0000 (0:00:02.187) 0:00:11.370 ********** 2026-04-03 07:30:10.544788 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-03 07:30:10.544795 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-03 07:30:10.544802 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-03 07:30:10.544856 | orchestrator | 2026-04-03 07:30:10.544863 | orchestrator | TASK [service-check-containers : memcached | Check containers] ***************** 2026-04-03 07:30:10.544871 | orchestrator | Friday 03 April 2026 07:29:54 +0000 (0:00:02.859) 0:00:14.229 ********** 2026-04-03 07:30:10.544880 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:30:10.544891 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:30:10.544910 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-03 07:30:10.544918 | orchestrator | 2026-04-03 07:30:10.544926 | orchestrator | TASK [service-check-containers : memcached | Notify handlers to restart containers] *** 2026-04-03 07:30:10.544933 | orchestrator | Friday 03 April 2026 07:29:56 +0000 (0:00:02.252) 0:00:16.482 ********** 2026-04-03 07:30:10.544940 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:30:10.544948 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:30:10.544955 | orchestrator | } 2026-04-03 07:30:10.544962 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:30:10.544969 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:30:10.544977 | orchestrator | } 2026-04-03 07:30:10.544983 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:30:10.544991 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:30:10.544998 | orchestrator | } 2026-04-03 07:30:10.545005 | orchestrator | 2026-04-03 07:30:10.545012 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:30:10.545020 | orchestrator | Friday 03 April 2026 07:29:57 +0000 (0:00:01.411) 0:00:17.893 ********** 2026-04-03 07:30:10.545031 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:30:10.545045 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:30:10.545053 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:30:10.545060 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:30:10.545069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-03 07:30:10.545078 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:30:10.545086 | orchestrator | 2026-04-03 07:30:10.545095 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-03 07:30:10.545103 | orchestrator | Friday 03 April 2026 07:29:59 +0000 (0:00:02.039) 0:00:19.933 ********** 2026-04-03 07:30:10.545111 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:30:10.545120 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:30:10.545138 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:30:10.545154 | orchestrator | 2026-04-03 07:30:10.545162 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:30:10.545170 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:30:10.545178 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:30:10.545185 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:30:10.545192 | orchestrator | 2026-04-03 07:30:10.545199 | orchestrator | 2026-04-03 07:30:10.545206 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:30:10.545218 | orchestrator | Friday 03 April 2026 07:30:10 +0000 (0:00:10.605) 0:00:30.538 ********** 2026-04-03 07:30:10.761840 | orchestrator | =============================================================================== 2026-04-03 07:30:10.761923 | orchestrator | memcached : Restart memcached container -------------------------------- 10.60s 2026-04-03 07:30:10.761938 | orchestrator | memcached : include_tasks ----------------------------------------------- 3.37s 2026-04-03 07:30:10.761949 | orchestrator | memcached : Copying over config.json files for services ----------------- 2.86s 2026-04-03 07:30:10.761983 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.30s 2026-04-03 07:30:10.761994 | orchestrator | service-check-containers : memcached | Check containers ----------------- 2.25s 2026-04-03 07:30:10.762005 | orchestrator | memcached : Ensuring config directories exist --------------------------- 2.19s 2026-04-03 07:30:10.762062 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.04s 2026-04-03 07:30:10.762086 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.70s 2026-04-03 07:30:10.762098 | orchestrator | service-check-containers : memcached | Notify handlers to restart containers --- 1.41s 2026-04-03 07:30:10.883552 | orchestrator | + osism apply -a upgrade redis 2026-04-03 07:30:12.041923 | orchestrator | 2026-04-03 07:30:12 | INFO  | Prepare task for execution of redis. 2026-04-03 07:30:12.106313 | orchestrator | 2026-04-03 07:30:12 | INFO  | Task 9b4da0b1-16fc-47e4-899b-9965b4368a33 (redis) was prepared for execution. 2026-04-03 07:30:12.106396 | orchestrator | 2026-04-03 07:30:12 | INFO  | It takes a moment until task 9b4da0b1-16fc-47e4-899b-9965b4368a33 (redis) has been started and output is visible here. 2026-04-03 07:30:29.577107 | orchestrator | 2026-04-03 07:30:29.577185 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:30:29.577199 | orchestrator | 2026-04-03 07:30:29.577209 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:30:29.577217 | orchestrator | Friday 03 April 2026 07:30:17 +0000 (0:00:02.038) 0:00:02.038 ********** 2026-04-03 07:30:29.577226 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:30:29.577236 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:30:29.577244 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:30:29.577252 | orchestrator | 2026-04-03 07:30:29.577261 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:30:29.577269 | orchestrator | Friday 03 April 2026 07:30:19 +0000 (0:00:01.929) 0:00:03.968 ********** 2026-04-03 07:30:29.577278 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-03 07:30:29.577287 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-03 07:30:29.577295 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-03 07:30:29.577304 | orchestrator | 2026-04-03 07:30:29.577312 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-03 07:30:29.577321 | orchestrator | 2026-04-03 07:30:29.577329 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-03 07:30:29.577338 | orchestrator | Friday 03 April 2026 07:30:21 +0000 (0:00:01.844) 0:00:05.813 ********** 2026-04-03 07:30:29.577346 | orchestrator | included: /ansible/roles/redis/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:30:29.577356 | orchestrator | 2026-04-03 07:30:29.577364 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-03 07:30:29.577373 | orchestrator | Friday 03 April 2026 07:30:24 +0000 (0:00:03.402) 0:00:09.216 ********** 2026-04-03 07:30:29.577384 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577397 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577425 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577445 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577470 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577480 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577489 | orchestrator | 2026-04-03 07:30:29.577498 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-03 07:30:29.577507 | orchestrator | Friday 03 April 2026 07:30:27 +0000 (0:00:02.841) 0:00:12.057 ********** 2026-04-03 07:30:29.577516 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577525 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577540 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577550 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:29.577568 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729050 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729144 | orchestrator | 2026-04-03 07:30:36.729162 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-03 07:30:36.729175 | orchestrator | Friday 03 April 2026 07:30:30 +0000 (0:00:03.176) 0:00:15.234 ********** 2026-04-03 07:30:36.729187 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729200 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729235 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729247 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729271 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729299 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729311 | orchestrator | 2026-04-03 07:30:36.729322 | orchestrator | TASK [service-check-containers : redis | Check containers] ********************* 2026-04-03 07:30:36.729333 | orchestrator | Friday 03 April 2026 07:30:34 +0000 (0:00:04.015) 0:00:19.249 ********** 2026-04-03 07:30:36.729345 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729364 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729376 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729387 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729406 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:30:36.729425 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-03 07:31:04.905338 | orchestrator | 2026-04-03 07:31:04.905468 | orchestrator | TASK [service-check-containers : redis | Notify handlers to restart containers] *** 2026-04-03 07:31:04.905485 | orchestrator | Friday 03 April 2026 07:30:37 +0000 (0:00:03.059) 0:00:22.309 ********** 2026-04-03 07:31:04.905499 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:31:04.905511 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:31:04.905522 | orchestrator | } 2026-04-03 07:31:04.905533 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:31:04.905544 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:31:04.905581 | orchestrator | } 2026-04-03 07:31:04.905593 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:31:04.905604 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:31:04.905614 | orchestrator | } 2026-04-03 07:31:04.905625 | orchestrator | 2026-04-03 07:31:04.905636 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:31:04.905647 | orchestrator | Friday 03 April 2026 07:30:39 +0000 (0:00:01.334) 0:00:23.644 ********** 2026-04-03 07:31:04.905661 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905675 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905687 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:31:04.905698 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905725 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905736 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:04.905748 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-03 07:31:04.905798 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:04.905838 | orchestrator | 2026-04-03 07:31:04.905852 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 07:31:04.905863 | orchestrator | Friday 03 April 2026 07:30:41 +0000 (0:00:02.015) 0:00:25.659 ********** 2026-04-03 07:31:04.905874 | orchestrator | 2026-04-03 07:31:04.905885 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 07:31:04.905896 | orchestrator | Friday 03 April 2026 07:30:41 +0000 (0:00:00.462) 0:00:26.122 ********** 2026-04-03 07:31:04.905906 | orchestrator | 2026-04-03 07:31:04.905917 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-03 07:31:04.905928 | orchestrator | Friday 03 April 2026 07:30:42 +0000 (0:00:00.419) 0:00:26.542 ********** 2026-04-03 07:31:04.905938 | orchestrator | 2026-04-03 07:31:04.905949 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-03 07:31:04.905971 | orchestrator | Friday 03 April 2026 07:30:42 +0000 (0:00:00.802) 0:00:27.345 ********** 2026-04-03 07:31:04.905982 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:31:04.905993 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:31:04.906004 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:31:04.906083 | orchestrator | 2026-04-03 07:31:04.906109 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-03 07:31:04.906127 | orchestrator | Friday 03 April 2026 07:30:53 +0000 (0:00:10.624) 0:00:37.969 ********** 2026-04-03 07:31:04.906181 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:31:04.906202 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:31:04.906222 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:31:04.906242 | orchestrator | 2026-04-03 07:31:04.906260 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:31:04.906275 | orchestrator | testbed-node-0 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:31:04.906288 | orchestrator | testbed-node-1 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:31:04.906299 | orchestrator | testbed-node-2 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:31:04.906310 | orchestrator | 2026-04-03 07:31:04.906321 | orchestrator | 2026-04-03 07:31:04.906331 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:31:04.906342 | orchestrator | Friday 03 April 2026 07:31:04 +0000 (0:00:11.090) 0:00:49.060 ********** 2026-04-03 07:31:04.906353 | orchestrator | =============================================================================== 2026-04-03 07:31:04.906364 | orchestrator | redis : Restart redis-sentinel container ------------------------------- 11.09s 2026-04-03 07:31:04.906375 | orchestrator | redis : Restart redis container ---------------------------------------- 10.62s 2026-04-03 07:31:04.906385 | orchestrator | redis : Copying over redis config files --------------------------------- 4.02s 2026-04-03 07:31:04.906396 | orchestrator | redis : include_tasks --------------------------------------------------- 3.40s 2026-04-03 07:31:04.906407 | orchestrator | redis : Copying over default config.json files -------------------------- 3.18s 2026-04-03 07:31:04.906417 | orchestrator | service-check-containers : redis | Check containers --------------------- 3.06s 2026-04-03 07:31:04.906436 | orchestrator | redis : Ensuring config directories exist ------------------------------- 2.84s 2026-04-03 07:31:04.906457 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.02s 2026-04-03 07:31:04.906470 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.93s 2026-04-03 07:31:04.906487 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.84s 2026-04-03 07:31:04.906505 | orchestrator | redis : Flush handlers -------------------------------------------------- 1.69s 2026-04-03 07:31:04.906523 | orchestrator | service-check-containers : redis | Notify handlers to restart containers --- 1.34s 2026-04-03 07:31:05.100533 | orchestrator | + osism apply -a upgrade mariadb 2026-04-03 07:31:06.390999 | orchestrator | 2026-04-03 07:31:06 | INFO  | Prepare task for execution of mariadb. 2026-04-03 07:31:06.456653 | orchestrator | 2026-04-03 07:31:06 | INFO  | Task 86bd7979-1cc8-4958-ae35-245fec2750f3 (mariadb) was prepared for execution. 2026-04-03 07:31:06.456751 | orchestrator | 2026-04-03 07:31:06 | INFO  | It takes a moment until task 86bd7979-1cc8-4958-ae35-245fec2750f3 (mariadb) has been started and output is visible here. 2026-04-03 07:31:34.378124 | orchestrator | 2026-04-03 07:31:34.378230 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:31:34.378248 | orchestrator | 2026-04-03 07:31:34.378261 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:31:34.378272 | orchestrator | Friday 03 April 2026 07:31:11 +0000 (0:00:01.375) 0:00:01.375 ********** 2026-04-03 07:31:34.378283 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:34.378296 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:31:34.378307 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:31:34.378318 | orchestrator | 2026-04-03 07:31:34.378330 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:31:34.378341 | orchestrator | Friday 03 April 2026 07:31:13 +0000 (0:00:02.060) 0:00:03.435 ********** 2026-04-03 07:31:34.378351 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-03 07:31:34.378363 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-03 07:31:34.378373 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-03 07:31:34.378384 | orchestrator | 2026-04-03 07:31:34.378394 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-03 07:31:34.378405 | orchestrator | 2026-04-03 07:31:34.378422 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-03 07:31:34.378440 | orchestrator | Friday 03 April 2026 07:31:14 +0000 (0:00:01.811) 0:00:05.247 ********** 2026-04-03 07:31:34.378457 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:31:34.378476 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 07:31:34.378494 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 07:31:34.378509 | orchestrator | 2026-04-03 07:31:34.378526 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 07:31:34.378544 | orchestrator | Friday 03 April 2026 07:31:16 +0000 (0:00:01.677) 0:00:06.925 ********** 2026-04-03 07:31:34.378563 | orchestrator | included: /ansible/roles/mariadb/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:31:34.378582 | orchestrator | 2026-04-03 07:31:34.378601 | orchestrator | TASK [mariadb : Remove mariadb-clustercheck] *********************************** 2026-04-03 07:31:34.378621 | orchestrator | Friday 03 April 2026 07:31:20 +0000 (0:00:03.732) 0:00:10.657 ********** 2026-04-03 07:31:34.378639 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:31:34.378658 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:34.378669 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:31:34.378679 | orchestrator | 2026-04-03 07:31:34.378691 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-03 07:31:34.378701 | orchestrator | Friday 03 April 2026 07:31:23 +0000 (0:00:02.951) 0:00:13.609 ********** 2026-04-03 07:31:34.378729 | orchestrator | ok: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:34.378794 | orchestrator | ok: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:34.378844 | orchestrator | ok: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:34.378877 | orchestrator | 2026-04-03 07:31:34.378889 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-03 07:31:34.378901 | orchestrator | Friday 03 April 2026 07:31:27 +0000 (0:00:03.908) 0:00:17.517 ********** 2026-04-03 07:31:34.378912 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:34.378924 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:34.378934 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:34.378945 | orchestrator | 2026-04-03 07:31:34.378956 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-03 07:31:34.378967 | orchestrator | Friday 03 April 2026 07:31:28 +0000 (0:00:01.716) 0:00:19.234 ********** 2026-04-03 07:31:34.378978 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:34.378988 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:34.378999 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:34.379010 | orchestrator | 2026-04-03 07:31:34.379021 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-03 07:31:34.379032 | orchestrator | Friday 03 April 2026 07:31:31 +0000 (0:00:02.226) 0:00:21.461 ********** 2026-04-03 07:31:34.379054 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:46.897508 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:46.897652 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:46.897698 | orchestrator | 2026-04-03 07:31:46.897735 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-03 07:31:46.897810 | orchestrator | Friday 03 April 2026 07:31:35 +0000 (0:00:04.400) 0:00:25.862 ********** 2026-04-03 07:31:46.897831 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:46.897851 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:46.897869 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:46.897888 | orchestrator | 2026-04-03 07:31:46.897907 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-03 07:31:46.897948 | orchestrator | Friday 03 April 2026 07:31:37 +0000 (0:00:02.050) 0:00:27.912 ********** 2026-04-03 07:31:46.897968 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:31:46.897984 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:31:46.898002 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:31:46.898098 | orchestrator | 2026-04-03 07:31:46.898124 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 07:31:46.898186 | orchestrator | Friday 03 April 2026 07:31:42 +0000 (0:00:05.037) 0:00:32.950 ********** 2026-04-03 07:31:46.898209 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:31:46.898229 | orchestrator | 2026-04-03 07:31:46.898249 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-03 07:31:46.898301 | orchestrator | Friday 03 April 2026 07:31:44 +0000 (0:00:01.710) 0:00:34.660 ********** 2026-04-03 07:31:46.898330 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:46.898352 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:31:46.898391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:53.868337 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:53.868525 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:53.868562 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:53.868585 | orchestrator | 2026-04-03 07:31:53.868605 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-03 07:31:53.868625 | orchestrator | Friday 03 April 2026 07:31:48 +0000 (0:00:03.677) 0:00:38.337 ********** 2026-04-03 07:31:53.868646 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:53.868700 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:31:53.868786 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:53.868811 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:53.868833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:53.868867 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:53.868887 | orchestrator | 2026-04-03 07:31:53.868907 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-03 07:31:53.868927 | orchestrator | Friday 03 April 2026 07:31:51 +0000 (0:00:03.589) 0:00:41.927 ********** 2026-04-03 07:31:53.868973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:58.687362 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:31:58.687473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:58.687524 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:31:58.687542 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:31:58.687556 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:31:58.687569 | orchestrator | 2026-04-03 07:31:58.687601 | orchestrator | TASK [service-check-containers : mariadb | Check containers] ******************* 2026-04-03 07:31:58.687617 | orchestrator | Friday 03 April 2026 07:31:55 +0000 (0:00:03.761) 0:00:45.689 ********** 2026-04-03 07:31:58.687654 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:58.687681 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:31:58.687765 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-03 07:32:13.770059 | orchestrator | 2026-04-03 07:32:13.770131 | orchestrator | TASK [service-check-containers : mariadb | Notify handlers to restart containers] *** 2026-04-03 07:32:13.770138 | orchestrator | Friday 03 April 2026 07:31:59 +0000 (0:00:04.381) 0:00:50.071 ********** 2026-04-03 07:32:13.770144 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:32:13.770148 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:32:13.770153 | orchestrator | } 2026-04-03 07:32:13.770157 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:32:13.770161 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:32:13.770165 | orchestrator | } 2026-04-03 07:32:13.770169 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:32:13.770173 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:32:13.770177 | orchestrator | } 2026-04-03 07:32:13.770181 | orchestrator | 2026-04-03 07:32:13.770185 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:32:13.770189 | orchestrator | Friday 03 April 2026 07:32:01 +0000 (0:00:01.374) 0:00:51.445 ********** 2026-04-03 07:32:13.770195 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:13.770200 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:13.770247 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:13.770255 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770259 | orchestrator | 2026-04-03 07:32:13.770263 | orchestrator | TASK [mariadb : Checking for mariadb cluster] ********************************** 2026-04-03 07:32:13.770267 | orchestrator | Friday 03 April 2026 07:32:04 +0000 (0:00:03.692) 0:00:55.137 ********** 2026-04-03 07:32:13.770271 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770275 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770278 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770282 | orchestrator | 2026-04-03 07:32:13.770286 | orchestrator | TASK [mariadb : Cleaning up temp file on localhost] **************************** 2026-04-03 07:32:13.770295 | orchestrator | Friday 03 April 2026 07:32:06 +0000 (0:00:01.645) 0:00:56.783 ********** 2026-04-03 07:32:13.770299 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770303 | orchestrator | 2026-04-03 07:32:13.770307 | orchestrator | TASK [mariadb : Stop MariaDB containers] *************************************** 2026-04-03 07:32:13.770311 | orchestrator | Friday 03 April 2026 07:32:07 +0000 (0:00:01.120) 0:00:57.903 ********** 2026-04-03 07:32:13.770314 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770318 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770322 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770326 | orchestrator | 2026-04-03 07:32:13.770329 | orchestrator | TASK [mariadb : Run MariaDB wsrep recovery] ************************************ 2026-04-03 07:32:13.770333 | orchestrator | Friday 03 April 2026 07:32:09 +0000 (0:00:01.385) 0:00:59.289 ********** 2026-04-03 07:32:13.770337 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770341 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770345 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770348 | orchestrator | 2026-04-03 07:32:13.770352 | orchestrator | TASK [mariadb : Copying MariaDB log file to /tmp] ****************************** 2026-04-03 07:32:13.770356 | orchestrator | Friday 03 April 2026 07:32:10 +0000 (0:00:01.400) 0:01:00.689 ********** 2026-04-03 07:32:13.770360 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770363 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770367 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770371 | orchestrator | 2026-04-03 07:32:13.770374 | orchestrator | TASK [mariadb : Get MariaDB wsrep recovery seqno] ****************************** 2026-04-03 07:32:13.770378 | orchestrator | Friday 03 April 2026 07:32:11 +0000 (0:00:01.523) 0:01:02.213 ********** 2026-04-03 07:32:13.770382 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770386 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770389 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770393 | orchestrator | 2026-04-03 07:32:13.770397 | orchestrator | TASK [mariadb : Removing MariaDB log file from /tmp] *************************** 2026-04-03 07:32:13.770401 | orchestrator | Friday 03 April 2026 07:32:13 +0000 (0:00:01.429) 0:01:03.643 ********** 2026-04-03 07:32:13.770404 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:13.770408 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:13.770412 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:13.770416 | orchestrator | 2026-04-03 07:32:13.770423 | orchestrator | TASK [mariadb : Registering MariaDB seqno variable] **************************** 2026-04-03 07:32:32.124772 | orchestrator | Friday 03 April 2026 07:32:14 +0000 (0:00:01.395) 0:01:05.038 ********** 2026-04-03 07:32:32.124890 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.124908 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.124919 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.124930 | orchestrator | 2026-04-03 07:32:32.124943 | orchestrator | TASK [mariadb : Comparing seqno value on all mariadb hosts] ******************** 2026-04-03 07:32:32.124955 | orchestrator | Friday 03 April 2026 07:32:16 +0000 (0:00:01.485) 0:01:06.524 ********** 2026-04-03 07:32:32.124967 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:32:32.124978 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:32:32.124989 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:32:32.124999 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125010 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 07:32:32.125020 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 07:32:32.125031 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 07:32:32.125041 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125052 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 07:32:32.125062 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 07:32:32.125073 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 07:32:32.125106 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125117 | orchestrator | 2026-04-03 07:32:32.125129 | orchestrator | TASK [mariadb : Writing hostname of host with the largest seqno to temp file] *** 2026-04-03 07:32:32.125139 | orchestrator | Friday 03 April 2026 07:32:17 +0000 (0:00:01.659) 0:01:08.183 ********** 2026-04-03 07:32:32.125150 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125160 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125171 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125181 | orchestrator | 2026-04-03 07:32:32.125192 | orchestrator | TASK [mariadb : Registering mariadb_recover_inventory_name from temp file] ***** 2026-04-03 07:32:32.125202 | orchestrator | Friday 03 April 2026 07:32:19 +0000 (0:00:01.372) 0:01:09.556 ********** 2026-04-03 07:32:32.125213 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125223 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125234 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125244 | orchestrator | 2026-04-03 07:32:32.125255 | orchestrator | TASK [mariadb : Store bootstrap and master hostnames into facts] *************** 2026-04-03 07:32:32.125265 | orchestrator | Friday 03 April 2026 07:32:20 +0000 (0:00:01.391) 0:01:10.947 ********** 2026-04-03 07:32:32.125276 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125286 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125297 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125307 | orchestrator | 2026-04-03 07:32:32.125318 | orchestrator | TASK [mariadb : Set grastate.dat file from MariaDB container in bootstrap host] *** 2026-04-03 07:32:32.125329 | orchestrator | Friday 03 April 2026 07:32:22 +0000 (0:00:01.806) 0:01:12.754 ********** 2026-04-03 07:32:32.125340 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125350 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125361 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125371 | orchestrator | 2026-04-03 07:32:32.125381 | orchestrator | TASK [mariadb : Starting first MariaDB container] ****************************** 2026-04-03 07:32:32.125392 | orchestrator | Friday 03 April 2026 07:32:23 +0000 (0:00:01.452) 0:01:14.207 ********** 2026-04-03 07:32:32.125403 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125413 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125424 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125434 | orchestrator | 2026-04-03 07:32:32.125445 | orchestrator | TASK [mariadb : Wait for first MariaDB container] ****************************** 2026-04-03 07:32:32.125469 | orchestrator | Friday 03 April 2026 07:32:25 +0000 (0:00:01.443) 0:01:15.650 ********** 2026-04-03 07:32:32.125480 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125491 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125501 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125512 | orchestrator | 2026-04-03 07:32:32.125522 | orchestrator | TASK [mariadb : Set first MariaDB container as primary] ************************ 2026-04-03 07:32:32.125533 | orchestrator | Friday 03 April 2026 07:32:26 +0000 (0:00:01.333) 0:01:16.984 ********** 2026-04-03 07:32:32.125543 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125618 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125629 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125640 | orchestrator | 2026-04-03 07:32:32.125651 | orchestrator | TASK [mariadb : Wait for MariaDB to become operational] ************************ 2026-04-03 07:32:32.125661 | orchestrator | Friday 03 April 2026 07:32:28 +0000 (0:00:01.604) 0:01:18.589 ********** 2026-04-03 07:32:32.125672 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125682 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125693 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:32.125703 | orchestrator | 2026-04-03 07:32:32.125714 | orchestrator | TASK [mariadb : Restart slave MariaDB container(s)] **************************** 2026-04-03 07:32:32.125725 | orchestrator | Friday 03 April 2026 07:32:29 +0000 (0:00:01.365) 0:01:19.954 ********** 2026-04-03 07:32:32.125764 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:32.125791 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:32.125810 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:32.125822 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:32.125843 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:49.723980 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724097 | orchestrator | 2026-04-03 07:32:49.724114 | orchestrator | TASK [mariadb : Wait for slave MariaDB] **************************************** 2026-04-03 07:32:49.724128 | orchestrator | Friday 03 April 2026 07:32:33 +0000 (0:00:03.498) 0:01:23.453 ********** 2026-04-03 07:32:49.724139 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724150 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724160 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724171 | orchestrator | 2026-04-03 07:32:49.724183 | orchestrator | TASK [mariadb : Restart master MariaDB container(s)] *************************** 2026-04-03 07:32:49.724194 | orchestrator | Friday 03 April 2026 07:32:34 +0000 (0:00:01.347) 0:01:24.800 ********** 2026-04-03 07:32:49.724226 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:49.724266 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724298 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:49.724312 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-03 07:32:49.724336 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724347 | orchestrator | 2026-04-03 07:32:49.724359 | orchestrator | TASK [mariadb : Wait for master mariadb] *************************************** 2026-04-03 07:32:49.724379 | orchestrator | Friday 03 April 2026 07:32:38 +0000 (0:00:03.499) 0:01:28.299 ********** 2026-04-03 07:32:49.724390 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724401 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724412 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724422 | orchestrator | 2026-04-03 07:32:49.724433 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-03 07:32:49.724444 | orchestrator | Friday 03 April 2026 07:32:39 +0000 (0:00:01.787) 0:01:30.087 ********** 2026-04-03 07:32:49.724455 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724466 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724518 | orchestrator | 2026-04-03 07:32:49.724531 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-03 07:32:49.724545 | orchestrator | Friday 03 April 2026 07:32:41 +0000 (0:00:01.386) 0:01:31.474 ********** 2026-04-03 07:32:49.724558 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724571 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724583 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724596 | orchestrator | 2026-04-03 07:32:49.724609 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-03 07:32:49.724622 | orchestrator | Friday 03 April 2026 07:32:42 +0000 (0:00:01.335) 0:01:32.809 ********** 2026-04-03 07:32:49.724636 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724648 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724661 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724673 | orchestrator | 2026-04-03 07:32:49.724686 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-03 07:32:49.724698 | orchestrator | Friday 03 April 2026 07:32:44 +0000 (0:00:01.722) 0:01:34.532 ********** 2026-04-03 07:32:49.724710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:32:49.724723 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:32:49.724736 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:32:49.724748 | orchestrator | 2026-04-03 07:32:49.724761 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-03 07:32:49.724775 | orchestrator | Friday 03 April 2026 07:32:46 +0000 (0:00:01.775) 0:01:36.307 ********** 2026-04-03 07:32:49.724787 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:32:49.724800 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:32:49.724813 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:32:49.724825 | orchestrator | 2026-04-03 07:32:49.724838 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-03 07:32:49.724850 | orchestrator | Friday 03 April 2026 07:32:48 +0000 (0:00:02.175) 0:01:38.483 ********** 2026-04-03 07:32:49.724861 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:32:49.724871 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:32:49.724882 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:32:49.724892 | orchestrator | 2026-04-03 07:32:49.724903 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-03 07:32:49.724914 | orchestrator | Friday 03 April 2026 07:32:49 +0000 (0:00:01.367) 0:01:39.851 ********** 2026-04-03 07:32:49.724932 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279210 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279327 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279343 | orchestrator | 2026-04-03 07:35:31.279357 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-03 07:35:31.279369 | orchestrator | Friday 03 April 2026 07:32:50 +0000 (0:00:01.385) 0:01:41.236 ********** 2026-04-03 07:35:31.279380 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279391 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279402 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279412 | orchestrator | 2026-04-03 07:35:31.279423 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-03 07:35:31.279434 | orchestrator | Friday 03 April 2026 07:32:52 +0000 (0:00:01.902) 0:01:43.139 ********** 2026-04-03 07:35:31.279475 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279487 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279498 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279508 | orchestrator | 2026-04-03 07:35:31.279519 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-03 07:35:31.279530 | orchestrator | Friday 03 April 2026 07:32:54 +0000 (0:00:01.731) 0:01:44.871 ********** 2026-04-03 07:35:31.279541 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.279552 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.279563 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.279573 | orchestrator | 2026-04-03 07:35:31.279584 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-03 07:35:31.279595 | orchestrator | Friday 03 April 2026 07:32:56 +0000 (0:00:01.520) 0:01:46.391 ********** 2026-04-03 07:35:31.279606 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279616 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279627 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279637 | orchestrator | 2026-04-03 07:35:31.279648 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-03 07:35:31.279658 | orchestrator | Friday 03 April 2026 07:32:59 +0000 (0:00:03.463) 0:01:49.855 ********** 2026-04-03 07:35:31.279669 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279679 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279735 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279750 | orchestrator | 2026-04-03 07:35:31.279764 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-03 07:35:31.279776 | orchestrator | Friday 03 April 2026 07:33:01 +0000 (0:00:01.403) 0:01:51.259 ********** 2026-04-03 07:35:31.279790 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.279802 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.279815 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.279828 | orchestrator | 2026-04-03 07:35:31.279847 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-03 07:35:31.279861 | orchestrator | Friday 03 April 2026 07:33:02 +0000 (0:00:01.374) 0:01:52.633 ********** 2026-04-03 07:35:31.279874 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.279886 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.279898 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.280016 | orchestrator | 2026-04-03 07:35:31.280030 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 07:35:31.280042 | orchestrator | Friday 03 April 2026 07:33:04 +0000 (0:00:01.732) 0:01:54.365 ********** 2026-04-03 07:35:31.280055 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.280068 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.280080 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.280093 | orchestrator | 2026-04-03 07:35:31.280104 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 07:35:31.280114 | orchestrator | Friday 03 April 2026 07:33:05 +0000 (0:00:01.525) 0:01:55.891 ********** 2026-04-03 07:35:31.280125 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.280136 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.280146 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.280157 | orchestrator | 2026-04-03 07:35:31.280168 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-03 07:35:31.280178 | orchestrator | Friday 03 April 2026 07:33:07 +0000 (0:00:01.768) 0:01:57.660 ********** 2026-04-03 07:35:31.280189 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:35:31.280199 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:35:31.280210 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:35:31.280220 | orchestrator | 2026-04-03 07:35:31.280231 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-03 07:35:31.280242 | orchestrator | Friday 03 April 2026 07:33:08 +0000 (0:00:01.401) 0:01:59.062 ********** 2026-04-03 07:35:31.280252 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.280274 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.280285 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.280296 | orchestrator | 2026-04-03 07:35:31.280307 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 07:35:31.280318 | orchestrator | 2026-04-03 07:35:31.280329 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 07:35:31.280340 | orchestrator | Friday 03 April 2026 07:33:10 +0000 (0:00:02.107) 0:02:01.170 ********** 2026-04-03 07:35:31.280351 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:35:31.280362 | orchestrator | 2026-04-03 07:35:31.280372 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 07:35:31.280383 | orchestrator | Friday 03 April 2026 07:33:38 +0000 (0:00:27.117) 0:02:28.287 ********** 2026-04-03 07:35:31.280394 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.280404 | orchestrator | 2026-04-03 07:35:31.280415 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 07:35:31.280426 | orchestrator | Friday 03 April 2026 07:33:44 +0000 (0:00:06.618) 0:02:34.906 ********** 2026-04-03 07:35:31.280437 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.280447 | orchestrator | 2026-04-03 07:35:31.280458 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 07:35:31.280469 | orchestrator | 2026-04-03 07:35:31.280480 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 07:35:31.280490 | orchestrator | Friday 03 April 2026 07:33:47 +0000 (0:00:02.994) 0:02:37.901 ********** 2026-04-03 07:35:31.280501 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:35:31.280511 | orchestrator | 2026-04-03 07:35:31.280522 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 07:35:31.280552 | orchestrator | Friday 03 April 2026 07:34:13 +0000 (0:00:25.832) 0:03:03.733 ********** 2026-04-03 07:35:31.280563 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Wait for MariaDB service port liveness (10 retries left). 2026-04-03 07:35:31.280575 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.280586 | orchestrator | 2026-04-03 07:35:31.280597 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 07:35:31.280607 | orchestrator | Friday 03 April 2026 07:34:21 +0000 (0:00:07.963) 0:03:11.696 ********** 2026-04-03 07:35:31.280618 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.280628 | orchestrator | 2026-04-03 07:35:31.280639 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 07:35:31.280650 | orchestrator | 2026-04-03 07:35:31.280660 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-03 07:35:31.280671 | orchestrator | Friday 03 April 2026 07:34:24 +0000 (0:00:03.033) 0:03:14.730 ********** 2026-04-03 07:35:31.280681 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:35:31.280692 | orchestrator | 2026-04-03 07:35:31.280703 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-03 07:35:31.280714 | orchestrator | Friday 03 April 2026 07:34:50 +0000 (0:00:25.651) 0:03:40.381 ********** 2026-04-03 07:35:31.280724 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Wait for MariaDB service port liveness (10 retries left). 2026-04-03 07:35:31.280735 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.280745 | orchestrator | 2026-04-03 07:35:31.280756 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-03 07:35:31.280766 | orchestrator | Friday 03 April 2026 07:34:58 +0000 (0:00:08.068) 0:03:48.450 ********** 2026-04-03 07:35:31.280777 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.280788 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-03 07:35:31.280798 | orchestrator | 2026-04-03 07:35:31.280809 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-03 07:35:31.280819 | orchestrator | skipping: no hosts matched 2026-04-03 07:35:31.280830 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-03 07:35:31.280841 | orchestrator | mariadb_bootstrap_restart 2026-04-03 07:35:31.280859 | orchestrator | 2026-04-03 07:35:31.280869 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-03 07:35:31.280880 | orchestrator | skipping: no hosts matched 2026-04-03 07:35:31.280890 | orchestrator | 2026-04-03 07:35:31.280923 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-03 07:35:31.280936 | orchestrator | 2026-04-03 07:35:31.280953 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-03 07:35:31.280964 | orchestrator | Friday 03 April 2026 07:35:02 +0000 (0:00:03.998) 0:03:52.448 ********** 2026-04-03 07:35:31.280975 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:35:31.280985 | orchestrator | 2026-04-03 07:35:31.280996 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-03 07:35:31.281007 | orchestrator | Friday 03 April 2026 07:35:03 +0000 (0:00:01.793) 0:03:54.241 ********** 2026-04-03 07:35:31.281017 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281028 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281039 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.281049 | orchestrator | 2026-04-03 07:35:31.281060 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-03 07:35:31.281070 | orchestrator | Friday 03 April 2026 07:35:07 +0000 (0:00:03.086) 0:03:57.328 ********** 2026-04-03 07:35:31.281081 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281091 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281102 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:35:31.281113 | orchestrator | 2026-04-03 07:35:31.281123 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-03 07:35:31.281134 | orchestrator | Friday 03 April 2026 07:35:10 +0000 (0:00:03.155) 0:04:00.483 ********** 2026-04-03 07:35:31.281144 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281155 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281166 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.281176 | orchestrator | 2026-04-03 07:35:31.281187 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-03 07:35:31.281197 | orchestrator | Friday 03 April 2026 07:35:13 +0000 (0:00:03.241) 0:04:03.725 ********** 2026-04-03 07:35:31.281208 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281218 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281229 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:35:31.281239 | orchestrator | 2026-04-03 07:35:31.281250 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-03 07:35:31.281261 | orchestrator | Friday 03 April 2026 07:35:16 +0000 (0:00:03.248) 0:04:06.973 ********** 2026-04-03 07:35:31.281271 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.281282 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.281293 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.281304 | orchestrator | 2026-04-03 07:35:31.281314 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-03 07:35:31.281325 | orchestrator | Friday 03 April 2026 07:35:23 +0000 (0:00:06.429) 0:04:13.403 ********** 2026-04-03 07:35:31.281336 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.281346 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281357 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281367 | orchestrator | 2026-04-03 07:35:31.281378 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-03 07:35:31.281389 | orchestrator | Friday 03 April 2026 07:35:26 +0000 (0:00:03.684) 0:04:17.087 ********** 2026-04-03 07:35:31.281399 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:35:31.281410 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:35:31.281420 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:35:31.281431 | orchestrator | 2026-04-03 07:35:31.281441 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-03 07:35:31.281452 | orchestrator | Friday 03 April 2026 07:35:28 +0000 (0:00:01.586) 0:04:18.673 ********** 2026-04-03 07:35:31.281470 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:35:31.281480 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:35:31.281491 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:35:31.281501 | orchestrator | 2026-04-03 07:35:31.281519 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-03 07:35:51.999797 | orchestrator | Friday 03 April 2026 07:35:32 +0000 (0:00:03.653) 0:04:22.326 ********** 2026-04-03 07:35:51.999960 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:35:51.999975 | orchestrator | 2026-04-03 07:35:51.999987 | orchestrator | TASK [mariadb : Run upgrade in MariaDB container] ****************************** 2026-04-03 07:35:51.999997 | orchestrator | Friday 03 April 2026 07:35:33 +0000 (0:00:01.911) 0:04:24.237 ********** 2026-04-03 07:35:52.000007 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:35:52.000018 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:35:52.000028 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:35:52.000038 | orchestrator | 2026-04-03 07:35:52.000048 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:35:52.000059 | orchestrator | testbed-node-0 : ok=35  changed=8  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-03 07:35:52.000070 | orchestrator | testbed-node-1 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-03 07:35:52.000079 | orchestrator | testbed-node-2 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-03 07:35:52.000089 | orchestrator | 2026-04-03 07:35:52.000098 | orchestrator | 2026-04-03 07:35:52.000108 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:35:52.000118 | orchestrator | Friday 03 April 2026 07:35:51 +0000 (0:00:17.645) 0:04:41.883 ********** 2026-04-03 07:35:52.000128 | orchestrator | =============================================================================== 2026-04-03 07:35:52.000137 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 78.60s 2026-04-03 07:35:52.000147 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 22.65s 2026-04-03 07:35:52.000156 | orchestrator | mariadb : Run upgrade in MariaDB container ----------------------------- 17.64s 2026-04-03 07:35:52.000165 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ----------------------- 10.03s 2026-04-03 07:35:52.000192 | orchestrator | service-check : mariadb | Get container facts --------------------------- 6.43s 2026-04-03 07:35:52.000202 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 5.04s 2026-04-03 07:35:52.000212 | orchestrator | mariadb : Copying over config.json files for services ------------------- 4.40s 2026-04-03 07:35:52.000221 | orchestrator | service-check-containers : mariadb | Check containers ------------------- 4.38s 2026-04-03 07:35:52.000231 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 3.91s 2026-04-03 07:35:52.000240 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 3.76s 2026-04-03 07:35:52.000249 | orchestrator | mariadb : include_tasks ------------------------------------------------- 3.73s 2026-04-03 07:35:52.000259 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.69s 2026-04-03 07:35:52.000269 | orchestrator | service-check : mariadb | Fail if containers are missing or not running --- 3.68s 2026-04-03 07:35:52.000278 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 3.68s 2026-04-03 07:35:52.000288 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 3.65s 2026-04-03 07:35:52.000297 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 3.59s 2026-04-03 07:35:52.000307 | orchestrator | mariadb : Restart master MariaDB container(s) --------------------------- 3.50s 2026-04-03 07:35:52.000316 | orchestrator | mariadb : Restart slave MariaDB container(s) ---------------------------- 3.50s 2026-04-03 07:35:52.000326 | orchestrator | mariadb : Check MariaDB service WSREP sync status ----------------------- 3.46s 2026-04-03 07:35:52.000358 | orchestrator | mariadb : Granting permissions on Mariabackup database to backup user --- 3.25s 2026-04-03 07:35:52.195488 | orchestrator | + osism apply -a upgrade rabbitmq 2026-04-03 07:35:53.463388 | orchestrator | 2026-04-03 07:35:53 | INFO  | Prepare task for execution of rabbitmq. 2026-04-03 07:35:53.533113 | orchestrator | 2026-04-03 07:35:53 | INFO  | Task 22b77b25-c829-44c9-a586-17c3ffa81012 (rabbitmq) was prepared for execution. 2026-04-03 07:35:53.533208 | orchestrator | 2026-04-03 07:35:53 | INFO  | It takes a moment until task 22b77b25-c829-44c9-a586-17c3ffa81012 (rabbitmq) has been started and output is visible here. 2026-04-03 07:36:36.631105 | orchestrator | 2026-04-03 07:36:36.631202 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:36:36.631214 | orchestrator | 2026-04-03 07:36:36.631223 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:36:36.631231 | orchestrator | Friday 03 April 2026 07:35:58 +0000 (0:00:01.634) 0:00:01.634 ********** 2026-04-03 07:36:36.631240 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:36:36.631249 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:36:36.631257 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:36:36.631265 | orchestrator | 2026-04-03 07:36:36.631272 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:36:36.631280 | orchestrator | Friday 03 April 2026 07:36:00 +0000 (0:00:01.846) 0:00:03.480 ********** 2026-04-03 07:36:36.631288 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-03 07:36:36.631297 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-03 07:36:36.631305 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-03 07:36:36.631312 | orchestrator | 2026-04-03 07:36:36.631320 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-03 07:36:36.631328 | orchestrator | 2026-04-03 07:36:36.631336 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 07:36:36.631344 | orchestrator | Friday 03 April 2026 07:36:03 +0000 (0:00:03.308) 0:00:06.788 ********** 2026-04-03 07:36:36.631353 | orchestrator | included: /ansible/roles/rabbitmq/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:36:36.631362 | orchestrator | 2026-04-03 07:36:36.631370 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-03 07:36:36.631378 | orchestrator | Friday 03 April 2026 07:36:05 +0000 (0:00:02.278) 0:00:09.067 ********** 2026-04-03 07:36:36.631386 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:36:36.631393 | orchestrator | 2026-04-03 07:36:36.631401 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-03 07:36:36.631409 | orchestrator | Friday 03 April 2026 07:36:08 +0000 (0:00:02.726) 0:00:11.793 ********** 2026-04-03 07:36:36.631417 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:36:36.631424 | orchestrator | 2026-04-03 07:36:36.631432 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-03 07:36:36.631440 | orchestrator | Friday 03 April 2026 07:36:11 +0000 (0:00:03.008) 0:00:14.802 ********** 2026-04-03 07:36:36.631448 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:36:36.631457 | orchestrator | 2026-04-03 07:36:36.631464 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-03 07:36:36.631472 | orchestrator | Friday 03 April 2026 07:36:21 +0000 (0:00:09.709) 0:00:24.511 ********** 2026-04-03 07:36:36.631480 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 07:36:36.631488 | orchestrator |  "changed": false, 2026-04-03 07:36:36.631496 | orchestrator |  "msg": "All assertions passed" 2026-04-03 07:36:36.631505 | orchestrator | } 2026-04-03 07:36:36.631513 | orchestrator | 2026-04-03 07:36:36.631520 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-03 07:36:36.631528 | orchestrator | Friday 03 April 2026 07:36:22 +0000 (0:00:01.323) 0:00:25.835 ********** 2026-04-03 07:36:36.631536 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 07:36:36.631562 | orchestrator |  "changed": false, 2026-04-03 07:36:36.631570 | orchestrator |  "msg": "All assertions passed" 2026-04-03 07:36:36.631578 | orchestrator | } 2026-04-03 07:36:36.631586 | orchestrator | 2026-04-03 07:36:36.631594 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 07:36:36.631601 | orchestrator | Friday 03 April 2026 07:36:24 +0000 (0:00:01.661) 0:00:27.497 ********** 2026-04-03 07:36:36.631622 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:36:36.631630 | orchestrator | 2026-04-03 07:36:36.631640 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-03 07:36:36.631649 | orchestrator | Friday 03 April 2026 07:36:26 +0000 (0:00:01.884) 0:00:29.381 ********** 2026-04-03 07:36:36.631658 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:36:36.631668 | orchestrator | 2026-04-03 07:36:36.631677 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-03 07:36:36.631686 | orchestrator | Friday 03 April 2026 07:36:28 +0000 (0:00:02.327) 0:00:31.708 ********** 2026-04-03 07:36:36.631696 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:36:36.631705 | orchestrator | 2026-04-03 07:36:36.631737 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-03 07:36:36.631746 | orchestrator | Friday 03 April 2026 07:36:31 +0000 (0:00:02.957) 0:00:34.666 ********** 2026-04-03 07:36:36.631755 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:36:36.631765 | orchestrator | 2026-04-03 07:36:36.631774 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-03 07:36:36.631783 | orchestrator | Friday 03 April 2026 07:36:33 +0000 (0:00:01.682) 0:00:36.349 ********** 2026-04-03 07:36:36.631814 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:36.631828 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:36.631839 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:36.631858 | orchestrator | 2026-04-03 07:36:36.631871 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-03 07:36:36.631879 | orchestrator | Friday 03 April 2026 07:36:35 +0000 (0:00:02.094) 0:00:38.443 ********** 2026-04-03 07:36:36.631887 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:36.631904 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:56.912837 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:56.912982 | orchestrator | 2026-04-03 07:36:56.913001 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-03 07:36:56.913015 | orchestrator | Friday 03 April 2026 07:36:37 +0000 (0:00:02.485) 0:00:40.928 ********** 2026-04-03 07:36:56.913026 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 07:36:56.913038 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 07:36:56.913048 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-03 07:36:56.913059 | orchestrator | 2026-04-03 07:36:56.913070 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-03 07:36:56.913081 | orchestrator | Friday 03 April 2026 07:36:40 +0000 (0:00:02.377) 0:00:43.306 ********** 2026-04-03 07:36:56.913107 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 07:36:56.913118 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 07:36:56.913129 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-03 07:36:56.913139 | orchestrator | 2026-04-03 07:36:56.913150 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-03 07:36:56.913161 | orchestrator | Friday 03 April 2026 07:36:42 +0000 (0:00:02.812) 0:00:46.119 ********** 2026-04-03 07:36:56.913171 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 07:36:56.913186 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 07:36:56.913204 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-03 07:36:56.913224 | orchestrator | 2026-04-03 07:36:56.913243 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-03 07:36:56.913261 | orchestrator | Friday 03 April 2026 07:36:45 +0000 (0:00:02.419) 0:00:48.538 ********** 2026-04-03 07:36:56.913275 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 07:36:56.913293 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 07:36:56.913313 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-03 07:36:56.913333 | orchestrator | 2026-04-03 07:36:56.913353 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-03 07:36:56.913373 | orchestrator | Friday 03 April 2026 07:36:47 +0000 (0:00:02.592) 0:00:51.131 ********** 2026-04-03 07:36:56.913394 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 07:36:56.913414 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 07:36:56.913435 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-03 07:36:56.913455 | orchestrator | 2026-04-03 07:36:56.913476 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-03 07:36:56.913494 | orchestrator | Friday 03 April 2026 07:36:50 +0000 (0:00:02.234) 0:00:53.366 ********** 2026-04-03 07:36:56.913515 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 07:36:56.913535 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 07:36:56.913562 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-03 07:36:56.913574 | orchestrator | 2026-04-03 07:36:56.913587 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-03 07:36:56.913600 | orchestrator | Friday 03 April 2026 07:36:52 +0000 (0:00:02.368) 0:00:55.734 ********** 2026-04-03 07:36:56.913613 | orchestrator | included: /ansible/roles/rabbitmq/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:36:56.913626 | orchestrator | 2026-04-03 07:36:56.913688 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over extra CA certificates] ******* 2026-04-03 07:36:56.913712 | orchestrator | Friday 03 April 2026 07:36:54 +0000 (0:00:01.917) 0:00:57.652 ********** 2026-04-03 07:36:56.913733 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:56.913767 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:56.913789 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:36:56.913822 | orchestrator | 2026-04-03 07:36:56.913841 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS certificate] *** 2026-04-03 07:36:56.913858 | orchestrator | Friday 03 April 2026 07:36:56 +0000 (0:00:02.284) 0:00:59.937 ********** 2026-04-03 07:36:56.913883 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400001 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:37:05.400143 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400176 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:37:05.400221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400243 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:37:05.400262 | orchestrator | 2026-04-03 07:37:05.400280 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS key] **** 2026-04-03 07:37:05.400292 | orchestrator | Friday 03 April 2026 07:36:58 +0000 (0:00:01.435) 0:01:01.373 ********** 2026-04-03 07:37:05.400303 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400342 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:37:05.400377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400390 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:37:05.400407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:37:05.400419 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:37:05.400430 | orchestrator | 2026-04-03 07:37:05.400442 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-03 07:37:05.400452 | orchestrator | Friday 03 April 2026 07:37:00 +0000 (0:00:02.016) 0:01:03.389 ********** 2026-04-03 07:37:05.400463 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:37:05.400475 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:37:05.400486 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:37:05.400496 | orchestrator | 2026-04-03 07:37:05.400508 | orchestrator | TASK [service-check-containers : rabbitmq | Check containers] ****************** 2026-04-03 07:37:05.400521 | orchestrator | Friday 03 April 2026 07:37:04 +0000 (0:00:04.132) 0:01:07.521 ********** 2026-04-03 07:37:05.400542 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:37:05.400567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:38:49.997936 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-03 07:38:49.998127 | orchestrator | 2026-04-03 07:38:49.998161 | orchestrator | TASK [service-check-containers : rabbitmq | Notify handlers to restart containers] *** 2026-04-03 07:38:49.998171 | orchestrator | Friday 03 April 2026 07:37:06 +0000 (0:00:02.162) 0:01:09.684 ********** 2026-04-03 07:38:49.998180 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:38:49.998189 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:38:49.998197 | orchestrator | } 2026-04-03 07:38:49.998205 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:38:49.998212 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:38:49.998220 | orchestrator | } 2026-04-03 07:38:49.998227 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:38:49.998258 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:38:49.998266 | orchestrator | } 2026-04-03 07:38:49.998273 | orchestrator | 2026-04-03 07:38:49.998281 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:38:49.998288 | orchestrator | Friday 03 April 2026 07:37:08 +0000 (0:00:01.619) 0:01:11.303 ********** 2026-04-03 07:38:49.998297 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:38:49.998305 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:38:49.998313 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:38:49.998320 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:38:49.998347 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-03 07:38:49.998355 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:38:49.998362 | orchestrator | 2026-04-03 07:38:49.998370 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-03 07:38:49.998403 | orchestrator | Friday 03 April 2026 07:37:10 +0000 (0:00:02.085) 0:01:13.390 ********** 2026-04-03 07:38:49.998419 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:38:49.998426 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:38:49.998433 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:38:49.998442 | orchestrator | 2026-04-03 07:38:49.998450 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 07:38:49.998459 | orchestrator | 2026-04-03 07:38:49.998467 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 07:38:49.998475 | orchestrator | Friday 03 April 2026 07:37:12 +0000 (0:00:01.913) 0:01:15.303 ********** 2026-04-03 07:38:49.998483 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:38:49.998493 | orchestrator | 2026-04-03 07:38:49.998502 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 07:38:49.998510 | orchestrator | Friday 03 April 2026 07:37:14 +0000 (0:00:02.105) 0:01:17.410 ********** 2026-04-03 07:38:49.998518 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:38:49.998527 | orchestrator | 2026-04-03 07:38:49.998536 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 07:38:49.998544 | orchestrator | Friday 03 April 2026 07:37:23 +0000 (0:00:09.643) 0:01:27.053 ********** 2026-04-03 07:38:49.998552 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:38:49.998561 | orchestrator | 2026-04-03 07:38:49.998569 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 07:38:49.998578 | orchestrator | Friday 03 April 2026 07:37:32 +0000 (0:00:09.004) 0:01:36.058 ********** 2026-04-03 07:38:49.998586 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:38:49.998595 | orchestrator | 2026-04-03 07:38:49.998603 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 07:38:49.998612 | orchestrator | 2026-04-03 07:38:49.998621 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 07:38:49.998629 | orchestrator | Friday 03 April 2026 07:37:42 +0000 (0:00:09.734) 0:01:45.793 ********** 2026-04-03 07:38:49.998638 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:38:49.998646 | orchestrator | 2026-04-03 07:38:49.998655 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 07:38:49.998663 | orchestrator | Friday 03 April 2026 07:37:44 +0000 (0:00:01.534) 0:01:47.327 ********** 2026-04-03 07:38:49.998671 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:38:49.998679 | orchestrator | 2026-04-03 07:38:49.998688 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 07:38:49.998696 | orchestrator | Friday 03 April 2026 07:37:53 +0000 (0:00:09.124) 0:01:56.452 ********** 2026-04-03 07:38:49.998704 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:38:49.998712 | orchestrator | 2026-04-03 07:38:49.998721 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 07:38:49.998729 | orchestrator | Friday 03 April 2026 07:38:07 +0000 (0:00:14.019) 0:02:10.472 ********** 2026-04-03 07:38:49.998737 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:38:49.998746 | orchestrator | 2026-04-03 07:38:49.998754 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-03 07:38:49.998763 | orchestrator | 2026-04-03 07:38:49.998771 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-03 07:38:49.998780 | orchestrator | Friday 03 April 2026 07:38:16 +0000 (0:00:09.079) 0:02:19.552 ********** 2026-04-03 07:38:49.998788 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:38:49.998796 | orchestrator | 2026-04-03 07:38:49.998805 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-03 07:38:49.998813 | orchestrator | Friday 03 April 2026 07:38:18 +0000 (0:00:01.645) 0:02:21.198 ********** 2026-04-03 07:38:49.998822 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:38:49.998829 | orchestrator | 2026-04-03 07:38:49.998836 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-03 07:38:49.998843 | orchestrator | Friday 03 April 2026 07:38:26 +0000 (0:00:08.514) 0:02:29.713 ********** 2026-04-03 07:38:49.998850 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:38:49.998862 | orchestrator | 2026-04-03 07:38:49.998870 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-03 07:38:49.998877 | orchestrator | Friday 03 April 2026 07:38:40 +0000 (0:00:13.971) 0:02:43.684 ********** 2026-04-03 07:38:49.998884 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:38:49.998891 | orchestrator | 2026-04-03 07:38:49.998898 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-03 07:38:49.998905 | orchestrator | 2026-04-03 07:38:49.998913 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-03 07:38:49.998925 | orchestrator | Friday 03 April 2026 07:38:49 +0000 (0:00:09.443) 0:02:53.128 ********** 2026-04-03 07:38:56.631624 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:38:56.631763 | orchestrator | 2026-04-03 07:38:56.631778 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-03 07:38:56.631788 | orchestrator | Friday 03 April 2026 07:38:51 +0000 (0:00:01.608) 0:02:54.737 ********** 2026-04-03 07:38:56.631798 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:38:56.631809 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:38:56.631817 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:38:56.631826 | orchestrator | 2026-04-03 07:38:56.631836 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:38:56.631846 | orchestrator | testbed-node-0 : ok=31  changed=11  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:38:56.631856 | orchestrator | testbed-node-1 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 07:38:56.631865 | orchestrator | testbed-node-2 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 07:38:56.631874 | orchestrator | 2026-04-03 07:38:56.631882 | orchestrator | 2026-04-03 07:38:56.631893 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:38:56.631908 | orchestrator | Friday 03 April 2026 07:38:56 +0000 (0:00:04.639) 0:02:59.377 ********** 2026-04-03 07:38:56.631950 | orchestrator | =============================================================================== 2026-04-03 07:38:56.631966 | orchestrator | rabbitmq : Restart rabbitmq container ---------------------------------- 37.00s 2026-04-03 07:38:56.631979 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 28.26s 2026-04-03 07:38:56.631994 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode --------------------- 27.28s 2026-04-03 07:38:56.632009 | orchestrator | rabbitmq : Get new RabbitMQ version ------------------------------------- 9.71s 2026-04-03 07:38:56.632023 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 5.29s 2026-04-03 07:38:56.632036 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 4.64s 2026-04-03 07:38:56.632049 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 4.13s 2026-04-03 07:38:56.632065 | orchestrator | Group hosts based on enabled services ----------------------------------- 3.31s 2026-04-03 07:38:56.632080 | orchestrator | rabbitmq : Get current RabbitMQ version --------------------------------- 3.01s 2026-04-03 07:38:56.632095 | orchestrator | rabbitmq : List RabbitMQ policies --------------------------------------- 2.96s 2026-04-03 07:38:56.632111 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 2.81s 2026-04-03 07:38:56.632127 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 2.73s 2026-04-03 07:38:56.632142 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 2.59s 2026-04-03 07:38:56.632158 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 2.49s 2026-04-03 07:38:56.632175 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 2.42s 2026-04-03 07:38:56.632191 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 2.38s 2026-04-03 07:38:56.632238 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 2.37s 2026-04-03 07:38:56.632253 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 2.33s 2026-04-03 07:38:56.632269 | orchestrator | service-cert-copy : rabbitmq | Copying over extra CA certificates ------- 2.28s 2026-04-03 07:38:56.632282 | orchestrator | rabbitmq : include_tasks ------------------------------------------------ 2.28s 2026-04-03 07:38:56.818095 | orchestrator | + osism apply -a upgrade openvswitch 2026-04-03 07:38:58.086872 | orchestrator | 2026-04-03 07:38:58 | INFO  | Prepare task for execution of openvswitch. 2026-04-03 07:38:58.156986 | orchestrator | 2026-04-03 07:38:58 | INFO  | Task 0f3ac34f-9f1a-48f1-807b-2cd5c4dd7cb3 (openvswitch) was prepared for execution. 2026-04-03 07:38:58.157086 | orchestrator | 2026-04-03 07:38:58 | INFO  | It takes a moment until task 0f3ac34f-9f1a-48f1-807b-2cd5c4dd7cb3 (openvswitch) has been started and output is visible here. 2026-04-03 07:39:24.045984 | orchestrator | 2026-04-03 07:39:24.046170 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:39:24.046185 | orchestrator | 2026-04-03 07:39:24.046196 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:39:24.046205 | orchestrator | Friday 03 April 2026 07:39:03 +0000 (0:00:01.489) 0:00:01.489 ********** 2026-04-03 07:39:24.046214 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:39:24.046224 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:39:24.046233 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:39:24.046242 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:39:24.046251 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:39:24.046259 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:39:24.046268 | orchestrator | 2026-04-03 07:39:24.046276 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:39:24.046285 | orchestrator | Friday 03 April 2026 07:39:05 +0000 (0:00:02.642) 0:00:04.131 ********** 2026-04-03 07:39:24.046294 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046364 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046375 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046383 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046392 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046401 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-03 07:39:24.046410 | orchestrator | 2026-04-03 07:39:24.046418 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-03 07:39:24.046427 | orchestrator | 2026-04-03 07:39:24.046436 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-03 07:39:24.046444 | orchestrator | Friday 03 April 2026 07:39:07 +0000 (0:00:02.086) 0:00:06.218 ********** 2026-04-03 07:39:24.046454 | orchestrator | included: /ansible/roles/openvswitch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:39:24.046465 | orchestrator | 2026-04-03 07:39:24.046474 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 07:39:24.046482 | orchestrator | Friday 03 April 2026 07:39:12 +0000 (0:00:04.213) 0:00:10.432 ********** 2026-04-03 07:39:24.046493 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-03 07:39:24.046505 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-03 07:39:24.046516 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-03 07:39:24.046526 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-03 07:39:24.046536 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-03 07:39:24.046568 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-03 07:39:24.046578 | orchestrator | 2026-04-03 07:39:24.046616 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 07:39:24.046627 | orchestrator | Friday 03 April 2026 07:39:15 +0000 (0:00:03.390) 0:00:13.823 ********** 2026-04-03 07:39:24.046637 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-03 07:39:24.046647 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-03 07:39:24.046658 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-03 07:39:24.046669 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-03 07:39:24.046679 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-03 07:39:24.046689 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-03 07:39:24.046699 | orchestrator | 2026-04-03 07:39:24.046709 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 07:39:24.046720 | orchestrator | Friday 03 April 2026 07:39:18 +0000 (0:00:02.981) 0:00:16.804 ********** 2026-04-03 07:39:24.046730 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-03 07:39:24.046741 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:39:24.046752 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-03 07:39:24.046762 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:39:24.046773 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-03 07:39:24.046783 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:39:24.046794 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-03 07:39:24.046805 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:39:24.046815 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-03 07:39:24.046824 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:39:24.046832 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-03 07:39:24.046841 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:39:24.046849 | orchestrator | 2026-04-03 07:39:24.046858 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-03 07:39:24.046867 | orchestrator | Friday 03 April 2026 07:39:20 +0000 (0:00:02.429) 0:00:19.233 ********** 2026-04-03 07:39:24.046876 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:39:24.046884 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:39:24.046893 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:39:24.046901 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:39:24.046910 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:39:24.046918 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:39:24.046927 | orchestrator | 2026-04-03 07:39:24.046935 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-03 07:39:24.046944 | orchestrator | Friday 03 April 2026 07:39:23 +0000 (0:00:02.265) 0:00:21.499 ********** 2026-04-03 07:39:24.046977 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:24.046995 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:24.047011 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:24.047026 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:24.047036 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:24.047045 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:24.047061 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435065 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435244 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435260 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435271 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435281 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435291 | orchestrator | 2026-04-03 07:39:27.435357 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-03 07:39:27.435370 | orchestrator | Friday 03 April 2026 07:39:25 +0000 (0:00:02.478) 0:00:23.978 ********** 2026-04-03 07:39:27.435400 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435421 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435437 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435447 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435457 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435467 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:27.435492 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.410953 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411098 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411114 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411126 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411137 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411176 | orchestrator | 2026-04-03 07:39:33.411191 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-03 07:39:33.411204 | orchestrator | Friday 03 April 2026 07:39:29 +0000 (0:00:03.457) 0:00:27.435 ********** 2026-04-03 07:39:33.411216 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:39:33.411228 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:39:33.411239 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:39:33.411250 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:39:33.411260 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:39:33.411271 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:39:33.411282 | orchestrator | 2026-04-03 07:39:33.411333 | orchestrator | TASK [service-check-containers : openvswitch | Check containers] *************** 2026-04-03 07:39:33.411365 | orchestrator | Friday 03 April 2026 07:39:31 +0000 (0:00:02.839) 0:00:30.275 ********** 2026-04-03 07:39:33.411384 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411399 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411411 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411422 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411444 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:33.411466 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967473 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967610 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967626 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967667 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967679 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967711 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-03 07:39:37.967725 | orchestrator | 2026-04-03 07:39:37.967738 | orchestrator | TASK [service-check-containers : openvswitch | Notify handlers to restart containers] *** 2026-04-03 07:39:37.967757 | orchestrator | Friday 03 April 2026 07:39:35 +0000 (0:00:03.537) 0:00:33.812 ********** 2026-04-03 07:39:37.967770 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:39:37.967783 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967794 | orchestrator | } 2026-04-03 07:39:37.967805 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:39:37.967816 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967828 | orchestrator | } 2026-04-03 07:39:37.967839 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:39:37.967850 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967860 | orchestrator | } 2026-04-03 07:39:37.967874 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 07:39:37.967887 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967900 | orchestrator | } 2026-04-03 07:39:37.967913 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 07:39:37.967926 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967939 | orchestrator | } 2026-04-03 07:39:37.967951 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 07:39:37.967964 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:39:37.967976 | orchestrator | } 2026-04-03 07:39:37.967989 | orchestrator | 2026-04-03 07:39:37.968002 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:39:37.968015 | orchestrator | Friday 03 April 2026 07:39:37 +0000 (0:00:02.061) 0:00:35.873 ********** 2026-04-03 07:39:37.968029 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:39:37.968053 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:39:37.968066 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:39:37.968080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:39:37.968095 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:39:37.968121 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:40:12.040539 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:40:12.040700 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:40:12.040728 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:40:12.040744 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:40:12.040760 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:40:12.040774 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:40:12.040788 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:40:12.040818 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:40:12.040832 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:40:12.040868 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-03 07:40:12.040894 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-03 07:40:12.040909 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:40:12.040923 | orchestrator | 2026-04-03 07:40:12.040939 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.040955 | orchestrator | Friday 03 April 2026 07:39:40 +0000 (0:00:02.566) 0:00:38.440 ********** 2026-04-03 07:40:12.040968 | orchestrator | 2026-04-03 07:40:12.040982 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.040995 | orchestrator | Friday 03 April 2026 07:39:40 +0000 (0:00:00.686) 0:00:39.126 ********** 2026-04-03 07:40:12.041008 | orchestrator | 2026-04-03 07:40:12.041020 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.041034 | orchestrator | Friday 03 April 2026 07:39:41 +0000 (0:00:00.556) 0:00:39.683 ********** 2026-04-03 07:40:12.041047 | orchestrator | 2026-04-03 07:40:12.041066 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.041086 | orchestrator | Friday 03 April 2026 07:39:41 +0000 (0:00:00.532) 0:00:40.215 ********** 2026-04-03 07:40:12.041105 | orchestrator | 2026-04-03 07:40:12.041124 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.041144 | orchestrator | Friday 03 April 2026 07:39:42 +0000 (0:00:00.542) 0:00:40.757 ********** 2026-04-03 07:40:12.041163 | orchestrator | 2026-04-03 07:40:12.041182 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-03 07:40:12.041202 | orchestrator | Friday 03 April 2026 07:39:42 +0000 (0:00:00.540) 0:00:41.298 ********** 2026-04-03 07:40:12.041244 | orchestrator | 2026-04-03 07:40:12.041263 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-03 07:40:12.041276 | orchestrator | Friday 03 April 2026 07:39:43 +0000 (0:00:00.853) 0:00:42.152 ********** 2026-04-03 07:40:12.041290 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:40:12.041303 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:40:12.041315 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:40:12.041328 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:40:12.041342 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:40:12.041356 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:40:12.041369 | orchestrator | 2026-04-03 07:40:12.041382 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-03 07:40:12.041397 | orchestrator | Friday 03 April 2026 07:39:56 +0000 (0:00:12.341) 0:00:54.494 ********** 2026-04-03 07:40:12.041413 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:40:12.041428 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:40:12.041441 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:40:12.041454 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:40:12.041466 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:40:12.041478 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:40:12.041491 | orchestrator | 2026-04-03 07:40:12.041505 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-03 07:40:12.041520 | orchestrator | Friday 03 April 2026 07:39:58 +0000 (0:00:02.332) 0:00:56.826 ********** 2026-04-03 07:40:12.041544 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:40:12.041552 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:40:12.041560 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:40:12.041568 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:40:12.041576 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:40:12.041583 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:40:12.041591 | orchestrator | 2026-04-03 07:40:12.041599 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-03 07:40:12.041607 | orchestrator | Friday 03 April 2026 07:40:09 +0000 (0:00:10.988) 0:01:07.815 ********** 2026-04-03 07:40:12.041615 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-03 07:40:12.041624 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-03 07:40:12.041640 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-03 07:40:12.041648 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-03 07:40:12.041656 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-03 07:40:12.041675 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-03 07:40:24.791456 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-03 07:40:24.791547 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-03 07:40:24.791558 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-03 07:40:24.791566 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-03 07:40:24.791574 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-03 07:40:24.791581 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-03 07:40:24.791588 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791596 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791603 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791610 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791617 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791624 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-03 07:40:24.791632 | orchestrator | 2026-04-03 07:40:24.791640 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-03 07:40:24.791649 | orchestrator | Friday 03 April 2026 07:40:16 +0000 (0:00:07.500) 0:01:15.315 ********** 2026-04-03 07:40:24.791657 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-03 07:40:24.791665 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:40:24.791673 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-03 07:40:24.791680 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:40:24.791687 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-03 07:40:24.791694 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:40:24.791701 | orchestrator | ok: [testbed-node-1] => (item=br-ex) 2026-04-03 07:40:24.791727 | orchestrator | ok: [testbed-node-0] => (item=br-ex) 2026-04-03 07:40:24.791735 | orchestrator | ok: [testbed-node-2] => (item=br-ex) 2026-04-03 07:40:24.791742 | orchestrator | 2026-04-03 07:40:24.791749 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-03 07:40:24.791759 | orchestrator | Friday 03 April 2026 07:40:20 +0000 (0:00:03.195) 0:01:18.511 ********** 2026-04-03 07:40:24.791772 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-03 07:40:24.791785 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:40:24.791798 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-03 07:40:24.791812 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:40:24.791824 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-03 07:40:24.791836 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:40:24.791849 | orchestrator | ok: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-03 07:40:24.791859 | orchestrator | ok: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-03 07:40:24.791869 | orchestrator | ok: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-03 07:40:24.791880 | orchestrator | 2026-04-03 07:40:24.791891 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:40:24.791903 | orchestrator | testbed-node-0 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:40:24.791916 | orchestrator | testbed-node-1 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:40:24.791927 | orchestrator | testbed-node-2 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 07:40:24.791939 | orchestrator | testbed-node-3 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:40:24.791951 | orchestrator | testbed-node-4 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:40:24.791979 | orchestrator | testbed-node-5 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:40:24.791992 | orchestrator | 2026-04-03 07:40:24.792004 | orchestrator | 2026-04-03 07:40:24.792017 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:40:24.792030 | orchestrator | Friday 03 April 2026 07:40:24 +0000 (0:00:04.243) 0:01:22.754 ********** 2026-04-03 07:40:24.792044 | orchestrator | =============================================================================== 2026-04-03 07:40:24.792057 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------ 12.34s 2026-04-03 07:40:24.792088 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 10.99s 2026-04-03 07:40:24.792102 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 7.50s 2026-04-03 07:40:24.792115 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 4.24s 2026-04-03 07:40:24.792128 | orchestrator | openvswitch : include_tasks --------------------------------------------- 4.22s 2026-04-03 07:40:24.792141 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 3.71s 2026-04-03 07:40:24.792154 | orchestrator | service-check-containers : openvswitch | Check containers --------------- 3.54s 2026-04-03 07:40:24.792167 | orchestrator | openvswitch : Copying over config.json files for services --------------- 3.46s 2026-04-03 07:40:24.792181 | orchestrator | module-load : Load modules ---------------------------------------------- 3.39s 2026-04-03 07:40:24.792218 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 3.20s 2026-04-03 07:40:24.792230 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 2.98s 2026-04-03 07:40:24.792246 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 2.84s 2026-04-03 07:40:24.792276 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.64s 2026-04-03 07:40:24.792292 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.57s 2026-04-03 07:40:24.792307 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 2.48s 2026-04-03 07:40:24.792321 | orchestrator | module-load : Drop module persistence ----------------------------------- 2.43s 2026-04-03 07:40:24.792335 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 2.33s 2026-04-03 07:40:24.792351 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 2.27s 2026-04-03 07:40:24.792365 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.09s 2026-04-03 07:40:24.792379 | orchestrator | service-check-containers : openvswitch | Notify handlers to restart containers --- 2.06s 2026-04-03 07:40:24.983381 | orchestrator | + osism apply -a upgrade ovn 2026-04-03 07:40:26.291585 | orchestrator | 2026-04-03 07:40:26 | INFO  | Prepare task for execution of ovn. 2026-04-03 07:40:26.356165 | orchestrator | 2026-04-03 07:40:26 | INFO  | Task d762b77f-0ec4-40c9-806c-c084a93abc29 (ovn) was prepared for execution. 2026-04-03 07:40:26.356287 | orchestrator | 2026-04-03 07:40:26 | INFO  | It takes a moment until task d762b77f-0ec4-40c9-806c-c084a93abc29 (ovn) has been started and output is visible here. 2026-04-03 07:40:50.253982 | orchestrator | 2026-04-03 07:40:50.254219 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 07:40:50.254243 | orchestrator | 2026-04-03 07:40:50.254257 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 07:40:50.254268 | orchestrator | Friday 03 April 2026 07:40:31 +0000 (0:00:02.122) 0:00:02.122 ********** 2026-04-03 07:40:50.254280 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:40:50.254292 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:40:50.254304 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:40:50.254315 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:40:50.254326 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:40:50.254336 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:40:50.254347 | orchestrator | 2026-04-03 07:40:50.254358 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 07:40:50.254369 | orchestrator | Friday 03 April 2026 07:40:35 +0000 (0:00:03.905) 0:00:06.028 ********** 2026-04-03 07:40:50.254380 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-03 07:40:50.254392 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-03 07:40:50.254402 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-03 07:40:50.254413 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-03 07:40:50.254424 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-03 07:40:50.254434 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-03 07:40:50.254445 | orchestrator | 2026-04-03 07:40:50.254456 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-03 07:40:50.254467 | orchestrator | 2026-04-03 07:40:50.254478 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-03 07:40:50.254489 | orchestrator | Friday 03 April 2026 07:40:39 +0000 (0:00:04.150) 0:00:10.178 ********** 2026-04-03 07:40:50.254500 | orchestrator | included: /ansible/roles/ovn-controller/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:40:50.254512 | orchestrator | 2026-04-03 07:40:50.254523 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-03 07:40:50.254534 | orchestrator | Friday 03 April 2026 07:40:43 +0000 (0:00:03.834) 0:00:14.013 ********** 2026-04-03 07:40:50.254563 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254601 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254613 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254630 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254650 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254693 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254713 | orchestrator | 2026-04-03 07:40:50.254730 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-03 07:40:50.254747 | orchestrator | Friday 03 April 2026 07:40:46 +0000 (0:00:03.136) 0:00:17.149 ********** 2026-04-03 07:40:50.254765 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254787 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254807 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254847 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254865 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254883 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254902 | orchestrator | 2026-04-03 07:40:50.254923 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-03 07:40:50.254941 | orchestrator | Friday 03 April 2026 07:40:49 +0000 (0:00:02.728) 0:00:19.878 ********** 2026-04-03 07:40:50.254954 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254965 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:50.254985 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418712 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418814 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418852 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418862 | orchestrator | 2026-04-03 07:40:59.418873 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-03 07:40:59.418895 | orchestrator | Friday 03 April 2026 07:40:51 +0000 (0:00:02.082) 0:00:21.961 ********** 2026-04-03 07:40:59.418904 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418913 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418922 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418930 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418939 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418965 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.418974 | orchestrator | 2026-04-03 07:40:59.418983 | orchestrator | TASK [service-check-containers : ovn_controller | Check containers] ************ 2026-04-03 07:40:59.418991 | orchestrator | Friday 03 April 2026 07:40:54 +0000 (0:00:03.100) 0:00:25.061 ********** 2026-04-03 07:40:59.419001 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419017 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419027 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419036 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419045 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419054 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:40:59.419062 | orchestrator | 2026-04-03 07:40:59.419071 | orchestrator | TASK [service-check-containers : ovn_controller | Notify handlers to restart containers] *** 2026-04-03 07:40:59.419081 | orchestrator | Friday 03 April 2026 07:40:57 +0000 (0:00:02.693) 0:00:27.755 ********** 2026-04-03 07:40:59.419089 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:40:59.419099 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419108 | orchestrator | } 2026-04-03 07:40:59.419152 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:40:59.419162 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419170 | orchestrator | } 2026-04-03 07:40:59.419179 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:40:59.419187 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419195 | orchestrator | } 2026-04-03 07:40:59.419204 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 07:40:59.419212 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419220 | orchestrator | } 2026-04-03 07:40:59.419227 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 07:40:59.419234 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419241 | orchestrator | } 2026-04-03 07:40:59.419286 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 07:40:59.419296 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:40:59.419306 | orchestrator | } 2026-04-03 07:40:59.419322 | orchestrator | 2026-04-03 07:40:59.419332 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:40:59.419342 | orchestrator | Friday 03 April 2026 07:40:59 +0000 (0:00:01.849) 0:00:29.605 ********** 2026-04-03 07:40:59.419361 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441628 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:41:22.441718 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441733 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:41:22.441742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441751 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:41:22.441774 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441782 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:41:22.441791 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441799 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:41:22.441807 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:41:22.441815 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:41:22.441823 | orchestrator | 2026-04-03 07:41:22.441832 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-03 07:41:22.441841 | orchestrator | Friday 03 April 2026 07:41:02 +0000 (0:00:02.703) 0:00:32.309 ********** 2026-04-03 07:41:22.441849 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:41:22.441858 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:41:22.441866 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:41:22.441873 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:41:22.441881 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:41:22.441911 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:41:22.441919 | orchestrator | 2026-04-03 07:41:22.441927 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-03 07:41:22.441935 | orchestrator | Friday 03 April 2026 07:41:05 +0000 (0:00:03.699) 0:00:36.008 ********** 2026-04-03 07:41:22.441943 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-03 07:41:22.441952 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-03 07:41:22.441960 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-03 07:41:22.441967 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-03 07:41:22.441976 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-03 07:41:22.441983 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-03 07:41:22.441991 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.441999 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.442007 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.442066 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.442111 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.442133 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-03 07:41:22.442142 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442152 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442160 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442170 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442179 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442188 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-03 07:41:22.442198 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442207 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442221 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442231 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442240 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442249 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-03 07:41:22.442259 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442268 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442277 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442286 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442303 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442313 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-03 07:41:22.442322 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442332 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442341 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442350 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442359 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442368 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-03 07:41:22.442377 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 07:41:22.442387 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 07:41:22.442397 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 07:41:22.442407 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-03 07:41:22.442416 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 07:41:22.442425 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-03 07:41:22.442435 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-03 07:41:22.442447 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-03 07:41:22.442456 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-03 07:41:22.442466 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-03 07:41:22.442475 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-03 07:41:22.442489 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-03 07:44:15.128441 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 07:44:15.128561 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 07:44:15.128577 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-03 07:44:15.128589 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 07:44:15.128603 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 07:44:15.128614 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-03 07:44:15.128625 | orchestrator | 2026-04-03 07:44:15.128637 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128649 | orchestrator | Friday 03 April 2026 07:41:25 +0000 (0:00:20.110) 0:00:56.118 ********** 2026-04-03 07:44:15.128660 | orchestrator | 2026-04-03 07:44:15.128671 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128709 | orchestrator | Friday 03 April 2026 07:41:26 +0000 (0:00:00.470) 0:00:56.589 ********** 2026-04-03 07:44:15.128751 | orchestrator | 2026-04-03 07:44:15.128778 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128789 | orchestrator | Friday 03 April 2026 07:41:26 +0000 (0:00:00.420) 0:00:57.010 ********** 2026-04-03 07:44:15.128800 | orchestrator | 2026-04-03 07:44:15.128861 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128873 | orchestrator | Friday 03 April 2026 07:41:27 +0000 (0:00:00.601) 0:00:57.611 ********** 2026-04-03 07:44:15.128884 | orchestrator | 2026-04-03 07:44:15.128895 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128906 | orchestrator | Friday 03 April 2026 07:41:27 +0000 (0:00:00.453) 0:00:58.065 ********** 2026-04-03 07:44:15.128916 | orchestrator | 2026-04-03 07:44:15.128927 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-03 07:44:15.128938 | orchestrator | Friday 03 April 2026 07:41:28 +0000 (0:00:00.453) 0:00:58.518 ********** 2026-04-03 07:44:15.128949 | orchestrator | 2026-04-03 07:44:15.128959 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-03 07:44:15.128970 | orchestrator | Friday 03 April 2026 07:41:29 +0000 (0:00:00.798) 0:00:59.317 ********** 2026-04-03 07:44:15.128981 | orchestrator | 2026-04-03 07:44:15.128994 | orchestrator | STILL ALIVE [task 'ovn-controller : Restart ovn-controller container' is running] *** 2026-04-03 07:44:15.129008 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:44:15.129021 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:44:15.129033 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:44:15.129046 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:44:15.129059 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:44:15.129071 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:44:15.129083 | orchestrator | 2026-04-03 07:44:15.129096 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-03 07:44:15.129109 | orchestrator | 2026-04-03 07:44:15.129121 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 07:44:15.129133 | orchestrator | Friday 03 April 2026 07:43:41 +0000 (0:02:11.968) 0:03:11.286 ********** 2026-04-03 07:44:15.129146 | orchestrator | included: /ansible/roles/ovn-db/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:44:15.129159 | orchestrator | 2026-04-03 07:44:15.129172 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 07:44:15.129185 | orchestrator | Friday 03 April 2026 07:43:42 +0000 (0:00:01.676) 0:03:12.962 ********** 2026-04-03 07:44:15.129198 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 07:44:15.129211 | orchestrator | 2026-04-03 07:44:15.129223 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-03 07:44:15.129235 | orchestrator | Friday 03 April 2026 07:43:44 +0000 (0:00:01.873) 0:03:14.835 ********** 2026-04-03 07:44:15.129248 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129262 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129274 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129287 | orchestrator | 2026-04-03 07:44:15.129299 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-03 07:44:15.129312 | orchestrator | Friday 03 April 2026 07:43:46 +0000 (0:00:01.934) 0:03:16.769 ********** 2026-04-03 07:44:15.129324 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129337 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129350 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129363 | orchestrator | 2026-04-03 07:44:15.129375 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-03 07:44:15.129387 | orchestrator | Friday 03 April 2026 07:43:48 +0000 (0:00:01.661) 0:03:18.430 ********** 2026-04-03 07:44:15.129400 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129419 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129430 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129441 | orchestrator | 2026-04-03 07:44:15.129452 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-03 07:44:15.129463 | orchestrator | Friday 03 April 2026 07:43:49 +0000 (0:00:01.423) 0:03:19.853 ********** 2026-04-03 07:44:15.129474 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129485 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129495 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129506 | orchestrator | 2026-04-03 07:44:15.129517 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-03 07:44:15.129528 | orchestrator | Friday 03 April 2026 07:43:50 +0000 (0:00:01.407) 0:03:21.261 ********** 2026-04-03 07:44:15.129539 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129568 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129579 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129590 | orchestrator | 2026-04-03 07:44:15.129601 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-03 07:44:15.129612 | orchestrator | Friday 03 April 2026 07:43:52 +0000 (0:00:01.373) 0:03:22.634 ********** 2026-04-03 07:44:15.129623 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:44:15.129634 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:44:15.129644 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:44:15.129655 | orchestrator | 2026-04-03 07:44:15.129666 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-03 07:44:15.129677 | orchestrator | Friday 03 April 2026 07:43:53 +0000 (0:00:01.525) 0:03:24.160 ********** 2026-04-03 07:44:15.129687 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129698 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129709 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129720 | orchestrator | 2026-04-03 07:44:15.129731 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-03 07:44:15.129741 | orchestrator | Friday 03 April 2026 07:43:55 +0000 (0:00:01.828) 0:03:25.989 ********** 2026-04-03 07:44:15.129752 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129763 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129773 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129784 | orchestrator | 2026-04-03 07:44:15.129795 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-03 07:44:15.129806 | orchestrator | Friday 03 April 2026 07:43:57 +0000 (0:00:01.342) 0:03:27.332 ********** 2026-04-03 07:44:15.129833 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129844 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129854 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129865 | orchestrator | 2026-04-03 07:44:15.129882 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-03 07:44:15.129893 | orchestrator | Friday 03 April 2026 07:43:58 +0000 (0:00:01.778) 0:03:29.111 ********** 2026-04-03 07:44:15.129904 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.129914 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.129925 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.129936 | orchestrator | 2026-04-03 07:44:15.129946 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-03 07:44:15.129957 | orchestrator | Friday 03 April 2026 07:44:00 +0000 (0:00:01.687) 0:03:30.799 ********** 2026-04-03 07:44:15.129968 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:44:15.129979 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:44:15.129990 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:44:15.130000 | orchestrator | 2026-04-03 07:44:15.130011 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-03 07:44:15.130086 | orchestrator | Friday 03 April 2026 07:44:02 +0000 (0:00:01.515) 0:03:32.314 ********** 2026-04-03 07:44:15.130097 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:44:15.130108 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:44:15.130118 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:44:15.130129 | orchestrator | 2026-04-03 07:44:15.130148 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-03 07:44:15.130170 | orchestrator | Friday 03 April 2026 07:44:03 +0000 (0:00:01.321) 0:03:33.636 ********** 2026-04-03 07:44:15.130180 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.130191 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.130201 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.130212 | orchestrator | 2026-04-03 07:44:15.130223 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-03 07:44:15.130233 | orchestrator | Friday 03 April 2026 07:44:05 +0000 (0:00:02.010) 0:03:35.647 ********** 2026-04-03 07:44:15.130244 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.130254 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.130265 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.130275 | orchestrator | 2026-04-03 07:44:15.130286 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-03 07:44:15.130297 | orchestrator | Friday 03 April 2026 07:44:06 +0000 (0:00:01.457) 0:03:37.104 ********** 2026-04-03 07:44:15.130307 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.130318 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.130328 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.130338 | orchestrator | 2026-04-03 07:44:15.130349 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-03 07:44:15.130359 | orchestrator | Friday 03 April 2026 07:44:08 +0000 (0:00:01.799) 0:03:38.904 ********** 2026-04-03 07:44:15.130370 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:44:15.130381 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:44:15.130391 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:44:15.130401 | orchestrator | 2026-04-03 07:44:15.130412 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-03 07:44:15.130423 | orchestrator | Friday 03 April 2026 07:44:09 +0000 (0:00:01.360) 0:03:40.265 ********** 2026-04-03 07:44:15.130433 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:44:15.130444 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:44:15.130454 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:44:15.130465 | orchestrator | 2026-04-03 07:44:15.130475 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-03 07:44:15.130486 | orchestrator | Friday 03 April 2026 07:44:11 +0000 (0:00:01.591) 0:03:41.856 ********** 2026-04-03 07:44:15.130496 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:44:15.130507 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:44:15.130517 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:44:15.130528 | orchestrator | 2026-04-03 07:44:15.130539 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-03 07:44:15.130549 | orchestrator | Friday 03 April 2026 07:44:13 +0000 (0:00:01.693) 0:03:43.550 ********** 2026-04-03 07:44:15.130571 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360198 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360339 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360380 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360395 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360405 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360415 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360426 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:21.360455 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:21.360488 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360498 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:21.360508 | orchestrator | 2026-04-03 07:44:21.360521 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-03 07:44:21.360532 | orchestrator | Friday 03 April 2026 07:44:17 +0000 (0:00:03.993) 0:03:47.543 ********** 2026-04-03 07:44:21.360542 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360553 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360563 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360573 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:21.360590 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.895708 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.895911 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.895929 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:36.895940 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.895951 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.895960 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:36.895974 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:36.896036 | orchestrator | 2026-04-03 07:44:36.896051 | orchestrator | TASK [ovn-db : Ensure configuration for relays exists] ************************* 2026-04-03 07:44:36.896062 | orchestrator | Friday 03 April 2026 07:44:23 +0000 (0:00:06.328) 0:03:53.872 ********** 2026-04-03 07:44:36.896073 | orchestrator | included: /ansible/roles/ovn-db/tasks/config-relay.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=1) 2026-04-03 07:44:36.896084 | orchestrator | 2026-04-03 07:44:36.896094 | orchestrator | TASK [ovn-db : Ensuring config directories exist for OVN relay containers] ***** 2026-04-03 07:44:36.896103 | orchestrator | Friday 03 April 2026 07:44:25 +0000 (0:00:01.991) 0:03:55.863 ********** 2026-04-03 07:44:36.896113 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:44:36.896125 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:44:36.896152 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:44:36.896162 | orchestrator | 2026-04-03 07:44:36.896175 | orchestrator | TASK [ovn-db : Copying over config.json files for OVN relay services] ********** 2026-04-03 07:44:36.896186 | orchestrator | Friday 03 April 2026 07:44:27 +0000 (0:00:01.725) 0:03:57.589 ********** 2026-04-03 07:44:36.896197 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:44:36.896209 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:44:36.896220 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:44:36.896231 | orchestrator | 2026-04-03 07:44:36.896242 | orchestrator | TASK [ovn-db : Generate config files for OVN relay services] ******************* 2026-04-03 07:44:36.896253 | orchestrator | Friday 03 April 2026 07:44:30 +0000 (0:00:03.031) 0:04:00.621 ********** 2026-04-03 07:44:36.896271 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:44:36.896283 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:44:36.896293 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:44:36.896305 | orchestrator | 2026-04-03 07:44:36.896315 | orchestrator | TASK [service-check-containers : ovn_db | Check containers] ******************** 2026-04-03 07:44:36.896327 | orchestrator | Friday 03 April 2026 07:44:33 +0000 (0:00:02.704) 0:04:03.325 ********** 2026-04-03 07:44:36.896340 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896353 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896363 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896373 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896391 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896401 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:36.896423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:41.758525 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:41.758665 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.758684 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.758696 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:44:41.758739 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.758753 | orchestrator | 2026-04-03 07:44:41.758767 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-03 07:44:41.758843 | orchestrator | Friday 03 April 2026 07:44:38 +0000 (0:00:05.132) 0:04:08.458 ********** 2026-04-03 07:44:41.758857 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:44:41.758869 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:44:41.758880 | orchestrator | } 2026-04-03 07:44:41.758892 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:44:41.758902 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:44:41.758913 | orchestrator | } 2026-04-03 07:44:41.758924 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:44:41.758934 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:44:41.758945 | orchestrator | } 2026-04-03 07:44:41.758956 | orchestrator | 2026-04-03 07:44:41.758968 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 07:44:41.758979 | orchestrator | Friday 03 April 2026 07:44:39 +0000 (0:00:01.395) 0:04:09.854 ********** 2026-04-03 07:44:41.758991 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759042 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759072 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759086 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759107 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759120 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759133 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759145 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 07:44:41.759172 | orchestrator | included: /ansible/roles/service-check-containers/tasks/iterated.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 07:46:39.421316 | orchestrator | 2026-04-03 07:46:39.421412 | orchestrator | TASK [service-check-containers : ovn_db | Check containers with iteration] ***** 2026-04-03 07:46:39.421423 | orchestrator | Friday 03 April 2026 07:44:43 +0000 (0:00:03.467) 0:04:13.321 ********** 2026-04-03 07:46:39.421431 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-03 07:46:39.421439 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-03 07:46:39.421446 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-03 07:46:39.421452 | orchestrator | 2026-04-03 07:46:39.421459 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-03 07:46:39.421466 | orchestrator | Friday 03 April 2026 07:45:08 +0000 (0:00:25.460) 0:04:38.782 ********** 2026-04-03 07:46:39.421492 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 07:46:39.421499 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:46:39.421506 | orchestrator | } 2026-04-03 07:46:39.421512 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 07:46:39.421518 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:46:39.421524 | orchestrator | } 2026-04-03 07:46:39.421531 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 07:46:39.421537 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 07:46:39.421543 | orchestrator | } 2026-04-03 07:46:39.421550 | orchestrator | 2026-04-03 07:46:39.421556 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 07:46:39.421562 | orchestrator | Friday 03 April 2026 07:45:09 +0000 (0:00:01.430) 0:04:40.213 ********** 2026-04-03 07:46:39.421568 | orchestrator | 2026-04-03 07:46:39.421574 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 07:46:39.421580 | orchestrator | Friday 03 April 2026 07:45:10 +0000 (0:00:00.444) 0:04:40.657 ********** 2026-04-03 07:46:39.421587 | orchestrator | 2026-04-03 07:46:39.421593 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-03 07:46:39.421599 | orchestrator | Friday 03 April 2026 07:45:10 +0000 (0:00:00.424) 0:04:41.082 ********** 2026-04-03 07:46:39.421605 | orchestrator | 2026-04-03 07:46:39.421652 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-03 07:46:39.421658 | orchestrator | Friday 03 April 2026 07:45:11 +0000 (0:00:00.827) 0:04:41.909 ********** 2026-04-03 07:46:39.421665 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:46:39.421671 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:46:39.421677 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:46:39.421683 | orchestrator | 2026-04-03 07:46:39.421689 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-03 07:46:39.421695 | orchestrator | Friday 03 April 2026 07:45:28 +0000 (0:00:16.917) 0:04:58.827 ********** 2026-04-03 07:46:39.421701 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:46:39.421707 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:46:39.421713 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:46:39.421719 | orchestrator | 2026-04-03 07:46:39.421725 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db-relay container] ******************* 2026-04-03 07:46:39.421732 | orchestrator | Friday 03 April 2026 07:45:45 +0000 (0:00:17.157) 0:05:15.984 ********** 2026-04-03 07:46:39.421738 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-03 07:46:39.421744 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-03 07:46:39.421750 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-03 07:46:39.421756 | orchestrator | 2026-04-03 07:46:39.421762 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-03 07:46:39.421769 | orchestrator | Friday 03 April 2026 07:46:02 +0000 (0:00:16.342) 0:05:32.327 ********** 2026-04-03 07:46:39.421775 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:46:39.421781 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:46:39.421787 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:46:39.421793 | orchestrator | 2026-04-03 07:46:39.421800 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-03 07:46:39.421806 | orchestrator | Friday 03 April 2026 07:46:18 +0000 (0:00:16.917) 0:05:49.244 ********** 2026-04-03 07:46:39.421812 | orchestrator | Pausing for 5 seconds 2026-04-03 07:46:39.421818 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:46:39.421825 | orchestrator | 2026-04-03 07:46:39.421831 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-03 07:46:39.421837 | orchestrator | Friday 03 April 2026 07:46:25 +0000 (0:00:06.194) 0:05:55.439 ********** 2026-04-03 07:46:39.421843 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:46:39.421849 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:46:39.421855 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:46:39.421862 | orchestrator | 2026-04-03 07:46:39.421870 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-03 07:46:39.421894 | orchestrator | Friday 03 April 2026 07:46:26 +0000 (0:00:01.824) 0:05:57.264 ********** 2026-04-03 07:46:39.421901 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:46:39.421908 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:46:39.421915 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:46:39.421923 | orchestrator | 2026-04-03 07:46:39.421930 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-03 07:46:39.421946 | orchestrator | Friday 03 April 2026 07:46:28 +0000 (0:00:01.584) 0:05:58.849 ********** 2026-04-03 07:46:39.421954 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:46:39.421961 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:46:39.421968 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:46:39.421975 | orchestrator | 2026-04-03 07:46:39.421982 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-03 07:46:39.421989 | orchestrator | Friday 03 April 2026 07:46:30 +0000 (0:00:01.995) 0:06:00.844 ********** 2026-04-03 07:46:39.421996 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:46:39.422055 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:46:39.422064 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:46:39.422071 | orchestrator | 2026-04-03 07:46:39.422078 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-03 07:46:39.422085 | orchestrator | Friday 03 April 2026 07:46:32 +0000 (0:00:01.684) 0:06:02.529 ********** 2026-04-03 07:46:39.422093 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:46:39.422100 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:46:39.422107 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:46:39.422113 | orchestrator | 2026-04-03 07:46:39.422120 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-03 07:46:39.422141 | orchestrator | Friday 03 April 2026 07:46:34 +0000 (0:00:02.075) 0:06:04.605 ********** 2026-04-03 07:46:39.422149 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:46:39.422156 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:46:39.422163 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:46:39.422170 | orchestrator | 2026-04-03 07:46:39.422177 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db-relay] *************************************** 2026-04-03 07:46:39.422184 | orchestrator | Friday 03 April 2026 07:46:36 +0000 (0:00:02.073) 0:06:06.678 ********** 2026-04-03 07:46:39.422191 | orchestrator | ok: [testbed-node-0] => (item=1) 2026-04-03 07:46:39.422198 | orchestrator | ok: [testbed-node-1] => (item=1) 2026-04-03 07:46:39.422205 | orchestrator | ok: [testbed-node-2] => (item=1) 2026-04-03 07:46:39.422212 | orchestrator | 2026-04-03 07:46:39.422219 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 07:46:39.422227 | orchestrator | testbed-node-0 : ok=50  changed=17  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 07:46:39.422236 | orchestrator | testbed-node-1 : ok=47  changed=15  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-03 07:46:39.422243 | orchestrator | testbed-node-2 : ok=47  changed=15  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-03 07:46:39.422251 | orchestrator | testbed-node-3 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:46:39.422259 | orchestrator | testbed-node-4 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:46:39.422266 | orchestrator | testbed-node-5 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 07:46:39.422273 | orchestrator | 2026-04-03 07:46:39.422280 | orchestrator | 2026-04-03 07:46:39.422287 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 07:46:39.422293 | orchestrator | Friday 03 April 2026 07:46:38 +0000 (0:00:02.550) 0:06:09.229 ********** 2026-04-03 07:46:39.422304 | orchestrator | =============================================================================== 2026-04-03 07:46:39.422310 | orchestrator | ovn-controller : Restart ovn-controller container --------------------- 131.97s 2026-04-03 07:46:39.422317 | orchestrator | service-check-containers : ovn_db | Check containers with iteration ---- 25.46s 2026-04-03 07:46:39.422323 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 20.11s 2026-04-03 07:46:39.422329 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 17.16s 2026-04-03 07:46:39.422335 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 16.92s 2026-04-03 07:46:39.422341 | orchestrator | ovn-db : Restart ovn-nb-db container ----------------------------------- 16.92s 2026-04-03 07:46:39.422347 | orchestrator | ovn-db : Restart ovn-sb-db-relay container ----------------------------- 16.34s 2026-04-03 07:46:39.422353 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 6.33s 2026-04-03 07:46:39.422359 | orchestrator | ovn-db : Wait for leader election --------------------------------------- 6.19s 2026-04-03 07:46:39.422365 | orchestrator | service-check-containers : ovn_db | Check containers -------------------- 5.13s 2026-04-03 07:46:39.422371 | orchestrator | Group hosts based on enabled services ----------------------------------- 4.15s 2026-04-03 07:46:39.422377 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 3.99s 2026-04-03 07:46:39.422383 | orchestrator | Group hosts based on Kolla action --------------------------------------- 3.91s 2026-04-03 07:46:39.422389 | orchestrator | ovn-controller : include_tasks ------------------------------------------ 3.84s 2026-04-03 07:46:39.422395 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 3.70s 2026-04-03 07:46:39.422401 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.47s 2026-04-03 07:46:39.422407 | orchestrator | ovn-controller : Flush handlers ----------------------------------------- 3.20s 2026-04-03 07:46:39.422413 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 3.14s 2026-04-03 07:46:39.422419 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 3.10s 2026-04-03 07:46:39.422425 | orchestrator | ovn-db : Copying over config.json files for OVN relay services ---------- 3.03s 2026-04-03 07:46:39.622984 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-03 07:46:39.623079 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 07:46:39.623096 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh 2026-04-03 07:46:39.633773 | orchestrator | + set -e 2026-04-03 07:46:39.633846 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 07:46:39.633860 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 07:46:39.633873 | orchestrator | ++ INTERACTIVE=false 2026-04-03 07:46:39.633883 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 07:46:39.633894 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 07:46:39.633924 | orchestrator | + osism apply ceph-rolling_update -e ireallymeanit=yes 2026-04-03 07:46:40.893904 | orchestrator | 2026-04-03 07:46:40 | INFO  | Prepare task for execution of ceph-rolling_update. 2026-04-03 07:46:40.956848 | orchestrator | 2026-04-03 07:46:40 | INFO  | Task 3660bc14-ffb5-46b4-b860-9904a0714abb (ceph-rolling_update) was prepared for execution. 2026-04-03 07:46:40.956930 | orchestrator | 2026-04-03 07:46:40 | INFO  | It takes a moment until task 3660bc14-ffb5-46b4-b860-9904a0714abb (ceph-rolling_update) has been started and output is visible here. 2026-04-03 07:48:08.957273 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-03 07:48:08.957391 | orchestrator | 2.16.14 2026-04-03 07:48:08.957409 | orchestrator | 2026-04-03 07:48:08.957423 | orchestrator | PLAY [Confirm whether user really meant to upgrade the cluster] **************** 2026-04-03 07:48:08.957436 | orchestrator | 2026-04-03 07:48:08.957447 | orchestrator | TASK [Exit playbook, if user did not mean to upgrade cluster] ****************** 2026-04-03 07:48:08.957459 | orchestrator | Friday 03 April 2026 07:46:48 +0000 (0:00:01.815) 0:00:01.815 ********** 2026-04-03 07:48:08.957470 | orchestrator | skipping: [localhost] 2026-04-03 07:48:08.957569 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: rbdmirrors 2026-04-03 07:48:08.957585 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: nfss 2026-04-03 07:48:08.957596 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: clients 2026-04-03 07:48:08.957607 | orchestrator | 2026-04-03 07:48:08.957618 | orchestrator | PLAY [Gather facts and check the init system] ********************************** 2026-04-03 07:48:08.957628 | orchestrator | 2026-04-03 07:48:08.957639 | orchestrator | TASK [Gather facts on all Ceph hosts for following reference] ****************** 2026-04-03 07:48:08.957650 | orchestrator | Friday 03 April 2026 07:46:51 +0000 (0:00:02.145) 0:00:03.960 ********** 2026-04-03 07:48:08.957661 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 07:48:08.957672 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957683 | orchestrator | } 2026-04-03 07:48:08.957694 | orchestrator | ok: [testbed-node-1] => { 2026-04-03 07:48:08.957705 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957716 | orchestrator | } 2026-04-03 07:48:08.957726 | orchestrator | ok: [testbed-node-2] => { 2026-04-03 07:48:08.957737 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957748 | orchestrator | } 2026-04-03 07:48:08.957758 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 07:48:08.957769 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957780 | orchestrator | } 2026-04-03 07:48:08.957794 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 07:48:08.957806 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957819 | orchestrator | } 2026-04-03 07:48:08.957831 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 07:48:08.957846 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957858 | orchestrator | } 2026-04-03 07:48:08.957870 | orchestrator | ok: [testbed-manager] => { 2026-04-03 07:48:08.957883 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-03 07:48:08.957896 | orchestrator | } 2026-04-03 07:48:08.957909 | orchestrator | 2026-04-03 07:48:08.957921 | orchestrator | TASK [Gather facts] ************************************************************ 2026-04-03 07:48:08.957935 | orchestrator | Friday 03 April 2026 07:46:57 +0000 (0:00:06.304) 0:00:10.265 ********** 2026-04-03 07:48:08.957948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:08.957961 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:08.957975 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:08.957987 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:08.958000 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:08.958013 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:08.958086 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958099 | orchestrator | 2026-04-03 07:48:08.958112 | orchestrator | TASK [Gather and delegate facts] *********************************************** 2026-04-03 07:48:08.958125 | orchestrator | Friday 03 April 2026 07:47:03 +0000 (0:00:06.215) 0:00:16.480 ********** 2026-04-03 07:48:08.958138 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:48:08.958151 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:48:08.958172 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:48:08.958183 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:48:08.958194 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:48:08.958205 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:48:08.958216 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:48:08.958227 | orchestrator | 2026-04-03 07:48:08.958238 | orchestrator | TASK [Set_fact rolling_update] ************************************************* 2026-04-03 07:48:08.958259 | orchestrator | Friday 03 April 2026 07:47:37 +0000 (0:00:33.521) 0:00:50.002 ********** 2026-04-03 07:48:08.958270 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958281 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.958291 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.958302 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.958313 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.958323 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.958334 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958344 | orchestrator | 2026-04-03 07:48:08.958355 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 07:48:08.958366 | orchestrator | Friday 03 April 2026 07:47:39 +0000 (0:00:02.109) 0:00:52.111 ********** 2026-04-03 07:48:08.958391 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-03 07:48:08.958406 | orchestrator | 2026-04-03 07:48:08.958417 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 07:48:08.958428 | orchestrator | Friday 03 April 2026 07:47:41 +0000 (0:00:02.728) 0:00:54.839 ********** 2026-04-03 07:48:08.958439 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.958450 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958460 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.958471 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.958481 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.958567 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.958581 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958591 | orchestrator | 2026-04-03 07:48:08.958623 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 07:48:08.958635 | orchestrator | Friday 03 April 2026 07:47:44 +0000 (0:00:02.810) 0:00:57.650 ********** 2026-04-03 07:48:08.958646 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958657 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.958668 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.958678 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.958689 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.958700 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.958711 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958722 | orchestrator | 2026-04-03 07:48:08.958733 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 07:48:08.958743 | orchestrator | Friday 03 April 2026 07:47:46 +0000 (0:00:02.054) 0:00:59.705 ********** 2026-04-03 07:48:08.958754 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958765 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.958776 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.958787 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.958797 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.958808 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.958819 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958830 | orchestrator | 2026-04-03 07:48:08.958841 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 07:48:08.958852 | orchestrator | Friday 03 April 2026 07:47:49 +0000 (0:00:02.600) 0:01:02.306 ********** 2026-04-03 07:48:08.958862 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958873 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.958884 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.958895 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.958906 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.958917 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.958927 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.958938 | orchestrator | 2026-04-03 07:48:08.958949 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 07:48:08.958960 | orchestrator | Friday 03 April 2026 07:47:51 +0000 (0:00:02.316) 0:01:04.622 ********** 2026-04-03 07:48:08.958971 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.958982 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.959002 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.959012 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.959023 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.959034 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.959044 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.959055 | orchestrator | 2026-04-03 07:48:08.959066 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 07:48:08.959077 | orchestrator | Friday 03 April 2026 07:47:53 +0000 (0:00:02.224) 0:01:06.846 ********** 2026-04-03 07:48:08.959088 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.959098 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.959109 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.959119 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.959130 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.959140 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.959151 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.959162 | orchestrator | 2026-04-03 07:48:08.959173 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 07:48:08.959184 | orchestrator | Friday 03 April 2026 07:47:56 +0000 (0:00:02.470) 0:01:09.317 ********** 2026-04-03 07:48:08.959194 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:08.959205 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:08.959216 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:08.959227 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:08.959238 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:08.959248 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:08.959259 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:08.959269 | orchestrator | 2026-04-03 07:48:08.959280 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 07:48:08.959291 | orchestrator | Friday 03 April 2026 07:47:59 +0000 (0:00:02.557) 0:01:11.874 ********** 2026-04-03 07:48:08.959302 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.959312 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.959323 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.959334 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.959344 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.959355 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.959366 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.959376 | orchestrator | 2026-04-03 07:48:08.959387 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 07:48:08.959398 | orchestrator | Friday 03 April 2026 07:48:01 +0000 (0:00:02.426) 0:01:14.302 ********** 2026-04-03 07:48:08.959409 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:48:08.959420 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:48:08.959431 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:48:08.959441 | orchestrator | 2026-04-03 07:48:08.959452 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 07:48:08.959463 | orchestrator | Friday 03 April 2026 07:48:03 +0000 (0:00:02.028) 0:01:16.330 ********** 2026-04-03 07:48:08.959474 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:08.959485 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:08.959533 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:08.959547 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:08.959566 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:08.959585 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:08.959603 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:08.959623 | orchestrator | 2026-04-03 07:48:08.959641 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 07:48:08.959668 | orchestrator | Friday 03 April 2026 07:48:05 +0000 (0:00:02.107) 0:01:18.438 ********** 2026-04-03 07:48:08.959688 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:48:08.959707 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:48:08.959742 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:48:08.959763 | orchestrator | 2026-04-03 07:48:08.959783 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 07:48:08.959802 | orchestrator | Friday 03 April 2026 07:48:08 +0000 (0:00:03.230) 0:01:21.668 ********** 2026-04-03 07:48:08.959833 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:48:31.812323 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:48:31.812438 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:48:31.812453 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.812517 | orchestrator | 2026-04-03 07:48:31.812531 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 07:48:31.812544 | orchestrator | Friday 03 April 2026 07:48:10 +0000 (0:00:01.440) 0:01:23.109 ********** 2026-04-03 07:48:31.812557 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812571 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812582 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812593 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.812604 | orchestrator | 2026-04-03 07:48:31.812615 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 07:48:31.812626 | orchestrator | Friday 03 April 2026 07:48:12 +0000 (0:00:01.905) 0:01:25.014 ********** 2026-04-03 07:48:31.812639 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812653 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812664 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:31.812675 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.812686 | orchestrator | 2026-04-03 07:48:31.812697 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 07:48:31.812708 | orchestrator | Friday 03 April 2026 07:48:13 +0000 (0:00:01.159) 0:01:26.174 ********** 2026-04-03 07:48:31.812721 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '190174266bca', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 07:48:06.290971', 'end': '2026-04-03 07:48:06.333714', 'delta': '0:00:00.042743', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['190174266bca'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 07:48:31.812797 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'a19b2cd80470', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 07:48:06.825417', 'end': '2026-04-03 07:48:06.880046', 'delta': '0:00:00.054629', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a19b2cd80470'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 07:48:31.812812 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '998d77407386', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 07:48:07.622553', 'end': '2026-04-03 07:48:07.672027', 'delta': '0:00:00.049474', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['998d77407386'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 07:48:31.812823 | orchestrator | 2026-04-03 07:48:31.812835 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 07:48:31.812846 | orchestrator | Friday 03 April 2026 07:48:14 +0000 (0:00:01.179) 0:01:27.354 ********** 2026-04-03 07:48:31.812859 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:31.812873 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:31.812886 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:31.812899 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:31.812912 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:31.812925 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:31.812938 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:31.812950 | orchestrator | 2026-04-03 07:48:31.812963 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 07:48:31.812975 | orchestrator | Friday 03 April 2026 07:48:16 +0000 (0:00:02.493) 0:01:29.847 ********** 2026-04-03 07:48:31.812988 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.813000 | orchestrator | 2026-04-03 07:48:31.813013 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 07:48:31.813026 | orchestrator | Friday 03 April 2026 07:48:18 +0000 (0:00:01.283) 0:01:31.130 ********** 2026-04-03 07:48:31.813038 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:31.813050 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:31.813062 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:31.813074 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:31.813087 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:31.813097 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:31.813108 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:31.813119 | orchestrator | 2026-04-03 07:48:31.813130 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 07:48:31.813140 | orchestrator | Friday 03 April 2026 07:48:20 +0000 (0:00:02.197) 0:01:33.328 ********** 2026-04-03 07:48:31.813151 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:31.813162 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813182 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813192 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813203 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813214 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813225 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:48:31.813235 | orchestrator | 2026-04-03 07:48:31.813247 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:48:31.813258 | orchestrator | Friday 03 April 2026 07:48:23 +0000 (0:00:03.231) 0:01:36.560 ********** 2026-04-03 07:48:31.813268 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:31.813279 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:31.813290 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:31.813301 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:31.813312 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:31.813323 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:31.813334 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:31.813345 | orchestrator | 2026-04-03 07:48:31.813355 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 07:48:31.813366 | orchestrator | Friday 03 April 2026 07:48:25 +0000 (0:00:02.214) 0:01:38.775 ********** 2026-04-03 07:48:31.813377 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.813388 | orchestrator | 2026-04-03 07:48:31.813398 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 07:48:31.813409 | orchestrator | Friday 03 April 2026 07:48:27 +0000 (0:00:01.187) 0:01:39.962 ********** 2026-04-03 07:48:31.813420 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.813431 | orchestrator | 2026-04-03 07:48:31.813442 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:48:31.813453 | orchestrator | Friday 03 April 2026 07:48:28 +0000 (0:00:01.229) 0:01:41.192 ********** 2026-04-03 07:48:31.813517 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.813529 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:31.813539 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:31.813556 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:31.813568 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:31.813578 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:31.813589 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:31.813600 | orchestrator | 2026-04-03 07:48:31.813611 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 07:48:31.813622 | orchestrator | Friday 03 April 2026 07:48:30 +0000 (0:00:02.545) 0:01:43.738 ********** 2026-04-03 07:48:31.813633 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:31.813643 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:31.813654 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:31.813665 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:31.813676 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:31.813687 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:31.813705 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758320 | orchestrator | 2026-04-03 07:48:43.758413 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 07:48:43.758427 | orchestrator | Friday 03 April 2026 07:48:32 +0000 (0:00:02.073) 0:01:45.811 ********** 2026-04-03 07:48:43.758437 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:43.758501 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:43.758521 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:43.758530 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:43.758539 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:43.758548 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:43.758557 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758565 | orchestrator | 2026-04-03 07:48:43.758575 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 07:48:43.758605 | orchestrator | Friday 03 April 2026 07:48:35 +0000 (0:00:02.192) 0:01:48.004 ********** 2026-04-03 07:48:43.758614 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:43.758623 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:43.758632 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:43.758640 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:43.758649 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:43.758657 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:43.758666 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758675 | orchestrator | 2026-04-03 07:48:43.758684 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 07:48:43.758692 | orchestrator | Friday 03 April 2026 07:48:37 +0000 (0:00:01.946) 0:01:49.951 ********** 2026-04-03 07:48:43.758701 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:43.758709 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:43.758718 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:43.758727 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:43.758735 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:43.758744 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:43.758752 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758761 | orchestrator | 2026-04-03 07:48:43.758769 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 07:48:43.758778 | orchestrator | Friday 03 April 2026 07:48:39 +0000 (0:00:02.211) 0:01:52.162 ********** 2026-04-03 07:48:43.758787 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:43.758796 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:43.758804 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:43.758813 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:43.758821 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:43.758830 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:43.758838 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758847 | orchestrator | 2026-04-03 07:48:43.758856 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 07:48:43.758865 | orchestrator | Friday 03 April 2026 07:48:41 +0000 (0:00:01.957) 0:01:54.120 ********** 2026-04-03 07:48:43.758874 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:43.758885 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:43.758895 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:43.758905 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:43.758915 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:43.758925 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:43.758935 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:43.758944 | orchestrator | 2026-04-03 07:48:43.758955 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 07:48:43.758965 | orchestrator | Friday 03 April 2026 07:48:43 +0000 (0:00:02.283) 0:01:56.403 ********** 2026-04-03 07:48:43.758978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.758991 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759014 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759049 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:43.759063 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759073 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759084 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759098 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:43.759121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:43.759142 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038065 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038143 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038153 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.038171 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038178 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038185 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038237 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.038247 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038254 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038262 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:44.038270 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038277 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038292 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.038299 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.038312 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276141 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276152 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:44.276166 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.276208 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276216 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276237 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276246 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}})  2026-04-03 07:48:44.276255 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.276264 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}})  2026-04-03 07:48:44.276278 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276289 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.276297 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.276305 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:44.276318 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445162 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445259 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445277 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}})  2026-04-03 07:48:44.445313 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}})  2026-04-03 07:48:44.445347 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445380 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.445395 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445418 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445430 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445506 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.445529 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}})  2026-04-03 07:48:44.445550 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.711353 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}})  2026-04-03 07:48:44.711519 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711598 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711614 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.711626 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711652 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711664 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:44.711677 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711723 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}})  2026-04-03 07:48:44.711751 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}})  2026-04-03 07:48:44.711782 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.711816 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.711850 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.834320 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835318 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835435 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835487 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}})  2026-04-03 07:48:44.835501 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.835527 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}})  2026-04-03 07:48:44.835540 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835573 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835585 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.835605 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835617 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835628 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.835646 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}})  2026-04-03 07:48:44.835658 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}})  2026-04-03 07:48:44.835676 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987704 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:44.987824 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987842 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:44.987870 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987884 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987896 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:44.987908 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987944 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987957 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987968 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-51-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:48:44.987979 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.987991 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.988002 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:44.988023 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b6a4aa0f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part16', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part14', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part15', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part1', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:48:46.587907 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:46.588012 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:48:46.588029 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:46.588042 | orchestrator | 2026-04-03 07:48:46.588055 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 07:48:46.588067 | orchestrator | Friday 03 April 2026 07:48:46 +0000 (0:00:02.616) 0:01:59.020 ********** 2026-04-03 07:48:46.588082 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588101 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588113 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588146 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588178 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588191 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588202 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588223 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.588252 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725386 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725535 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725569 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725581 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725616 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725628 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725658 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725670 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725692 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725712 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:46.725724 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136275 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:48:47.136370 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136401 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136411 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136499 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136513 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136521 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136546 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136564 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136580 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136588 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.136595 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:48:47.136609 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.340857 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.340990 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341008 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341024 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341038 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:48:47.341052 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341089 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341110 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341122 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341134 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341145 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.341164 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516710 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516809 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516820 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516828 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516851 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516869 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516877 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516884 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.516896 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570274 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570354 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570363 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570371 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570379 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570387 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570427 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570465 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570475 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570482 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570489 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.570502 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640682 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-51-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640750 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640757 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:48:47.640765 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640772 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640793 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640814 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640819 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640825 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.640846 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.670912 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671012 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671028 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671042 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671098 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b6a4aa0f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part16', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part14', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part15', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part1', 'scsi-SQEMU_QEMU_HARDDISK_b6a4aa0f-934c-4786-af69-31d7f429b32a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671136 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671148 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671160 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671180 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671198 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:47.671218 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.017977 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018230 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:48:52.018255 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:48:52.018270 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018284 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018323 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018376 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018391 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018427 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018483 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:48:52.018497 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:48:52.018510 | orchestrator | 2026-04-03 07:48:52.018526 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 07:48:52.018540 | orchestrator | Friday 03 April 2026 07:48:48 +0000 (0:00:02.762) 0:02:01.782 ********** 2026-04-03 07:48:52.018553 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:52.018566 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:52.018579 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:52.018592 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:48:52.018605 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:48:52.018617 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:48:52.018629 | orchestrator | ok: [testbed-manager] 2026-04-03 07:48:52.018642 | orchestrator | 2026-04-03 07:48:52.018655 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 07:48:52.018668 | orchestrator | Friday 03 April 2026 07:48:51 +0000 (0:00:02.639) 0:02:04.422 ********** 2026-04-03 07:48:52.018680 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:48:52.018693 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:48:52.018705 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:48:52.018726 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:49:22.961808 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:49:22.961920 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:49:22.961937 | orchestrator | ok: [testbed-manager] 2026-04-03 07:49:22.961950 | orchestrator | 2026-04-03 07:49:22.961963 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:49:22.961976 | orchestrator | Friday 03 April 2026 07:48:53 +0000 (0:00:01.911) 0:02:06.334 ********** 2026-04-03 07:49:22.961987 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:49:22.961998 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:49:22.962009 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:49:22.962073 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:49:22.962085 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:49:22.962097 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:49:22.962108 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:49:22.962119 | orchestrator | 2026-04-03 07:49:22.962130 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:49:22.962166 | orchestrator | Friday 03 April 2026 07:48:56 +0000 (0:00:02.641) 0:02:08.975 ********** 2026-04-03 07:49:22.962178 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:49:22.962189 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:49:22.962200 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:49:22.962210 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.962221 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.962232 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.962242 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:49:22.962253 | orchestrator | 2026-04-03 07:49:22.962264 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:49:22.962275 | orchestrator | Friday 03 April 2026 07:48:58 +0000 (0:00:02.146) 0:02:11.122 ********** 2026-04-03 07:49:22.962285 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:49:22.962296 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:49:22.962306 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:49:22.962317 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.962329 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.962341 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.962354 | orchestrator | ok: [testbed-manager -> testbed-node-2(192.168.16.12)] 2026-04-03 07:49:22.962367 | orchestrator | 2026-04-03 07:49:22.962381 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:49:22.962431 | orchestrator | Friday 03 April 2026 07:49:00 +0000 (0:00:02.733) 0:02:13.856 ********** 2026-04-03 07:49:22.962445 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:49:22.962458 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:49:22.962471 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:49:22.962483 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.962496 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.962508 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.962521 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:49:22.962533 | orchestrator | 2026-04-03 07:49:22.962547 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 07:49:22.962560 | orchestrator | Friday 03 April 2026 07:49:03 +0000 (0:00:02.097) 0:02:15.954 ********** 2026-04-03 07:49:22.962573 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:49:22.962586 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-03 07:49:22.962598 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 07:49:22.962611 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-03 07:49:22.962623 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:49:22.962635 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 07:49:22.962647 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 07:49:22.962659 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-03 07:49:22.962672 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-03 07:49:22.962685 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 07:49:22.962697 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 07:49:22.962708 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 07:49:22.962719 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 07:49:22.962729 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 07:49:22.962740 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 07:49:22.962750 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-03 07:49:22.962761 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 07:49:22.962772 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 07:49:22.962782 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-03 07:49:22.962793 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 07:49:22.962812 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-03 07:49:22.962823 | orchestrator | 2026-04-03 07:49:22.962849 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 07:49:22.962861 | orchestrator | Friday 03 April 2026 07:49:06 +0000 (0:00:03.257) 0:02:19.211 ********** 2026-04-03 07:49:22.962872 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:49:22.962883 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:49:22.962894 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:49:22.962904 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:49:22.962915 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 07:49:22.962926 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 07:49:22.962983 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 07:49:22.962995 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:49:22.963005 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 07:49:22.963016 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 07:49:22.963027 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 07:49:22.963037 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:49:22.963048 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 07:49:22.963076 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 07:49:22.963087 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 07:49:22.963098 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963109 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 07:49:22.963119 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 07:49:22.963130 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 07:49:22.963141 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 07:49:22.963151 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 07:49:22.963162 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 07:49:22.963173 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.963183 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.963194 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-03 07:49:22.963205 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-03 07:49:22.963216 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-03 07:49:22.963226 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:49:22.963237 | orchestrator | 2026-04-03 07:49:22.963248 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 07:49:22.963259 | orchestrator | Friday 03 April 2026 07:49:08 +0000 (0:00:01.941) 0:02:21.153 ********** 2026-04-03 07:49:22.963270 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:49:22.963280 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:49:22.963291 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:49:22.963302 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:49:22.963313 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:49:22.963326 | orchestrator | 2026-04-03 07:49:22.963345 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 07:49:22.963364 | orchestrator | Friday 03 April 2026 07:49:10 +0000 (0:00:02.010) 0:02:23.163 ********** 2026-04-03 07:49:22.963381 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963425 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.963444 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.963461 | orchestrator | 2026-04-03 07:49:22.963479 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 07:49:22.963506 | orchestrator | Friday 03 April 2026 07:49:11 +0000 (0:00:01.363) 0:02:24.527 ********** 2026-04-03 07:49:22.963523 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963542 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.963559 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.963577 | orchestrator | 2026-04-03 07:49:22.963595 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 07:49:22.963613 | orchestrator | Friday 03 April 2026 07:49:13 +0000 (0:00:01.363) 0:02:25.891 ********** 2026-04-03 07:49:22.963632 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963652 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:49:22.963669 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:49:22.963687 | orchestrator | 2026-04-03 07:49:22.963702 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 07:49:22.963713 | orchestrator | Friday 03 April 2026 07:49:14 +0000 (0:00:01.523) 0:02:27.415 ********** 2026-04-03 07:49:22.963724 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:49:22.963735 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:49:22.963745 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:49:22.963756 | orchestrator | 2026-04-03 07:49:22.963767 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 07:49:22.963778 | orchestrator | Friday 03 April 2026 07:49:16 +0000 (0:00:01.466) 0:02:28.881 ********** 2026-04-03 07:49:22.963788 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 07:49:22.963799 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 07:49:22.963810 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 07:49:22.963820 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963831 | orchestrator | 2026-04-03 07:49:22.963841 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 07:49:22.963852 | orchestrator | Friday 03 April 2026 07:49:17 +0000 (0:00:01.438) 0:02:30.320 ********** 2026-04-03 07:49:22.963863 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 07:49:22.963873 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 07:49:22.963884 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 07:49:22.963903 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963913 | orchestrator | 2026-04-03 07:49:22.963924 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 07:49:22.963935 | orchestrator | Friday 03 April 2026 07:49:19 +0000 (0:00:01.701) 0:02:32.021 ********** 2026-04-03 07:49:22.963946 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 07:49:22.963956 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 07:49:22.963967 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 07:49:22.963978 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:49:22.963988 | orchestrator | 2026-04-03 07:49:22.963999 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 07:49:22.964010 | orchestrator | Friday 03 April 2026 07:49:20 +0000 (0:00:01.757) 0:02:33.778 ********** 2026-04-03 07:49:22.964021 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:49:22.964031 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:49:22.964042 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:49:22.964052 | orchestrator | 2026-04-03 07:49:22.964063 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 07:49:22.964074 | orchestrator | Friday 03 April 2026 07:49:22 +0000 (0:00:01.662) 0:02:35.441 ********** 2026-04-03 07:49:22.964085 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 07:49:22.964105 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 07:50:17.602655 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 07:50:17.602764 | orchestrator | 2026-04-03 07:50:17.602786 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 07:50:17.602802 | orchestrator | Friday 03 April 2026 07:49:24 +0000 (0:00:01.550) 0:02:36.992 ********** 2026-04-03 07:50:17.602844 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:50:17.602861 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:50:17.602876 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:50:17.602891 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:50:17.602905 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:50:17.602920 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:50:17.602934 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:50:17.602949 | orchestrator | 2026-04-03 07:50:17.602964 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 07:50:17.602979 | orchestrator | Friday 03 April 2026 07:49:25 +0000 (0:00:01.846) 0:02:38.838 ********** 2026-04-03 07:50:17.602993 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:50:17.603007 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:50:17.603021 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:50:17.603036 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:50:17.603051 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:50:17.603065 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:50:17.603079 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:50:17.603092 | orchestrator | 2026-04-03 07:50:17.603107 | orchestrator | TASK [ceph-infra : Update cache for Debian based OSs] ************************** 2026-04-03 07:50:17.603121 | orchestrator | Friday 03 April 2026 07:49:28 +0000 (0:00:03.013) 0:02:41.852 ********** 2026-04-03 07:50:17.603136 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:50:17.603150 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:50:17.603164 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:50:17.603178 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:50:17.603192 | orchestrator | changed: [testbed-manager] 2026-04-03 07:50:17.603207 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:50:17.603222 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:50:17.603237 | orchestrator | 2026-04-03 07:50:17.603252 | orchestrator | TASK [ceph-infra : Include_tasks configure_firewall.yml] *********************** 2026-04-03 07:50:17.603267 | orchestrator | Friday 03 April 2026 07:49:45 +0000 (0:00:16.432) 0:02:58.285 ********** 2026-04-03 07:50:17.603281 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.603296 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.603310 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.603350 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.603365 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.603379 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.603393 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.603406 | orchestrator | 2026-04-03 07:50:17.603420 | orchestrator | TASK [ceph-infra : Include_tasks setup_ntp.yml] ******************************** 2026-04-03 07:50:17.603434 | orchestrator | Friday 03 April 2026 07:49:47 +0000 (0:00:02.081) 0:03:00.367 ********** 2026-04-03 07:50:17.603449 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.603462 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.603475 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.603488 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.603501 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.603515 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.603529 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.603542 | orchestrator | 2026-04-03 07:50:17.603556 | orchestrator | TASK [ceph-infra : Add logrotate configuration] ******************************** 2026-04-03 07:50:17.603579 | orchestrator | Friday 03 April 2026 07:49:49 +0000 (0:00:01.893) 0:03:02.260 ********** 2026-04-03 07:50:17.603592 | orchestrator | changed: [testbed-node-2] 2026-04-03 07:50:17.603605 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.603618 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:50:17.603631 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:50:17.603661 | orchestrator | changed: [testbed-node-3] 2026-04-03 07:50:17.603674 | orchestrator | changed: [testbed-node-4] 2026-04-03 07:50:17.603687 | orchestrator | changed: [testbed-node-5] 2026-04-03 07:50:17.603699 | orchestrator | 2026-04-03 07:50:17.603712 | orchestrator | TASK [ceph-validate : Include check_system.yml] ******************************** 2026-04-03 07:50:17.603726 | orchestrator | Friday 03 April 2026 07:49:52 +0000 (0:00:03.126) 0:03:05.387 ********** 2026-04-03 07:50:17.603741 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_system.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-03 07:50:17.603756 | orchestrator | 2026-04-03 07:50:17.603769 | orchestrator | TASK [ceph-validate : Fail on unsupported ansible version (1.X)] *************** 2026-04-03 07:50:17.603782 | orchestrator | Friday 03 April 2026 07:49:55 +0000 (0:00:03.006) 0:03:08.393 ********** 2026-04-03 07:50:17.603796 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.603808 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.603821 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.603835 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.603849 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.603862 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.603875 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.603888 | orchestrator | 2026-04-03 07:50:17.603922 | orchestrator | TASK [ceph-validate : Fail on unsupported system] ****************************** 2026-04-03 07:50:17.603937 | orchestrator | Friday 03 April 2026 07:49:57 +0000 (0:00:01.954) 0:03:10.347 ********** 2026-04-03 07:50:17.603951 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.603964 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.603977 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.603990 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604003 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604016 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604030 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604043 | orchestrator | 2026-04-03 07:50:17.604056 | orchestrator | TASK [ceph-validate : Fail on unsupported architecture] ************************ 2026-04-03 07:50:17.604069 | orchestrator | Friday 03 April 2026 07:49:59 +0000 (0:00:02.163) 0:03:12.511 ********** 2026-04-03 07:50:17.604082 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604095 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604107 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604120 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604134 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604148 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604161 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604175 | orchestrator | 2026-04-03 07:50:17.604183 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution] ************************ 2026-04-03 07:50:17.604192 | orchestrator | Friday 03 April 2026 07:50:02 +0000 (0:00:02.361) 0:03:14.873 ********** 2026-04-03 07:50:17.604199 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604207 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604215 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604222 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604230 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604238 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604245 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604253 | orchestrator | 2026-04-03 07:50:17.604261 | orchestrator | TASK [ceph-validate : Fail on unsupported CentOS release] ********************** 2026-04-03 07:50:17.604278 | orchestrator | Friday 03 April 2026 07:50:04 +0000 (0:00:02.225) 0:03:17.099 ********** 2026-04-03 07:50:17.604291 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604303 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604315 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604371 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604386 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604401 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604414 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604428 | orchestrator | 2026-04-03 07:50:17.604443 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution for ubuntu cloud archive] *** 2026-04-03 07:50:17.604456 | orchestrator | Friday 03 April 2026 07:50:06 +0000 (0:00:02.093) 0:03:19.192 ********** 2026-04-03 07:50:17.604468 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604482 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604494 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604507 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604521 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604534 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604547 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604561 | orchestrator | 2026-04-03 07:50:17.604575 | orchestrator | TASK [ceph-validate : Fail on unsupported SUSE/openSUSE distribution (only 15.x supported)] *** 2026-04-03 07:50:17.604587 | orchestrator | Friday 03 April 2026 07:50:08 +0000 (0:00:02.142) 0:03:21.335 ********** 2026-04-03 07:50:17.604601 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604614 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604628 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604641 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604655 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604667 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604680 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604694 | orchestrator | 2026-04-03 07:50:17.604706 | orchestrator | TASK [ceph-validate : Fail if systemd is not present] ************************** 2026-04-03 07:50:17.604719 | orchestrator | Friday 03 April 2026 07:50:10 +0000 (0:00:01.924) 0:03:23.259 ********** 2026-04-03 07:50:17.604732 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604745 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604758 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604771 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604784 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604798 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604811 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604824 | orchestrator | 2026-04-03 07:50:17.604837 | orchestrator | TASK [ceph-validate : Validate repository variables in non-containerized scenario] *** 2026-04-03 07:50:17.604851 | orchestrator | Friday 03 April 2026 07:50:12 +0000 (0:00:02.241) 0:03:25.500 ********** 2026-04-03 07:50:17.604870 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.604885 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.604899 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.604912 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.604925 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.604937 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.604951 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.604963 | orchestrator | 2026-04-03 07:50:17.604976 | orchestrator | TASK [ceph-validate : Validate osd_objectstore] ******************************** 2026-04-03 07:50:17.604989 | orchestrator | Friday 03 April 2026 07:50:15 +0000 (0:00:02.430) 0:03:27.930 ********** 2026-04-03 07:50:17.605003 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.605016 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.605029 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:17.605042 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:17.605055 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:17.605076 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:17.605090 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:17.605103 | orchestrator | 2026-04-03 07:50:17.605117 | orchestrator | TASK [ceph-validate : Validate radosgw network configuration] ****************** 2026-04-03 07:50:17.605129 | orchestrator | Friday 03 April 2026 07:50:17 +0000 (0:00:02.166) 0:03:30.098 ********** 2026-04-03 07:50:17.605143 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:17.605156 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:17.605178 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.947389 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.947498 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.947513 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.947524 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.947535 | orchestrator | 2026-04-03 07:50:43.947548 | orchestrator | TASK [ceph-validate : Validate lvm osd scenario] ******************************* 2026-04-03 07:50:43.947561 | orchestrator | Friday 03 April 2026 07:50:19 +0000 (0:00:02.279) 0:03:32.378 ********** 2026-04-03 07:50:43.947572 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.947583 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.947594 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.947605 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.947615 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.947626 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.947636 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.947647 | orchestrator | 2026-04-03 07:50:43.947658 | orchestrator | TASK [ceph-validate : Validate bluestore lvm osd scenario] ********************* 2026-04-03 07:50:43.947669 | orchestrator | Friday 03 April 2026 07:50:21 +0000 (0:00:02.348) 0:03:34.726 ********** 2026-04-03 07:50:43.947680 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.947691 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.947701 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.947713 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 07:50:43.947725 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 07:50:43.947736 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.947747 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 07:50:43.947758 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 07:50:43.947769 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.947780 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 07:50:43.947791 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 07:50:43.947801 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.947812 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.947823 | orchestrator | 2026-04-03 07:50:43.947833 | orchestrator | TASK [ceph-validate : Fail if local scenario is enabled on debian] ************* 2026-04-03 07:50:43.947844 | orchestrator | Friday 03 April 2026 07:50:24 +0000 (0:00:02.312) 0:03:37.038 ********** 2026-04-03 07:50:43.947855 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.947869 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.947881 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.947894 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.947908 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.947922 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.947960 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.947973 | orchestrator | 2026-04-03 07:50:43.947987 | orchestrator | TASK [ceph-validate : Fail if rhcs repository is enabled on debian] ************ 2026-04-03 07:50:43.947999 | orchestrator | Friday 03 April 2026 07:50:26 +0000 (0:00:02.405) 0:03:39.444 ********** 2026-04-03 07:50:43.948012 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948025 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948037 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948050 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948063 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948075 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948087 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948100 | orchestrator | 2026-04-03 07:50:43.948114 | orchestrator | TASK [ceph-validate : Check ceph_origin definition on SUSE/openSUSE Leap] ****** 2026-04-03 07:50:43.948127 | orchestrator | Friday 03 April 2026 07:50:28 +0000 (0:00:02.191) 0:03:41.636 ********** 2026-04-03 07:50:43.948139 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948152 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948164 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948192 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948205 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948219 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948230 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948241 | orchestrator | 2026-04-03 07:50:43.948252 | orchestrator | TASK [ceph-validate : Check ceph_repository definition on SUSE/openSUSE Leap] *** 2026-04-03 07:50:43.948263 | orchestrator | Friday 03 April 2026 07:50:31 +0000 (0:00:02.239) 0:03:43.875 ********** 2026-04-03 07:50:43.948274 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948285 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948317 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948329 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948340 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948351 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948362 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948372 | orchestrator | 2026-04-03 07:50:43.948383 | orchestrator | TASK [ceph-validate : Validate ntp daemon type] ******************************** 2026-04-03 07:50:43.948394 | orchestrator | Friday 03 April 2026 07:50:33 +0000 (0:00:02.611) 0:03:46.486 ********** 2026-04-03 07:50:43.948405 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948416 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948426 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948437 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948448 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948476 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948488 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948498 | orchestrator | 2026-04-03 07:50:43.948509 | orchestrator | TASK [ceph-validate : Abort if ntp_daemon_type is ntpd on Atomic] ************** 2026-04-03 07:50:43.948520 | orchestrator | Friday 03 April 2026 07:50:35 +0000 (0:00:02.308) 0:03:48.795 ********** 2026-04-03 07:50:43.948531 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948541 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948552 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948562 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948573 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948584 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948594 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948605 | orchestrator | 2026-04-03 07:50:43.948616 | orchestrator | TASK [ceph-validate : Include check_devices.yml] ******************************* 2026-04-03 07:50:43.948627 | orchestrator | Friday 03 April 2026 07:50:38 +0000 (0:00:02.128) 0:03:50.924 ********** 2026-04-03 07:50:43.948637 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:50:43.948648 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:50:43.948667 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:50:43.948678 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:50:43.948689 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_devices.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:50:43.948700 | orchestrator | 2026-04-03 07:50:43.948711 | orchestrator | TASK [ceph-validate : Set_fact root_device] ************************************ 2026-04-03 07:50:43.948721 | orchestrator | Friday 03 April 2026 07:50:40 +0000 (0:00:02.612) 0:03:53.536 ********** 2026-04-03 07:50:43.948732 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:50:43.948744 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:50:43.948755 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:50:43.948765 | orchestrator | 2026-04-03 07:50:43.948776 | orchestrator | TASK [ceph-validate : Resolve devices in lvm_volumes] ************************** 2026-04-03 07:50:43.948787 | orchestrator | Friday 03 April 2026 07:50:42 +0000 (0:00:01.446) 0:03:54.982 ********** 2026-04-03 07:50:43.948798 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 07:50:43.948809 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 07:50:43.948819 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948830 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 07:50:43.948841 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 07:50:43.948851 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.948862 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 07:50:43.948873 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 07:50:43.948884 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:43.948894 | orchestrator | 2026-04-03 07:50:43.948906 | orchestrator | TASK [ceph-validate : Set_fact lvm_volumes_data_devices] *********************** 2026-04-03 07:50:43.948917 | orchestrator | Friday 03 April 2026 07:50:43 +0000 (0:00:01.490) 0:03:56.473 ********** 2026-04-03 07:50:43.948929 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:43.948948 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:43.948959 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:43.948971 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:43.948982 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:43.948999 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:43.949019 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.422894 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.423040 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:53.423074 | orchestrator | 2026-04-03 07:50:53.423096 | orchestrator | TASK [ceph-validate : Fail if root_device is passed in lvm_volumes or devices] *** 2026-04-03 07:50:53.423109 | orchestrator | Friday 03 April 2026 07:50:45 +0000 (0:00:01.610) 0:03:58.083 ********** 2026-04-03 07:50:53.423121 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:53.423133 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:53.423144 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:53.423155 | orchestrator | 2026-04-03 07:50:53.423166 | orchestrator | TASK [ceph-validate : Get devices information] ********************************* 2026-04-03 07:50:53.423178 | orchestrator | Friday 03 April 2026 07:50:46 +0000 (0:00:01.373) 0:03:59.457 ********** 2026-04-03 07:50:53.423189 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:53.423200 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:53.423211 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:53.423221 | orchestrator | 2026-04-03 07:50:53.423233 | orchestrator | TASK [ceph-validate : Fail if one of the devices is not a device] ************** 2026-04-03 07:50:53.423244 | orchestrator | Friday 03 April 2026 07:50:47 +0000 (0:00:01.342) 0:04:00.800 ********** 2026-04-03 07:50:53.423254 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:53.423265 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:53.423276 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:53.423321 | orchestrator | 2026-04-03 07:50:53.423333 | orchestrator | TASK [ceph-validate : Fail when gpt header found on osd devices] *************** 2026-04-03 07:50:53.423345 | orchestrator | Friday 03 April 2026 07:50:49 +0000 (0:00:01.312) 0:04:02.113 ********** 2026-04-03 07:50:53.423356 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:53.423367 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:53.423378 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:53.423388 | orchestrator | 2026-04-03 07:50:53.423400 | orchestrator | TASK [ceph-validate : Check data logical volume] ******************************* 2026-04-03 07:50:53.423411 | orchestrator | Friday 03 April 2026 07:50:50 +0000 (0:00:01.408) 0:04:03.522 ********** 2026-04-03 07:50:53.423422 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}) 2026-04-03 07:50:53.423437 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}) 2026-04-03 07:50:53.423450 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}) 2026-04-03 07:50:53.423463 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}) 2026-04-03 07:50:53.423483 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}) 2026-04-03 07:50:53.423502 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}) 2026-04-03 07:50:53.423521 | orchestrator | 2026-04-03 07:50:53.423541 | orchestrator | TASK [ceph-validate : Fail if one of the data logical volume is not a device or doesn't exist] *** 2026-04-03 07:50:53.423590 | orchestrator | Friday 03 April 2026 07:50:53 +0000 (0:00:02.439) 0:04:05.961 ********** 2026-04-03 07:50:53.423627 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e/osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 953, 'dev': 6, 'nlink': 1, 'atime': 1775194913.2147248, 'mtime': 1775194913.2087247, 'ctime': 1775194913.2087247, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e/osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.423667 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb/osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 963, 'dev': 6, 'nlink': 1, 'atime': 1775194930.8209832, 'mtime': 1775194930.8149831, 'ctime': 1775194930.8149831, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb/osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.423683 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:53.423697 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-22674541-64cc-5df8-a9f8-30ff652f1dce/osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 955, 'dev': 6, 'nlink': 1, 'atime': 1775194913.141899, 'mtime': 1775194913.135899, 'ctime': 1775194913.135899, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-22674541-64cc-5df8-a9f8-30ff652f1dce/osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.423726 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-d44e23ea-2eda-5203-86ef-10b85847f309/osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 965, 'dev': 6, 'nlink': 1, 'atime': 1775194931.024163, 'mtime': 1775194931.0191631, 'ctime': 1775194931.0191631, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-d44e23ea-2eda-5203-86ef-10b85847f309/osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:53.423742 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:53.423766 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-0168ecd7-dd70-56c3-8572-150117512a85/osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 956, 'dev': 6, 'nlink': 1, 'atime': 1775194915.1820004, 'mtime': 1775194915.1780002, 'ctime': 1775194915.1780002, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-0168ecd7-dd70-56c3-8572-150117512a85/osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511485 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29/osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 966, 'dev': 6, 'nlink': 1, 'atime': 1775194933.2992685, 'mtime': 1775194933.2962685, 'ctime': 1775194933.2962685, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29/osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511578 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:59.511586 | orchestrator | 2026-04-03 07:50:59.511591 | orchestrator | TASK [ceph-validate : Check bluestore db logical volume] *********************** 2026-04-03 07:50:59.511596 | orchestrator | Friday 03 April 2026 07:50:54 +0000 (0:00:01.463) 0:04:07.425 ********** 2026-04-03 07:50:59.511612 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 07:50:59.511618 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 07:50:59.511622 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:59.511625 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 07:50:59.511629 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 07:50:59.511633 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:59.511637 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 07:50:59.511641 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 07:50:59.511644 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:59.511648 | orchestrator | 2026-04-03 07:50:59.511652 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore db logical volume is not a device or doesn't exist] *** 2026-04-03 07:50:59.511657 | orchestrator | Friday 03 April 2026 07:50:56 +0000 (0:00:01.497) 0:04:08.923 ********** 2026-04-03 07:50:59.511662 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511667 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511671 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:59.511675 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511688 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511693 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:59.511696 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511700 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511708 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:59.511712 | orchestrator | 2026-04-03 07:50:59.511715 | orchestrator | TASK [ceph-validate : Check bluestore wal logical volume] ********************** 2026-04-03 07:50:59.511719 | orchestrator | Friday 03 April 2026 07:50:57 +0000 (0:00:01.403) 0:04:10.326 ********** 2026-04-03 07:50:59.511723 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'})  2026-04-03 07:50:59.511727 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'})  2026-04-03 07:50:59.511730 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:59.511734 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'})  2026-04-03 07:50:59.511738 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'})  2026-04-03 07:50:59.511742 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:59.511748 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'})  2026-04-03 07:50:59.511752 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'})  2026-04-03 07:50:59.511756 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:50:59.511760 | orchestrator | 2026-04-03 07:50:59.511763 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore wal logical volume is not a device or doesn't exist] *** 2026-04-03 07:50:59.511767 | orchestrator | Friday 03 April 2026 07:50:59 +0000 (0:00:01.727) 0:04:12.054 ********** 2026-04-03 07:50:59.511771 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-6e05808f-fb53-52d6-a83f-27c91ff5177e', 'data_vg': 'ceph-6e05808f-fb53-52d6-a83f-27c91ff5177e'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511775 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-dc85739a-96e8-5e43-9ed8-b11ad01343fb', 'data_vg': 'ceph-dc85739a-96e8-5e43-9ed8-b11ad01343fb'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511779 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:50:59.511783 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-22674541-64cc-5df8-a9f8-30ff652f1dce', 'data_vg': 'ceph-22674541-64cc-5df8-a9f8-30ff652f1dce'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511787 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-d44e23ea-2eda-5203-86ef-10b85847f309', 'data_vg': 'ceph-d44e23ea-2eda-5203-86ef-10b85847f309'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511791 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:50:59.511794 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-0168ecd7-dd70-56c3-8572-150117512a85', 'data_vg': 'ceph-0168ecd7-dd70-56c3-8572-150117512a85'}, 'ansible_loop_var': 'item'})  2026-04-03 07:50:59.511804 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29', 'data_vg': 'ceph-7e0184c0-0e73-56db-b9bd-1c5b3e3cac29'}, 'ansible_loop_var': 'item'})  2026-04-03 07:51:10.605200 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:10.605308 | orchestrator | 2026-04-03 07:51:10.605317 | orchestrator | TASK [ceph-validate : Include check_eth_rgw.yml] ******************************* 2026-04-03 07:51:10.605322 | orchestrator | Friday 03 April 2026 07:51:00 +0000 (0:00:01.482) 0:04:13.536 ********** 2026-04-03 07:51:10.605327 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:10.605331 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:10.605335 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:10.605339 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:10.605343 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:10.605347 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:10.605351 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:10.605354 | orchestrator | 2026-04-03 07:51:10.605359 | orchestrator | TASK [ceph-validate : Include check_rgw_pools.yml] ***************************** 2026-04-03 07:51:10.605363 | orchestrator | Friday 03 April 2026 07:51:02 +0000 (0:00:02.009) 0:04:15.546 ********** 2026-04-03 07:51:10.605367 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:10.605370 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:10.605374 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:10.605378 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:10.605382 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_rgw_pools.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 07:51:10.605387 | orchestrator | 2026-04-03 07:51:10.605390 | orchestrator | TASK [ceph-validate : Fail if ec_profile is not set for ec pools] ************** 2026-04-03 07:51:10.605395 | orchestrator | Friday 03 April 2026 07:51:05 +0000 (0:00:02.776) 0:04:18.323 ********** 2026-04-03 07:51:10.605402 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605411 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605418 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605440 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605447 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605451 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:10.605458 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605464 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605470 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605476 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605482 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605489 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:10.605495 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605521 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605527 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605531 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605535 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605538 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:10.605542 | orchestrator | 2026-04-03 07:51:10.605546 | orchestrator | TASK [ceph-validate : Fail if ec_k is not set for ec pools] ******************** 2026-04-03 07:51:10.605550 | orchestrator | Friday 03 April 2026 07:51:06 +0000 (0:00:01.436) 0:04:19.760 ********** 2026-04-03 07:51:10.605554 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605558 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605561 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605565 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605580 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605584 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:10.605588 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605592 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605596 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605600 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605604 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605607 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:10.605611 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605615 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605619 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605623 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605626 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605630 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:10.605634 | orchestrator | 2026-04-03 07:51:10.605641 | orchestrator | TASK [ceph-validate : Fail if ec_m is not set for ec pools] ******************** 2026-04-03 07:51:10.605645 | orchestrator | Friday 03 April 2026 07:51:08 +0000 (0:00:01.817) 0:04:21.577 ********** 2026-04-03 07:51:10.605648 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605656 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605660 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605663 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605667 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605671 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:10.605675 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605679 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605683 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605686 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605690 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605694 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:10.605697 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605701 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605705 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605708 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605712 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 07:51:10.605716 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:10.605719 | orchestrator | 2026-04-03 07:51:10.605723 | orchestrator | TASK [ceph-validate : Include check_nfs.yml] *********************************** 2026-04-03 07:51:10.605727 | orchestrator | Friday 03 April 2026 07:51:10 +0000 (0:00:01.526) 0:04:23.104 ********** 2026-04-03 07:51:10.605731 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:10.605734 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:10.605741 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.050998 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051078 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051086 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051093 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051099 | orchestrator | 2026-04-03 07:51:26.051105 | orchestrator | TASK [ceph-validate : Include check_rbdmirror.yml] ***************************** 2026-04-03 07:51:26.051113 | orchestrator | Friday 03 April 2026 07:51:12 +0000 (0:00:01.852) 0:04:24.957 ********** 2026-04-03 07:51:26.051118 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051124 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051129 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051135 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051140 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051146 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051151 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051156 | orchestrator | 2026-04-03 07:51:26.051162 | orchestrator | TASK [ceph-validate : Fail if monitoring group doesn't exist] ****************** 2026-04-03 07:51:26.051184 | orchestrator | Friday 03 April 2026 07:51:14 +0000 (0:00:02.258) 0:04:27.215 ********** 2026-04-03 07:51:26.051190 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051195 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051201 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051206 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051211 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051217 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051222 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051227 | orchestrator | 2026-04-03 07:51:26.051233 | orchestrator | TASK [ceph-validate : Fail when monitoring doesn't contain at least one node.] *** 2026-04-03 07:51:26.051239 | orchestrator | Friday 03 April 2026 07:51:16 +0000 (0:00:02.463) 0:04:29.678 ********** 2026-04-03 07:51:26.051288 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051299 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051309 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051316 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051322 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051327 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051333 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051338 | orchestrator | 2026-04-03 07:51:26.051356 | orchestrator | TASK [ceph-validate : Fail when dashboard_admin_password and/or grafana_admin_password are not set] *** 2026-04-03 07:51:26.051362 | orchestrator | Friday 03 April 2026 07:51:18 +0000 (0:00:02.011) 0:04:31.690 ********** 2026-04-03 07:51:26.051368 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051373 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051379 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051384 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051389 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051394 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051400 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051405 | orchestrator | 2026-04-03 07:51:26.051411 | orchestrator | TASK [ceph-validate : Validate container registry credentials] ***************** 2026-04-03 07:51:26.051416 | orchestrator | Friday 03 April 2026 07:51:20 +0000 (0:00:02.108) 0:04:33.799 ********** 2026-04-03 07:51:26.051422 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051427 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051432 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051438 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051443 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051448 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051454 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051459 | orchestrator | 2026-04-03 07:51:26.051464 | orchestrator | TASK [ceph-validate : Validate container service and container package] ******** 2026-04-03 07:51:26.051470 | orchestrator | Friday 03 April 2026 07:51:22 +0000 (0:00:01.946) 0:04:35.746 ********** 2026-04-03 07:51:26.051475 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051481 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051486 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051491 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:26.051497 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:26.051502 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:26.051508 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:26.051513 | orchestrator | 2026-04-03 07:51:26.051519 | orchestrator | TASK [ceph-validate : Validate openstack_keys key format] ********************** 2026-04-03 07:51:26.051524 | orchestrator | Friday 03 April 2026 07:51:25 +0000 (0:00:02.284) 0:04:38.031 ********** 2026-04-03 07:51:26.051531 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:26.051538 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:26.051551 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:26.051558 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:26.051564 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:26.051571 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:26.051577 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:26.051594 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:26.051600 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:26.051606 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:26.051611 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:26.051617 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:26.051622 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:26.051628 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:26.051633 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:26.051642 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:26.051647 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:26.051653 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:26.051658 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:26.051664 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:26.051669 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:26.051675 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:26.051680 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:26.051689 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:26.051695 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:26.051700 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:26.051706 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:26.051711 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:26.051717 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:26.051722 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:26.051731 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304346 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304444 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:30.304459 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304472 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304481 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304490 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.304500 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:30.304509 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304517 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304541 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.304550 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304559 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304567 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304593 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304603 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:30.304611 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304620 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304628 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:30.304637 | orchestrator | 2026-04-03 07:51:30.304648 | orchestrator | TASK [ceph-validate : Validate clients keys key format] ************************ 2026-04-03 07:51:30.304658 | orchestrator | Friday 03 April 2026 07:51:27 +0000 (0:00:02.166) 0:04:40.198 ********** 2026-04-03 07:51:30.304667 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:30.304675 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:30.304684 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:30.304692 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:30.304700 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:30.304709 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:30.304717 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:30.304726 | orchestrator | 2026-04-03 07:51:30.304735 | orchestrator | TASK [ceph-validate : Validate openstack_keys caps] **************************** 2026-04-03 07:51:30.304744 | orchestrator | Friday 03 April 2026 07:51:29 +0000 (0:00:02.115) 0:04:42.314 ********** 2026-04-03 07:51:30.304753 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304761 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304770 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.304779 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304801 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304810 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304819 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:30.304828 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304836 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304845 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.304854 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304872 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304883 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304893 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:30.304903 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304913 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304924 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.304933 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.304943 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.304953 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.304963 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:30.304973 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.304983 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:30.304994 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:30.305004 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:30.305014 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:30.305024 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:30.305069 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:30.305079 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:30.305095 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:59.104046 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:59.104163 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:59.104266 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:59.104283 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:59.104295 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:59.104306 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:59.104317 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-03 07:51:59.104344 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-03 07:51:59.104356 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-03 07:51:59.104367 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-03 07:51:59.104378 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:59.104392 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:59.104403 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-03 07:51:59.104414 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:59.104425 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.104438 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:59.104449 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.104460 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-03 07:51:59.104471 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.104482 | orchestrator | 2026-04-03 07:51:59.104495 | orchestrator | TASK [ceph-validate : Validate clients keys caps] ****************************** 2026-04-03 07:51:59.104508 | orchestrator | Friday 03 April 2026 07:51:31 +0000 (0:00:02.293) 0:04:44.607 ********** 2026-04-03 07:51:59.104518 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.104529 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.104540 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.104551 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.104565 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.104578 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.104590 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.104603 | orchestrator | 2026-04-03 07:51:59.104616 | orchestrator | TASK [ceph-validate : Check virtual_ips is defined] **************************** 2026-04-03 07:51:59.104638 | orchestrator | Friday 03 April 2026 07:51:34 +0000 (0:00:02.336) 0:04:46.944 ********** 2026-04-03 07:51:59.104652 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.104665 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.104677 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.104689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.104702 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.104715 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.104727 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.104740 | orchestrator | 2026-04-03 07:51:59.104753 | orchestrator | TASK [ceph-validate : Validate virtual_ips length] ***************************** 2026-04-03 07:51:59.104784 | orchestrator | Friday 03 April 2026 07:51:36 +0000 (0:00:02.156) 0:04:49.100 ********** 2026-04-03 07:51:59.104798 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.104810 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.104823 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.104836 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.104848 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.104860 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.104873 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.104885 | orchestrator | 2026-04-03 07:51:59.104898 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-03 07:51:59.104911 | orchestrator | Friday 03 April 2026 07:51:38 +0000 (0:00:02.367) 0:04:51.468 ********** 2026-04-03 07:51:59.104923 | orchestrator | included: /ansible/roles/ceph-container-engine/tasks/pre_requisites/prerequisites.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-03 07:51:59.104936 | orchestrator | 2026-04-03 07:51:59.104947 | orchestrator | TASK [ceph-container-engine : Include specific variables] ********************** 2026-04-03 07:51:59.104957 | orchestrator | Friday 03 April 2026 07:51:41 +0000 (0:00:02.882) 0:04:54.350 ********** 2026-04-03 07:51:59.104968 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.104979 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.104990 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.105001 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.105017 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.105028 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.105039 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-03 07:51:59.105049 | orchestrator | 2026-04-03 07:51:59.105060 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override directory] **** 2026-04-03 07:51:59.105071 | orchestrator | Friday 03 April 2026 07:51:43 +0000 (0:00:02.144) 0:04:56.495 ********** 2026-04-03 07:51:59.105081 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.105092 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.105103 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.105113 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.105124 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.105135 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.105145 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.105156 | orchestrator | 2026-04-03 07:51:59.105168 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override file] ********* 2026-04-03 07:51:59.105179 | orchestrator | Friday 03 April 2026 07:51:46 +0000 (0:00:02.398) 0:04:58.894 ********** 2026-04-03 07:51:59.105190 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.105201 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.105237 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.105255 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.105266 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.105277 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.105288 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.105298 | orchestrator | 2026-04-03 07:51:59.105310 | orchestrator | TASK [ceph-container-engine : Remove docker proxy configuration] *************** 2026-04-03 07:51:59.105321 | orchestrator | Friday 03 April 2026 07:51:48 +0000 (0:00:01.972) 0:05:00.866 ********** 2026-04-03 07:51:59.105332 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:51:59.105343 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:51:59.105354 | orchestrator | ok: [testbed-node-2] 2026-04-03 07:51:59.105364 | orchestrator | ok: [testbed-node-3] 2026-04-03 07:51:59.105375 | orchestrator | ok: [testbed-node-4] 2026-04-03 07:51:59.105386 | orchestrator | ok: [testbed-node-5] 2026-04-03 07:51:59.105397 | orchestrator | ok: [testbed-manager] 2026-04-03 07:51:59.105408 | orchestrator | 2026-04-03 07:51:59.105419 | orchestrator | TASK [ceph-container-engine : Restart docker] ********************************** 2026-04-03 07:51:59.105430 | orchestrator | Friday 03 April 2026 07:51:50 +0000 (0:00:02.792) 0:05:03.658 ********** 2026-04-03 07:51:59.105441 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.105452 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.105463 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.105474 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.105485 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.105495 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.105506 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.105517 | orchestrator | 2026-04-03 07:51:59.105528 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-03 07:51:59.105539 | orchestrator | Friday 03 April 2026 07:51:53 +0000 (0:00:02.355) 0:05:06.014 ********** 2026-04-03 07:51:59.105550 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.105561 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:51:59.105572 | orchestrator | skipping: [testbed-node-2] 2026-04-03 07:51:59.105583 | orchestrator | skipping: [testbed-node-3] 2026-04-03 07:51:59.105593 | orchestrator | skipping: [testbed-node-4] 2026-04-03 07:51:59.105604 | orchestrator | skipping: [testbed-node-5] 2026-04-03 07:51:59.105615 | orchestrator | skipping: [testbed-manager] 2026-04-03 07:51:59.105626 | orchestrator | 2026-04-03 07:51:59.105637 | orchestrator | TASK [Get the ceph release being deployed] ************************************* 2026-04-03 07:51:59.105648 | orchestrator | Friday 03 April 2026 07:51:55 +0000 (0:00:02.493) 0:05:08.508 ********** 2026-04-03 07:51:59.105659 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:51:59.105670 | orchestrator | 2026-04-03 07:51:59.105681 | orchestrator | TASK [Check ceph release being deployed] *************************************** 2026-04-03 07:51:59.105691 | orchestrator | Friday 03 April 2026 07:51:58 +0000 (0:00:02.712) 0:05:11.221 ********** 2026-04-03 07:51:59.105702 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:51:59.105713 | orchestrator | 2026-04-03 07:51:59.105724 | orchestrator | PLAY [Ensure cluster config is applied] **************************************** 2026-04-03 07:51:59.105735 | orchestrator | 2026-04-03 07:51:59.105754 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 07:52:38.979725 | orchestrator | Friday 03 April 2026 07:51:59 +0000 (0:00:01.431) 0:05:12.653 ********** 2026-04-03 07:52:38.979841 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.979856 | orchestrator | 2026-04-03 07:52:38.979870 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 07:52:38.979882 | orchestrator | Friday 03 April 2026 07:52:01 +0000 (0:00:01.518) 0:05:14.171 ********** 2026-04-03 07:52:38.979892 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.979903 | orchestrator | 2026-04-03 07:52:38.979914 | orchestrator | TASK [Set cluster configs] ***************************************************** 2026-04-03 07:52:38.979926 | orchestrator | Friday 03 April 2026 07:52:02 +0000 (0:00:01.159) 0:05:15.330 ********** 2026-04-03 07:52:38.979939 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-03 07:52:38.979977 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-03 07:52:38.980004 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-03 07:52:38.980016 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-03 07:52:38.980028 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-03 07:52:38.980040 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}])  2026-04-03 07:52:38.980052 | orchestrator | 2026-04-03 07:52:38.980063 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-03 07:52:38.980074 | orchestrator | 2026-04-03 07:52:38.980084 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-03 07:52:38.980095 | orchestrator | Friday 03 April 2026 07:52:13 +0000 (0:00:10.745) 0:05:26.075 ********** 2026-04-03 07:52:38.980105 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980116 | orchestrator | 2026-04-03 07:52:38.980127 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-03 07:52:38.980137 | orchestrator | Friday 03 April 2026 07:52:14 +0000 (0:00:01.463) 0:05:27.539 ********** 2026-04-03 07:52:38.980148 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980158 | orchestrator | 2026-04-03 07:52:38.980218 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-03 07:52:38.980228 | orchestrator | Friday 03 April 2026 07:52:15 +0000 (0:00:01.206) 0:05:28.746 ********** 2026-04-03 07:52:38.980239 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:38.980251 | orchestrator | 2026-04-03 07:52:38.980262 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-03 07:52:38.980275 | orchestrator | Friday 03 April 2026 07:52:17 +0000 (0:00:01.176) 0:05:29.922 ********** 2026-04-03 07:52:38.980287 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980300 | orchestrator | 2026-04-03 07:52:38.980313 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 07:52:38.980326 | orchestrator | Friday 03 April 2026 07:52:18 +0000 (0:00:01.145) 0:05:31.067 ********** 2026-04-03 07:52:38.980348 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-03 07:52:38.980361 | orchestrator | 2026-04-03 07:52:38.980372 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 07:52:38.980383 | orchestrator | Friday 03 April 2026 07:52:19 +0000 (0:00:01.187) 0:05:32.255 ********** 2026-04-03 07:52:38.980411 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980423 | orchestrator | 2026-04-03 07:52:38.980434 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 07:52:38.980445 | orchestrator | Friday 03 April 2026 07:52:20 +0000 (0:00:01.523) 0:05:33.779 ********** 2026-04-03 07:52:38.980456 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980466 | orchestrator | 2026-04-03 07:52:38.980477 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 07:52:38.980488 | orchestrator | Friday 03 April 2026 07:52:22 +0000 (0:00:01.127) 0:05:34.906 ********** 2026-04-03 07:52:38.980499 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980509 | orchestrator | 2026-04-03 07:52:38.980520 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 07:52:38.980530 | orchestrator | Friday 03 April 2026 07:52:23 +0000 (0:00:01.476) 0:05:36.382 ********** 2026-04-03 07:52:38.980541 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980552 | orchestrator | 2026-04-03 07:52:38.980562 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 07:52:38.980573 | orchestrator | Friday 03 April 2026 07:52:24 +0000 (0:00:01.123) 0:05:37.506 ********** 2026-04-03 07:52:38.980583 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980594 | orchestrator | 2026-04-03 07:52:38.980605 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 07:52:38.980615 | orchestrator | Friday 03 April 2026 07:52:25 +0000 (0:00:01.192) 0:05:38.698 ********** 2026-04-03 07:52:38.980626 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980637 | orchestrator | 2026-04-03 07:52:38.980648 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 07:52:38.980659 | orchestrator | Friday 03 April 2026 07:52:27 +0000 (0:00:01.196) 0:05:39.895 ********** 2026-04-03 07:52:38.980670 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:38.980681 | orchestrator | 2026-04-03 07:52:38.980697 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 07:52:38.980708 | orchestrator | Friday 03 April 2026 07:52:28 +0000 (0:00:01.135) 0:05:41.031 ********** 2026-04-03 07:52:38.980719 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980730 | orchestrator | 2026-04-03 07:52:38.980740 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 07:52:38.980751 | orchestrator | Friday 03 April 2026 07:52:29 +0000 (0:00:01.191) 0:05:42.222 ********** 2026-04-03 07:52:38.980762 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:52:38.980773 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:52:38.980784 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:52:38.980795 | orchestrator | 2026-04-03 07:52:38.980805 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 07:52:38.980816 | orchestrator | Friday 03 April 2026 07:52:31 +0000 (0:00:01.719) 0:05:43.942 ********** 2026-04-03 07:52:38.980827 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:38.980837 | orchestrator | 2026-04-03 07:52:38.980848 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 07:52:38.980859 | orchestrator | Friday 03 April 2026 07:52:32 +0000 (0:00:01.293) 0:05:45.235 ********** 2026-04-03 07:52:38.980870 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:52:38.980881 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:52:38.980891 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:52:38.980902 | orchestrator | 2026-04-03 07:52:38.980920 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 07:52:38.980931 | orchestrator | Friday 03 April 2026 07:52:35 +0000 (0:00:03.208) 0:05:48.444 ********** 2026-04-03 07:52:38.980942 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:52:38.980953 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:52:38.980963 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:52:38.980974 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:38.980985 | orchestrator | 2026-04-03 07:52:38.980996 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 07:52:38.981006 | orchestrator | Friday 03 April 2026 07:52:36 +0000 (0:00:01.388) 0:05:49.832 ********** 2026-04-03 07:52:38.981018 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 07:52:38.981032 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 07:52:38.981043 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 07:52:38.981054 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:38.981065 | orchestrator | 2026-04-03 07:52:38.981076 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 07:52:38.981087 | orchestrator | Friday 03 April 2026 07:52:38 +0000 (0:00:01.931) 0:05:51.764 ********** 2026-04-03 07:52:38.981105 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:52:59.589953 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:52:59.590072 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:52:59.590083 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590092 | orchestrator | 2026-04-03 07:52:59.590100 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 07:52:59.590121 | orchestrator | Friday 03 April 2026 07:52:40 +0000 (0:00:01.195) 0:05:52.959 ********** 2026-04-03 07:52:59.590130 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '190174266bca', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 07:52:32.888171', 'end': '2026-04-03 07:52:32.936098', 'delta': '0:00:00.047927', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['190174266bca'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 07:52:59.590186 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'a19b2cd80470', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 07:52:33.440070', 'end': '2026-04-03 07:52:33.493083', 'delta': '0:00:00.053013', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a19b2cd80470'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 07:52:59.590194 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '998d77407386', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 07:52:34.317883', 'end': '2026-04-03 07:52:34.385880', 'delta': '0:00:00.067997', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['998d77407386'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 07:52:59.590201 | orchestrator | 2026-04-03 07:52:59.590208 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 07:52:59.590214 | orchestrator | Friday 03 April 2026 07:52:41 +0000 (0:00:01.219) 0:05:54.178 ********** 2026-04-03 07:52:59.590220 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:59.590228 | orchestrator | 2026-04-03 07:52:59.590234 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 07:52:59.590241 | orchestrator | Friday 03 April 2026 07:52:42 +0000 (0:00:01.649) 0:05:55.828 ********** 2026-04-03 07:52:59.590247 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590253 | orchestrator | 2026-04-03 07:52:59.590260 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 07:52:59.590266 | orchestrator | Friday 03 April 2026 07:52:44 +0000 (0:00:01.297) 0:05:57.126 ********** 2026-04-03 07:52:59.590272 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:59.590278 | orchestrator | 2026-04-03 07:52:59.590284 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 07:52:59.590290 | orchestrator | Friday 03 April 2026 07:52:45 +0000 (0:00:01.148) 0:05:58.275 ********** 2026-04-03 07:52:59.590308 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-03 07:52:59.590315 | orchestrator | 2026-04-03 07:52:59.590322 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:52:59.590328 | orchestrator | Friday 03 April 2026 07:52:47 +0000 (0:00:02.482) 0:06:00.758 ********** 2026-04-03 07:52:59.590334 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:52:59.590340 | orchestrator | 2026-04-03 07:52:59.590346 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 07:52:59.590353 | orchestrator | Friday 03 April 2026 07:52:49 +0000 (0:00:01.141) 0:06:01.899 ********** 2026-04-03 07:52:59.590359 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590365 | orchestrator | 2026-04-03 07:52:59.590371 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 07:52:59.590378 | orchestrator | Friday 03 April 2026 07:52:50 +0000 (0:00:01.132) 0:06:03.032 ********** 2026-04-03 07:52:59.590384 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590395 | orchestrator | 2026-04-03 07:52:59.590401 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:52:59.590407 | orchestrator | Friday 03 April 2026 07:52:51 +0000 (0:00:01.274) 0:06:04.307 ********** 2026-04-03 07:52:59.590413 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590420 | orchestrator | 2026-04-03 07:52:59.590426 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 07:52:59.590432 | orchestrator | Friday 03 April 2026 07:52:52 +0000 (0:00:01.124) 0:06:05.432 ********** 2026-04-03 07:52:59.590438 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590444 | orchestrator | 2026-04-03 07:52:59.590455 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 07:52:59.590461 | orchestrator | Friday 03 April 2026 07:52:53 +0000 (0:00:01.137) 0:06:06.569 ********** 2026-04-03 07:52:59.590467 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590473 | orchestrator | 2026-04-03 07:52:59.590480 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 07:52:59.590486 | orchestrator | Friday 03 April 2026 07:52:54 +0000 (0:00:01.126) 0:06:07.696 ********** 2026-04-03 07:52:59.590492 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590498 | orchestrator | 2026-04-03 07:52:59.590504 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 07:52:59.590512 | orchestrator | Friday 03 April 2026 07:52:55 +0000 (0:00:01.139) 0:06:08.836 ********** 2026-04-03 07:52:59.590520 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590527 | orchestrator | 2026-04-03 07:52:59.590534 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 07:52:59.590541 | orchestrator | Friday 03 April 2026 07:52:57 +0000 (0:00:01.165) 0:06:10.001 ********** 2026-04-03 07:52:59.590548 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590556 | orchestrator | 2026-04-03 07:52:59.590563 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 07:52:59.590571 | orchestrator | Friday 03 April 2026 07:52:58 +0000 (0:00:01.147) 0:06:11.148 ********** 2026-04-03 07:52:59.590578 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:52:59.590586 | orchestrator | 2026-04-03 07:52:59.590593 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 07:52:59.590599 | orchestrator | Friday 03 April 2026 07:52:59 +0000 (0:00:01.170) 0:06:12.319 ********** 2026-04-03 07:52:59.590605 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:52:59.590612 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:52:59.590619 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:52:59.590626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:52:59.590643 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:53:00.861746 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:53:00.861863 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:53:00.861887 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:53:00.861905 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:53:00.861938 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:53:00.861951 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:00.861965 | orchestrator | 2026-04-03 07:53:00.861978 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 07:53:00.861990 | orchestrator | Friday 03 April 2026 07:53:00 +0000 (0:00:01.295) 0:06:13.615 ********** 2026-04-03 07:53:00.862081 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862104 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862116 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862129 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862205 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862256 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:00.862291 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:26.020855 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:26.020974 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:26.021013 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:53:26.021027 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021041 | orchestrator | 2026-04-03 07:53:26.021054 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 07:53:26.021066 | orchestrator | Friday 03 April 2026 07:53:01 +0000 (0:00:01.232) 0:06:14.847 ********** 2026-04-03 07:53:26.021077 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:53:26.021089 | orchestrator | 2026-04-03 07:53:26.021101 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 07:53:26.021112 | orchestrator | Friday 03 April 2026 07:53:03 +0000 (0:00:01.507) 0:06:16.354 ********** 2026-04-03 07:53:26.021123 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:53:26.021182 | orchestrator | 2026-04-03 07:53:26.021194 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:53:26.021222 | orchestrator | Friday 03 April 2026 07:53:04 +0000 (0:00:01.217) 0:06:17.572 ********** 2026-04-03 07:53:26.021234 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:53:26.021245 | orchestrator | 2026-04-03 07:53:26.021256 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:53:26.021267 | orchestrator | Friday 03 April 2026 07:53:06 +0000 (0:00:01.483) 0:06:19.056 ********** 2026-04-03 07:53:26.021278 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021289 | orchestrator | 2026-04-03 07:53:26.021307 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:53:26.021318 | orchestrator | Friday 03 April 2026 07:53:07 +0000 (0:00:01.150) 0:06:20.206 ********** 2026-04-03 07:53:26.021329 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021343 | orchestrator | 2026-04-03 07:53:26.021356 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:53:26.021370 | orchestrator | Friday 03 April 2026 07:53:08 +0000 (0:00:01.220) 0:06:21.426 ********** 2026-04-03 07:53:26.021382 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021395 | orchestrator | 2026-04-03 07:53:26.021408 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 07:53:26.021421 | orchestrator | Friday 03 April 2026 07:53:09 +0000 (0:00:01.153) 0:06:22.580 ********** 2026-04-03 07:53:26.021434 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:53:26.021448 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 07:53:26.021461 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 07:53:26.021474 | orchestrator | 2026-04-03 07:53:26.021487 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 07:53:26.021500 | orchestrator | Friday 03 April 2026 07:53:11 +0000 (0:00:02.057) 0:06:24.637 ********** 2026-04-03 07:53:26.021514 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:53:26.021527 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:53:26.021540 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:53:26.021561 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021575 | orchestrator | 2026-04-03 07:53:26.021588 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 07:53:26.021600 | orchestrator | Friday 03 April 2026 07:53:12 +0000 (0:00:01.154) 0:06:25.792 ********** 2026-04-03 07:53:26.021613 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021626 | orchestrator | 2026-04-03 07:53:26.021639 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 07:53:26.021651 | orchestrator | Friday 03 April 2026 07:53:14 +0000 (0:00:01.128) 0:06:26.921 ********** 2026-04-03 07:53:26.021664 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:53:26.021677 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:53:26.021692 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:53:26.021704 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:53:26.021715 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:53:26.021726 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:53:26.021736 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:53:26.021747 | orchestrator | 2026-04-03 07:53:26.021757 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 07:53:26.021768 | orchestrator | Friday 03 April 2026 07:53:16 +0000 (0:00:02.197) 0:06:29.118 ********** 2026-04-03 07:53:26.021779 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:53:26.021789 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:53:26.021800 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:53:26.021811 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:53:26.021822 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:53:26.021833 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:53:26.021844 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:53:26.021855 | orchestrator | 2026-04-03 07:53:26.021866 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-03 07:53:26.021877 | orchestrator | Friday 03 April 2026 07:53:19 +0000 (0:00:02.869) 0:06:31.987 ********** 2026-04-03 07:53:26.021888 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-03 07:53:26.021898 | orchestrator | 2026-04-03 07:53:26.021909 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-03 07:53:26.021920 | orchestrator | Friday 03 April 2026 07:53:21 +0000 (0:00:02.209) 0:06:34.197 ********** 2026-04-03 07:53:26.021931 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021942 | orchestrator | 2026-04-03 07:53:26.021953 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-03 07:53:26.021963 | orchestrator | Friday 03 April 2026 07:53:22 +0000 (0:00:01.261) 0:06:35.458 ********** 2026-04-03 07:53:26.021974 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:53:26.021985 | orchestrator | 2026-04-03 07:53:26.021996 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-03 07:53:26.022006 | orchestrator | Friday 03 April 2026 07:53:23 +0000 (0:00:01.140) 0:06:36.600 ********** 2026-04-03 07:53:26.022080 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-03 07:53:26.022092 | orchestrator | 2026-04-03 07:53:26.022103 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-03 07:53:26.022122 | orchestrator | Friday 03 April 2026 07:53:26 +0000 (0:00:02.272) 0:06:38.872 ********** 2026-04-03 07:54:28.130374 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.130518 | orchestrator | 2026-04-03 07:54:28.130547 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-03 07:54:28.130568 | orchestrator | Friday 03 April 2026 07:53:27 +0000 (0:00:01.177) 0:06:40.049 ********** 2026-04-03 07:54:28.130610 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:54:28.130629 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 07:54:28.130648 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:54:28.130667 | orchestrator | 2026-04-03 07:54:28.130686 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-03 07:54:28.130706 | orchestrator | Friday 03 April 2026 07:53:29 +0000 (0:00:02.509) 0:06:42.558 ********** 2026-04-03 07:54:28.130725 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd', 'testbed-node-0']) 2026-04-03 07:54:28.130744 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd', 'testbed-node-1']) 2026-04-03 07:54:28.130765 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd', 'testbed-node-2']) 2026-04-03 07:54:28.130783 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd-mirror', 'testbed-node-0']) 2026-04-03 07:54:28.130803 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd-mirror', 'testbed-node-1']) 2026-04-03 07:54:28.130823 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd-mirror', 'testbed-node-2']) 2026-04-03 07:54:28.130842 | orchestrator | 2026-04-03 07:54:28.130854 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-03 07:54:28.130865 | orchestrator | Friday 03 April 2026 07:53:42 +0000 (0:00:13.227) 0:06:55.786 ********** 2026-04-03 07:54:28.130876 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:54:28.130888 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:54:28.130900 | orchestrator | 2026-04-03 07:54:28.130912 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-03 07:54:28.130925 | orchestrator | Friday 03 April 2026 07:53:47 +0000 (0:00:04.104) 0:06:59.891 ********** 2026-04-03 07:54:28.130938 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:54:28.130951 | orchestrator | 2026-04-03 07:54:28.130966 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 07:54:28.130986 | orchestrator | Friday 03 April 2026 07:53:49 +0000 (0:00:02.525) 0:07:02.416 ********** 2026-04-03 07:54:28.131005 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-03 07:54:28.131026 | orchestrator | 2026-04-03 07:54:28.131046 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 07:54:28.131063 | orchestrator | Friday 03 April 2026 07:53:51 +0000 (0:00:01.455) 0:07:03.872 ********** 2026-04-03 07:54:28.131077 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-03 07:54:28.131119 | orchestrator | 2026-04-03 07:54:28.131131 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 07:54:28.131150 | orchestrator | Friday 03 April 2026 07:53:52 +0000 (0:00:01.597) 0:07:05.469 ********** 2026-04-03 07:54:28.131168 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.131186 | orchestrator | 2026-04-03 07:54:28.131206 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 07:54:28.131227 | orchestrator | Friday 03 April 2026 07:53:54 +0000 (0:00:01.600) 0:07:07.069 ********** 2026-04-03 07:54:28.131247 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131265 | orchestrator | 2026-04-03 07:54:28.131282 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 07:54:28.131300 | orchestrator | Friday 03 April 2026 07:53:55 +0000 (0:00:01.188) 0:07:08.257 ********** 2026-04-03 07:54:28.131351 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131371 | orchestrator | 2026-04-03 07:54:28.131389 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 07:54:28.131406 | orchestrator | Friday 03 April 2026 07:53:56 +0000 (0:00:01.139) 0:07:09.397 ********** 2026-04-03 07:54:28.131424 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131442 | orchestrator | 2026-04-03 07:54:28.131461 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 07:54:28.131480 | orchestrator | Friday 03 April 2026 07:53:57 +0000 (0:00:01.137) 0:07:10.535 ********** 2026-04-03 07:54:28.131500 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.131519 | orchestrator | 2026-04-03 07:54:28.131537 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 07:54:28.131554 | orchestrator | Friday 03 April 2026 07:53:59 +0000 (0:00:01.567) 0:07:12.103 ********** 2026-04-03 07:54:28.131571 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131588 | orchestrator | 2026-04-03 07:54:28.131605 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 07:54:28.131623 | orchestrator | Friday 03 April 2026 07:54:00 +0000 (0:00:01.151) 0:07:13.255 ********** 2026-04-03 07:54:28.131640 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131660 | orchestrator | 2026-04-03 07:54:28.131679 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 07:54:28.131697 | orchestrator | Friday 03 April 2026 07:54:01 +0000 (0:00:01.119) 0:07:14.374 ********** 2026-04-03 07:54:28.131715 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.131734 | orchestrator | 2026-04-03 07:54:28.131753 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 07:54:28.131771 | orchestrator | Friday 03 April 2026 07:54:03 +0000 (0:00:01.584) 0:07:15.959 ********** 2026-04-03 07:54:28.131787 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.131798 | orchestrator | 2026-04-03 07:54:28.131831 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 07:54:28.131843 | orchestrator | Friday 03 April 2026 07:54:04 +0000 (0:00:01.566) 0:07:17.526 ********** 2026-04-03 07:54:28.131853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131864 | orchestrator | 2026-04-03 07:54:28.131875 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 07:54:28.131895 | orchestrator | Friday 03 April 2026 07:54:05 +0000 (0:00:01.159) 0:07:18.686 ********** 2026-04-03 07:54:28.131906 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.131916 | orchestrator | 2026-04-03 07:54:28.131927 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 07:54:28.131938 | orchestrator | Friday 03 April 2026 07:54:07 +0000 (0:00:01.211) 0:07:19.897 ********** 2026-04-03 07:54:28.131948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.131959 | orchestrator | 2026-04-03 07:54:28.131970 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 07:54:28.131981 | orchestrator | Friday 03 April 2026 07:54:08 +0000 (0:00:01.143) 0:07:21.041 ********** 2026-04-03 07:54:28.131991 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132002 | orchestrator | 2026-04-03 07:54:28.132013 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 07:54:28.132023 | orchestrator | Friday 03 April 2026 07:54:09 +0000 (0:00:01.161) 0:07:22.203 ********** 2026-04-03 07:54:28.132034 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132045 | orchestrator | 2026-04-03 07:54:28.132056 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 07:54:28.132069 | orchestrator | Friday 03 April 2026 07:54:10 +0000 (0:00:01.210) 0:07:23.413 ********** 2026-04-03 07:54:28.132113 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132132 | orchestrator | 2026-04-03 07:54:28.132150 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 07:54:28.132168 | orchestrator | Friday 03 April 2026 07:54:11 +0000 (0:00:01.222) 0:07:24.635 ********** 2026-04-03 07:54:28.132208 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132227 | orchestrator | 2026-04-03 07:54:28.132244 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 07:54:28.132255 | orchestrator | Friday 03 April 2026 07:54:12 +0000 (0:00:01.137) 0:07:25.773 ********** 2026-04-03 07:54:28.132266 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.132277 | orchestrator | 2026-04-03 07:54:28.132288 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 07:54:28.132298 | orchestrator | Friday 03 April 2026 07:54:14 +0000 (0:00:01.194) 0:07:26.967 ********** 2026-04-03 07:54:28.132309 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.132320 | orchestrator | 2026-04-03 07:54:28.132330 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 07:54:28.132341 | orchestrator | Friday 03 April 2026 07:54:15 +0000 (0:00:01.211) 0:07:28.179 ********** 2026-04-03 07:54:28.132352 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:54:28.132362 | orchestrator | 2026-04-03 07:54:28.132373 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 07:54:28.132384 | orchestrator | Friday 03 April 2026 07:54:16 +0000 (0:00:01.169) 0:07:29.348 ********** 2026-04-03 07:54:28.132395 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132405 | orchestrator | 2026-04-03 07:54:28.132416 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 07:54:28.132426 | orchestrator | Friday 03 April 2026 07:54:17 +0000 (0:00:01.131) 0:07:30.480 ********** 2026-04-03 07:54:28.132437 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132448 | orchestrator | 2026-04-03 07:54:28.132459 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 07:54:28.132470 | orchestrator | Friday 03 April 2026 07:54:18 +0000 (0:00:01.116) 0:07:31.597 ********** 2026-04-03 07:54:28.132481 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132491 | orchestrator | 2026-04-03 07:54:28.132502 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 07:54:28.132518 | orchestrator | Friday 03 April 2026 07:54:19 +0000 (0:00:01.143) 0:07:32.740 ********** 2026-04-03 07:54:28.132530 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132540 | orchestrator | 2026-04-03 07:54:28.132552 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 07:54:28.132562 | orchestrator | Friday 03 April 2026 07:54:21 +0000 (0:00:01.224) 0:07:33.964 ********** 2026-04-03 07:54:28.132573 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132584 | orchestrator | 2026-04-03 07:54:28.132595 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 07:54:28.132606 | orchestrator | Friday 03 April 2026 07:54:22 +0000 (0:00:01.173) 0:07:35.138 ********** 2026-04-03 07:54:28.132616 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132627 | orchestrator | 2026-04-03 07:54:28.132638 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 07:54:28.132649 | orchestrator | Friday 03 April 2026 07:54:23 +0000 (0:00:01.152) 0:07:36.291 ********** 2026-04-03 07:54:28.132660 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132671 | orchestrator | 2026-04-03 07:54:28.132682 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 07:54:28.132693 | orchestrator | Friday 03 April 2026 07:54:24 +0000 (0:00:01.173) 0:07:37.465 ********** 2026-04-03 07:54:28.132704 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132715 | orchestrator | 2026-04-03 07:54:28.132726 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 07:54:28.132737 | orchestrator | Friday 03 April 2026 07:54:25 +0000 (0:00:01.181) 0:07:38.646 ********** 2026-04-03 07:54:28.132747 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132759 | orchestrator | 2026-04-03 07:54:28.132769 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 07:54:28.132780 | orchestrator | Friday 03 April 2026 07:54:26 +0000 (0:00:01.213) 0:07:39.860 ********** 2026-04-03 07:54:28.132798 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:54:28.132809 | orchestrator | 2026-04-03 07:54:28.132820 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 07:54:28.132831 | orchestrator | Friday 03 April 2026 07:54:28 +0000 (0:00:01.124) 0:07:40.985 ********** 2026-04-03 07:55:18.925444 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925558 | orchestrator | 2026-04-03 07:55:18.925573 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 07:55:18.925583 | orchestrator | Friday 03 April 2026 07:54:29 +0000 (0:00:01.136) 0:07:42.121 ********** 2026-04-03 07:55:18.925592 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925600 | orchestrator | 2026-04-03 07:55:18.925623 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 07:55:18.925631 | orchestrator | Friday 03 April 2026 07:54:30 +0000 (0:00:01.151) 0:07:43.273 ********** 2026-04-03 07:55:18.925639 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.925648 | orchestrator | 2026-04-03 07:55:18.925656 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 07:55:18.925664 | orchestrator | Friday 03 April 2026 07:54:32 +0000 (0:00:01.992) 0:07:45.265 ********** 2026-04-03 07:55:18.925672 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.925680 | orchestrator | 2026-04-03 07:55:18.925688 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 07:55:18.925696 | orchestrator | Friday 03 April 2026 07:54:34 +0000 (0:00:02.448) 0:07:47.713 ********** 2026-04-03 07:55:18.925704 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-03 07:55:18.925712 | orchestrator | 2026-04-03 07:55:18.925720 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 07:55:18.925728 | orchestrator | Friday 03 April 2026 07:54:36 +0000 (0:00:01.530) 0:07:49.244 ********** 2026-04-03 07:55:18.925736 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925744 | orchestrator | 2026-04-03 07:55:18.925752 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 07:55:18.925761 | orchestrator | Friday 03 April 2026 07:54:37 +0000 (0:00:01.132) 0:07:50.376 ********** 2026-04-03 07:55:18.925774 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925788 | orchestrator | 2026-04-03 07:55:18.925801 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 07:55:18.925815 | orchestrator | Friday 03 April 2026 07:54:38 +0000 (0:00:01.166) 0:07:51.543 ********** 2026-04-03 07:55:18.925823 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 07:55:18.925831 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 07:55:18.925839 | orchestrator | 2026-04-03 07:55:18.925847 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 07:55:18.925855 | orchestrator | Friday 03 April 2026 07:54:40 +0000 (0:00:01.912) 0:07:53.456 ********** 2026-04-03 07:55:18.925863 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.925870 | orchestrator | 2026-04-03 07:55:18.925878 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 07:55:18.925886 | orchestrator | Friday 03 April 2026 07:54:42 +0000 (0:00:01.653) 0:07:55.110 ********** 2026-04-03 07:55:18.925894 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925902 | orchestrator | 2026-04-03 07:55:18.925910 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 07:55:18.925917 | orchestrator | Friday 03 April 2026 07:54:43 +0000 (0:00:01.215) 0:07:56.325 ********** 2026-04-03 07:55:18.925925 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925933 | orchestrator | 2026-04-03 07:55:18.925941 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 07:55:18.925948 | orchestrator | Friday 03 April 2026 07:54:44 +0000 (0:00:01.243) 0:07:57.569 ********** 2026-04-03 07:55:18.925956 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.925984 | orchestrator | 2026-04-03 07:55:18.925992 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 07:55:18.926002 | orchestrator | Friday 03 April 2026 07:54:45 +0000 (0:00:01.170) 0:07:58.740 ********** 2026-04-03 07:55:18.926011 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-03 07:55:18.926085 | orchestrator | 2026-04-03 07:55:18.926095 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 07:55:18.926104 | orchestrator | Friday 03 April 2026 07:54:47 +0000 (0:00:01.497) 0:08:00.237 ********** 2026-04-03 07:55:18.926113 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.926122 | orchestrator | 2026-04-03 07:55:18.926131 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 07:55:18.926141 | orchestrator | Friday 03 April 2026 07:54:49 +0000 (0:00:01.806) 0:08:02.044 ********** 2026-04-03 07:55:18.926150 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 07:55:18.926168 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 07:55:18.926178 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 07:55:18.926187 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926197 | orchestrator | 2026-04-03 07:55:18.926206 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 07:55:18.926215 | orchestrator | Friday 03 April 2026 07:54:50 +0000 (0:00:01.170) 0:08:03.214 ********** 2026-04-03 07:55:18.926224 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926233 | orchestrator | 2026-04-03 07:55:18.926242 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 07:55:18.926252 | orchestrator | Friday 03 April 2026 07:54:51 +0000 (0:00:01.125) 0:08:04.340 ********** 2026-04-03 07:55:18.926260 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926270 | orchestrator | 2026-04-03 07:55:18.926279 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 07:55:18.926288 | orchestrator | Friday 03 April 2026 07:54:52 +0000 (0:00:01.224) 0:08:05.565 ********** 2026-04-03 07:55:18.926297 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926306 | orchestrator | 2026-04-03 07:55:18.926316 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 07:55:18.926340 | orchestrator | Friday 03 April 2026 07:54:53 +0000 (0:00:01.191) 0:08:06.757 ********** 2026-04-03 07:55:18.926350 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926360 | orchestrator | 2026-04-03 07:55:18.926369 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 07:55:18.926379 | orchestrator | Friday 03 April 2026 07:54:55 +0000 (0:00:01.173) 0:08:07.930 ********** 2026-04-03 07:55:18.926394 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926403 | orchestrator | 2026-04-03 07:55:18.926411 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 07:55:18.926418 | orchestrator | Friday 03 April 2026 07:54:56 +0000 (0:00:01.210) 0:08:09.141 ********** 2026-04-03 07:55:18.926426 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.926434 | orchestrator | 2026-04-03 07:55:18.926442 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 07:55:18.926450 | orchestrator | Friday 03 April 2026 07:54:58 +0000 (0:00:02.655) 0:08:11.796 ********** 2026-04-03 07:55:18.926458 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.926465 | orchestrator | 2026-04-03 07:55:18.926473 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 07:55:18.926481 | orchestrator | Friday 03 April 2026 07:55:00 +0000 (0:00:01.162) 0:08:12.959 ********** 2026-04-03 07:55:18.926489 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-03 07:55:18.926497 | orchestrator | 2026-04-03 07:55:18.926505 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 07:55:18.926513 | orchestrator | Friday 03 April 2026 07:55:01 +0000 (0:00:01.550) 0:08:14.510 ********** 2026-04-03 07:55:18.926528 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926536 | orchestrator | 2026-04-03 07:55:18.926544 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 07:55:18.926551 | orchestrator | Friday 03 April 2026 07:55:02 +0000 (0:00:01.187) 0:08:15.697 ********** 2026-04-03 07:55:18.926559 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926567 | orchestrator | 2026-04-03 07:55:18.926575 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 07:55:18.926583 | orchestrator | Friday 03 April 2026 07:55:03 +0000 (0:00:01.130) 0:08:16.828 ********** 2026-04-03 07:55:18.926590 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926598 | orchestrator | 2026-04-03 07:55:18.926606 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 07:55:18.926614 | orchestrator | Friday 03 April 2026 07:55:05 +0000 (0:00:01.147) 0:08:17.975 ********** 2026-04-03 07:55:18.926622 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926630 | orchestrator | 2026-04-03 07:55:18.926638 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 07:55:18.926645 | orchestrator | Friday 03 April 2026 07:55:06 +0000 (0:00:01.178) 0:08:19.154 ********** 2026-04-03 07:55:18.926653 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926661 | orchestrator | 2026-04-03 07:55:18.926669 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 07:55:18.926677 | orchestrator | Friday 03 April 2026 07:55:07 +0000 (0:00:01.126) 0:08:20.281 ********** 2026-04-03 07:55:18.926684 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926692 | orchestrator | 2026-04-03 07:55:18.926700 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 07:55:18.926708 | orchestrator | Friday 03 April 2026 07:55:08 +0000 (0:00:01.139) 0:08:21.420 ********** 2026-04-03 07:55:18.926716 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926724 | orchestrator | 2026-04-03 07:55:18.926732 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 07:55:18.926739 | orchestrator | Friday 03 April 2026 07:55:09 +0000 (0:00:01.118) 0:08:22.539 ********** 2026-04-03 07:55:18.926747 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:55:18.926755 | orchestrator | 2026-04-03 07:55:18.926763 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 07:55:18.926771 | orchestrator | Friday 03 April 2026 07:55:10 +0000 (0:00:01.156) 0:08:23.696 ********** 2026-04-03 07:55:18.926779 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:55:18.926786 | orchestrator | 2026-04-03 07:55:18.926794 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 07:55:18.926802 | orchestrator | Friday 03 April 2026 07:55:12 +0000 (0:00:01.169) 0:08:24.865 ********** 2026-04-03 07:55:18.926810 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-03 07:55:18.926818 | orchestrator | 2026-04-03 07:55:18.926826 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 07:55:18.926834 | orchestrator | Friday 03 April 2026 07:55:13 +0000 (0:00:01.465) 0:08:26.331 ********** 2026-04-03 07:55:18.926842 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-03 07:55:18.926851 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-03 07:55:18.926859 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-03 07:55:18.926867 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-03 07:55:18.926874 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-03 07:55:18.926882 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-03 07:55:18.926890 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-03 07:55:18.926898 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-03 07:55:18.926906 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 07:55:18.926919 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 07:55:18.926927 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 07:55:18.926934 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 07:55:18.926942 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 07:55:18.926950 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 07:55:18.926962 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-03 07:56:07.957255 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-03 07:56:07.957370 | orchestrator | 2026-04-03 07:56:07.957388 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 07:56:07.957401 | orchestrator | Friday 03 April 2026 07:55:20 +0000 (0:00:07.026) 0:08:33.358 ********** 2026-04-03 07:56:07.957428 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957441 | orchestrator | 2026-04-03 07:56:07.957453 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 07:56:07.957464 | orchestrator | Friday 03 April 2026 07:55:21 +0000 (0:00:01.148) 0:08:34.506 ********** 2026-04-03 07:56:07.957475 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957486 | orchestrator | 2026-04-03 07:56:07.957498 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 07:56:07.957509 | orchestrator | Friday 03 April 2026 07:55:22 +0000 (0:00:01.132) 0:08:35.638 ********** 2026-04-03 07:56:07.957520 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957531 | orchestrator | 2026-04-03 07:56:07.957542 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 07:56:07.957553 | orchestrator | Friday 03 April 2026 07:55:23 +0000 (0:00:01.176) 0:08:36.815 ********** 2026-04-03 07:56:07.957564 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957575 | orchestrator | 2026-04-03 07:56:07.957586 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 07:56:07.957597 | orchestrator | Friday 03 April 2026 07:55:25 +0000 (0:00:01.142) 0:08:37.957 ********** 2026-04-03 07:56:07.957608 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957619 | orchestrator | 2026-04-03 07:56:07.957630 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 07:56:07.957641 | orchestrator | Friday 03 April 2026 07:55:26 +0000 (0:00:01.113) 0:08:39.071 ********** 2026-04-03 07:56:07.957652 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957671 | orchestrator | 2026-04-03 07:56:07.957689 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 07:56:07.957708 | orchestrator | Friday 03 April 2026 07:55:27 +0000 (0:00:01.116) 0:08:40.187 ********** 2026-04-03 07:56:07.957727 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957746 | orchestrator | 2026-04-03 07:56:07.957766 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 07:56:07.957785 | orchestrator | Friday 03 April 2026 07:55:28 +0000 (0:00:01.120) 0:08:41.308 ********** 2026-04-03 07:56:07.957804 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957824 | orchestrator | 2026-04-03 07:56:07.957838 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 07:56:07.957851 | orchestrator | Friday 03 April 2026 07:55:29 +0000 (0:00:01.126) 0:08:42.435 ********** 2026-04-03 07:56:07.957864 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957877 | orchestrator | 2026-04-03 07:56:07.957890 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 07:56:07.957903 | orchestrator | Friday 03 April 2026 07:55:30 +0000 (0:00:01.203) 0:08:43.639 ********** 2026-04-03 07:56:07.957916 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.957929 | orchestrator | 2026-04-03 07:56:07.957943 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 07:56:07.957980 | orchestrator | Friday 03 April 2026 07:55:31 +0000 (0:00:01.209) 0:08:44.849 ********** 2026-04-03 07:56:07.957994 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958006 | orchestrator | 2026-04-03 07:56:07.958099 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 07:56:07.958113 | orchestrator | Friday 03 April 2026 07:55:33 +0000 (0:00:01.157) 0:08:46.006 ********** 2026-04-03 07:56:07.958126 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958140 | orchestrator | 2026-04-03 07:56:07.958151 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 07:56:07.958163 | orchestrator | Friday 03 April 2026 07:55:34 +0000 (0:00:01.106) 0:08:47.112 ********** 2026-04-03 07:56:07.958173 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958184 | orchestrator | 2026-04-03 07:56:07.958194 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 07:56:07.958205 | orchestrator | Friday 03 April 2026 07:55:35 +0000 (0:00:01.317) 0:08:48.430 ********** 2026-04-03 07:56:07.958216 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958226 | orchestrator | 2026-04-03 07:56:07.958237 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 07:56:07.958248 | orchestrator | Friday 03 April 2026 07:55:36 +0000 (0:00:01.156) 0:08:49.586 ********** 2026-04-03 07:56:07.958259 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958269 | orchestrator | 2026-04-03 07:56:07.958280 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 07:56:07.958290 | orchestrator | Friday 03 April 2026 07:55:37 +0000 (0:00:01.221) 0:08:50.807 ********** 2026-04-03 07:56:07.958301 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958312 | orchestrator | 2026-04-03 07:56:07.958336 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 07:56:07.958359 | orchestrator | Friday 03 April 2026 07:55:39 +0000 (0:00:01.115) 0:08:51.923 ********** 2026-04-03 07:56:07.958370 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958381 | orchestrator | 2026-04-03 07:56:07.958392 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 07:56:07.958404 | orchestrator | Friday 03 April 2026 07:55:40 +0000 (0:00:01.152) 0:08:53.076 ********** 2026-04-03 07:56:07.958415 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958426 | orchestrator | 2026-04-03 07:56:07.958437 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 07:56:07.958448 | orchestrator | Friday 03 April 2026 07:55:41 +0000 (0:00:01.149) 0:08:54.225 ********** 2026-04-03 07:56:07.958458 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958469 | orchestrator | 2026-04-03 07:56:07.958507 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 07:56:07.958525 | orchestrator | Friday 03 April 2026 07:55:42 +0000 (0:00:01.142) 0:08:55.367 ********** 2026-04-03 07:56:07.958543 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958560 | orchestrator | 2026-04-03 07:56:07.958577 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 07:56:07.958604 | orchestrator | Friday 03 April 2026 07:55:43 +0000 (0:00:01.135) 0:08:56.503 ********** 2026-04-03 07:56:07.958625 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958643 | orchestrator | 2026-04-03 07:56:07.958662 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 07:56:07.958673 | orchestrator | Friday 03 April 2026 07:55:44 +0000 (0:00:01.129) 0:08:57.632 ********** 2026-04-03 07:56:07.958684 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 07:56:07.958695 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 07:56:07.958706 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 07:56:07.958719 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958738 | orchestrator | 2026-04-03 07:56:07.958755 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 07:56:07.958790 | orchestrator | Friday 03 April 2026 07:55:46 +0000 (0:00:01.876) 0:08:59.509 ********** 2026-04-03 07:56:07.958806 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 07:56:07.958817 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 07:56:07.958828 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 07:56:07.958839 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958849 | orchestrator | 2026-04-03 07:56:07.958860 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 07:56:07.958871 | orchestrator | Friday 03 April 2026 07:55:48 +0000 (0:00:01.450) 0:09:00.959 ********** 2026-04-03 07:56:07.958882 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 07:56:07.958892 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 07:56:07.958903 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 07:56:07.958914 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958924 | orchestrator | 2026-04-03 07:56:07.958935 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 07:56:07.958946 | orchestrator | Friday 03 April 2026 07:55:49 +0000 (0:00:01.400) 0:09:02.360 ********** 2026-04-03 07:56:07.958956 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.958967 | orchestrator | 2026-04-03 07:56:07.958978 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 07:56:07.958989 | orchestrator | Friday 03 April 2026 07:55:50 +0000 (0:00:01.210) 0:09:03.570 ********** 2026-04-03 07:56:07.959000 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-03 07:56:07.959035 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.959052 | orchestrator | 2026-04-03 07:56:07.959063 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 07:56:07.959074 | orchestrator | Friday 03 April 2026 07:55:52 +0000 (0:00:01.470) 0:09:05.041 ********** 2026-04-03 07:56:07.959085 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959096 | orchestrator | 2026-04-03 07:56:07.959107 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-03 07:56:07.959118 | orchestrator | Friday 03 April 2026 07:55:54 +0000 (0:00:01.934) 0:09:06.975 ********** 2026-04-03 07:56:07.959128 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959139 | orchestrator | 2026-04-03 07:56:07.959150 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-03 07:56:07.959161 | orchestrator | Friday 03 April 2026 07:55:55 +0000 (0:00:01.170) 0:09:08.146 ********** 2026-04-03 07:56:07.959172 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0 2026-04-03 07:56:07.959184 | orchestrator | 2026-04-03 07:56:07.959195 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-03 07:56:07.959206 | orchestrator | Friday 03 April 2026 07:55:56 +0000 (0:00:01.518) 0:09:09.665 ********** 2026-04-03 07:56:07.959216 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-03 07:56:07.959227 | orchestrator | 2026-04-03 07:56:07.959238 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-03 07:56:07.959249 | orchestrator | Friday 03 April 2026 07:56:00 +0000 (0:00:03.294) 0:09:12.959 ********** 2026-04-03 07:56:07.959259 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:56:07.959270 | orchestrator | 2026-04-03 07:56:07.959281 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-03 07:56:07.959291 | orchestrator | Friday 03 April 2026 07:56:01 +0000 (0:00:01.216) 0:09:14.176 ********** 2026-04-03 07:56:07.959302 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959313 | orchestrator | 2026-04-03 07:56:07.959324 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-03 07:56:07.959335 | orchestrator | Friday 03 April 2026 07:56:02 +0000 (0:00:01.161) 0:09:15.338 ********** 2026-04-03 07:56:07.959346 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959364 | orchestrator | 2026-04-03 07:56:07.959375 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-03 07:56:07.959385 | orchestrator | Friday 03 April 2026 07:56:03 +0000 (0:00:01.201) 0:09:16.540 ********** 2026-04-03 07:56:07.959396 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:56:07.959407 | orchestrator | 2026-04-03 07:56:07.959418 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-03 07:56:07.959428 | orchestrator | Friday 03 April 2026 07:56:05 +0000 (0:00:02.140) 0:09:18.680 ********** 2026-04-03 07:56:07.959439 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959450 | orchestrator | 2026-04-03 07:56:07.959461 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-03 07:56:07.959472 | orchestrator | Friday 03 April 2026 07:56:07 +0000 (0:00:01.617) 0:09:20.297 ********** 2026-04-03 07:56:07.959483 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:56:07.959493 | orchestrator | 2026-04-03 07:56:07.959513 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-03 07:57:08.756124 | orchestrator | Friday 03 April 2026 07:56:08 +0000 (0:00:01.533) 0:09:21.831 ********** 2026-04-03 07:57:08.756241 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756260 | orchestrator | 2026-04-03 07:57:08.756273 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-03 07:57:08.756302 | orchestrator | Friday 03 April 2026 07:56:10 +0000 (0:00:01.683) 0:09:23.515 ********** 2026-04-03 07:57:08.756314 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756325 | orchestrator | 2026-04-03 07:57:08.756337 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-03 07:57:08.756348 | orchestrator | Friday 03 April 2026 07:56:12 +0000 (0:00:01.815) 0:09:25.331 ********** 2026-04-03 07:57:08.756359 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756370 | orchestrator | 2026-04-03 07:57:08.756381 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-03 07:57:08.756392 | orchestrator | Friday 03 April 2026 07:56:14 +0000 (0:00:01.864) 0:09:27.195 ********** 2026-04-03 07:57:08.756403 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 07:57:08.756415 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 07:57:08.756426 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 07:57:08.756437 | orchestrator | ok: [testbed-node-0 -> {{ item }}] 2026-04-03 07:57:08.756448 | orchestrator | 2026-04-03 07:57:08.756459 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-03 07:57:08.756470 | orchestrator | Friday 03 April 2026 07:56:18 +0000 (0:00:03.920) 0:09:31.116 ********** 2026-04-03 07:57:08.756480 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:57:08.756492 | orchestrator | 2026-04-03 07:57:08.756503 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-03 07:57:08.756514 | orchestrator | Friday 03 April 2026 07:56:20 +0000 (0:00:02.107) 0:09:33.223 ********** 2026-04-03 07:57:08.756525 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756535 | orchestrator | 2026-04-03 07:57:08.756546 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-03 07:57:08.756557 | orchestrator | Friday 03 April 2026 07:56:21 +0000 (0:00:01.177) 0:09:34.401 ********** 2026-04-03 07:57:08.756568 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756579 | orchestrator | 2026-04-03 07:57:08.756590 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-03 07:57:08.756600 | orchestrator | Friday 03 April 2026 07:56:22 +0000 (0:00:01.143) 0:09:35.545 ********** 2026-04-03 07:57:08.756611 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756622 | orchestrator | 2026-04-03 07:57:08.756632 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-03 07:57:08.756643 | orchestrator | Friday 03 April 2026 07:56:24 +0000 (0:00:02.068) 0:09:37.614 ********** 2026-04-03 07:57:08.756654 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756665 | orchestrator | 2026-04-03 07:57:08.756675 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-03 07:57:08.756710 | orchestrator | Friday 03 April 2026 07:56:26 +0000 (0:00:01.514) 0:09:39.128 ********** 2026-04-03 07:57:08.756722 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:08.756733 | orchestrator | 2026-04-03 07:57:08.756743 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-03 07:57:08.756754 | orchestrator | Friday 03 April 2026 07:56:27 +0000 (0:00:01.130) 0:09:40.259 ********** 2026-04-03 07:57:08.756765 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0 2026-04-03 07:57:08.756776 | orchestrator | 2026-04-03 07:57:08.756787 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-03 07:57:08.756798 | orchestrator | Friday 03 April 2026 07:56:28 +0000 (0:00:01.453) 0:09:41.713 ********** 2026-04-03 07:57:08.756808 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:08.756819 | orchestrator | 2026-04-03 07:57:08.756830 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-03 07:57:08.756840 | orchestrator | Friday 03 April 2026 07:56:29 +0000 (0:00:01.103) 0:09:42.817 ********** 2026-04-03 07:57:08.756851 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:08.756862 | orchestrator | 2026-04-03 07:57:08.756873 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-03 07:57:08.756884 | orchestrator | Friday 03 April 2026 07:56:31 +0000 (0:00:01.149) 0:09:43.966 ********** 2026-04-03 07:57:08.756895 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0 2026-04-03 07:57:08.756905 | orchestrator | 2026-04-03 07:57:08.756916 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-03 07:57:08.756927 | orchestrator | Friday 03 April 2026 07:56:32 +0000 (0:00:01.501) 0:09:45.468 ********** 2026-04-03 07:57:08.756937 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.756948 | orchestrator | 2026-04-03 07:57:08.756958 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-03 07:57:08.756969 | orchestrator | Friday 03 April 2026 07:56:35 +0000 (0:00:02.440) 0:09:47.908 ********** 2026-04-03 07:57:08.757011 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.757022 | orchestrator | 2026-04-03 07:57:08.757033 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-03 07:57:08.757044 | orchestrator | Friday 03 April 2026 07:56:37 +0000 (0:00:02.029) 0:09:49.938 ********** 2026-04-03 07:57:08.757054 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.757065 | orchestrator | 2026-04-03 07:57:08.757076 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-03 07:57:08.757087 | orchestrator | Friday 03 April 2026 07:56:39 +0000 (0:00:02.415) 0:09:52.354 ********** 2026-04-03 07:57:08.757098 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:57:08.757109 | orchestrator | 2026-04-03 07:57:08.757119 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-03 07:57:08.757130 | orchestrator | Friday 03 April 2026 07:56:42 +0000 (0:00:03.220) 0:09:55.575 ********** 2026-04-03 07:57:08.757141 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0 2026-04-03 07:57:08.757152 | orchestrator | 2026-04-03 07:57:08.757180 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-03 07:57:08.757191 | orchestrator | Friday 03 April 2026 07:56:44 +0000 (0:00:01.550) 0:09:57.125 ********** 2026-04-03 07:57:08.757202 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.757213 | orchestrator | 2026-04-03 07:57:08.757224 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-03 07:57:08.757241 | orchestrator | Friday 03 April 2026 07:56:46 +0000 (0:00:02.357) 0:09:59.483 ********** 2026-04-03 07:57:08.757252 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:08.757263 | orchestrator | 2026-04-03 07:57:08.757273 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-03 07:57:08.757284 | orchestrator | Friday 03 April 2026 07:56:49 +0000 (0:00:03.017) 0:10:02.501 ********** 2026-04-03 07:57:08.757304 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:08.757315 | orchestrator | 2026-04-03 07:57:08.757326 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-03 07:57:08.757337 | orchestrator | Friday 03 April 2026 07:56:50 +0000 (0:00:01.197) 0:10:03.698 ********** 2026-04-03 07:57:08.757350 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-03 07:57:08.757364 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-03 07:57:08.757375 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-03 07:57:08.757386 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-03 07:57:08.757399 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-03 07:57:08.757411 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}])  2026-04-03 07:57:08.757424 | orchestrator | 2026-04-03 07:57:08.757435 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-03 07:57:08.757446 | orchestrator | Friday 03 April 2026 07:57:02 +0000 (0:00:11.420) 0:10:15.119 ********** 2026-04-03 07:57:08.757457 | orchestrator | changed: [testbed-node-0] 2026-04-03 07:57:08.757468 | orchestrator | 2026-04-03 07:57:08.757478 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 07:57:08.757489 | orchestrator | Friday 03 April 2026 07:57:04 +0000 (0:00:02.723) 0:10:17.843 ********** 2026-04-03 07:57:08.757500 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 07:57:08.757511 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 07:57:08.757522 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 07:57:08.757533 | orchestrator | 2026-04-03 07:57:08.757544 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 07:57:08.757555 | orchestrator | Friday 03 April 2026 07:57:07 +0000 (0:00:02.312) 0:10:20.155 ********** 2026-04-03 07:57:08.757566 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 07:57:08.757584 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 07:57:08.757612 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 07:57:08.757630 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:08.757648 | orchestrator | 2026-04-03 07:57:08.757667 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-03 07:57:08.757685 | orchestrator | Friday 03 April 2026 07:57:08 +0000 (0:00:01.453) 0:10:21.608 ********** 2026-04-03 07:57:37.692144 | orchestrator | skipping: [testbed-node-0] 2026-04-03 07:57:37.692253 | orchestrator | 2026-04-03 07:57:37.692270 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-03 07:57:37.692282 | orchestrator | Friday 03 April 2026 07:57:09 +0000 (0:00:01.123) 0:10:22.732 ********** 2026-04-03 07:57:37.692294 | orchestrator | ok: [testbed-node-0] 2026-04-03 07:57:37.692322 | orchestrator | 2026-04-03 07:57:37.692335 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-03 07:57:37.692345 | orchestrator | 2026-04-03 07:57:37.692356 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-03 07:57:37.692367 | orchestrator | Friday 03 April 2026 07:57:12 +0000 (0:00:02.284) 0:10:25.016 ********** 2026-04-03 07:57:37.692377 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692388 | orchestrator | 2026-04-03 07:57:37.692398 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-03 07:57:37.692409 | orchestrator | Friday 03 April 2026 07:57:13 +0000 (0:00:01.217) 0:10:26.233 ********** 2026-04-03 07:57:37.692420 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692430 | orchestrator | 2026-04-03 07:57:37.692441 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-03 07:57:37.692451 | orchestrator | Friday 03 April 2026 07:57:14 +0000 (0:00:00.812) 0:10:27.046 ********** 2026-04-03 07:57:37.692462 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:37.692474 | orchestrator | 2026-04-03 07:57:37.692484 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-03 07:57:37.692495 | orchestrator | Friday 03 April 2026 07:57:15 +0000 (0:00:00.882) 0:10:27.929 ********** 2026-04-03 07:57:37.692505 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692516 | orchestrator | 2026-04-03 07:57:37.692527 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 07:57:37.692537 | orchestrator | Friday 03 April 2026 07:57:15 +0000 (0:00:00.793) 0:10:28.723 ********** 2026-04-03 07:57:37.692548 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-03 07:57:37.692558 | orchestrator | 2026-04-03 07:57:37.692569 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 07:57:37.692579 | orchestrator | Friday 03 April 2026 07:57:17 +0000 (0:00:01.157) 0:10:29.880 ********** 2026-04-03 07:57:37.692590 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692600 | orchestrator | 2026-04-03 07:57:37.692611 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 07:57:37.692621 | orchestrator | Friday 03 April 2026 07:57:18 +0000 (0:00:01.489) 0:10:31.369 ********** 2026-04-03 07:57:37.692632 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692642 | orchestrator | 2026-04-03 07:57:37.692652 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 07:57:37.692663 | orchestrator | Friday 03 April 2026 07:57:19 +0000 (0:00:01.189) 0:10:32.559 ********** 2026-04-03 07:57:37.692676 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692777 | orchestrator | 2026-04-03 07:57:37.692793 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 07:57:37.692805 | orchestrator | Friday 03 April 2026 07:57:21 +0000 (0:00:01.522) 0:10:34.082 ********** 2026-04-03 07:57:37.692818 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692830 | orchestrator | 2026-04-03 07:57:37.692843 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 07:57:37.692855 | orchestrator | Friday 03 April 2026 07:57:22 +0000 (0:00:01.207) 0:10:35.290 ********** 2026-04-03 07:57:37.692867 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692903 | orchestrator | 2026-04-03 07:57:37.692916 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 07:57:37.692929 | orchestrator | Friday 03 April 2026 07:57:23 +0000 (0:00:01.294) 0:10:36.585 ********** 2026-04-03 07:57:37.692941 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.692977 | orchestrator | 2026-04-03 07:57:37.692990 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 07:57:37.693003 | orchestrator | Friday 03 April 2026 07:57:24 +0000 (0:00:01.161) 0:10:37.746 ********** 2026-04-03 07:57:37.693015 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:37.693029 | orchestrator | 2026-04-03 07:57:37.693039 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 07:57:37.693050 | orchestrator | Friday 03 April 2026 07:57:26 +0000 (0:00:01.207) 0:10:38.954 ********** 2026-04-03 07:57:37.693061 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.693071 | orchestrator | 2026-04-03 07:57:37.693082 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 07:57:37.693093 | orchestrator | Friday 03 April 2026 07:57:27 +0000 (0:00:01.216) 0:10:40.171 ********** 2026-04-03 07:57:37.693103 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 07:57:37.693114 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:57:37.693125 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:57:37.693136 | orchestrator | 2026-04-03 07:57:37.693146 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 07:57:37.693157 | orchestrator | Friday 03 April 2026 07:57:29 +0000 (0:00:01.755) 0:10:41.926 ********** 2026-04-03 07:57:37.693168 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:37.693178 | orchestrator | 2026-04-03 07:57:37.693189 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 07:57:37.693200 | orchestrator | Friday 03 April 2026 07:57:30 +0000 (0:00:01.311) 0:10:43.237 ********** 2026-04-03 07:57:37.693211 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 07:57:37.693221 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:57:37.693232 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:57:37.693243 | orchestrator | 2026-04-03 07:57:37.693254 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 07:57:37.693265 | orchestrator | Friday 03 April 2026 07:57:33 +0000 (0:00:02.890) 0:10:46.128 ********** 2026-04-03 07:57:37.693294 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 07:57:37.693306 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 07:57:37.693317 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 07:57:37.693327 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:37.693338 | orchestrator | 2026-04-03 07:57:37.693355 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 07:57:37.693366 | orchestrator | Friday 03 April 2026 07:57:34 +0000 (0:00:01.417) 0:10:47.545 ********** 2026-04-03 07:57:37.693378 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693392 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693403 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693414 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:37.693433 | orchestrator | 2026-04-03 07:57:37.693444 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 07:57:37.693455 | orchestrator | Friday 03 April 2026 07:57:36 +0000 (0:00:01.690) 0:10:49.236 ********** 2026-04-03 07:57:37.693468 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693482 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693494 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:37.693505 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:37.693516 | orchestrator | 2026-04-03 07:57:37.693526 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 07:57:37.693537 | orchestrator | Friday 03 April 2026 07:57:37 +0000 (0:00:01.176) 0:10:50.412 ********** 2026-04-03 07:57:37.693551 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 07:57:30.917589', 'end': '2026-04-03 07:57:30.971666', 'delta': '0:00:00.054077', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 07:57:37.693574 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'a19b2cd80470', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 07:57:31.479549', 'end': '2026-04-03 07:57:31.532539', 'delta': '0:00:00.052990', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a19b2cd80470'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 07:57:56.596470 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '998d77407386', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 07:57:32.040089', 'end': '2026-04-03 07:57:32.085846', 'delta': '0:00:00.045757', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['998d77407386'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 07:57:56.596604 | orchestrator | 2026-04-03 07:57:56.596622 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 07:57:56.596636 | orchestrator | Friday 03 April 2026 07:57:38 +0000 (0:00:01.226) 0:10:51.639 ********** 2026-04-03 07:57:56.596647 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:56.596659 | orchestrator | 2026-04-03 07:57:56.596671 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 07:57:56.596682 | orchestrator | Friday 03 April 2026 07:57:40 +0000 (0:00:01.341) 0:10:52.981 ********** 2026-04-03 07:57:56.596693 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.596704 | orchestrator | 2026-04-03 07:57:56.596716 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 07:57:56.596726 | orchestrator | Friday 03 April 2026 07:57:41 +0000 (0:00:01.302) 0:10:54.284 ********** 2026-04-03 07:57:56.596737 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:56.596748 | orchestrator | 2026-04-03 07:57:56.596759 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 07:57:56.596769 | orchestrator | Friday 03 April 2026 07:57:42 +0000 (0:00:01.213) 0:10:55.498 ********** 2026-04-03 07:57:56.596780 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-03 07:57:56.596791 | orchestrator | 2026-04-03 07:57:56.596802 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:57:56.596812 | orchestrator | Friday 03 April 2026 07:57:44 +0000 (0:00:02.037) 0:10:57.535 ********** 2026-04-03 07:57:56.596823 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:57:56.596834 | orchestrator | 2026-04-03 07:57:56.596845 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 07:57:56.596855 | orchestrator | Friday 03 April 2026 07:57:45 +0000 (0:00:01.216) 0:10:58.752 ********** 2026-04-03 07:57:56.596866 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.596877 | orchestrator | 2026-04-03 07:57:56.596888 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 07:57:56.596901 | orchestrator | Friday 03 April 2026 07:57:47 +0000 (0:00:01.159) 0:10:59.912 ********** 2026-04-03 07:57:56.596922 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.596934 | orchestrator | 2026-04-03 07:57:56.596973 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 07:57:56.596987 | orchestrator | Friday 03 April 2026 07:57:48 +0000 (0:00:01.199) 0:11:01.111 ********** 2026-04-03 07:57:56.597000 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597013 | orchestrator | 2026-04-03 07:57:56.597026 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 07:57:56.597039 | orchestrator | Friday 03 April 2026 07:57:49 +0000 (0:00:01.162) 0:11:02.274 ********** 2026-04-03 07:57:56.597052 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597064 | orchestrator | 2026-04-03 07:57:56.597077 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 07:57:56.597091 | orchestrator | Friday 03 April 2026 07:57:50 +0000 (0:00:01.225) 0:11:03.499 ********** 2026-04-03 07:57:56.597103 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597116 | orchestrator | 2026-04-03 07:57:56.597129 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 07:57:56.597172 | orchestrator | Friday 03 April 2026 07:57:51 +0000 (0:00:01.157) 0:11:04.657 ********** 2026-04-03 07:57:56.597196 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597209 | orchestrator | 2026-04-03 07:57:56.597222 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 07:57:56.597235 | orchestrator | Friday 03 April 2026 07:57:52 +0000 (0:00:01.169) 0:11:05.827 ********** 2026-04-03 07:57:56.597248 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597261 | orchestrator | 2026-04-03 07:57:56.597274 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 07:57:56.597296 | orchestrator | Friday 03 April 2026 07:57:54 +0000 (0:00:01.111) 0:11:06.939 ********** 2026-04-03 07:57:56.597309 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597322 | orchestrator | 2026-04-03 07:57:56.597336 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 07:57:56.597348 | orchestrator | Friday 03 April 2026 07:57:55 +0000 (0:00:01.204) 0:11:08.144 ********** 2026-04-03 07:57:56.597358 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:56.597369 | orchestrator | 2026-04-03 07:57:56.597380 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 07:57:56.597390 | orchestrator | Friday 03 April 2026 07:57:56 +0000 (0:00:01.161) 0:11:09.305 ********** 2026-04-03 07:57:56.597426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597441 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597464 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 07:57:56.597477 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597489 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597500 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:56.597536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 07:57:57.898427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:57.898510 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 07:57:57.898521 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:57:57.898531 | orchestrator | 2026-04-03 07:57:57.898539 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 07:57:57.898547 | orchestrator | Friday 03 April 2026 07:57:57 +0000 (0:00:01.306) 0:11:10.612 ********** 2026-04-03 07:57:57.898558 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898588 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898596 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898617 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898640 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898648 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898656 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898670 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:57:57.898691 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:58:33.750281 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 07:58:33.750416 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.750479 | orchestrator | 2026-04-03 07:58:33.750495 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 07:58:33.750508 | orchestrator | Friday 03 April 2026 07:57:59 +0000 (0:00:01.286) 0:11:11.898 ********** 2026-04-03 07:58:33.750519 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:58:33.750531 | orchestrator | 2026-04-03 07:58:33.750543 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 07:58:33.750581 | orchestrator | Friday 03 April 2026 07:58:00 +0000 (0:00:01.519) 0:11:13.418 ********** 2026-04-03 07:58:33.750593 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:58:33.750614 | orchestrator | 2026-04-03 07:58:33.750625 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:58:33.750636 | orchestrator | Friday 03 April 2026 07:58:01 +0000 (0:00:01.148) 0:11:14.566 ********** 2026-04-03 07:58:33.750647 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:58:33.750657 | orchestrator | 2026-04-03 07:58:33.750668 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:58:33.750681 | orchestrator | Friday 03 April 2026 07:58:03 +0000 (0:00:01.544) 0:11:16.111 ********** 2026-04-03 07:58:33.750700 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.750716 | orchestrator | 2026-04-03 07:58:33.750732 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 07:58:33.750749 | orchestrator | Friday 03 April 2026 07:58:04 +0000 (0:00:01.250) 0:11:17.361 ********** 2026-04-03 07:58:33.750767 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.750786 | orchestrator | 2026-04-03 07:58:33.750807 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 07:58:33.750827 | orchestrator | Friday 03 April 2026 07:58:05 +0000 (0:00:01.247) 0:11:18.609 ********** 2026-04-03 07:58:33.750843 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.750856 | orchestrator | 2026-04-03 07:58:33.750868 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 07:58:33.750881 | orchestrator | Friday 03 April 2026 07:58:06 +0000 (0:00:01.165) 0:11:19.774 ********** 2026-04-03 07:58:33.750894 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-03 07:58:33.750907 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:58:33.750949 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-03 07:58:33.750963 | orchestrator | 2026-04-03 07:58:33.750976 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 07:58:33.750989 | orchestrator | Friday 03 April 2026 07:58:08 +0000 (0:00:01.716) 0:11:21.490 ********** 2026-04-03 07:58:33.751001 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 07:58:33.751014 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 07:58:33.751026 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 07:58:33.751039 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751052 | orchestrator | 2026-04-03 07:58:33.751064 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 07:58:33.751077 | orchestrator | Friday 03 April 2026 07:58:09 +0000 (0:00:01.166) 0:11:22.657 ********** 2026-04-03 07:58:33.751090 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751102 | orchestrator | 2026-04-03 07:58:33.751115 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 07:58:33.751127 | orchestrator | Friday 03 April 2026 07:58:10 +0000 (0:00:01.197) 0:11:23.854 ********** 2026-04-03 07:58:33.751140 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 07:58:33.751168 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:58:33.751179 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:58:33.751190 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:58:33.751201 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:58:33.751211 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:58:33.751222 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:58:33.751233 | orchestrator | 2026-04-03 07:58:33.751243 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 07:58:33.751255 | orchestrator | Friday 03 April 2026 07:58:13 +0000 (0:00:02.155) 0:11:26.010 ********** 2026-04-03 07:58:33.751275 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 07:58:33.751286 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:58:33.751297 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 07:58:33.751308 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 07:58:33.751337 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 07:58:33.751349 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 07:58:33.751360 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 07:58:33.751370 | orchestrator | 2026-04-03 07:58:33.751381 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-03 07:58:33.751392 | orchestrator | Friday 03 April 2026 07:58:15 +0000 (0:00:02.323) 0:11:28.334 ********** 2026-04-03 07:58:33.751402 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751413 | orchestrator | 2026-04-03 07:58:33.751424 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-03 07:58:33.751434 | orchestrator | Friday 03 April 2026 07:58:16 +0000 (0:00:00.860) 0:11:29.195 ********** 2026-04-03 07:58:33.751445 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751455 | orchestrator | 2026-04-03 07:58:33.751466 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-03 07:58:33.751477 | orchestrator | Friday 03 April 2026 07:58:17 +0000 (0:00:00.875) 0:11:30.071 ********** 2026-04-03 07:58:33.751487 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751498 | orchestrator | 2026-04-03 07:58:33.751509 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-03 07:58:33.751520 | orchestrator | Friday 03 April 2026 07:58:18 +0000 (0:00:00.801) 0:11:30.872 ********** 2026-04-03 07:58:33.751530 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751541 | orchestrator | 2026-04-03 07:58:33.751552 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-03 07:58:33.751562 | orchestrator | Friday 03 April 2026 07:58:18 +0000 (0:00:00.880) 0:11:31.752 ********** 2026-04-03 07:58:33.751573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751584 | orchestrator | 2026-04-03 07:58:33.751594 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-03 07:58:33.751605 | orchestrator | Friday 03 April 2026 07:58:19 +0000 (0:00:00.873) 0:11:32.626 ********** 2026-04-03 07:58:33.751616 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 07:58:33.751627 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 07:58:33.751638 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 07:58:33.751648 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751659 | orchestrator | 2026-04-03 07:58:33.751670 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-03 07:58:33.751681 | orchestrator | Friday 03 April 2026 07:58:20 +0000 (0:00:01.077) 0:11:33.704 ********** 2026-04-03 07:58:33.751691 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-03 07:58:33.751702 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-03 07:58:33.751713 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-03 07:58:33.751723 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-03 07:58:33.751734 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-03 07:58:33.751745 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-03 07:58:33.751764 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.751793 | orchestrator | 2026-04-03 07:58:33.751814 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-03 07:58:33.751834 | orchestrator | Friday 03 April 2026 07:58:22 +0000 (0:00:01.374) 0:11:35.078 ********** 2026-04-03 07:58:33.751853 | orchestrator | changed: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:58:33.751866 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 07:58:33.751876 | orchestrator | 2026-04-03 07:58:33.751887 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-03 07:58:33.751898 | orchestrator | Friday 03 April 2026 07:58:25 +0000 (0:00:03.179) 0:11:38.258 ********** 2026-04-03 07:58:33.751908 | orchestrator | changed: [testbed-node-1] 2026-04-03 07:58:33.751975 | orchestrator | 2026-04-03 07:58:33.751989 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 07:58:33.752000 | orchestrator | Friday 03 April 2026 07:58:27 +0000 (0:00:02.124) 0:11:40.382 ********** 2026-04-03 07:58:33.752018 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-03 07:58:33.752030 | orchestrator | 2026-04-03 07:58:33.752041 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 07:58:33.752052 | orchestrator | Friday 03 April 2026 07:58:28 +0000 (0:00:01.198) 0:11:41.580 ********** 2026-04-03 07:58:33.752062 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-03 07:58:33.752073 | orchestrator | 2026-04-03 07:58:33.752084 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 07:58:33.752095 | orchestrator | Friday 03 April 2026 07:58:29 +0000 (0:00:01.155) 0:11:42.736 ********** 2026-04-03 07:58:33.752105 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:58:33.752116 | orchestrator | 2026-04-03 07:58:33.752127 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 07:58:33.752137 | orchestrator | Friday 03 April 2026 07:58:31 +0000 (0:00:01.607) 0:11:44.343 ********** 2026-04-03 07:58:33.752148 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.752159 | orchestrator | 2026-04-03 07:58:33.752169 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 07:58:33.752180 | orchestrator | Friday 03 April 2026 07:58:32 +0000 (0:00:01.118) 0:11:45.462 ********** 2026-04-03 07:58:33.752190 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:58:33.752201 | orchestrator | 2026-04-03 07:58:33.752212 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 07:58:33.752231 | orchestrator | Friday 03 April 2026 07:58:33 +0000 (0:00:01.141) 0:11:46.603 ********** 2026-04-03 07:59:15.714682 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.714833 | orchestrator | 2026-04-03 07:59:15.714864 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 07:59:15.714886 | orchestrator | Friday 03 April 2026 07:58:34 +0000 (0:00:01.130) 0:11:47.734 ********** 2026-04-03 07:59:15.714990 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715010 | orchestrator | 2026-04-03 07:59:15.715023 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 07:59:15.715034 | orchestrator | Friday 03 April 2026 07:58:36 +0000 (0:00:01.561) 0:11:49.296 ********** 2026-04-03 07:59:15.715045 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715056 | orchestrator | 2026-04-03 07:59:15.715067 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 07:59:15.715078 | orchestrator | Friday 03 April 2026 07:58:37 +0000 (0:00:01.141) 0:11:50.437 ********** 2026-04-03 07:59:15.715089 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715100 | orchestrator | 2026-04-03 07:59:15.715111 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 07:59:15.715122 | orchestrator | Friday 03 April 2026 07:58:38 +0000 (0:00:01.127) 0:11:51.564 ********** 2026-04-03 07:59:15.715133 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715144 | orchestrator | 2026-04-03 07:59:15.715155 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 07:59:15.715197 | orchestrator | Friday 03 April 2026 07:58:40 +0000 (0:00:01.541) 0:11:53.106 ********** 2026-04-03 07:59:15.715210 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715223 | orchestrator | 2026-04-03 07:59:15.715243 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 07:59:15.715262 | orchestrator | Friday 03 April 2026 07:58:41 +0000 (0:00:01.546) 0:11:54.652 ********** 2026-04-03 07:59:15.715280 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715298 | orchestrator | 2026-04-03 07:59:15.715317 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 07:59:15.715336 | orchestrator | Friday 03 April 2026 07:58:42 +0000 (0:00:00.822) 0:11:55.475 ********** 2026-04-03 07:59:15.715354 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715374 | orchestrator | 2026-04-03 07:59:15.715390 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 07:59:15.715406 | orchestrator | Friday 03 April 2026 07:58:43 +0000 (0:00:00.763) 0:11:56.238 ********** 2026-04-03 07:59:15.715426 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715444 | orchestrator | 2026-04-03 07:59:15.715463 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 07:59:15.715481 | orchestrator | Friday 03 April 2026 07:58:44 +0000 (0:00:00.765) 0:11:57.004 ********** 2026-04-03 07:59:15.715499 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715516 | orchestrator | 2026-04-03 07:59:15.715534 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 07:59:15.715552 | orchestrator | Friday 03 April 2026 07:58:44 +0000 (0:00:00.802) 0:11:57.807 ********** 2026-04-03 07:59:15.715570 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715589 | orchestrator | 2026-04-03 07:59:15.715608 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 07:59:15.715626 | orchestrator | Friday 03 April 2026 07:58:45 +0000 (0:00:00.804) 0:11:58.611 ********** 2026-04-03 07:59:15.715643 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715659 | orchestrator | 2026-04-03 07:59:15.715675 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 07:59:15.715691 | orchestrator | Friday 03 April 2026 07:58:46 +0000 (0:00:00.796) 0:11:59.407 ********** 2026-04-03 07:59:15.715710 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.715729 | orchestrator | 2026-04-03 07:59:15.715746 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 07:59:15.715763 | orchestrator | Friday 03 April 2026 07:58:47 +0000 (0:00:00.792) 0:12:00.200 ********** 2026-04-03 07:59:15.715780 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715797 | orchestrator | 2026-04-03 07:59:15.715815 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 07:59:15.715832 | orchestrator | Friday 03 April 2026 07:58:48 +0000 (0:00:00.799) 0:12:00.999 ********** 2026-04-03 07:59:15.715849 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715867 | orchestrator | 2026-04-03 07:59:15.715884 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 07:59:15.715934 | orchestrator | Friday 03 April 2026 07:58:48 +0000 (0:00:00.825) 0:12:01.825 ********** 2026-04-03 07:59:15.715953 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.715972 | orchestrator | 2026-04-03 07:59:15.716011 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 07:59:15.716029 | orchestrator | Friday 03 April 2026 07:58:49 +0000 (0:00:00.797) 0:12:02.623 ********** 2026-04-03 07:59:15.716048 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716068 | orchestrator | 2026-04-03 07:59:15.716087 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 07:59:15.716106 | orchestrator | Friday 03 April 2026 07:58:50 +0000 (0:00:00.844) 0:12:03.468 ********** 2026-04-03 07:59:15.716126 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716144 | orchestrator | 2026-04-03 07:59:15.716162 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 07:59:15.716199 | orchestrator | Friday 03 April 2026 07:58:51 +0000 (0:00:00.771) 0:12:04.239 ********** 2026-04-03 07:59:15.716217 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716235 | orchestrator | 2026-04-03 07:59:15.716254 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 07:59:15.716274 | orchestrator | Friday 03 April 2026 07:58:52 +0000 (0:00:00.787) 0:12:05.027 ********** 2026-04-03 07:59:15.716294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716312 | orchestrator | 2026-04-03 07:59:15.716333 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 07:59:15.716351 | orchestrator | Friday 03 April 2026 07:58:52 +0000 (0:00:00.785) 0:12:05.812 ********** 2026-04-03 07:59:15.716370 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716383 | orchestrator | 2026-04-03 07:59:15.716430 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 07:59:15.716449 | orchestrator | Friday 03 April 2026 07:58:53 +0000 (0:00:00.796) 0:12:06.608 ********** 2026-04-03 07:59:15.716468 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716485 | orchestrator | 2026-04-03 07:59:15.716504 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 07:59:15.716523 | orchestrator | Friday 03 April 2026 07:58:54 +0000 (0:00:00.801) 0:12:07.410 ********** 2026-04-03 07:59:15.716542 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716561 | orchestrator | 2026-04-03 07:59:15.716579 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 07:59:15.716599 | orchestrator | Friday 03 April 2026 07:58:55 +0000 (0:00:00.785) 0:12:08.195 ********** 2026-04-03 07:59:15.716618 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716636 | orchestrator | 2026-04-03 07:59:15.716655 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 07:59:15.716674 | orchestrator | Friday 03 April 2026 07:58:56 +0000 (0:00:00.769) 0:12:08.965 ********** 2026-04-03 07:59:15.716693 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716711 | orchestrator | 2026-04-03 07:59:15.716730 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 07:59:15.716748 | orchestrator | Friday 03 April 2026 07:58:56 +0000 (0:00:00.784) 0:12:09.749 ********** 2026-04-03 07:59:15.716767 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716786 | orchestrator | 2026-04-03 07:59:15.716803 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 07:59:15.716822 | orchestrator | Friday 03 April 2026 07:58:57 +0000 (0:00:00.812) 0:12:10.561 ********** 2026-04-03 07:59:15.716840 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716859 | orchestrator | 2026-04-03 07:59:15.716878 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 07:59:15.716920 | orchestrator | Friday 03 April 2026 07:58:58 +0000 (0:00:00.842) 0:12:11.404 ********** 2026-04-03 07:59:15.716939 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.716958 | orchestrator | 2026-04-03 07:59:15.716971 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 07:59:15.716981 | orchestrator | Friday 03 April 2026 07:58:59 +0000 (0:00:00.745) 0:12:12.150 ********** 2026-04-03 07:59:15.716990 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.717000 | orchestrator | 2026-04-03 07:59:15.717009 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 07:59:15.717019 | orchestrator | Friday 03 April 2026 07:59:00 +0000 (0:00:01.611) 0:12:13.761 ********** 2026-04-03 07:59:15.717028 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.717037 | orchestrator | 2026-04-03 07:59:15.717047 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 07:59:15.717056 | orchestrator | Friday 03 April 2026 07:59:03 +0000 (0:00:02.132) 0:12:15.894 ********** 2026-04-03 07:59:15.717066 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-03 07:59:15.717087 | orchestrator | 2026-04-03 07:59:15.717098 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 07:59:15.717107 | orchestrator | Friday 03 April 2026 07:59:04 +0000 (0:00:01.234) 0:12:17.128 ********** 2026-04-03 07:59:15.717117 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.717126 | orchestrator | 2026-04-03 07:59:15.717136 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 07:59:15.717146 | orchestrator | Friday 03 April 2026 07:59:05 +0000 (0:00:01.201) 0:12:18.330 ********** 2026-04-03 07:59:15.717155 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.717165 | orchestrator | 2026-04-03 07:59:15.717174 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 07:59:15.717184 | orchestrator | Friday 03 April 2026 07:59:06 +0000 (0:00:01.137) 0:12:19.468 ********** 2026-04-03 07:59:15.717193 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 07:59:15.717203 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 07:59:15.717212 | orchestrator | 2026-04-03 07:59:15.717222 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 07:59:15.717232 | orchestrator | Friday 03 April 2026 07:59:08 +0000 (0:00:01.800) 0:12:21.268 ********** 2026-04-03 07:59:15.717241 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.717251 | orchestrator | 2026-04-03 07:59:15.717260 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 07:59:15.717278 | orchestrator | Friday 03 April 2026 07:59:09 +0000 (0:00:01.506) 0:12:22.774 ********** 2026-04-03 07:59:15.717288 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.717298 | orchestrator | 2026-04-03 07:59:15.717307 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 07:59:15.717317 | orchestrator | Friday 03 April 2026 07:59:11 +0000 (0:00:01.207) 0:12:23.982 ********** 2026-04-03 07:59:15.717326 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.717336 | orchestrator | 2026-04-03 07:59:15.717345 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 07:59:15.717358 | orchestrator | Friday 03 April 2026 07:59:11 +0000 (0:00:00.764) 0:12:24.747 ********** 2026-04-03 07:59:15.717374 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:15.717390 | orchestrator | 2026-04-03 07:59:15.717406 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 07:59:15.717421 | orchestrator | Friday 03 April 2026 07:59:12 +0000 (0:00:00.782) 0:12:25.530 ********** 2026-04-03 07:59:15.717438 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-03 07:59:15.717453 | orchestrator | 2026-04-03 07:59:15.717470 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 07:59:15.717487 | orchestrator | Friday 03 April 2026 07:59:13 +0000 (0:00:01.196) 0:12:26.726 ********** 2026-04-03 07:59:15.717503 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:15.717519 | orchestrator | 2026-04-03 07:59:15.717535 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 07:59:15.717561 | orchestrator | Friday 03 April 2026 07:59:15 +0000 (0:00:01.839) 0:12:28.566 ********** 2026-04-03 07:59:55.847846 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 07:59:55.848101 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 07:59:55.848125 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 07:59:55.848138 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848152 | orchestrator | 2026-04-03 07:59:55.848164 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 07:59:55.848176 | orchestrator | Friday 03 April 2026 07:59:16 +0000 (0:00:01.145) 0:12:29.711 ********** 2026-04-03 07:59:55.848187 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848198 | orchestrator | 2026-04-03 07:59:55.848209 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 07:59:55.848246 | orchestrator | Friday 03 April 2026 07:59:17 +0000 (0:00:01.139) 0:12:30.852 ********** 2026-04-03 07:59:55.848258 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848269 | orchestrator | 2026-04-03 07:59:55.848280 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 07:59:55.848291 | orchestrator | Friday 03 April 2026 07:59:19 +0000 (0:00:01.186) 0:12:32.038 ********** 2026-04-03 07:59:55.848303 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848314 | orchestrator | 2026-04-03 07:59:55.848325 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 07:59:55.848335 | orchestrator | Friday 03 April 2026 07:59:20 +0000 (0:00:01.205) 0:12:33.243 ********** 2026-04-03 07:59:55.848346 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848356 | orchestrator | 2026-04-03 07:59:55.848368 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 07:59:55.848381 | orchestrator | Friday 03 April 2026 07:59:21 +0000 (0:00:01.226) 0:12:34.470 ********** 2026-04-03 07:59:55.848393 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848405 | orchestrator | 2026-04-03 07:59:55.848418 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 07:59:55.848430 | orchestrator | Friday 03 April 2026 07:59:22 +0000 (0:00:00.848) 0:12:35.318 ********** 2026-04-03 07:59:55.848443 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:55.848457 | orchestrator | 2026-04-03 07:59:55.848470 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 07:59:55.848482 | orchestrator | Friday 03 April 2026 07:59:24 +0000 (0:00:02.243) 0:12:37.562 ********** 2026-04-03 07:59:55.848495 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:55.848507 | orchestrator | 2026-04-03 07:59:55.848520 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 07:59:55.848532 | orchestrator | Friday 03 April 2026 07:59:25 +0000 (0:00:00.844) 0:12:38.407 ********** 2026-04-03 07:59:55.848545 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-03 07:59:55.848558 | orchestrator | 2026-04-03 07:59:55.848573 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 07:59:55.848592 | orchestrator | Friday 03 April 2026 07:59:26 +0000 (0:00:01.149) 0:12:39.556 ********** 2026-04-03 07:59:55.848611 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848629 | orchestrator | 2026-04-03 07:59:55.848647 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 07:59:55.848664 | orchestrator | Friday 03 April 2026 07:59:27 +0000 (0:00:01.172) 0:12:40.729 ********** 2026-04-03 07:59:55.848683 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848700 | orchestrator | 2026-04-03 07:59:55.848720 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 07:59:55.848739 | orchestrator | Friday 03 April 2026 07:59:29 +0000 (0:00:01.139) 0:12:41.868 ********** 2026-04-03 07:59:55.848758 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848769 | orchestrator | 2026-04-03 07:59:55.848780 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 07:59:55.848790 | orchestrator | Friday 03 April 2026 07:59:30 +0000 (0:00:01.171) 0:12:43.039 ********** 2026-04-03 07:59:55.848801 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848811 | orchestrator | 2026-04-03 07:59:55.848822 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 07:59:55.848832 | orchestrator | Friday 03 April 2026 07:59:31 +0000 (0:00:01.230) 0:12:44.270 ********** 2026-04-03 07:59:55.848843 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848853 | orchestrator | 2026-04-03 07:59:55.848912 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 07:59:55.848927 | orchestrator | Friday 03 April 2026 07:59:32 +0000 (0:00:01.162) 0:12:45.433 ********** 2026-04-03 07:59:55.848937 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.848968 | orchestrator | 2026-04-03 07:59:55.848987 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 07:59:55.849005 | orchestrator | Friday 03 April 2026 07:59:33 +0000 (0:00:01.197) 0:12:46.630 ********** 2026-04-03 07:59:55.849022 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849037 | orchestrator | 2026-04-03 07:59:55.849053 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 07:59:55.849071 | orchestrator | Friday 03 April 2026 07:59:34 +0000 (0:00:01.150) 0:12:47.780 ********** 2026-04-03 07:59:55.849090 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849107 | orchestrator | 2026-04-03 07:59:55.849125 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 07:59:55.849143 | orchestrator | Friday 03 April 2026 07:59:36 +0000 (0:00:01.242) 0:12:49.022 ********** 2026-04-03 07:59:55.849162 | orchestrator | ok: [testbed-node-1] 2026-04-03 07:59:55.849178 | orchestrator | 2026-04-03 07:59:55.849196 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 07:59:55.849214 | orchestrator | Friday 03 April 2026 07:59:37 +0000 (0:00:00.858) 0:12:49.881 ********** 2026-04-03 07:59:55.849229 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-03 07:59:55.849247 | orchestrator | 2026-04-03 07:59:55.849266 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 07:59:55.849309 | orchestrator | Friday 03 April 2026 07:59:38 +0000 (0:00:01.116) 0:12:50.998 ********** 2026-04-03 07:59:55.849328 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-03 07:59:55.849347 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-03 07:59:55.849365 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-03 07:59:55.849383 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-03 07:59:55.849401 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-03 07:59:55.849420 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-03 07:59:55.849438 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-03 07:59:55.849456 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-03 07:59:55.849474 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 07:59:55.849495 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 07:59:55.849514 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 07:59:55.849532 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 07:59:55.849551 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 07:59:55.849569 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 07:59:55.849587 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-03 07:59:55.849606 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-03 07:59:55.849624 | orchestrator | 2026-04-03 07:59:55.849645 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 07:59:55.849664 | orchestrator | Friday 03 April 2026 07:59:44 +0000 (0:00:06.340) 0:12:57.339 ********** 2026-04-03 07:59:55.849683 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849701 | orchestrator | 2026-04-03 07:59:55.849719 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 07:59:55.849736 | orchestrator | Friday 03 April 2026 07:59:45 +0000 (0:00:00.792) 0:12:58.131 ********** 2026-04-03 07:59:55.849754 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849771 | orchestrator | 2026-04-03 07:59:55.849791 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 07:59:55.849809 | orchestrator | Friday 03 April 2026 07:59:46 +0000 (0:00:00.764) 0:12:58.895 ********** 2026-04-03 07:59:55.849827 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849845 | orchestrator | 2026-04-03 07:59:55.849891 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 07:59:55.849927 | orchestrator | Friday 03 April 2026 07:59:46 +0000 (0:00:00.792) 0:12:59.687 ********** 2026-04-03 07:59:55.849945 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.849963 | orchestrator | 2026-04-03 07:59:55.849981 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 07:59:55.849999 | orchestrator | Friday 03 April 2026 07:59:47 +0000 (0:00:00.795) 0:13:00.483 ********** 2026-04-03 07:59:55.850094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850113 | orchestrator | 2026-04-03 07:59:55.850131 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 07:59:55.850149 | orchestrator | Friday 03 April 2026 07:59:48 +0000 (0:00:00.754) 0:13:01.238 ********** 2026-04-03 07:59:55.850167 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850185 | orchestrator | 2026-04-03 07:59:55.850203 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 07:59:55.850222 | orchestrator | Friday 03 April 2026 07:59:49 +0000 (0:00:00.793) 0:13:02.031 ********** 2026-04-03 07:59:55.850240 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850259 | orchestrator | 2026-04-03 07:59:55.850277 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 07:59:55.850296 | orchestrator | Friday 03 April 2026 07:59:49 +0000 (0:00:00.805) 0:13:02.836 ********** 2026-04-03 07:59:55.850314 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850332 | orchestrator | 2026-04-03 07:59:55.850351 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 07:59:55.850369 | orchestrator | Friday 03 April 2026 07:59:50 +0000 (0:00:00.856) 0:13:03.692 ********** 2026-04-03 07:59:55.850403 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850422 | orchestrator | 2026-04-03 07:59:55.850440 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 07:59:55.850459 | orchestrator | Friday 03 April 2026 07:59:51 +0000 (0:00:00.773) 0:13:04.465 ********** 2026-04-03 07:59:55.850478 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850496 | orchestrator | 2026-04-03 07:59:55.850515 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 07:59:55.850533 | orchestrator | Friday 03 April 2026 07:59:52 +0000 (0:00:00.826) 0:13:05.292 ********** 2026-04-03 07:59:55.850551 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850569 | orchestrator | 2026-04-03 07:59:55.850588 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 07:59:55.850607 | orchestrator | Friday 03 April 2026 07:59:53 +0000 (0:00:00.778) 0:13:06.071 ********** 2026-04-03 07:59:55.850626 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850644 | orchestrator | 2026-04-03 07:59:55.850662 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 07:59:55.850680 | orchestrator | Friday 03 April 2026 07:59:54 +0000 (0:00:00.826) 0:13:06.897 ********** 2026-04-03 07:59:55.850698 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850716 | orchestrator | 2026-04-03 07:59:55.850734 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 07:59:55.850753 | orchestrator | Friday 03 April 2026 07:59:54 +0000 (0:00:00.891) 0:13:07.789 ********** 2026-04-03 07:59:55.850773 | orchestrator | skipping: [testbed-node-1] 2026-04-03 07:59:55.850792 | orchestrator | 2026-04-03 07:59:55.850811 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 07:59:55.850844 | orchestrator | Friday 03 April 2026 07:59:55 +0000 (0:00:00.910) 0:13:08.699 ********** 2026-04-03 08:00:45.352768 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.352874 | orchestrator | 2026-04-03 08:00:45.352882 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:00:45.352888 | orchestrator | Friday 03 April 2026 07:59:56 +0000 (0:00:00.897) 0:13:09.597 ********** 2026-04-03 08:00:45.352908 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.352915 | orchestrator | 2026-04-03 08:00:45.352921 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:00:45.352928 | orchestrator | Friday 03 April 2026 07:59:57 +0000 (0:00:00.791) 0:13:10.388 ********** 2026-04-03 08:00:45.352933 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.352942 | orchestrator | 2026-04-03 08:00:45.352951 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:00:45.352960 | orchestrator | Friday 03 April 2026 07:59:58 +0000 (0:00:00.761) 0:13:11.150 ********** 2026-04-03 08:00:45.352966 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.352973 | orchestrator | 2026-04-03 08:00:45.352979 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:00:45.352985 | orchestrator | Friday 03 April 2026 07:59:59 +0000 (0:00:00.786) 0:13:11.937 ********** 2026-04-03 08:00:45.352992 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.352998 | orchestrator | 2026-04-03 08:00:45.353005 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:00:45.353010 | orchestrator | Friday 03 April 2026 07:59:59 +0000 (0:00:00.862) 0:13:12.799 ********** 2026-04-03 08:00:45.353017 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353023 | orchestrator | 2026-04-03 08:00:45.353029 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:00:45.353035 | orchestrator | Friday 03 April 2026 08:00:00 +0000 (0:00:00.814) 0:13:13.614 ********** 2026-04-03 08:00:45.353042 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353048 | orchestrator | 2026-04-03 08:00:45.353054 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:00:45.353060 | orchestrator | Friday 03 April 2026 08:00:01 +0000 (0:00:00.772) 0:13:14.387 ********** 2026-04-03 08:00:45.353067 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:00:45.353073 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:00:45.353079 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:00:45.353086 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353092 | orchestrator | 2026-04-03 08:00:45.353098 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:00:45.353105 | orchestrator | Friday 03 April 2026 08:00:02 +0000 (0:00:01.122) 0:13:15.509 ********** 2026-04-03 08:00:45.353111 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:00:45.353115 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:00:45.353119 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:00:45.353124 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353127 | orchestrator | 2026-04-03 08:00:45.353132 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:00:45.353136 | orchestrator | Friday 03 April 2026 08:00:03 +0000 (0:00:01.121) 0:13:16.631 ********** 2026-04-03 08:00:45.353140 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:00:45.353144 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:00:45.353147 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:00:45.353151 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353155 | orchestrator | 2026-04-03 08:00:45.353159 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:00:45.353163 | orchestrator | Friday 03 April 2026 08:00:04 +0000 (0:00:01.079) 0:13:17.710 ********** 2026-04-03 08:00:45.353167 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353171 | orchestrator | 2026-04-03 08:00:45.353175 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:00:45.353179 | orchestrator | Friday 03 April 2026 08:00:05 +0000 (0:00:00.816) 0:13:18.527 ********** 2026-04-03 08:00:45.353194 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-03 08:00:45.353205 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353209 | orchestrator | 2026-04-03 08:00:45.353213 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:00:45.353217 | orchestrator | Friday 03 April 2026 08:00:06 +0000 (0:00:00.895) 0:13:19.422 ********** 2026-04-03 08:00:45.353221 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353225 | orchestrator | 2026-04-03 08:00:45.353229 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:00:45.353233 | orchestrator | Friday 03 April 2026 08:00:08 +0000 (0:00:01.743) 0:13:21.166 ********** 2026-04-03 08:00:45.353237 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353241 | orchestrator | 2026-04-03 08:00:45.353245 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-03 08:00:45.353249 | orchestrator | Friday 03 April 2026 08:00:09 +0000 (0:00:00.771) 0:13:21.937 ********** 2026-04-03 08:00:45.353253 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-1 2026-04-03 08:00:45.353258 | orchestrator | 2026-04-03 08:00:45.353262 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-03 08:00:45.353266 | orchestrator | Friday 03 April 2026 08:00:10 +0000 (0:00:01.152) 0:13:23.090 ********** 2026-04-03 08:00:45.353270 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:00:45.353274 | orchestrator | 2026-04-03 08:00:45.353278 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-03 08:00:45.353282 | orchestrator | Friday 03 April 2026 08:00:13 +0000 (0:00:03.312) 0:13:26.403 ********** 2026-04-03 08:00:45.353285 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353289 | orchestrator | 2026-04-03 08:00:45.353293 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-03 08:00:45.353310 | orchestrator | Friday 03 April 2026 08:00:14 +0000 (0:00:01.283) 0:13:27.686 ********** 2026-04-03 08:00:45.353314 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353318 | orchestrator | 2026-04-03 08:00:45.353322 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-03 08:00:45.353326 | orchestrator | Friday 03 April 2026 08:00:16 +0000 (0:00:01.195) 0:13:28.881 ********** 2026-04-03 08:00:45.353330 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353333 | orchestrator | 2026-04-03 08:00:45.353337 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-03 08:00:45.353342 | orchestrator | Friday 03 April 2026 08:00:17 +0000 (0:00:01.161) 0:13:30.042 ********** 2026-04-03 08:00:45.353347 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:00:45.353352 | orchestrator | 2026-04-03 08:00:45.353357 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-03 08:00:45.353362 | orchestrator | Friday 03 April 2026 08:00:19 +0000 (0:00:02.040) 0:13:32.082 ********** 2026-04-03 08:00:45.353366 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353371 | orchestrator | 2026-04-03 08:00:45.353376 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-03 08:00:45.353381 | orchestrator | Friday 03 April 2026 08:00:20 +0000 (0:00:01.719) 0:13:33.802 ********** 2026-04-03 08:00:45.353385 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353390 | orchestrator | 2026-04-03 08:00:45.353395 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-03 08:00:45.353399 | orchestrator | Friday 03 April 2026 08:00:22 +0000 (0:00:01.491) 0:13:35.293 ********** 2026-04-03 08:00:45.353404 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353409 | orchestrator | 2026-04-03 08:00:45.353414 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-03 08:00:45.353418 | orchestrator | Friday 03 April 2026 08:00:23 +0000 (0:00:01.558) 0:13:36.852 ********** 2026-04-03 08:00:45.353423 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:00:45.353427 | orchestrator | 2026-04-03 08:00:45.353432 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-03 08:00:45.353440 | orchestrator | Friday 03 April 2026 08:00:26 +0000 (0:00:02.186) 0:13:39.039 ********** 2026-04-03 08:00:45.353445 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:00:45.353450 | orchestrator | 2026-04-03 08:00:45.353454 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-03 08:00:45.353459 | orchestrator | Friday 03 April 2026 08:00:27 +0000 (0:00:01.656) 0:13:40.695 ********** 2026-04-03 08:00:45.353464 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:00:45.353468 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-03 08:00:45.353473 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 08:00:45.353478 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-03 08:00:45.353483 | orchestrator | 2026-04-03 08:00:45.353487 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-03 08:00:45.353492 | orchestrator | Friday 03 April 2026 08:00:32 +0000 (0:00:05.039) 0:13:45.735 ********** 2026-04-03 08:00:45.353497 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:00:45.353501 | orchestrator | 2026-04-03 08:00:45.353506 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-03 08:00:45.353511 | orchestrator | Friday 03 April 2026 08:00:35 +0000 (0:00:02.204) 0:13:47.939 ********** 2026-04-03 08:00:45.353515 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353520 | orchestrator | 2026-04-03 08:00:45.353525 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-03 08:00:45.353529 | orchestrator | Friday 03 April 2026 08:00:36 +0000 (0:00:01.122) 0:13:49.062 ********** 2026-04-03 08:00:45.353534 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353538 | orchestrator | 2026-04-03 08:00:45.353543 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-03 08:00:45.353547 | orchestrator | Friday 03 April 2026 08:00:37 +0000 (0:00:01.122) 0:13:50.185 ********** 2026-04-03 08:00:45.353553 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353559 | orchestrator | 2026-04-03 08:00:45.353566 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-03 08:00:45.353575 | orchestrator | Friday 03 April 2026 08:00:39 +0000 (0:00:01.832) 0:13:52.018 ********** 2026-04-03 08:00:45.353583 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:00:45.353589 | orchestrator | 2026-04-03 08:00:45.353595 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-03 08:00:45.353602 | orchestrator | Friday 03 April 2026 08:00:40 +0000 (0:00:01.477) 0:13:53.495 ********** 2026-04-03 08:00:45.353608 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353615 | orchestrator | 2026-04-03 08:00:45.353621 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-03 08:00:45.353628 | orchestrator | Friday 03 April 2026 08:00:41 +0000 (0:00:00.759) 0:13:54.254 ********** 2026-04-03 08:00:45.353634 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-1 2026-04-03 08:00:45.353641 | orchestrator | 2026-04-03 08:00:45.353648 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-03 08:00:45.353654 | orchestrator | Friday 03 April 2026 08:00:42 +0000 (0:00:01.095) 0:13:55.350 ********** 2026-04-03 08:00:45.353660 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353667 | orchestrator | 2026-04-03 08:00:45.353673 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-03 08:00:45.353679 | orchestrator | Friday 03 April 2026 08:00:43 +0000 (0:00:01.176) 0:13:56.527 ********** 2026-04-03 08:00:45.353686 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:00:45.353692 | orchestrator | 2026-04-03 08:00:45.353699 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-03 08:00:45.353705 | orchestrator | Friday 03 April 2026 08:00:44 +0000 (0:00:01.154) 0:13:57.682 ********** 2026-04-03 08:00:45.353711 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-1 2026-04-03 08:00:45.353717 | orchestrator | 2026-04-03 08:00:45.353732 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-03 08:01:54.177181 | orchestrator | Friday 03 April 2026 08:00:46 +0000 (0:00:01.236) 0:13:58.918 ********** 2026-04-03 08:01:54.177292 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.177309 | orchestrator | 2026-04-03 08:01:54.177323 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-03 08:01:54.177335 | orchestrator | Friday 03 April 2026 08:00:48 +0000 (0:00:02.326) 0:14:01.244 ********** 2026-04-03 08:01:54.177346 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.177357 | orchestrator | 2026-04-03 08:01:54.177368 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-03 08:01:54.177379 | orchestrator | Friday 03 April 2026 08:00:50 +0000 (0:00:02.055) 0:14:03.299 ********** 2026-04-03 08:01:54.177390 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.177401 | orchestrator | 2026-04-03 08:01:54.177412 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-03 08:01:54.177423 | orchestrator | Friday 03 April 2026 08:00:52 +0000 (0:00:02.380) 0:14:05.680 ********** 2026-04-03 08:01:54.177434 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:01:54.177446 | orchestrator | 2026-04-03 08:01:54.177457 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-03 08:01:54.177468 | orchestrator | Friday 03 April 2026 08:00:55 +0000 (0:00:02.970) 0:14:08.651 ********** 2026-04-03 08:01:54.177479 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-1 2026-04-03 08:01:54.177490 | orchestrator | 2026-04-03 08:01:54.177502 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-03 08:01:54.177512 | orchestrator | Friday 03 April 2026 08:00:56 +0000 (0:00:01.133) 0:14:09.785 ********** 2026-04-03 08:01:54.177523 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-03 08:01:54.177535 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.177546 | orchestrator | 2026-04-03 08:01:54.177557 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-03 08:01:54.177568 | orchestrator | Friday 03 April 2026 08:01:19 +0000 (0:00:22.926) 0:14:32.712 ********** 2026-04-03 08:01:54.177578 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.177589 | orchestrator | 2026-04-03 08:01:54.177600 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-03 08:01:54.177611 | orchestrator | Friday 03 April 2026 08:01:22 +0000 (0:00:02.650) 0:14:35.363 ********** 2026-04-03 08:01:54.177622 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:01:54.177633 | orchestrator | 2026-04-03 08:01:54.177643 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-03 08:01:54.177654 | orchestrator | Friday 03 April 2026 08:01:23 +0000 (0:00:00.797) 0:14:36.160 ********** 2026-04-03 08:01:54.177667 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-03 08:01:54.177682 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-03 08:01:54.177710 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-03 08:01:54.177748 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-03 08:01:54.177763 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-03 08:01:54.177828 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}])  2026-04-03 08:01:54.177845 | orchestrator | 2026-04-03 08:01:54.177858 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-03 08:01:54.177870 | orchestrator | Friday 03 April 2026 08:01:32 +0000 (0:00:09.516) 0:14:45.676 ********** 2026-04-03 08:01:54.177881 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:01:54.177892 | orchestrator | 2026-04-03 08:01:54.177903 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:01:54.177914 | orchestrator | Friday 03 April 2026 08:01:34 +0000 (0:00:02.120) 0:14:47.797 ********** 2026-04-03 08:01:54.177924 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:01:54.177935 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-03 08:01:54.177946 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-03 08:01:54.177957 | orchestrator | 2026-04-03 08:01:54.177968 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:01:54.177978 | orchestrator | Friday 03 April 2026 08:01:36 +0000 (0:00:01.630) 0:14:49.428 ********** 2026-04-03 08:01:54.177989 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 08:01:54.178000 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 08:01:54.178010 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 08:01:54.178085 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:01:54.178097 | orchestrator | 2026-04-03 08:01:54.178108 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-03 08:01:54.178119 | orchestrator | Friday 03 April 2026 08:01:37 +0000 (0:00:01.103) 0:14:50.531 ********** 2026-04-03 08:01:54.178129 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:01:54.178140 | orchestrator | 2026-04-03 08:01:54.178151 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-03 08:01:54.178162 | orchestrator | Friday 03 April 2026 08:01:38 +0000 (0:00:00.792) 0:14:51.324 ********** 2026-04-03 08:01:54.178173 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:01:54.178183 | orchestrator | 2026-04-03 08:01:54.178194 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-03 08:01:54.178205 | orchestrator | 2026-04-03 08:01:54.178215 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-03 08:01:54.178226 | orchestrator | Friday 03 April 2026 08:01:40 +0000 (0:00:02.184) 0:14:53.508 ********** 2026-04-03 08:01:54.178237 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178248 | orchestrator | 2026-04-03 08:01:54.178259 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-03 08:01:54.178270 | orchestrator | Friday 03 April 2026 08:01:41 +0000 (0:00:01.145) 0:14:54.654 ********** 2026-04-03 08:01:54.178291 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178302 | orchestrator | 2026-04-03 08:01:54.178313 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-03 08:01:54.178324 | orchestrator | Friday 03 April 2026 08:01:42 +0000 (0:00:00.871) 0:14:55.526 ********** 2026-04-03 08:01:54.178334 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:01:54.178345 | orchestrator | 2026-04-03 08:01:54.178356 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-03 08:01:54.178366 | orchestrator | Friday 03 April 2026 08:01:43 +0000 (0:00:00.816) 0:14:56.343 ********** 2026-04-03 08:01:54.178377 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178388 | orchestrator | 2026-04-03 08:01:54.178399 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:01:54.178413 | orchestrator | Friday 03 April 2026 08:01:44 +0000 (0:00:00.829) 0:14:57.173 ********** 2026-04-03 08:01:54.178431 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-03 08:01:54.178449 | orchestrator | 2026-04-03 08:01:54.178466 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:01:54.178484 | orchestrator | Friday 03 April 2026 08:01:45 +0000 (0:00:01.140) 0:14:58.314 ********** 2026-04-03 08:01:54.178501 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178519 | orchestrator | 2026-04-03 08:01:54.178537 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:01:54.178564 | orchestrator | Friday 03 April 2026 08:01:46 +0000 (0:00:01.438) 0:14:59.752 ********** 2026-04-03 08:01:54.178582 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178600 | orchestrator | 2026-04-03 08:01:54.178619 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:01:54.178637 | orchestrator | Friday 03 April 2026 08:01:48 +0000 (0:00:01.133) 0:15:00.886 ********** 2026-04-03 08:01:54.178656 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178675 | orchestrator | 2026-04-03 08:01:54.178694 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:01:54.178714 | orchestrator | Friday 03 April 2026 08:01:49 +0000 (0:00:01.461) 0:15:02.347 ********** 2026-04-03 08:01:54.178732 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178752 | orchestrator | 2026-04-03 08:01:54.178770 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:01:54.178813 | orchestrator | Friday 03 April 2026 08:01:50 +0000 (0:00:01.211) 0:15:03.559 ********** 2026-04-03 08:01:54.178824 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178835 | orchestrator | 2026-04-03 08:01:54.178845 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:01:54.178856 | orchestrator | Friday 03 April 2026 08:01:51 +0000 (0:00:01.155) 0:15:04.715 ********** 2026-04-03 08:01:54.178867 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:01:54.178877 | orchestrator | 2026-04-03 08:01:54.178888 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:01:54.178899 | orchestrator | Friday 03 April 2026 08:01:53 +0000 (0:00:01.156) 0:15:05.872 ********** 2026-04-03 08:01:54.178910 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:01:54.178920 | orchestrator | 2026-04-03 08:01:54.178931 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:01:54.178955 | orchestrator | Friday 03 April 2026 08:01:54 +0000 (0:00:01.157) 0:15:07.030 ********** 2026-04-03 08:02:19.638170 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:19.638307 | orchestrator | 2026-04-03 08:02:19.638334 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:02:19.638355 | orchestrator | Friday 03 April 2026 08:01:55 +0000 (0:00:01.195) 0:15:08.226 ********** 2026-04-03 08:02:19.638374 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:02:19.638395 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:02:19.638452 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:02:19.638474 | orchestrator | 2026-04-03 08:02:19.638493 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:02:19.638514 | orchestrator | Friday 03 April 2026 08:01:57 +0000 (0:00:01.953) 0:15:10.180 ********** 2026-04-03 08:02:19.638533 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:19.638553 | orchestrator | 2026-04-03 08:02:19.638573 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:02:19.638594 | orchestrator | Friday 03 April 2026 08:01:58 +0000 (0:00:01.251) 0:15:11.431 ********** 2026-04-03 08:02:19.638616 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:02:19.638635 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:02:19.638658 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:02:19.638682 | orchestrator | 2026-04-03 08:02:19.638704 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:02:19.638726 | orchestrator | Friday 03 April 2026 08:02:01 +0000 (0:00:03.249) 0:15:14.681 ********** 2026-04-03 08:02:19.638748 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:02:19.638799 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:02:19.638821 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:02:19.638844 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.638866 | orchestrator | 2026-04-03 08:02:19.638886 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:02:19.638909 | orchestrator | Friday 03 April 2026 08:02:03 +0000 (0:00:01.761) 0:15:16.442 ********** 2026-04-03 08:02:19.638930 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.638956 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.638977 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.638998 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639018 | orchestrator | 2026-04-03 08:02:19.639038 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:02:19.639059 | orchestrator | Friday 03 April 2026 08:02:05 +0000 (0:00:02.119) 0:15:18.562 ********** 2026-04-03 08:02:19.639100 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.639124 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.639143 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:19.639177 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639196 | orchestrator | 2026-04-03 08:02:19.639216 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:02:19.639235 | orchestrator | Friday 03 April 2026 08:02:06 +0000 (0:00:01.200) 0:15:19.763 ********** 2026-04-03 08:02:19.639283 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:01:59.115023', 'end': '2026-04-03 08:01:59.164202', 'delta': '0:00:00.049179', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:02:19.639306 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:02:00.008391', 'end': '2026-04-03 08:02:00.066362', 'delta': '0:00:00.057971', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:02:19.639327 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '998d77407386', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:02:00.579550', 'end': '2026-04-03 08:02:00.631913', 'delta': '0:00:00.052363', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['998d77407386'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:02:19.639345 | orchestrator | 2026-04-03 08:02:19.639363 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:02:19.639432 | orchestrator | Friday 03 April 2026 08:02:08 +0000 (0:00:01.192) 0:15:20.955 ********** 2026-04-03 08:02:19.639487 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:19.639507 | orchestrator | 2026-04-03 08:02:19.639525 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:02:19.639543 | orchestrator | Friday 03 April 2026 08:02:09 +0000 (0:00:01.346) 0:15:22.302 ********** 2026-04-03 08:02:19.639562 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639580 | orchestrator | 2026-04-03 08:02:19.639600 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:02:19.639619 | orchestrator | Friday 03 April 2026 08:02:10 +0000 (0:00:01.289) 0:15:23.592 ********** 2026-04-03 08:02:19.639635 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:19.639646 | orchestrator | 2026-04-03 08:02:19.639656 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:02:19.639677 | orchestrator | Friday 03 April 2026 08:02:11 +0000 (0:00:01.150) 0:15:24.742 ********** 2026-04-03 08:02:19.639699 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:02:19.639710 | orchestrator | 2026-04-03 08:02:19.639721 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:02:19.639731 | orchestrator | Friday 03 April 2026 08:02:13 +0000 (0:00:01.993) 0:15:26.736 ********** 2026-04-03 08:02:19.639742 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:19.639753 | orchestrator | 2026-04-03 08:02:19.639796 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:02:19.639817 | orchestrator | Friday 03 April 2026 08:02:14 +0000 (0:00:01.125) 0:15:27.861 ********** 2026-04-03 08:02:19.639837 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639855 | orchestrator | 2026-04-03 08:02:19.639870 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:02:19.639888 | orchestrator | Friday 03 April 2026 08:02:16 +0000 (0:00:01.147) 0:15:29.009 ********** 2026-04-03 08:02:19.639906 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639925 | orchestrator | 2026-04-03 08:02:19.639943 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:02:19.639961 | orchestrator | Friday 03 April 2026 08:02:17 +0000 (0:00:01.197) 0:15:30.206 ********** 2026-04-03 08:02:19.639979 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.639998 | orchestrator | 2026-04-03 08:02:19.640017 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:02:19.640031 | orchestrator | Friday 03 April 2026 08:02:18 +0000 (0:00:01.109) 0:15:31.315 ********** 2026-04-03 08:02:19.640041 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:19.640052 | orchestrator | 2026-04-03 08:02:19.640063 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:02:19.640088 | orchestrator | Friday 03 April 2026 08:02:19 +0000 (0:00:01.174) 0:15:32.489 ********** 2026-04-03 08:02:27.030875 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031066 | orchestrator | 2026-04-03 08:02:27.031084 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:02:27.031098 | orchestrator | Friday 03 April 2026 08:02:20 +0000 (0:00:01.281) 0:15:33.771 ********** 2026-04-03 08:02:27.031110 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031121 | orchestrator | 2026-04-03 08:02:27.031132 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:02:27.031144 | orchestrator | Friday 03 April 2026 08:02:22 +0000 (0:00:01.152) 0:15:34.923 ********** 2026-04-03 08:02:27.031155 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031166 | orchestrator | 2026-04-03 08:02:27.031176 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:02:27.031187 | orchestrator | Friday 03 April 2026 08:02:23 +0000 (0:00:01.145) 0:15:36.069 ********** 2026-04-03 08:02:27.031198 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031208 | orchestrator | 2026-04-03 08:02:27.031220 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:02:27.031231 | orchestrator | Friday 03 April 2026 08:02:24 +0000 (0:00:01.199) 0:15:37.269 ********** 2026-04-03 08:02:27.031242 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031253 | orchestrator | 2026-04-03 08:02:27.031264 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:02:27.031275 | orchestrator | Friday 03 April 2026 08:02:25 +0000 (0:00:01.216) 0:15:38.486 ********** 2026-04-03 08:02:27.031288 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031303 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031339 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:02:27.031389 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031404 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031438 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031457 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:02:27.031483 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:02:27.031511 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:27.031525 | orchestrator | 2026-04-03 08:02:27.031538 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:02:27.031552 | orchestrator | Friday 03 April 2026 08:02:26 +0000 (0:00:01.317) 0:15:39.803 ********** 2026-04-03 08:02:27.031566 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:27.031590 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030014 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030205 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030260 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030352 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030379 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030432 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030471 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030498 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:02:36.030517 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:36.030537 | orchestrator | 2026-04-03 08:02:36.030557 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:02:36.030579 | orchestrator | Friday 03 April 2026 08:02:28 +0000 (0:00:01.241) 0:15:41.045 ********** 2026-04-03 08:02:36.030597 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:36.030616 | orchestrator | 2026-04-03 08:02:36.030634 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:02:36.030653 | orchestrator | Friday 03 April 2026 08:02:29 +0000 (0:00:01.589) 0:15:42.634 ********** 2026-04-03 08:02:36.030671 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:36.030689 | orchestrator | 2026-04-03 08:02:36.030707 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:02:36.030727 | orchestrator | Friday 03 April 2026 08:02:30 +0000 (0:00:01.149) 0:15:43.784 ********** 2026-04-03 08:02:36.030745 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:02:36.030798 | orchestrator | 2026-04-03 08:02:36.030820 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:02:36.030840 | orchestrator | Friday 03 April 2026 08:02:32 +0000 (0:00:01.507) 0:15:45.291 ********** 2026-04-03 08:02:36.030860 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:36.030881 | orchestrator | 2026-04-03 08:02:36.030902 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:02:36.030922 | orchestrator | Friday 03 April 2026 08:02:33 +0000 (0:00:01.113) 0:15:46.405 ********** 2026-04-03 08:02:36.030942 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:36.030964 | orchestrator | 2026-04-03 08:02:36.030983 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:02:36.031003 | orchestrator | Friday 03 April 2026 08:02:34 +0000 (0:00:01.297) 0:15:47.702 ********** 2026-04-03 08:02:36.031024 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:02:36.031059 | orchestrator | 2026-04-03 08:02:36.031081 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:02:36.031116 | orchestrator | Friday 03 April 2026 08:02:36 +0000 (0:00:01.182) 0:15:48.885 ********** 2026-04-03 08:03:15.193822 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-03 08:03:15.193922 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-03 08:03:15.193933 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:03:15.193942 | orchestrator | 2026-04-03 08:03:15.193952 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:03:15.193961 | orchestrator | Friday 03 April 2026 08:02:38 +0000 (0:00:02.043) 0:15:50.929 ********** 2026-04-03 08:03:15.193971 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:03:15.193979 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:03:15.193987 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:03:15.193995 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194003 | orchestrator | 2026-04-03 08:03:15.194012 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:03:15.194069 | orchestrator | Friday 03 April 2026 08:02:39 +0000 (0:00:01.183) 0:15:52.112 ********** 2026-04-03 08:03:15.194077 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194084 | orchestrator | 2026-04-03 08:03:15.194093 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:03:15.194101 | orchestrator | Friday 03 April 2026 08:02:40 +0000 (0:00:01.201) 0:15:53.314 ********** 2026-04-03 08:03:15.194108 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:03:15.194117 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:03:15.194126 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:03:15.194134 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:03:15.194142 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:03:15.194150 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:03:15.194157 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:03:15.194165 | orchestrator | 2026-04-03 08:03:15.194173 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:03:15.194181 | orchestrator | Friday 03 April 2026 08:02:42 +0000 (0:00:02.150) 0:15:55.465 ********** 2026-04-03 08:03:15.194189 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:03:15.194197 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:03:15.194205 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:03:15.194212 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:03:15.194220 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:03:15.194228 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:03:15.194236 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:03:15.194243 | orchestrator | 2026-04-03 08:03:15.194251 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-03 08:03:15.194272 | orchestrator | Friday 03 April 2026 08:02:44 +0000 (0:00:02.309) 0:15:57.774 ********** 2026-04-03 08:03:15.194280 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194288 | orchestrator | 2026-04-03 08:03:15.194296 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-03 08:03:15.194304 | orchestrator | Friday 03 April 2026 08:02:45 +0000 (0:00:00.916) 0:15:58.691 ********** 2026-04-03 08:03:15.194331 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194339 | orchestrator | 2026-04-03 08:03:15.194349 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-03 08:03:15.194359 | orchestrator | Friday 03 April 2026 08:02:46 +0000 (0:00:00.893) 0:15:59.585 ********** 2026-04-03 08:03:15.194368 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194377 | orchestrator | 2026-04-03 08:03:15.194387 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-03 08:03:15.194396 | orchestrator | Friday 03 April 2026 08:02:47 +0000 (0:00:00.783) 0:16:00.368 ********** 2026-04-03 08:03:15.194406 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194415 | orchestrator | 2026-04-03 08:03:15.194425 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-03 08:03:15.194434 | orchestrator | Friday 03 April 2026 08:02:48 +0000 (0:00:00.980) 0:16:01.349 ********** 2026-04-03 08:03:15.194443 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194452 | orchestrator | 2026-04-03 08:03:15.194462 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-03 08:03:15.194472 | orchestrator | Friday 03 April 2026 08:02:49 +0000 (0:00:00.764) 0:16:02.114 ********** 2026-04-03 08:03:15.194482 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:03:15.194491 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:03:15.194501 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:03:15.194510 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194520 | orchestrator | 2026-04-03 08:03:15.194530 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-03 08:03:15.194539 | orchestrator | Friday 03 April 2026 08:02:50 +0000 (0:00:01.129) 0:16:03.243 ********** 2026-04-03 08:03:15.194549 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-03 08:03:15.194559 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-03 08:03:15.194586 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-03 08:03:15.194600 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-03 08:03:15.194620 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-03 08:03:15.194638 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-03 08:03:15.194649 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194661 | orchestrator | 2026-04-03 08:03:15.194674 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-03 08:03:15.194686 | orchestrator | Friday 03 April 2026 08:02:52 +0000 (0:00:01.692) 0:16:04.935 ********** 2026-04-03 08:03:15.194699 | orchestrator | changed: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:03:15.194713 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:03:15.194750 | orchestrator | 2026-04-03 08:03:15.194764 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-03 08:03:15.194777 | orchestrator | Friday 03 April 2026 08:02:55 +0000 (0:00:03.224) 0:16:08.160 ********** 2026-04-03 08:03:15.194786 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:03:15.194793 | orchestrator | 2026-04-03 08:03:15.194801 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:03:15.194809 | orchestrator | Friday 03 April 2026 08:02:57 +0000 (0:00:02.145) 0:16:10.306 ********** 2026-04-03 08:03:15.194817 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-03 08:03:15.194826 | orchestrator | 2026-04-03 08:03:15.194834 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:03:15.194841 | orchestrator | Friday 03 April 2026 08:02:58 +0000 (0:00:01.323) 0:16:11.629 ********** 2026-04-03 08:03:15.194849 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-03 08:03:15.194866 | orchestrator | 2026-04-03 08:03:15.194874 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:03:15.194882 | orchestrator | Friday 03 April 2026 08:02:59 +0000 (0:00:01.147) 0:16:12.777 ********** 2026-04-03 08:03:15.194890 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:15.194898 | orchestrator | 2026-04-03 08:03:15.194905 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:03:15.194913 | orchestrator | Friday 03 April 2026 08:03:01 +0000 (0:00:01.533) 0:16:14.310 ********** 2026-04-03 08:03:15.194921 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194929 | orchestrator | 2026-04-03 08:03:15.194937 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:03:15.194944 | orchestrator | Friday 03 April 2026 08:03:02 +0000 (0:00:01.168) 0:16:15.479 ********** 2026-04-03 08:03:15.194953 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.194967 | orchestrator | 2026-04-03 08:03:15.194986 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:03:15.195001 | orchestrator | Friday 03 April 2026 08:03:03 +0000 (0:00:01.133) 0:16:16.612 ********** 2026-04-03 08:03:15.195015 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195028 | orchestrator | 2026-04-03 08:03:15.195040 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:03:15.195053 | orchestrator | Friday 03 April 2026 08:03:04 +0000 (0:00:01.188) 0:16:17.801 ********** 2026-04-03 08:03:15.195065 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:15.195078 | orchestrator | 2026-04-03 08:03:15.195091 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:03:15.195111 | orchestrator | Friday 03 April 2026 08:03:06 +0000 (0:00:01.560) 0:16:19.361 ********** 2026-04-03 08:03:15.195123 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195136 | orchestrator | 2026-04-03 08:03:15.195149 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:03:15.195164 | orchestrator | Friday 03 April 2026 08:03:07 +0000 (0:00:01.119) 0:16:20.481 ********** 2026-04-03 08:03:15.195177 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195190 | orchestrator | 2026-04-03 08:03:15.195204 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:03:15.195218 | orchestrator | Friday 03 April 2026 08:03:08 +0000 (0:00:01.173) 0:16:21.654 ********** 2026-04-03 08:03:15.195231 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:15.195241 | orchestrator | 2026-04-03 08:03:15.195255 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:03:15.195268 | orchestrator | Friday 03 April 2026 08:03:10 +0000 (0:00:01.626) 0:16:23.280 ********** 2026-04-03 08:03:15.195282 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:15.195296 | orchestrator | 2026-04-03 08:03:15.195304 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:03:15.195311 | orchestrator | Friday 03 April 2026 08:03:11 +0000 (0:00:01.559) 0:16:24.840 ********** 2026-04-03 08:03:15.195319 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195327 | orchestrator | 2026-04-03 08:03:15.195335 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:03:15.195343 | orchestrator | Friday 03 April 2026 08:03:12 +0000 (0:00:00.787) 0:16:25.628 ********** 2026-04-03 08:03:15.195351 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:15.195359 | orchestrator | 2026-04-03 08:03:15.195367 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:03:15.195374 | orchestrator | Friday 03 April 2026 08:03:13 +0000 (0:00:00.811) 0:16:26.440 ********** 2026-04-03 08:03:15.195382 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195390 | orchestrator | 2026-04-03 08:03:15.195398 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:03:15.195406 | orchestrator | Friday 03 April 2026 08:03:14 +0000 (0:00:00.775) 0:16:27.216 ********** 2026-04-03 08:03:15.195422 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:15.195430 | orchestrator | 2026-04-03 08:03:15.195437 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:03:15.195445 | orchestrator | Friday 03 April 2026 08:03:15 +0000 (0:00:00.777) 0:16:27.993 ********** 2026-04-03 08:03:15.195462 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.895686 | orchestrator | 2026-04-03 08:03:55.895847 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:03:55.895860 | orchestrator | Friday 03 April 2026 08:03:15 +0000 (0:00:00.799) 0:16:28.793 ********** 2026-04-03 08:03:55.895869 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.895878 | orchestrator | 2026-04-03 08:03:55.895886 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:03:55.895893 | orchestrator | Friday 03 April 2026 08:03:16 +0000 (0:00:00.832) 0:16:29.626 ********** 2026-04-03 08:03:55.895901 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.895908 | orchestrator | 2026-04-03 08:03:55.895915 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:03:55.895923 | orchestrator | Friday 03 April 2026 08:03:17 +0000 (0:00:00.784) 0:16:30.410 ********** 2026-04-03 08:03:55.895930 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.895938 | orchestrator | 2026-04-03 08:03:55.895946 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:03:55.895953 | orchestrator | Friday 03 April 2026 08:03:18 +0000 (0:00:00.785) 0:16:31.196 ********** 2026-04-03 08:03:55.895960 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.895967 | orchestrator | 2026-04-03 08:03:55.895974 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:03:55.895982 | orchestrator | Friday 03 April 2026 08:03:19 +0000 (0:00:00.794) 0:16:31.990 ********** 2026-04-03 08:03:55.895989 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.895996 | orchestrator | 2026-04-03 08:03:55.896003 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:03:55.896010 | orchestrator | Friday 03 April 2026 08:03:19 +0000 (0:00:00.825) 0:16:32.815 ********** 2026-04-03 08:03:55.896018 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896025 | orchestrator | 2026-04-03 08:03:55.896032 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:03:55.896039 | orchestrator | Friday 03 April 2026 08:03:20 +0000 (0:00:00.803) 0:16:33.619 ********** 2026-04-03 08:03:55.896046 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896053 | orchestrator | 2026-04-03 08:03:55.896061 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:03:55.896068 | orchestrator | Friday 03 April 2026 08:03:21 +0000 (0:00:00.794) 0:16:34.414 ********** 2026-04-03 08:03:55.896075 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896082 | orchestrator | 2026-04-03 08:03:55.896090 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:03:55.896097 | orchestrator | Friday 03 April 2026 08:03:22 +0000 (0:00:00.773) 0:16:35.188 ********** 2026-04-03 08:03:55.896104 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896111 | orchestrator | 2026-04-03 08:03:55.896118 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:03:55.896126 | orchestrator | Friday 03 April 2026 08:03:23 +0000 (0:00:00.858) 0:16:36.046 ********** 2026-04-03 08:03:55.896133 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896140 | orchestrator | 2026-04-03 08:03:55.896147 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:03:55.896155 | orchestrator | Friday 03 April 2026 08:03:23 +0000 (0:00:00.765) 0:16:36.812 ********** 2026-04-03 08:03:55.896162 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896170 | orchestrator | 2026-04-03 08:03:55.896177 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:03:55.896184 | orchestrator | Friday 03 April 2026 08:03:24 +0000 (0:00:00.767) 0:16:37.579 ********** 2026-04-03 08:03:55.896223 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896232 | orchestrator | 2026-04-03 08:03:55.896239 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:03:55.896250 | orchestrator | Friday 03 April 2026 08:03:25 +0000 (0:00:00.801) 0:16:38.381 ********** 2026-04-03 08:03:55.896258 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896267 | orchestrator | 2026-04-03 08:03:55.896276 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:03:55.896285 | orchestrator | Friday 03 April 2026 08:03:26 +0000 (0:00:00.797) 0:16:39.178 ********** 2026-04-03 08:03:55.896293 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896301 | orchestrator | 2026-04-03 08:03:55.896310 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:03:55.896319 | orchestrator | Friday 03 April 2026 08:03:27 +0000 (0:00:00.777) 0:16:39.956 ********** 2026-04-03 08:03:55.896328 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896336 | orchestrator | 2026-04-03 08:03:55.896345 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:03:55.896354 | orchestrator | Friday 03 April 2026 08:03:27 +0000 (0:00:00.765) 0:16:40.722 ********** 2026-04-03 08:03:55.896362 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896371 | orchestrator | 2026-04-03 08:03:55.896380 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:03:55.896388 | orchestrator | Friday 03 April 2026 08:03:28 +0000 (0:00:00.796) 0:16:41.518 ********** 2026-04-03 08:03:55.896396 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896405 | orchestrator | 2026-04-03 08:03:55.896413 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:03:55.896422 | orchestrator | Friday 03 April 2026 08:03:29 +0000 (0:00:00.768) 0:16:42.287 ********** 2026-04-03 08:03:55.896430 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.896439 | orchestrator | 2026-04-03 08:03:55.896447 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:03:55.896456 | orchestrator | Friday 03 April 2026 08:03:31 +0000 (0:00:01.689) 0:16:43.977 ********** 2026-04-03 08:03:55.896465 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.896474 | orchestrator | 2026-04-03 08:03:55.896483 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:03:55.896492 | orchestrator | Friday 03 April 2026 08:03:33 +0000 (0:00:02.159) 0:16:46.136 ********** 2026-04-03 08:03:55.896500 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-03 08:03:55.896510 | orchestrator | 2026-04-03 08:03:55.896543 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:03:55.896553 | orchestrator | Friday 03 April 2026 08:03:34 +0000 (0:00:01.129) 0:16:47.266 ********** 2026-04-03 08:03:55.896561 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896570 | orchestrator | 2026-04-03 08:03:55.896579 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:03:55.896588 | orchestrator | Friday 03 April 2026 08:03:35 +0000 (0:00:01.342) 0:16:48.608 ********** 2026-04-03 08:03:55.896597 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896605 | orchestrator | 2026-04-03 08:03:55.896612 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:03:55.896619 | orchestrator | Friday 03 April 2026 08:03:36 +0000 (0:00:01.228) 0:16:49.837 ********** 2026-04-03 08:03:55.896626 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:03:55.896634 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:03:55.896641 | orchestrator | 2026-04-03 08:03:55.896648 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:03:55.896656 | orchestrator | Friday 03 April 2026 08:03:38 +0000 (0:00:01.813) 0:16:51.651 ********** 2026-04-03 08:03:55.896663 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.896676 | orchestrator | 2026-04-03 08:03:55.896683 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:03:55.896691 | orchestrator | Friday 03 April 2026 08:03:40 +0000 (0:00:01.443) 0:16:53.095 ********** 2026-04-03 08:03:55.896715 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896723 | orchestrator | 2026-04-03 08:03:55.896730 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:03:55.896738 | orchestrator | Friday 03 April 2026 08:03:41 +0000 (0:00:01.184) 0:16:54.279 ********** 2026-04-03 08:03:55.896745 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896752 | orchestrator | 2026-04-03 08:03:55.896759 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:03:55.896766 | orchestrator | Friday 03 April 2026 08:03:42 +0000 (0:00:00.810) 0:16:55.090 ********** 2026-04-03 08:03:55.896773 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896781 | orchestrator | 2026-04-03 08:03:55.896788 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:03:55.896795 | orchestrator | Friday 03 April 2026 08:03:43 +0000 (0:00:00.777) 0:16:55.868 ********** 2026-04-03 08:03:55.896802 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-03 08:03:55.896809 | orchestrator | 2026-04-03 08:03:55.896817 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:03:55.896824 | orchestrator | Friday 03 April 2026 08:03:44 +0000 (0:00:01.178) 0:16:57.047 ********** 2026-04-03 08:03:55.896831 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.896838 | orchestrator | 2026-04-03 08:03:55.896846 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:03:55.896853 | orchestrator | Friday 03 April 2026 08:03:45 +0000 (0:00:01.777) 0:16:58.825 ********** 2026-04-03 08:03:55.896860 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:03:55.896867 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:03:55.896874 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:03:55.896885 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896893 | orchestrator | 2026-04-03 08:03:55.896900 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:03:55.896907 | orchestrator | Friday 03 April 2026 08:03:47 +0000 (0:00:01.151) 0:16:59.977 ********** 2026-04-03 08:03:55.896914 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896922 | orchestrator | 2026-04-03 08:03:55.896929 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:03:55.896936 | orchestrator | Friday 03 April 2026 08:03:48 +0000 (0:00:01.116) 0:17:01.093 ********** 2026-04-03 08:03:55.896944 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896951 | orchestrator | 2026-04-03 08:03:55.896958 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:03:55.896965 | orchestrator | Friday 03 April 2026 08:03:49 +0000 (0:00:01.158) 0:17:02.251 ********** 2026-04-03 08:03:55.896972 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.896980 | orchestrator | 2026-04-03 08:03:55.896987 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:03:55.896994 | orchestrator | Friday 03 April 2026 08:03:50 +0000 (0:00:01.159) 0:17:03.411 ********** 2026-04-03 08:03:55.897001 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.897013 | orchestrator | 2026-04-03 08:03:55.897025 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:03:55.897038 | orchestrator | Friday 03 April 2026 08:03:51 +0000 (0:00:01.162) 0:17:04.574 ********** 2026-04-03 08:03:55.897050 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:03:55.897062 | orchestrator | 2026-04-03 08:03:55.897076 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:03:55.897090 | orchestrator | Friday 03 April 2026 08:03:52 +0000 (0:00:00.799) 0:17:05.374 ********** 2026-04-03 08:03:55.897111 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.897125 | orchestrator | 2026-04-03 08:03:55.897137 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:03:55.897150 | orchestrator | Friday 03 April 2026 08:03:54 +0000 (0:00:02.313) 0:17:07.687 ********** 2026-04-03 08:03:55.897165 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:03:55.897178 | orchestrator | 2026-04-03 08:03:55.897192 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:03:55.897206 | orchestrator | Friday 03 April 2026 08:03:55 +0000 (0:00:00.818) 0:17:08.505 ********** 2026-04-03 08:03:55.897219 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-03 08:03:55.897230 | orchestrator | 2026-04-03 08:03:55.897244 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:04:33.038057 | orchestrator | Friday 03 April 2026 08:03:56 +0000 (0:00:01.124) 0:17:09.630 ********** 2026-04-03 08:04:33.038155 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038175 | orchestrator | 2026-04-03 08:04:33.038185 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:04:33.038194 | orchestrator | Friday 03 April 2026 08:03:57 +0000 (0:00:01.141) 0:17:10.772 ********** 2026-04-03 08:04:33.038203 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038210 | orchestrator | 2026-04-03 08:04:33.038218 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:04:33.038226 | orchestrator | Friday 03 April 2026 08:03:59 +0000 (0:00:01.136) 0:17:11.908 ********** 2026-04-03 08:04:33.038233 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038240 | orchestrator | 2026-04-03 08:04:33.038248 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:04:33.038255 | orchestrator | Friday 03 April 2026 08:04:00 +0000 (0:00:01.243) 0:17:13.152 ********** 2026-04-03 08:04:33.038263 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038270 | orchestrator | 2026-04-03 08:04:33.038278 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:04:33.038285 | orchestrator | Friday 03 April 2026 08:04:01 +0000 (0:00:01.137) 0:17:14.290 ********** 2026-04-03 08:04:33.038292 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038300 | orchestrator | 2026-04-03 08:04:33.038307 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:04:33.038314 | orchestrator | Friday 03 April 2026 08:04:02 +0000 (0:00:01.122) 0:17:15.413 ********** 2026-04-03 08:04:33.038322 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038329 | orchestrator | 2026-04-03 08:04:33.038336 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:04:33.038344 | orchestrator | Friday 03 April 2026 08:04:03 +0000 (0:00:01.177) 0:17:16.590 ********** 2026-04-03 08:04:33.038351 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038358 | orchestrator | 2026-04-03 08:04:33.038366 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:04:33.038373 | orchestrator | Friday 03 April 2026 08:04:05 +0000 (0:00:01.290) 0:17:17.881 ********** 2026-04-03 08:04:33.038380 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038388 | orchestrator | 2026-04-03 08:04:33.038395 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:04:33.038403 | orchestrator | Friday 03 April 2026 08:04:06 +0000 (0:00:01.177) 0:17:19.059 ********** 2026-04-03 08:04:33.038410 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:04:33.038418 | orchestrator | 2026-04-03 08:04:33.038426 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:04:33.038433 | orchestrator | Friday 03 April 2026 08:04:07 +0000 (0:00:00.805) 0:17:19.865 ********** 2026-04-03 08:04:33.038440 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-03 08:04:33.038448 | orchestrator | 2026-04-03 08:04:33.038456 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:04:33.038482 | orchestrator | Friday 03 April 2026 08:04:08 +0000 (0:00:01.178) 0:17:21.043 ********** 2026-04-03 08:04:33.038490 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-03 08:04:33.038497 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-03 08:04:33.038505 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-03 08:04:33.038525 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-03 08:04:33.038532 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-03 08:04:33.038540 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-03 08:04:33.038547 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-03 08:04:33.038554 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:04:33.038561 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:04:33.038569 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:04:33.038579 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:04:33.038588 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:04:33.038596 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:04:33.038605 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:04:33.038614 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-03 08:04:33.038623 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-03 08:04:33.038632 | orchestrator | 2026-04-03 08:04:33.038641 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:04:33.038650 | orchestrator | Friday 03 April 2026 08:04:14 +0000 (0:00:06.215) 0:17:27.259 ********** 2026-04-03 08:04:33.038659 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038668 | orchestrator | 2026-04-03 08:04:33.038693 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:04:33.038703 | orchestrator | Friday 03 April 2026 08:04:15 +0000 (0:00:00.787) 0:17:28.047 ********** 2026-04-03 08:04:33.038712 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038720 | orchestrator | 2026-04-03 08:04:33.038729 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:04:33.038738 | orchestrator | Friday 03 April 2026 08:04:15 +0000 (0:00:00.813) 0:17:28.860 ********** 2026-04-03 08:04:33.038746 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038756 | orchestrator | 2026-04-03 08:04:33.038765 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:04:33.038773 | orchestrator | Friday 03 April 2026 08:04:16 +0000 (0:00:00.769) 0:17:29.630 ********** 2026-04-03 08:04:33.038783 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038791 | orchestrator | 2026-04-03 08:04:33.038800 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:04:33.038822 | orchestrator | Friday 03 April 2026 08:04:17 +0000 (0:00:00.862) 0:17:30.493 ********** 2026-04-03 08:04:33.038831 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038840 | orchestrator | 2026-04-03 08:04:33.038849 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:04:33.038858 | orchestrator | Friday 03 April 2026 08:04:18 +0000 (0:00:00.773) 0:17:31.266 ********** 2026-04-03 08:04:33.038867 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038876 | orchestrator | 2026-04-03 08:04:33.038884 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:04:33.038893 | orchestrator | Friday 03 April 2026 08:04:19 +0000 (0:00:00.768) 0:17:32.034 ********** 2026-04-03 08:04:33.038902 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038911 | orchestrator | 2026-04-03 08:04:33.038920 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:04:33.038935 | orchestrator | Friday 03 April 2026 08:04:19 +0000 (0:00:00.825) 0:17:32.860 ********** 2026-04-03 08:04:33.038943 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038950 | orchestrator | 2026-04-03 08:04:33.038957 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:04:33.038965 | orchestrator | Friday 03 April 2026 08:04:20 +0000 (0:00:00.840) 0:17:33.700 ********** 2026-04-03 08:04:33.038972 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.038979 | orchestrator | 2026-04-03 08:04:33.038986 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:04:33.038993 | orchestrator | Friday 03 April 2026 08:04:21 +0000 (0:00:00.835) 0:17:34.536 ********** 2026-04-03 08:04:33.039001 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039008 | orchestrator | 2026-04-03 08:04:33.039015 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:04:33.039022 | orchestrator | Friday 03 April 2026 08:04:22 +0000 (0:00:00.798) 0:17:35.334 ********** 2026-04-03 08:04:33.039029 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039037 | orchestrator | 2026-04-03 08:04:33.039044 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:04:33.039051 | orchestrator | Friday 03 April 2026 08:04:23 +0000 (0:00:00.790) 0:17:36.124 ********** 2026-04-03 08:04:33.039058 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039065 | orchestrator | 2026-04-03 08:04:33.039072 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:04:33.039080 | orchestrator | Friday 03 April 2026 08:04:24 +0000 (0:00:00.812) 0:17:36.936 ********** 2026-04-03 08:04:33.039087 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039094 | orchestrator | 2026-04-03 08:04:33.039101 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:04:33.039108 | orchestrator | Friday 03 April 2026 08:04:24 +0000 (0:00:00.875) 0:17:37.812 ********** 2026-04-03 08:04:33.039115 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039123 | orchestrator | 2026-04-03 08:04:33.039130 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:04:33.039137 | orchestrator | Friday 03 April 2026 08:04:25 +0000 (0:00:00.838) 0:17:38.650 ********** 2026-04-03 08:04:33.039144 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039151 | orchestrator | 2026-04-03 08:04:33.039158 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:04:33.039169 | orchestrator | Friday 03 April 2026 08:04:26 +0000 (0:00:00.897) 0:17:39.547 ********** 2026-04-03 08:04:33.039177 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039184 | orchestrator | 2026-04-03 08:04:33.039191 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:04:33.039198 | orchestrator | Friday 03 April 2026 08:04:27 +0000 (0:00:00.801) 0:17:40.349 ********** 2026-04-03 08:04:33.039205 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039212 | orchestrator | 2026-04-03 08:04:33.039220 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:04:33.039228 | orchestrator | Friday 03 April 2026 08:04:28 +0000 (0:00:00.784) 0:17:41.134 ********** 2026-04-03 08:04:33.039235 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039242 | orchestrator | 2026-04-03 08:04:33.039250 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:04:33.039257 | orchestrator | Friday 03 April 2026 08:04:29 +0000 (0:00:00.797) 0:17:41.932 ********** 2026-04-03 08:04:33.039264 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039271 | orchestrator | 2026-04-03 08:04:33.039278 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:04:33.039285 | orchestrator | Friday 03 April 2026 08:04:29 +0000 (0:00:00.784) 0:17:42.717 ********** 2026-04-03 08:04:33.039293 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039300 | orchestrator | 2026-04-03 08:04:33.039312 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:04:33.039319 | orchestrator | Friday 03 April 2026 08:04:30 +0000 (0:00:00.891) 0:17:43.608 ********** 2026-04-03 08:04:33.039327 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039334 | orchestrator | 2026-04-03 08:04:33.039341 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:04:33.039348 | orchestrator | Friday 03 April 2026 08:04:31 +0000 (0:00:00.814) 0:17:44.423 ********** 2026-04-03 08:04:33.039355 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:04:33.039363 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:04:33.039370 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:04:33.039377 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:04:33.039384 | orchestrator | 2026-04-03 08:04:33.039391 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:04:33.039398 | orchestrator | Friday 03 April 2026 08:04:32 +0000 (0:00:01.172) 0:17:45.596 ********** 2026-04-03 08:04:33.039406 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:04:33.039417 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:05:53.590428 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:05:53.590545 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.590562 | orchestrator | 2026-04-03 08:05:53.590576 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:05:53.590589 | orchestrator | Friday 03 April 2026 08:04:33 +0000 (0:00:01.154) 0:17:46.750 ********** 2026-04-03 08:05:53.590600 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:05:53.590611 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:05:53.590622 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:05:53.590633 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.590644 | orchestrator | 2026-04-03 08:05:53.590707 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:05:53.590719 | orchestrator | Friday 03 April 2026 08:04:35 +0000 (0:00:01.182) 0:17:47.933 ********** 2026-04-03 08:05:53.590730 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.590741 | orchestrator | 2026-04-03 08:05:53.590752 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:05:53.590763 | orchestrator | Friday 03 April 2026 08:04:35 +0000 (0:00:00.852) 0:17:48.786 ********** 2026-04-03 08:05:53.590776 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-03 08:05:53.590787 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.590798 | orchestrator | 2026-04-03 08:05:53.590810 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:05:53.590821 | orchestrator | Friday 03 April 2026 08:04:36 +0000 (0:00:00.917) 0:17:49.703 ********** 2026-04-03 08:05:53.590832 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.590843 | orchestrator | 2026-04-03 08:05:53.590854 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:05:53.590865 | orchestrator | Friday 03 April 2026 08:04:38 +0000 (0:00:01.400) 0:17:51.104 ********** 2026-04-03 08:05:53.590876 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.590887 | orchestrator | 2026-04-03 08:05:53.590898 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-03 08:05:53.590909 | orchestrator | Friday 03 April 2026 08:04:39 +0000 (0:00:00.811) 0:17:51.916 ********** 2026-04-03 08:05:53.590920 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-2 2026-04-03 08:05:53.590932 | orchestrator | 2026-04-03 08:05:53.590942 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-03 08:05:53.590954 | orchestrator | Friday 03 April 2026 08:04:40 +0000 (0:00:01.171) 0:17:53.088 ********** 2026-04-03 08:05:53.590967 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591003 | orchestrator | 2026-04-03 08:05:53.591017 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-03 08:05:53.591030 | orchestrator | Friday 03 April 2026 08:04:43 +0000 (0:00:03.603) 0:17:56.692 ********** 2026-04-03 08:05:53.591043 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.591056 | orchestrator | 2026-04-03 08:05:53.591068 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-03 08:05:53.591081 | orchestrator | Friday 03 April 2026 08:04:45 +0000 (0:00:01.252) 0:17:57.944 ********** 2026-04-03 08:05:53.591094 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591107 | orchestrator | 2026-04-03 08:05:53.591120 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-03 08:05:53.591147 | orchestrator | Friday 03 April 2026 08:04:46 +0000 (0:00:01.142) 0:17:59.087 ********** 2026-04-03 08:05:53.591160 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591174 | orchestrator | 2026-04-03 08:05:53.591186 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-03 08:05:53.591199 | orchestrator | Friday 03 April 2026 08:04:47 +0000 (0:00:01.221) 0:18:00.308 ********** 2026-04-03 08:05:53.591212 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:05:53.591226 | orchestrator | 2026-04-03 08:05:53.591239 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-03 08:05:53.591251 | orchestrator | Friday 03 April 2026 08:04:49 +0000 (0:00:02.027) 0:18:02.336 ********** 2026-04-03 08:05:53.591264 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591277 | orchestrator | 2026-04-03 08:05:53.591290 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-03 08:05:53.591302 | orchestrator | Friday 03 April 2026 08:04:51 +0000 (0:00:01.618) 0:18:03.955 ********** 2026-04-03 08:05:53.591314 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591328 | orchestrator | 2026-04-03 08:05:53.591340 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-03 08:05:53.591353 | orchestrator | Friday 03 April 2026 08:04:52 +0000 (0:00:01.502) 0:18:05.458 ********** 2026-04-03 08:05:53.591364 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591375 | orchestrator | 2026-04-03 08:05:53.591386 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-03 08:05:53.591396 | orchestrator | Friday 03 April 2026 08:04:54 +0000 (0:00:01.513) 0:18:06.971 ********** 2026-04-03 08:05:53.591407 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:05:53.591418 | orchestrator | 2026-04-03 08:05:53.591429 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-03 08:05:53.591440 | orchestrator | Friday 03 April 2026 08:04:55 +0000 (0:00:01.653) 0:18:08.625 ********** 2026-04-03 08:05:53.591451 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:05:53.591461 | orchestrator | 2026-04-03 08:05:53.591472 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-03 08:05:53.591483 | orchestrator | Friday 03 April 2026 08:04:57 +0000 (0:00:01.576) 0:18:10.202 ********** 2026-04-03 08:05:53.591494 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:05:53.591504 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-03 08:05:53.591515 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-03 08:05:53.591526 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-03 08:05:53.591537 | orchestrator | 2026-04-03 08:05:53.591565 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-03 08:05:53.591576 | orchestrator | Friday 03 April 2026 08:05:01 +0000 (0:00:04.024) 0:18:14.227 ********** 2026-04-03 08:05:53.591587 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:05:53.591598 | orchestrator | 2026-04-03 08:05:53.591608 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-03 08:05:53.591619 | orchestrator | Friday 03 April 2026 08:05:03 +0000 (0:00:02.149) 0:18:16.377 ********** 2026-04-03 08:05:53.591630 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591674 | orchestrator | 2026-04-03 08:05:53.591687 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-03 08:05:53.591698 | orchestrator | Friday 03 April 2026 08:05:04 +0000 (0:00:01.144) 0:18:17.522 ********** 2026-04-03 08:05:53.591708 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591719 | orchestrator | 2026-04-03 08:05:53.591730 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-03 08:05:53.591740 | orchestrator | Friday 03 April 2026 08:05:05 +0000 (0:00:01.271) 0:18:18.793 ********** 2026-04-03 08:05:53.591751 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591761 | orchestrator | 2026-04-03 08:05:53.591772 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-03 08:05:53.591783 | orchestrator | Friday 03 April 2026 08:05:08 +0000 (0:00:02.070) 0:18:20.864 ********** 2026-04-03 08:05:53.591793 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.591804 | orchestrator | 2026-04-03 08:05:53.591815 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-03 08:05:53.591826 | orchestrator | Friday 03 April 2026 08:05:09 +0000 (0:00:01.448) 0:18:22.312 ********** 2026-04-03 08:05:53.591836 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.591847 | orchestrator | 2026-04-03 08:05:53.591858 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-03 08:05:53.591869 | orchestrator | Friday 03 April 2026 08:05:10 +0000 (0:00:00.774) 0:18:23.087 ********** 2026-04-03 08:05:53.591880 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-2 2026-04-03 08:05:53.591890 | orchestrator | 2026-04-03 08:05:53.591901 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-03 08:05:53.591912 | orchestrator | Friday 03 April 2026 08:05:11 +0000 (0:00:01.135) 0:18:24.223 ********** 2026-04-03 08:05:53.591922 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.591933 | orchestrator | 2026-04-03 08:05:53.591944 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-03 08:05:53.591955 | orchestrator | Friday 03 April 2026 08:05:12 +0000 (0:00:01.109) 0:18:25.333 ********** 2026-04-03 08:05:53.591965 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.591976 | orchestrator | 2026-04-03 08:05:53.591987 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-03 08:05:53.591997 | orchestrator | Friday 03 April 2026 08:05:13 +0000 (0:00:01.165) 0:18:26.498 ********** 2026-04-03 08:05:53.592008 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-2 2026-04-03 08:05:53.592019 | orchestrator | 2026-04-03 08:05:53.592030 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-03 08:05:53.592040 | orchestrator | Friday 03 April 2026 08:05:14 +0000 (0:00:01.136) 0:18:27.634 ********** 2026-04-03 08:05:53.592051 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.592061 | orchestrator | 2026-04-03 08:05:53.592072 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-03 08:05:53.592088 | orchestrator | Friday 03 April 2026 08:05:17 +0000 (0:00:02.333) 0:18:29.968 ********** 2026-04-03 08:05:53.592099 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.592110 | orchestrator | 2026-04-03 08:05:53.592120 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-03 08:05:53.592131 | orchestrator | Friday 03 April 2026 08:05:19 +0000 (0:00:01.947) 0:18:31.916 ********** 2026-04-03 08:05:53.592142 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.592152 | orchestrator | 2026-04-03 08:05:53.592163 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-03 08:05:53.592174 | orchestrator | Friday 03 April 2026 08:05:21 +0000 (0:00:02.401) 0:18:34.318 ********** 2026-04-03 08:05:53.592185 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:05:53.592195 | orchestrator | 2026-04-03 08:05:53.592206 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-03 08:05:53.592217 | orchestrator | Friday 03 April 2026 08:05:24 +0000 (0:00:02.730) 0:18:37.049 ********** 2026-04-03 08:05:53.592261 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-2 2026-04-03 08:05:53.592272 | orchestrator | 2026-04-03 08:05:53.592283 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-03 08:05:53.592293 | orchestrator | Friday 03 April 2026 08:05:25 +0000 (0:00:01.248) 0:18:38.298 ********** 2026-04-03 08:05:53.592304 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-03 08:05:53.592315 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.592326 | orchestrator | 2026-04-03 08:05:53.592336 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-03 08:05:53.592347 | orchestrator | Friday 03 April 2026 08:05:48 +0000 (0:00:22.828) 0:19:01.126 ********** 2026-04-03 08:05:53.592358 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:05:53.592368 | orchestrator | 2026-04-03 08:05:53.592379 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-03 08:05:53.592390 | orchestrator | Friday 03 April 2026 08:05:50 +0000 (0:00:02.683) 0:19:03.810 ********** 2026-04-03 08:05:53.592400 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:05:53.592411 | orchestrator | 2026-04-03 08:05:53.592422 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-03 08:05:53.592432 | orchestrator | Friday 03 April 2026 08:05:51 +0000 (0:00:00.789) 0:19:04.600 ********** 2026-04-03 08:05:53.592454 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-03 08:06:36.279514 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-03 08:06:36.279633 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-03 08:06:36.279648 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-03 08:06:36.279662 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-03 08:06:36.279675 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__bc9f8483077054858c87f2673a036f68d85b80e1'}])  2026-04-03 08:06:36.279689 | orchestrator | 2026-04-03 08:06:36.279702 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-03 08:06:36.279823 | orchestrator | Friday 03 April 2026 08:06:01 +0000 (0:00:09.719) 0:19:14.319 ********** 2026-04-03 08:06:36.279837 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:06:36.279850 | orchestrator | 2026-04-03 08:06:36.279862 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:06:36.279873 | orchestrator | Friday 03 April 2026 08:06:03 +0000 (0:00:02.079) 0:19:16.398 ********** 2026-04-03 08:06:36.279884 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:06:36.279895 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-03 08:06:36.279906 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-03 08:06:36.279917 | orchestrator | 2026-04-03 08:06:36.279928 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:06:36.279939 | orchestrator | Friday 03 April 2026 08:06:05 +0000 (0:00:01.918) 0:19:18.317 ********** 2026-04-03 08:06:36.279949 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:06:36.279961 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:06:36.279971 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:06:36.279982 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:06:36.279993 | orchestrator | 2026-04-03 08:06:36.280004 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-03 08:06:36.280015 | orchestrator | Friday 03 April 2026 08:06:06 +0000 (0:00:01.069) 0:19:19.386 ********** 2026-04-03 08:06:36.280026 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:06:36.280037 | orchestrator | 2026-04-03 08:06:36.280051 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-03 08:06:36.280064 | orchestrator | Friday 03 April 2026 08:06:07 +0000 (0:00:00.819) 0:19:20.206 ********** 2026-04-03 08:06:36.280077 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:06:36.280092 | orchestrator | 2026-04-03 08:06:36.280105 | orchestrator | PLAY [Reset mon_host] ********************************************************** 2026-04-03 08:06:36.280118 | orchestrator | 2026-04-03 08:06:36.280131 | orchestrator | TASK [Reset mon_host fact] ***************************************************** 2026-04-03 08:06:36.280144 | orchestrator | Friday 03 April 2026 08:06:10 +0000 (0:00:02.982) 0:19:23.189 ********** 2026-04-03 08:06:36.280157 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:06:36.280171 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:06:36.280183 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:06:36.280195 | orchestrator | 2026-04-03 08:06:36.280208 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-03 08:06:36.280221 | orchestrator | 2026-04-03 08:06:36.280235 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:06:36.280249 | orchestrator | Friday 03 April 2026 08:06:11 +0000 (0:00:01.570) 0:19:24.760 ********** 2026-04-03 08:06:36.280261 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280274 | orchestrator | 2026-04-03 08:06:36.280287 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:06:36.280317 | orchestrator | Friday 03 April 2026 08:06:13 +0000 (0:00:01.128) 0:19:25.889 ********** 2026-04-03 08:06:36.280331 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280344 | orchestrator | 2026-04-03 08:06:36.280357 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:06:36.280370 | orchestrator | Friday 03 April 2026 08:06:14 +0000 (0:00:01.115) 0:19:27.004 ********** 2026-04-03 08:06:36.280383 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280396 | orchestrator | 2026-04-03 08:06:36.280408 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:06:36.280419 | orchestrator | Friday 03 April 2026 08:06:15 +0000 (0:00:01.161) 0:19:28.166 ********** 2026-04-03 08:06:36.280430 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280440 | orchestrator | 2026-04-03 08:06:36.280451 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:06:36.280470 | orchestrator | Friday 03 April 2026 08:06:16 +0000 (0:00:01.122) 0:19:29.289 ********** 2026-04-03 08:06:36.280481 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280492 | orchestrator | 2026-04-03 08:06:36.280503 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:06:36.280513 | orchestrator | Friday 03 April 2026 08:06:17 +0000 (0:00:01.121) 0:19:30.410 ********** 2026-04-03 08:06:36.280524 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280535 | orchestrator | 2026-04-03 08:06:36.280546 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:06:36.280556 | orchestrator | Friday 03 April 2026 08:06:18 +0000 (0:00:01.226) 0:19:31.637 ********** 2026-04-03 08:06:36.280567 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280578 | orchestrator | 2026-04-03 08:06:36.280589 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:06:36.280599 | orchestrator | Friday 03 April 2026 08:06:19 +0000 (0:00:01.120) 0:19:32.757 ********** 2026-04-03 08:06:36.280610 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280621 | orchestrator | 2026-04-03 08:06:36.280632 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:06:36.280642 | orchestrator | Friday 03 April 2026 08:06:21 +0000 (0:00:01.214) 0:19:33.971 ********** 2026-04-03 08:06:36.280653 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280664 | orchestrator | 2026-04-03 08:06:36.280674 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:06:36.280685 | orchestrator | Friday 03 April 2026 08:06:22 +0000 (0:00:01.156) 0:19:35.128 ********** 2026-04-03 08:06:36.280696 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280706 | orchestrator | 2026-04-03 08:06:36.280737 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:06:36.280749 | orchestrator | Friday 03 April 2026 08:06:23 +0000 (0:00:01.129) 0:19:36.258 ********** 2026-04-03 08:06:36.280760 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280771 | orchestrator | 2026-04-03 08:06:36.280781 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:06:36.280792 | orchestrator | Friday 03 April 2026 08:06:24 +0000 (0:00:01.197) 0:19:37.456 ********** 2026-04-03 08:06:36.280807 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280818 | orchestrator | 2026-04-03 08:06:36.280829 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:06:36.280840 | orchestrator | Friday 03 April 2026 08:06:25 +0000 (0:00:01.226) 0:19:38.682 ********** 2026-04-03 08:06:36.280851 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280861 | orchestrator | 2026-04-03 08:06:36.280872 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:06:36.280883 | orchestrator | Friday 03 April 2026 08:06:26 +0000 (0:00:01.133) 0:19:39.816 ********** 2026-04-03 08:06:36.280894 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280904 | orchestrator | 2026-04-03 08:06:36.280915 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:06:36.280926 | orchestrator | Friday 03 April 2026 08:06:28 +0000 (0:00:01.162) 0:19:40.978 ********** 2026-04-03 08:06:36.280936 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280947 | orchestrator | 2026-04-03 08:06:36.280958 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:06:36.280969 | orchestrator | Friday 03 April 2026 08:06:29 +0000 (0:00:01.157) 0:19:42.136 ********** 2026-04-03 08:06:36.280979 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.280990 | orchestrator | 2026-04-03 08:06:36.281001 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:06:36.281011 | orchestrator | Friday 03 April 2026 08:06:30 +0000 (0:00:01.102) 0:19:43.239 ********** 2026-04-03 08:06:36.281022 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.281033 | orchestrator | 2026-04-03 08:06:36.281044 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:06:36.281061 | orchestrator | Friday 03 April 2026 08:06:31 +0000 (0:00:01.107) 0:19:44.346 ********** 2026-04-03 08:06:36.281072 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.281083 | orchestrator | 2026-04-03 08:06:36.281094 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:06:36.281105 | orchestrator | Friday 03 April 2026 08:06:32 +0000 (0:00:01.129) 0:19:45.476 ********** 2026-04-03 08:06:36.281116 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.281126 | orchestrator | 2026-04-03 08:06:36.281137 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:06:36.281148 | orchestrator | Friday 03 April 2026 08:06:33 +0000 (0:00:01.153) 0:19:46.629 ********** 2026-04-03 08:06:36.281159 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.281170 | orchestrator | 2026-04-03 08:06:36.281180 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:06:36.281191 | orchestrator | Friday 03 April 2026 08:06:34 +0000 (0:00:01.157) 0:19:47.787 ********** 2026-04-03 08:06:36.281202 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:06:36.281213 | orchestrator | 2026-04-03 08:06:36.281224 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:06:36.281234 | orchestrator | Friday 03 April 2026 08:06:36 +0000 (0:00:01.274) 0:19:49.062 ********** 2026-04-03 08:06:36.281251 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030359 | orchestrator | 2026-04-03 08:07:21.030476 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:07:21.030493 | orchestrator | Friday 03 April 2026 08:06:37 +0000 (0:00:01.177) 0:19:50.240 ********** 2026-04-03 08:07:21.030505 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030517 | orchestrator | 2026-04-03 08:07:21.030529 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:07:21.030540 | orchestrator | Friday 03 April 2026 08:06:38 +0000 (0:00:01.198) 0:19:51.438 ********** 2026-04-03 08:07:21.030551 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030562 | orchestrator | 2026-04-03 08:07:21.030573 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:07:21.030584 | orchestrator | Friday 03 April 2026 08:06:39 +0000 (0:00:01.164) 0:19:52.603 ********** 2026-04-03 08:07:21.030595 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030606 | orchestrator | 2026-04-03 08:07:21.030617 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:07:21.030628 | orchestrator | Friday 03 April 2026 08:06:40 +0000 (0:00:01.181) 0:19:53.784 ********** 2026-04-03 08:07:21.030639 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030650 | orchestrator | 2026-04-03 08:07:21.030661 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:07:21.030672 | orchestrator | Friday 03 April 2026 08:06:42 +0000 (0:00:01.142) 0:19:54.926 ********** 2026-04-03 08:07:21.030683 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030694 | orchestrator | 2026-04-03 08:07:21.030705 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:07:21.030716 | orchestrator | Friday 03 April 2026 08:06:43 +0000 (0:00:01.120) 0:19:56.047 ********** 2026-04-03 08:07:21.030727 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030738 | orchestrator | 2026-04-03 08:07:21.030749 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:07:21.030760 | orchestrator | Friday 03 April 2026 08:06:44 +0000 (0:00:01.176) 0:19:57.223 ********** 2026-04-03 08:07:21.030771 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030808 | orchestrator | 2026-04-03 08:07:21.030821 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:07:21.030832 | orchestrator | Friday 03 April 2026 08:06:45 +0000 (0:00:01.124) 0:19:58.348 ********** 2026-04-03 08:07:21.030843 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030877 | orchestrator | 2026-04-03 08:07:21.030891 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:07:21.030905 | orchestrator | Friday 03 April 2026 08:06:46 +0000 (0:00:01.114) 0:19:59.463 ********** 2026-04-03 08:07:21.030918 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030931 | orchestrator | 2026-04-03 08:07:21.030945 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:07:21.030959 | orchestrator | Friday 03 April 2026 08:06:47 +0000 (0:00:01.197) 0:20:00.660 ********** 2026-04-03 08:07:21.030972 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.030984 | orchestrator | 2026-04-03 08:07:21.031011 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:07:21.031024 | orchestrator | Friday 03 April 2026 08:06:48 +0000 (0:00:01.166) 0:20:01.827 ********** 2026-04-03 08:07:21.031037 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031051 | orchestrator | 2026-04-03 08:07:21.031064 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:07:21.031077 | orchestrator | Friday 03 April 2026 08:06:50 +0000 (0:00:01.132) 0:20:02.959 ********** 2026-04-03 08:07:21.031089 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031100 | orchestrator | 2026-04-03 08:07:21.031110 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:07:21.031121 | orchestrator | Friday 03 April 2026 08:06:51 +0000 (0:00:01.112) 0:20:04.071 ********** 2026-04-03 08:07:21.031132 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031142 | orchestrator | 2026-04-03 08:07:21.031153 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:07:21.031164 | orchestrator | Friday 03 April 2026 08:06:52 +0000 (0:00:01.140) 0:20:05.212 ********** 2026-04-03 08:07:21.031175 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031186 | orchestrator | 2026-04-03 08:07:21.031196 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:07:21.031207 | orchestrator | Friday 03 April 2026 08:06:53 +0000 (0:00:01.127) 0:20:06.340 ********** 2026-04-03 08:07:21.031218 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031228 | orchestrator | 2026-04-03 08:07:21.031239 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:07:21.031250 | orchestrator | Friday 03 April 2026 08:06:54 +0000 (0:00:01.114) 0:20:07.454 ********** 2026-04-03 08:07:21.031260 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031271 | orchestrator | 2026-04-03 08:07:21.031282 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:07:21.031292 | orchestrator | Friday 03 April 2026 08:06:55 +0000 (0:00:01.187) 0:20:08.642 ********** 2026-04-03 08:07:21.031303 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031314 | orchestrator | 2026-04-03 08:07:21.031325 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:07:21.031337 | orchestrator | Friday 03 April 2026 08:06:56 +0000 (0:00:01.136) 0:20:09.778 ********** 2026-04-03 08:07:21.031348 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031359 | orchestrator | 2026-04-03 08:07:21.031370 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:07:21.031381 | orchestrator | Friday 03 April 2026 08:06:58 +0000 (0:00:01.156) 0:20:10.934 ********** 2026-04-03 08:07:21.031392 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031402 | orchestrator | 2026-04-03 08:07:21.031413 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:07:21.031424 | orchestrator | Friday 03 April 2026 08:06:59 +0000 (0:00:01.200) 0:20:12.135 ********** 2026-04-03 08:07:21.031452 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031464 | orchestrator | 2026-04-03 08:07:21.031475 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:07:21.031486 | orchestrator | Friday 03 April 2026 08:07:00 +0000 (0:00:01.222) 0:20:13.358 ********** 2026-04-03 08:07:21.031505 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031516 | orchestrator | 2026-04-03 08:07:21.031527 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:07:21.031538 | orchestrator | Friday 03 April 2026 08:07:01 +0000 (0:00:01.162) 0:20:14.520 ********** 2026-04-03 08:07:21.031549 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031560 | orchestrator | 2026-04-03 08:07:21.031570 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:07:21.031581 | orchestrator | Friday 03 April 2026 08:07:02 +0000 (0:00:01.154) 0:20:15.675 ********** 2026-04-03 08:07:21.031592 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031603 | orchestrator | 2026-04-03 08:07:21.031613 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:07:21.031624 | orchestrator | Friday 03 April 2026 08:07:03 +0000 (0:00:01.142) 0:20:16.817 ********** 2026-04-03 08:07:21.031635 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031646 | orchestrator | 2026-04-03 08:07:21.031657 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:07:21.031667 | orchestrator | Friday 03 April 2026 08:07:05 +0000 (0:00:01.256) 0:20:18.074 ********** 2026-04-03 08:07:21.031678 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031688 | orchestrator | 2026-04-03 08:07:21.031699 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:07:21.031710 | orchestrator | Friday 03 April 2026 08:07:06 +0000 (0:00:01.242) 0:20:19.316 ********** 2026-04-03 08:07:21.031721 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031731 | orchestrator | 2026-04-03 08:07:21.031742 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:07:21.031753 | orchestrator | Friday 03 April 2026 08:07:07 +0000 (0:00:01.288) 0:20:20.605 ********** 2026-04-03 08:07:21.031764 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031774 | orchestrator | 2026-04-03 08:07:21.031810 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:07:21.031822 | orchestrator | Friday 03 April 2026 08:07:08 +0000 (0:00:01.199) 0:20:21.805 ********** 2026-04-03 08:07:21.031832 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031843 | orchestrator | 2026-04-03 08:07:21.031854 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:07:21.031866 | orchestrator | Friday 03 April 2026 08:07:10 +0000 (0:00:01.144) 0:20:22.949 ********** 2026-04-03 08:07:21.031877 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031888 | orchestrator | 2026-04-03 08:07:21.031899 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:07:21.031910 | orchestrator | Friday 03 April 2026 08:07:11 +0000 (0:00:01.125) 0:20:24.075 ********** 2026-04-03 08:07:21.031925 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031936 | orchestrator | 2026-04-03 08:07:21.031947 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:07:21.031958 | orchestrator | Friday 03 April 2026 08:07:12 +0000 (0:00:01.158) 0:20:25.233 ********** 2026-04-03 08:07:21.031969 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.031980 | orchestrator | 2026-04-03 08:07:21.031991 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:07:21.032001 | orchestrator | Friday 03 April 2026 08:07:13 +0000 (0:00:01.120) 0:20:26.354 ********** 2026-04-03 08:07:21.032012 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.032023 | orchestrator | 2026-04-03 08:07:21.032034 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:07:21.032044 | orchestrator | Friday 03 April 2026 08:07:14 +0000 (0:00:01.147) 0:20:27.502 ********** 2026-04-03 08:07:21.032055 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:07:21.032066 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:07:21.032084 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:07:21.032095 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.032105 | orchestrator | 2026-04-03 08:07:21.032116 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:07:21.032127 | orchestrator | Friday 03 April 2026 08:07:16 +0000 (0:00:01.795) 0:20:29.298 ********** 2026-04-03 08:07:21.032138 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:07:21.032148 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:07:21.032159 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:07:21.032170 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.032181 | orchestrator | 2026-04-03 08:07:21.032192 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:07:21.032202 | orchestrator | Friday 03 April 2026 08:07:18 +0000 (0:00:01.767) 0:20:31.066 ********** 2026-04-03 08:07:21.032213 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:07:21.032224 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:07:21.032235 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:07:21.032245 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.032256 | orchestrator | 2026-04-03 08:07:21.032267 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:07:21.032277 | orchestrator | Friday 03 April 2026 08:07:19 +0000 (0:00:01.416) 0:20:32.483 ********** 2026-04-03 08:07:21.032288 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:21.032299 | orchestrator | 2026-04-03 08:07:21.032310 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:07:21.032321 | orchestrator | Friday 03 April 2026 08:07:20 +0000 (0:00:01.213) 0:20:33.696 ********** 2026-04-03 08:07:21.032332 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-03 08:07:21.032349 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.405398 | orchestrator | 2026-04-03 08:07:55.405547 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:07:55.405573 | orchestrator | Friday 03 April 2026 08:07:22 +0000 (0:00:01.311) 0:20:35.007 ********** 2026-04-03 08:07:55.405593 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.405614 | orchestrator | 2026-04-03 08:07:55.405633 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:07:55.405652 | orchestrator | Friday 03 April 2026 08:07:23 +0000 (0:00:01.144) 0:20:36.152 ********** 2026-04-03 08:07:55.405672 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 08:07:55.405691 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 08:07:55.405710 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 08:07:55.405728 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.405747 | orchestrator | 2026-04-03 08:07:55.405765 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:07:55.405784 | orchestrator | Friday 03 April 2026 08:07:24 +0000 (0:00:01.460) 0:20:37.613 ********** 2026-04-03 08:07:55.405803 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.405822 | orchestrator | 2026-04-03 08:07:55.405905 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:07:55.405926 | orchestrator | Friday 03 April 2026 08:07:25 +0000 (0:00:01.142) 0:20:38.756 ********** 2026-04-03 08:07:55.405946 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.405966 | orchestrator | 2026-04-03 08:07:55.405984 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:07:55.406004 | orchestrator | Friday 03 April 2026 08:07:27 +0000 (0:00:01.167) 0:20:39.924 ********** 2026-04-03 08:07:55.406096 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.406118 | orchestrator | 2026-04-03 08:07:55.406137 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:07:55.406155 | orchestrator | Friday 03 April 2026 08:07:28 +0000 (0:00:01.140) 0:20:41.065 ********** 2026-04-03 08:07:55.406208 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:07:55.406228 | orchestrator | 2026-04-03 08:07:55.406245 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-03 08:07:55.406261 | orchestrator | 2026-04-03 08:07:55.406280 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:07:55.406299 | orchestrator | Friday 03 April 2026 08:07:29 +0000 (0:00:00.943) 0:20:42.008 ********** 2026-04-03 08:07:55.406317 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406336 | orchestrator | 2026-04-03 08:07:55.406355 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:07:55.406374 | orchestrator | Friday 03 April 2026 08:07:30 +0000 (0:00:00.926) 0:20:42.934 ********** 2026-04-03 08:07:55.406387 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406397 | orchestrator | 2026-04-03 08:07:55.406408 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:07:55.406434 | orchestrator | Friday 03 April 2026 08:07:30 +0000 (0:00:00.803) 0:20:43.737 ********** 2026-04-03 08:07:55.406445 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406455 | orchestrator | 2026-04-03 08:07:55.406466 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:07:55.406477 | orchestrator | Friday 03 April 2026 08:07:31 +0000 (0:00:00.914) 0:20:44.652 ********** 2026-04-03 08:07:55.406487 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406498 | orchestrator | 2026-04-03 08:07:55.406508 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:07:55.406519 | orchestrator | Friday 03 April 2026 08:07:32 +0000 (0:00:00.779) 0:20:45.432 ********** 2026-04-03 08:07:55.406530 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406541 | orchestrator | 2026-04-03 08:07:55.406551 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:07:55.406562 | orchestrator | Friday 03 April 2026 08:07:33 +0000 (0:00:00.809) 0:20:46.242 ********** 2026-04-03 08:07:55.406573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406583 | orchestrator | 2026-04-03 08:07:55.406594 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:07:55.406604 | orchestrator | Friday 03 April 2026 08:07:34 +0000 (0:00:00.809) 0:20:47.051 ********** 2026-04-03 08:07:55.406615 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406625 | orchestrator | 2026-04-03 08:07:55.406636 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:07:55.406647 | orchestrator | Friday 03 April 2026 08:07:34 +0000 (0:00:00.765) 0:20:47.817 ********** 2026-04-03 08:07:55.406657 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406668 | orchestrator | 2026-04-03 08:07:55.406678 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:07:55.406689 | orchestrator | Friday 03 April 2026 08:07:35 +0000 (0:00:00.876) 0:20:48.694 ********** 2026-04-03 08:07:55.406699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406710 | orchestrator | 2026-04-03 08:07:55.406720 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:07:55.406731 | orchestrator | Friday 03 April 2026 08:07:36 +0000 (0:00:00.802) 0:20:49.496 ********** 2026-04-03 08:07:55.406742 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406752 | orchestrator | 2026-04-03 08:07:55.406763 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:07:55.406774 | orchestrator | Friday 03 April 2026 08:07:37 +0000 (0:00:00.796) 0:20:50.293 ********** 2026-04-03 08:07:55.406785 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406795 | orchestrator | 2026-04-03 08:07:55.406806 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:07:55.406817 | orchestrator | Friday 03 April 2026 08:07:38 +0000 (0:00:00.780) 0:20:51.074 ********** 2026-04-03 08:07:55.406856 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406884 | orchestrator | 2026-04-03 08:07:55.406895 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:07:55.406906 | orchestrator | Friday 03 April 2026 08:07:39 +0000 (0:00:00.919) 0:20:51.994 ********** 2026-04-03 08:07:55.406918 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406929 | orchestrator | 2026-04-03 08:07:55.406966 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:07:55.406978 | orchestrator | Friday 03 April 2026 08:07:39 +0000 (0:00:00.795) 0:20:52.789 ********** 2026-04-03 08:07:55.406989 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.406999 | orchestrator | 2026-04-03 08:07:55.407010 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:07:55.407021 | orchestrator | Friday 03 April 2026 08:07:40 +0000 (0:00:00.908) 0:20:53.697 ********** 2026-04-03 08:07:55.407031 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407042 | orchestrator | 2026-04-03 08:07:55.407053 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:07:55.407063 | orchestrator | Friday 03 April 2026 08:07:41 +0000 (0:00:00.775) 0:20:54.473 ********** 2026-04-03 08:07:55.407074 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407084 | orchestrator | 2026-04-03 08:07:55.407095 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:07:55.407105 | orchestrator | Friday 03 April 2026 08:07:42 +0000 (0:00:00.777) 0:20:55.250 ********** 2026-04-03 08:07:55.407116 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407127 | orchestrator | 2026-04-03 08:07:55.407137 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:07:55.407148 | orchestrator | Friday 03 April 2026 08:07:43 +0000 (0:00:00.794) 0:20:56.045 ********** 2026-04-03 08:07:55.407158 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407172 | orchestrator | 2026-04-03 08:07:55.407189 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:07:55.407206 | orchestrator | Friday 03 April 2026 08:07:43 +0000 (0:00:00.817) 0:20:56.862 ********** 2026-04-03 08:07:55.407225 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407243 | orchestrator | 2026-04-03 08:07:55.407261 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:07:55.407281 | orchestrator | Friday 03 April 2026 08:07:44 +0000 (0:00:00.805) 0:20:57.668 ********** 2026-04-03 08:07:55.407299 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407317 | orchestrator | 2026-04-03 08:07:55.407335 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:07:55.407352 | orchestrator | Friday 03 April 2026 08:07:45 +0000 (0:00:00.808) 0:20:58.477 ********** 2026-04-03 08:07:55.407370 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407387 | orchestrator | 2026-04-03 08:07:55.407398 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:07:55.407409 | orchestrator | Friday 03 April 2026 08:07:46 +0000 (0:00:00.786) 0:20:59.263 ********** 2026-04-03 08:07:55.407419 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407430 | orchestrator | 2026-04-03 08:07:55.407440 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:07:55.407451 | orchestrator | Friday 03 April 2026 08:07:47 +0000 (0:00:00.798) 0:21:00.062 ********** 2026-04-03 08:07:55.407461 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407472 | orchestrator | 2026-04-03 08:07:55.407490 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:07:55.407501 | orchestrator | Friday 03 April 2026 08:07:47 +0000 (0:00:00.767) 0:21:00.829 ********** 2026-04-03 08:07:55.407512 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407522 | orchestrator | 2026-04-03 08:07:55.407533 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:07:55.407544 | orchestrator | Friday 03 April 2026 08:07:48 +0000 (0:00:00.895) 0:21:01.725 ********** 2026-04-03 08:07:55.407554 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407573 | orchestrator | 2026-04-03 08:07:55.407584 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:07:55.407594 | orchestrator | Friday 03 April 2026 08:07:49 +0000 (0:00:00.800) 0:21:02.526 ********** 2026-04-03 08:07:55.407605 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407615 | orchestrator | 2026-04-03 08:07:55.407626 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:07:55.407637 | orchestrator | Friday 03 April 2026 08:07:50 +0000 (0:00:00.778) 0:21:03.305 ********** 2026-04-03 08:07:55.407647 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407658 | orchestrator | 2026-04-03 08:07:55.407669 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:07:55.407680 | orchestrator | Friday 03 April 2026 08:07:51 +0000 (0:00:00.782) 0:21:04.088 ********** 2026-04-03 08:07:55.407690 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407701 | orchestrator | 2026-04-03 08:07:55.407711 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:07:55.407722 | orchestrator | Friday 03 April 2026 08:07:52 +0000 (0:00:00.799) 0:21:04.887 ********** 2026-04-03 08:07:55.407732 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407743 | orchestrator | 2026-04-03 08:07:55.407753 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:07:55.407764 | orchestrator | Friday 03 April 2026 08:07:52 +0000 (0:00:00.779) 0:21:05.666 ********** 2026-04-03 08:07:55.407775 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407785 | orchestrator | 2026-04-03 08:07:55.407796 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:07:55.407807 | orchestrator | Friday 03 April 2026 08:07:53 +0000 (0:00:00.793) 0:21:06.459 ********** 2026-04-03 08:07:55.407817 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407861 | orchestrator | 2026-04-03 08:07:55.407873 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:07:55.407884 | orchestrator | Friday 03 April 2026 08:07:54 +0000 (0:00:00.854) 0:21:07.314 ********** 2026-04-03 08:07:55.407894 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407905 | orchestrator | 2026-04-03 08:07:55.407916 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:07:55.407927 | orchestrator | Friday 03 April 2026 08:07:55 +0000 (0:00:00.787) 0:21:08.101 ********** 2026-04-03 08:07:55.407937 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:07:55.407948 | orchestrator | 2026-04-03 08:07:55.407968 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:08:26.743052 | orchestrator | Friday 03 April 2026 08:07:56 +0000 (0:00:00.820) 0:21:08.922 ********** 2026-04-03 08:08:26.743168 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743186 | orchestrator | 2026-04-03 08:08:26.743200 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:08:26.743212 | orchestrator | Friday 03 April 2026 08:07:56 +0000 (0:00:00.769) 0:21:09.691 ********** 2026-04-03 08:08:26.743224 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743235 | orchestrator | 2026-04-03 08:08:26.743247 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:08:26.743258 | orchestrator | Friday 03 April 2026 08:07:57 +0000 (0:00:00.794) 0:21:10.485 ********** 2026-04-03 08:08:26.743269 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743280 | orchestrator | 2026-04-03 08:08:26.743291 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:08:26.743302 | orchestrator | Friday 03 April 2026 08:07:58 +0000 (0:00:00.829) 0:21:11.315 ********** 2026-04-03 08:08:26.743314 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743325 | orchestrator | 2026-04-03 08:08:26.743335 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:08:26.743346 | orchestrator | Friday 03 April 2026 08:07:59 +0000 (0:00:00.839) 0:21:12.155 ********** 2026-04-03 08:08:26.743382 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743394 | orchestrator | 2026-04-03 08:08:26.743405 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:08:26.743416 | orchestrator | Friday 03 April 2026 08:08:00 +0000 (0:00:00.786) 0:21:12.941 ********** 2026-04-03 08:08:26.743427 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743437 | orchestrator | 2026-04-03 08:08:26.743449 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:08:26.743461 | orchestrator | Friday 03 April 2026 08:08:00 +0000 (0:00:00.815) 0:21:13.757 ********** 2026-04-03 08:08:26.743472 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743482 | orchestrator | 2026-04-03 08:08:26.743493 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:08:26.743504 | orchestrator | Friday 03 April 2026 08:08:01 +0000 (0:00:00.800) 0:21:14.558 ********** 2026-04-03 08:08:26.743515 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743525 | orchestrator | 2026-04-03 08:08:26.743536 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:08:26.743547 | orchestrator | Friday 03 April 2026 08:08:02 +0000 (0:00:00.764) 0:21:15.322 ********** 2026-04-03 08:08:26.743558 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743569 | orchestrator | 2026-04-03 08:08:26.743580 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:08:26.743594 | orchestrator | Friday 03 April 2026 08:08:03 +0000 (0:00:00.779) 0:21:16.102 ********** 2026-04-03 08:08:26.743621 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743635 | orchestrator | 2026-04-03 08:08:26.743649 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:08:26.743662 | orchestrator | Friday 03 April 2026 08:08:04 +0000 (0:00:00.774) 0:21:16.877 ********** 2026-04-03 08:08:26.743673 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743683 | orchestrator | 2026-04-03 08:08:26.743694 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:08:26.743705 | orchestrator | Friday 03 April 2026 08:08:04 +0000 (0:00:00.778) 0:21:17.655 ********** 2026-04-03 08:08:26.743716 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743727 | orchestrator | 2026-04-03 08:08:26.743738 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:08:26.743748 | orchestrator | Friday 03 April 2026 08:08:05 +0000 (0:00:00.826) 0:21:18.482 ********** 2026-04-03 08:08:26.743759 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743770 | orchestrator | 2026-04-03 08:08:26.743780 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:08:26.743791 | orchestrator | Friday 03 April 2026 08:08:06 +0000 (0:00:00.882) 0:21:19.365 ********** 2026-04-03 08:08:26.743802 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743812 | orchestrator | 2026-04-03 08:08:26.743823 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:08:26.743834 | orchestrator | Friday 03 April 2026 08:08:07 +0000 (0:00:01.352) 0:21:20.718 ********** 2026-04-03 08:08:26.743845 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743856 | orchestrator | 2026-04-03 08:08:26.743891 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:08:26.743902 | orchestrator | Friday 03 April 2026 08:08:08 +0000 (0:00:00.852) 0:21:21.571 ********** 2026-04-03 08:08:26.743913 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743924 | orchestrator | 2026-04-03 08:08:26.743935 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:08:26.743945 | orchestrator | Friday 03 April 2026 08:08:09 +0000 (0:00:00.842) 0:21:22.413 ********** 2026-04-03 08:08:26.743956 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.743966 | orchestrator | 2026-04-03 08:08:26.743978 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:08:26.743997 | orchestrator | Friday 03 April 2026 08:08:10 +0000 (0:00:00.816) 0:21:23.230 ********** 2026-04-03 08:08:26.744008 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744019 | orchestrator | 2026-04-03 08:08:26.744030 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:08:26.744040 | orchestrator | Friday 03 April 2026 08:08:11 +0000 (0:00:00.760) 0:21:23.991 ********** 2026-04-03 08:08:26.744051 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744061 | orchestrator | 2026-04-03 08:08:26.744072 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:08:26.744083 | orchestrator | Friday 03 April 2026 08:08:11 +0000 (0:00:00.794) 0:21:24.786 ********** 2026-04-03 08:08:26.744094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744105 | orchestrator | 2026-04-03 08:08:26.744132 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:08:26.744143 | orchestrator | Friday 03 April 2026 08:08:12 +0000 (0:00:00.810) 0:21:25.596 ********** 2026-04-03 08:08:26.744154 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744165 | orchestrator | 2026-04-03 08:08:26.744176 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:08:26.744187 | orchestrator | Friday 03 April 2026 08:08:13 +0000 (0:00:00.791) 0:21:26.388 ********** 2026-04-03 08:08:26.744197 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:08:26.744209 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:08:26.744220 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:08:26.744230 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744241 | orchestrator | 2026-04-03 08:08:26.744252 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:08:26.744263 | orchestrator | Friday 03 April 2026 08:08:14 +0000 (0:00:01.054) 0:21:27.443 ********** 2026-04-03 08:08:26.744274 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:08:26.744285 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:08:26.744296 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:08:26.744306 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744317 | orchestrator | 2026-04-03 08:08:26.744328 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:08:26.744339 | orchestrator | Friday 03 April 2026 08:08:15 +0000 (0:00:01.068) 0:21:28.511 ********** 2026-04-03 08:08:26.744350 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:08:26.744360 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:08:26.744371 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:08:26.744381 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744392 | orchestrator | 2026-04-03 08:08:26.744403 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:08:26.744414 | orchestrator | Friday 03 April 2026 08:08:16 +0000 (0:00:01.146) 0:21:29.658 ********** 2026-04-03 08:08:26.744425 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744435 | orchestrator | 2026-04-03 08:08:26.744446 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:08:26.744457 | orchestrator | Friday 03 April 2026 08:08:17 +0000 (0:00:00.769) 0:21:30.428 ********** 2026-04-03 08:08:26.744468 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-03 08:08:26.744479 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744490 | orchestrator | 2026-04-03 08:08:26.744500 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:08:26.744511 | orchestrator | Friday 03 April 2026 08:08:18 +0000 (0:00:00.882) 0:21:31.311 ********** 2026-04-03 08:08:26.744527 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744539 | orchestrator | 2026-04-03 08:08:26.744550 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:08:26.744573 | orchestrator | Friday 03 April 2026 08:08:19 +0000 (0:00:00.812) 0:21:32.123 ********** 2026-04-03 08:08:26.744585 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 08:08:26.744595 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 08:08:26.744606 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 08:08:26.744616 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744627 | orchestrator | 2026-04-03 08:08:26.744638 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:08:26.744649 | orchestrator | Friday 03 April 2026 08:08:20 +0000 (0:00:01.505) 0:21:33.629 ********** 2026-04-03 08:08:26.744660 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744670 | orchestrator | 2026-04-03 08:08:26.744681 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:08:26.744692 | orchestrator | Friday 03 April 2026 08:08:21 +0000 (0:00:00.810) 0:21:34.440 ********** 2026-04-03 08:08:26.744703 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744713 | orchestrator | 2026-04-03 08:08:26.744724 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:08:26.744735 | orchestrator | Friday 03 April 2026 08:08:22 +0000 (0:00:00.876) 0:21:35.317 ********** 2026-04-03 08:08:26.744746 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744756 | orchestrator | 2026-04-03 08:08:26.744767 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:08:26.744778 | orchestrator | Friday 03 April 2026 08:08:23 +0000 (0:00:00.778) 0:21:36.096 ********** 2026-04-03 08:08:26.744788 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:08:26.744799 | orchestrator | 2026-04-03 08:08:26.744810 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-03 08:08:26.744821 | orchestrator | 2026-04-03 08:08:26.744832 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:08:26.744842 | orchestrator | Friday 03 April 2026 08:08:24 +0000 (0:00:00.999) 0:21:37.096 ********** 2026-04-03 08:08:26.744853 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:26.744864 | orchestrator | 2026-04-03 08:08:26.744909 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:08:26.744920 | orchestrator | Friday 03 April 2026 08:08:25 +0000 (0:00:00.813) 0:21:37.909 ********** 2026-04-03 08:08:26.744930 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:26.744941 | orchestrator | 2026-04-03 08:08:26.744952 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:08:26.744963 | orchestrator | Friday 03 April 2026 08:08:25 +0000 (0:00:00.795) 0:21:38.705 ********** 2026-04-03 08:08:26.744973 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:26.744984 | orchestrator | 2026-04-03 08:08:26.744995 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:08:26.745006 | orchestrator | Friday 03 April 2026 08:08:26 +0000 (0:00:00.847) 0:21:39.553 ********** 2026-04-03 08:08:26.745023 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043063 | orchestrator | 2026-04-03 08:08:59.043174 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:08:59.043191 | orchestrator | Friday 03 April 2026 08:08:27 +0000 (0:00:00.775) 0:21:40.328 ********** 2026-04-03 08:08:59.043204 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043216 | orchestrator | 2026-04-03 08:08:59.043228 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:08:59.043239 | orchestrator | Friday 03 April 2026 08:08:28 +0000 (0:00:00.789) 0:21:41.118 ********** 2026-04-03 08:08:59.043249 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043260 | orchestrator | 2026-04-03 08:08:59.043271 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:08:59.043282 | orchestrator | Friday 03 April 2026 08:08:29 +0000 (0:00:00.792) 0:21:41.910 ********** 2026-04-03 08:08:59.043292 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043326 | orchestrator | 2026-04-03 08:08:59.043338 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:08:59.043349 | orchestrator | Friday 03 April 2026 08:08:29 +0000 (0:00:00.769) 0:21:42.680 ********** 2026-04-03 08:08:59.043360 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043371 | orchestrator | 2026-04-03 08:08:59.043381 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:08:59.043392 | orchestrator | Friday 03 April 2026 08:08:30 +0000 (0:00:00.797) 0:21:43.478 ********** 2026-04-03 08:08:59.043403 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043413 | orchestrator | 2026-04-03 08:08:59.043424 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:08:59.043434 | orchestrator | Friday 03 April 2026 08:08:31 +0000 (0:00:00.776) 0:21:44.255 ********** 2026-04-03 08:08:59.043445 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043456 | orchestrator | 2026-04-03 08:08:59.043466 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:08:59.043477 | orchestrator | Friday 03 April 2026 08:08:32 +0000 (0:00:00.817) 0:21:45.073 ********** 2026-04-03 08:08:59.043487 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043498 | orchestrator | 2026-04-03 08:08:59.043509 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:08:59.043520 | orchestrator | Friday 03 April 2026 08:08:32 +0000 (0:00:00.764) 0:21:45.837 ********** 2026-04-03 08:08:59.043531 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043541 | orchestrator | 2026-04-03 08:08:59.043555 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:08:59.043569 | orchestrator | Friday 03 April 2026 08:08:33 +0000 (0:00:00.809) 0:21:46.647 ********** 2026-04-03 08:08:59.043582 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043595 | orchestrator | 2026-04-03 08:08:59.043608 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:08:59.043620 | orchestrator | Friday 03 April 2026 08:08:34 +0000 (0:00:00.821) 0:21:47.469 ********** 2026-04-03 08:08:59.043646 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043659 | orchestrator | 2026-04-03 08:08:59.043673 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:08:59.043685 | orchestrator | Friday 03 April 2026 08:08:35 +0000 (0:00:00.824) 0:21:48.293 ********** 2026-04-03 08:08:59.043698 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043711 | orchestrator | 2026-04-03 08:08:59.043724 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:08:59.043737 | orchestrator | Friday 03 April 2026 08:08:36 +0000 (0:00:00.781) 0:21:49.074 ********** 2026-04-03 08:08:59.043751 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043763 | orchestrator | 2026-04-03 08:08:59.043776 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:08:59.043789 | orchestrator | Friday 03 April 2026 08:08:36 +0000 (0:00:00.774) 0:21:49.849 ********** 2026-04-03 08:08:59.043802 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043815 | orchestrator | 2026-04-03 08:08:59.043828 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:08:59.043841 | orchestrator | Friday 03 April 2026 08:08:37 +0000 (0:00:00.790) 0:21:50.639 ********** 2026-04-03 08:08:59.043853 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043867 | orchestrator | 2026-04-03 08:08:59.043880 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:08:59.043893 | orchestrator | Friday 03 April 2026 08:08:38 +0000 (0:00:00.859) 0:21:51.498 ********** 2026-04-03 08:08:59.043930 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.043944 | orchestrator | 2026-04-03 08:08:59.043958 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:08:59.043971 | orchestrator | Friday 03 April 2026 08:08:39 +0000 (0:00:00.818) 0:21:52.317 ********** 2026-04-03 08:08:59.043989 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044000 | orchestrator | 2026-04-03 08:08:59.044011 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:08:59.044022 | orchestrator | Friday 03 April 2026 08:08:40 +0000 (0:00:00.819) 0:21:53.136 ********** 2026-04-03 08:08:59.044033 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044044 | orchestrator | 2026-04-03 08:08:59.044054 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:08:59.044065 | orchestrator | Friday 03 April 2026 08:08:41 +0000 (0:00:00.788) 0:21:53.925 ********** 2026-04-03 08:08:59.044076 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044087 | orchestrator | 2026-04-03 08:08:59.044098 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:08:59.044109 | orchestrator | Friday 03 April 2026 08:08:41 +0000 (0:00:00.805) 0:21:54.731 ********** 2026-04-03 08:08:59.044119 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044130 | orchestrator | 2026-04-03 08:08:59.044141 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:08:59.044152 | orchestrator | Friday 03 April 2026 08:08:42 +0000 (0:00:00.819) 0:21:55.551 ********** 2026-04-03 08:08:59.044163 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044174 | orchestrator | 2026-04-03 08:08:59.044200 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:08:59.044212 | orchestrator | Friday 03 April 2026 08:08:43 +0000 (0:00:00.802) 0:21:56.354 ********** 2026-04-03 08:08:59.044223 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044233 | orchestrator | 2026-04-03 08:08:59.044244 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:08:59.044255 | orchestrator | Friday 03 April 2026 08:08:44 +0000 (0:00:00.813) 0:21:57.167 ********** 2026-04-03 08:08:59.044266 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044277 | orchestrator | 2026-04-03 08:08:59.044288 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:08:59.044302 | orchestrator | Friday 03 April 2026 08:08:45 +0000 (0:00:00.807) 0:21:57.975 ********** 2026-04-03 08:08:59.044319 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044338 | orchestrator | 2026-04-03 08:08:59.044357 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:08:59.044374 | orchestrator | Friday 03 April 2026 08:08:45 +0000 (0:00:00.804) 0:21:58.780 ********** 2026-04-03 08:08:59.044392 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044410 | orchestrator | 2026-04-03 08:08:59.044426 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:08:59.044444 | orchestrator | Friday 03 April 2026 08:08:46 +0000 (0:00:00.811) 0:21:59.592 ********** 2026-04-03 08:08:59.044462 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044479 | orchestrator | 2026-04-03 08:08:59.044497 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:08:59.044514 | orchestrator | Friday 03 April 2026 08:08:47 +0000 (0:00:00.811) 0:22:00.403 ********** 2026-04-03 08:08:59.044533 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044553 | orchestrator | 2026-04-03 08:08:59.044570 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:08:59.044587 | orchestrator | Friday 03 April 2026 08:08:48 +0000 (0:00:00.783) 0:22:01.187 ********** 2026-04-03 08:08:59.044598 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044609 | orchestrator | 2026-04-03 08:08:59.044620 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:08:59.044630 | orchestrator | Friday 03 April 2026 08:08:49 +0000 (0:00:00.824) 0:22:02.011 ********** 2026-04-03 08:08:59.044641 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044652 | orchestrator | 2026-04-03 08:08:59.044662 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:08:59.044673 | orchestrator | Friday 03 April 2026 08:08:49 +0000 (0:00:00.775) 0:22:02.787 ********** 2026-04-03 08:08:59.044694 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044704 | orchestrator | 2026-04-03 08:08:59.044715 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:08:59.044726 | orchestrator | Friday 03 April 2026 08:08:50 +0000 (0:00:00.781) 0:22:03.569 ********** 2026-04-03 08:08:59.044737 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044747 | orchestrator | 2026-04-03 08:08:59.044766 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:08:59.044777 | orchestrator | Friday 03 April 2026 08:08:51 +0000 (0:00:00.855) 0:22:04.424 ********** 2026-04-03 08:08:59.044788 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044798 | orchestrator | 2026-04-03 08:08:59.044809 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:08:59.044820 | orchestrator | Friday 03 April 2026 08:08:52 +0000 (0:00:00.805) 0:22:05.230 ********** 2026-04-03 08:08:59.044830 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044841 | orchestrator | 2026-04-03 08:08:59.044852 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:08:59.044862 | orchestrator | Friday 03 April 2026 08:08:53 +0000 (0:00:00.784) 0:22:06.014 ********** 2026-04-03 08:08:59.044873 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044884 | orchestrator | 2026-04-03 08:08:59.044895 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:08:59.044932 | orchestrator | Friday 03 April 2026 08:08:53 +0000 (0:00:00.779) 0:22:06.794 ********** 2026-04-03 08:08:59.044944 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044955 | orchestrator | 2026-04-03 08:08:59.044966 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:08:59.044977 | orchestrator | Friday 03 April 2026 08:08:54 +0000 (0:00:00.819) 0:22:07.613 ********** 2026-04-03 08:08:59.044987 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.044998 | orchestrator | 2026-04-03 08:08:59.045009 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:08:59.045021 | orchestrator | Friday 03 April 2026 08:08:55 +0000 (0:00:00.890) 0:22:08.503 ********** 2026-04-03 08:08:59.045031 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.045042 | orchestrator | 2026-04-03 08:08:59.045053 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:08:59.045064 | orchestrator | Friday 03 April 2026 08:08:56 +0000 (0:00:00.790) 0:22:09.294 ********** 2026-04-03 08:08:59.045075 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.045086 | orchestrator | 2026-04-03 08:08:59.045097 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:08:59.045112 | orchestrator | Friday 03 April 2026 08:08:57 +0000 (0:00:00.798) 0:22:10.093 ********** 2026-04-03 08:08:59.045130 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.045149 | orchestrator | 2026-04-03 08:08:59.045167 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:08:59.045185 | orchestrator | Friday 03 April 2026 08:08:58 +0000 (0:00:00.813) 0:22:10.907 ********** 2026-04-03 08:08:59.045203 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.045222 | orchestrator | 2026-04-03 08:08:59.045241 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:08:59.045260 | orchestrator | Friday 03 April 2026 08:08:58 +0000 (0:00:00.826) 0:22:11.734 ********** 2026-04-03 08:08:59.045279 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:08:59.045291 | orchestrator | 2026-04-03 08:08:59.045312 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:09:51.466450 | orchestrator | Friday 03 April 2026 08:08:59 +0000 (0:00:00.798) 0:22:12.533 ********** 2026-04-03 08:09:51.466559 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466572 | orchestrator | 2026-04-03 08:09:51.466580 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:09:51.466603 | orchestrator | Friday 03 April 2026 08:09:00 +0000 (0:00:00.801) 0:22:13.334 ********** 2026-04-03 08:09:51.466609 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466614 | orchestrator | 2026-04-03 08:09:51.466620 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:09:51.466625 | orchestrator | Friday 03 April 2026 08:09:01 +0000 (0:00:00.893) 0:22:14.228 ********** 2026-04-03 08:09:51.466631 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466636 | orchestrator | 2026-04-03 08:09:51.466642 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:09:51.466648 | orchestrator | Friday 03 April 2026 08:09:02 +0000 (0:00:00.906) 0:22:15.135 ********** 2026-04-03 08:09:51.466653 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466658 | orchestrator | 2026-04-03 08:09:51.466664 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:09:51.466669 | orchestrator | Friday 03 April 2026 08:09:03 +0000 (0:00:00.870) 0:22:16.006 ********** 2026-04-03 08:09:51.466674 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466681 | orchestrator | 2026-04-03 08:09:51.466686 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:09:51.466692 | orchestrator | Friday 03 April 2026 08:09:03 +0000 (0:00:00.786) 0:22:16.792 ********** 2026-04-03 08:09:51.466697 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466702 | orchestrator | 2026-04-03 08:09:51.466708 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:09:51.466715 | orchestrator | Friday 03 April 2026 08:09:04 +0000 (0:00:00.783) 0:22:17.576 ********** 2026-04-03 08:09:51.466721 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466727 | orchestrator | 2026-04-03 08:09:51.466735 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:09:51.466745 | orchestrator | Friday 03 April 2026 08:09:05 +0000 (0:00:00.899) 0:22:18.476 ********** 2026-04-03 08:09:51.466755 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466764 | orchestrator | 2026-04-03 08:09:51.466771 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:09:51.466777 | orchestrator | Friday 03 April 2026 08:09:06 +0000 (0:00:00.791) 0:22:19.267 ********** 2026-04-03 08:09:51.466782 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466788 | orchestrator | 2026-04-03 08:09:51.466793 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:09:51.466799 | orchestrator | Friday 03 April 2026 08:09:07 +0000 (0:00:00.809) 0:22:20.077 ********** 2026-04-03 08:09:51.466815 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466821 | orchestrator | 2026-04-03 08:09:51.466826 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:09:51.466832 | orchestrator | Friday 03 April 2026 08:09:07 +0000 (0:00:00.784) 0:22:20.861 ********** 2026-04-03 08:09:51.466837 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:09:51.466843 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:09:51.466848 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:09:51.466854 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466859 | orchestrator | 2026-04-03 08:09:51.466865 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:09:51.466870 | orchestrator | Friday 03 April 2026 08:09:09 +0000 (0:00:01.521) 0:22:22.383 ********** 2026-04-03 08:09:51.466875 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:09:51.466881 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:09:51.466886 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:09:51.466892 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466897 | orchestrator | 2026-04-03 08:09:51.466903 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:09:51.466913 | orchestrator | Friday 03 April 2026 08:09:10 +0000 (0:00:01.453) 0:22:23.837 ********** 2026-04-03 08:09:51.466919 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:09:51.466924 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:09:51.466929 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:09:51.466935 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466940 | orchestrator | 2026-04-03 08:09:51.466946 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:09:51.466951 | orchestrator | Friday 03 April 2026 08:09:12 +0000 (0:00:01.431) 0:22:25.268 ********** 2026-04-03 08:09:51.466956 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.466962 | orchestrator | 2026-04-03 08:09:51.466990 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:09:51.466999 | orchestrator | Friday 03 April 2026 08:09:13 +0000 (0:00:00.821) 0:22:26.090 ********** 2026-04-03 08:09:51.467009 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-03 08:09:51.467018 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467027 | orchestrator | 2026-04-03 08:09:51.467036 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:09:51.467046 | orchestrator | Friday 03 April 2026 08:09:14 +0000 (0:00:00.920) 0:22:27.011 ********** 2026-04-03 08:09:51.467054 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467065 | orchestrator | 2026-04-03 08:09:51.467074 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:09:51.467084 | orchestrator | Friday 03 April 2026 08:09:14 +0000 (0:00:00.831) 0:22:27.843 ********** 2026-04-03 08:09:51.467092 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:09:51.467112 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:09:51.467119 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:09:51.467125 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467132 | orchestrator | 2026-04-03 08:09:51.467138 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:09:51.467144 | orchestrator | Friday 03 April 2026 08:09:16 +0000 (0:00:01.108) 0:22:28.951 ********** 2026-04-03 08:09:51.467150 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467157 | orchestrator | 2026-04-03 08:09:51.467163 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:09:51.467170 | orchestrator | Friday 03 April 2026 08:09:16 +0000 (0:00:00.791) 0:22:29.743 ********** 2026-04-03 08:09:51.467176 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467183 | orchestrator | 2026-04-03 08:09:51.467190 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:09:51.467196 | orchestrator | Friday 03 April 2026 08:09:17 +0000 (0:00:00.774) 0:22:30.518 ********** 2026-04-03 08:09:51.467203 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467210 | orchestrator | 2026-04-03 08:09:51.467216 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:09:51.467222 | orchestrator | Friday 03 April 2026 08:09:18 +0000 (0:00:00.823) 0:22:31.341 ********** 2026-04-03 08:09:51.467229 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:09:51.467235 | orchestrator | 2026-04-03 08:09:51.467242 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-03 08:09:51.467248 | orchestrator | 2026-04-03 08:09:51.467254 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:09:51.467261 | orchestrator | Friday 03 April 2026 08:09:19 +0000 (0:00:01.367) 0:22:32.709 ********** 2026-04-03 08:09:51.467267 | orchestrator | changed: [testbed-node-0] 2026-04-03 08:09:51.467274 | orchestrator | 2026-04-03 08:09:51.467281 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-03 08:09:51.467287 | orchestrator | Friday 03 April 2026 08:09:32 +0000 (0:00:12.824) 0:22:45.533 ********** 2026-04-03 08:09:51.467299 | orchestrator | changed: [testbed-node-0] 2026-04-03 08:09:51.467305 | orchestrator | 2026-04-03 08:09:51.467312 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:09:51.467318 | orchestrator | Friday 03 April 2026 08:09:35 +0000 (0:00:02.501) 0:22:48.035 ********** 2026-04-03 08:09:51.467325 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-03 08:09:51.467331 | orchestrator | 2026-04-03 08:09:51.467338 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:09:51.467344 | orchestrator | Friday 03 April 2026 08:09:36 +0000 (0:00:01.221) 0:22:49.256 ********** 2026-04-03 08:09:51.467351 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467358 | orchestrator | 2026-04-03 08:09:51.467364 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:09:51.467375 | orchestrator | Friday 03 April 2026 08:09:37 +0000 (0:00:01.497) 0:22:50.754 ********** 2026-04-03 08:09:51.467381 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467388 | orchestrator | 2026-04-03 08:09:51.467394 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:09:51.467401 | orchestrator | Friday 03 April 2026 08:09:39 +0000 (0:00:01.130) 0:22:51.885 ********** 2026-04-03 08:09:51.467406 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467411 | orchestrator | 2026-04-03 08:09:51.467417 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:09:51.467422 | orchestrator | Friday 03 April 2026 08:09:40 +0000 (0:00:01.538) 0:22:53.424 ********** 2026-04-03 08:09:51.467427 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467432 | orchestrator | 2026-04-03 08:09:51.467438 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:09:51.467443 | orchestrator | Friday 03 April 2026 08:09:41 +0000 (0:00:01.149) 0:22:54.573 ********** 2026-04-03 08:09:51.467449 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467454 | orchestrator | 2026-04-03 08:09:51.467459 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:09:51.467465 | orchestrator | Friday 03 April 2026 08:09:42 +0000 (0:00:01.147) 0:22:55.720 ********** 2026-04-03 08:09:51.467470 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467475 | orchestrator | 2026-04-03 08:09:51.467481 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:09:51.467487 | orchestrator | Friday 03 April 2026 08:09:44 +0000 (0:00:01.177) 0:22:56.898 ********** 2026-04-03 08:09:51.467492 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:09:51.467497 | orchestrator | 2026-04-03 08:09:51.467503 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:09:51.467508 | orchestrator | Friday 03 April 2026 08:09:45 +0000 (0:00:01.286) 0:22:58.185 ********** 2026-04-03 08:09:51.467513 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467519 | orchestrator | 2026-04-03 08:09:51.467524 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:09:51.467529 | orchestrator | Friday 03 April 2026 08:09:46 +0000 (0:00:01.178) 0:22:59.363 ********** 2026-04-03 08:09:51.467535 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:09:51.467540 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:09:51.467546 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:09:51.467551 | orchestrator | 2026-04-03 08:09:51.467556 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:09:51.467562 | orchestrator | Friday 03 April 2026 08:09:48 +0000 (0:00:02.119) 0:23:01.482 ********** 2026-04-03 08:09:51.467567 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:09:51.467572 | orchestrator | 2026-04-03 08:09:51.467578 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:09:51.467583 | orchestrator | Friday 03 April 2026 08:09:50 +0000 (0:00:01.627) 0:23:03.110 ********** 2026-04-03 08:09:51.467588 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:09:51.467601 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:10:15.027804 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:10:15.027919 | orchestrator | 2026-04-03 08:10:15.027936 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:10:15.027949 | orchestrator | Friday 03 April 2026 08:09:53 +0000 (0:00:02.915) 0:23:06.026 ********** 2026-04-03 08:10:15.027962 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 08:10:15.027973 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 08:10:15.027984 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 08:10:15.028049 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028062 | orchestrator | 2026-04-03 08:10:15.028074 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:10:15.028085 | orchestrator | Friday 03 April 2026 08:09:54 +0000 (0:00:01.423) 0:23:07.450 ********** 2026-04-03 08:10:15.028097 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028112 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028123 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028134 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028145 | orchestrator | 2026-04-03 08:10:15.028156 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:10:15.028167 | orchestrator | Friday 03 April 2026 08:09:56 +0000 (0:00:01.754) 0:23:09.204 ********** 2026-04-03 08:10:15.028196 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028211 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028222 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:15.028233 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028244 | orchestrator | 2026-04-03 08:10:15.028255 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:10:15.028266 | orchestrator | Friday 03 April 2026 08:09:57 +0000 (0:00:01.147) 0:23:10.352 ********** 2026-04-03 08:10:15.028278 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:09:50.800379', 'end': '2026-04-03 08:09:50.842791', 'delta': '0:00:00.042412', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:10:15.028335 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:09:51.364375', 'end': '2026-04-03 08:09:51.410675', 'delta': '0:00:00.046300', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:10:15.028349 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:09:51.947122', 'end': '2026-04-03 08:09:51.999689', 'delta': '0:00:00.052567', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:10:15.028360 | orchestrator | 2026-04-03 08:10:15.028372 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:10:15.028383 | orchestrator | Friday 03 April 2026 08:09:58 +0000 (0:00:01.206) 0:23:11.558 ********** 2026-04-03 08:10:15.028394 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:15.028406 | orchestrator | 2026-04-03 08:10:15.028417 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:10:15.028427 | orchestrator | Friday 03 April 2026 08:09:59 +0000 (0:00:01.267) 0:23:12.826 ********** 2026-04-03 08:10:15.028438 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028449 | orchestrator | 2026-04-03 08:10:15.028460 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:10:15.028471 | orchestrator | Friday 03 April 2026 08:10:01 +0000 (0:00:01.305) 0:23:14.131 ********** 2026-04-03 08:10:15.028481 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:15.028492 | orchestrator | 2026-04-03 08:10:15.028503 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:10:15.028519 | orchestrator | Friday 03 April 2026 08:10:02 +0000 (0:00:01.163) 0:23:15.294 ********** 2026-04-03 08:10:15.028530 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:15.028541 | orchestrator | 2026-04-03 08:10:15.028552 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:10:15.028563 | orchestrator | Friday 03 April 2026 08:10:04 +0000 (0:00:02.053) 0:23:17.348 ********** 2026-04-03 08:10:15.028573 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:15.028584 | orchestrator | 2026-04-03 08:10:15.028595 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:10:15.028606 | orchestrator | Friday 03 April 2026 08:10:05 +0000 (0:00:01.180) 0:23:18.528 ********** 2026-04-03 08:10:15.028617 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028635 | orchestrator | 2026-04-03 08:10:15.028646 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:10:15.028657 | orchestrator | Friday 03 April 2026 08:10:06 +0000 (0:00:01.174) 0:23:19.702 ********** 2026-04-03 08:10:15.028668 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028679 | orchestrator | 2026-04-03 08:10:15.028689 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:10:15.028700 | orchestrator | Friday 03 April 2026 08:10:08 +0000 (0:00:01.210) 0:23:20.912 ********** 2026-04-03 08:10:15.028711 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028722 | orchestrator | 2026-04-03 08:10:15.028732 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:10:15.028743 | orchestrator | Friday 03 April 2026 08:10:09 +0000 (0:00:01.098) 0:23:22.011 ********** 2026-04-03 08:10:15.028754 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028764 | orchestrator | 2026-04-03 08:10:15.028775 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:10:15.028786 | orchestrator | Friday 03 April 2026 08:10:10 +0000 (0:00:01.143) 0:23:23.154 ********** 2026-04-03 08:10:15.028797 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028807 | orchestrator | 2026-04-03 08:10:15.028818 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:10:15.028829 | orchestrator | Friday 03 April 2026 08:10:11 +0000 (0:00:01.114) 0:23:24.269 ********** 2026-04-03 08:10:15.028840 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028850 | orchestrator | 2026-04-03 08:10:15.028861 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:10:15.028872 | orchestrator | Friday 03 April 2026 08:10:12 +0000 (0:00:01.125) 0:23:25.395 ********** 2026-04-03 08:10:15.028883 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028894 | orchestrator | 2026-04-03 08:10:15.028905 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:10:15.028915 | orchestrator | Friday 03 April 2026 08:10:13 +0000 (0:00:01.197) 0:23:26.593 ********** 2026-04-03 08:10:15.028926 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028937 | orchestrator | 2026-04-03 08:10:15.028948 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:10:15.028959 | orchestrator | Friday 03 April 2026 08:10:14 +0000 (0:00:01.124) 0:23:27.717 ********** 2026-04-03 08:10:15.028970 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:15.028981 | orchestrator | 2026-04-03 08:10:15.029022 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:10:17.332424 | orchestrator | Friday 03 April 2026 08:10:16 +0000 (0:00:01.163) 0:23:28.880 ********** 2026-04-03 08:10:17.332528 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332547 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332560 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332610 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:10:17.332626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332638 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332649 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332685 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:10:17.332708 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332725 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:10:17.332737 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:17.332750 | orchestrator | 2026-04-03 08:10:17.332763 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:10:17.332775 | orchestrator | Friday 03 April 2026 08:10:17 +0000 (0:00:01.227) 0:23:30.108 ********** 2026-04-03 08:10:17.332787 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:17.332800 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:17.332819 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564091 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564206 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564259 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564272 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564308 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564333 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564350 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:10:28.564363 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:28.564377 | orchestrator | 2026-04-03 08:10:28.564389 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:10:28.564402 | orchestrator | Friday 03 April 2026 08:10:18 +0000 (0:00:01.235) 0:23:31.343 ********** 2026-04-03 08:10:28.564413 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:28.564425 | orchestrator | 2026-04-03 08:10:28.564436 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:10:28.564447 | orchestrator | Friday 03 April 2026 08:10:20 +0000 (0:00:01.541) 0:23:32.885 ********** 2026-04-03 08:10:28.564457 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:28.564468 | orchestrator | 2026-04-03 08:10:28.564479 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:10:28.564490 | orchestrator | Friday 03 April 2026 08:10:21 +0000 (0:00:01.120) 0:23:34.005 ********** 2026-04-03 08:10:28.564500 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:10:28.564511 | orchestrator | 2026-04-03 08:10:28.564522 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:10:28.564532 | orchestrator | Friday 03 April 2026 08:10:22 +0000 (0:00:01.524) 0:23:35.530 ********** 2026-04-03 08:10:28.564543 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:28.564554 | orchestrator | 2026-04-03 08:10:28.564564 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:10:28.564575 | orchestrator | Friday 03 April 2026 08:10:23 +0000 (0:00:01.127) 0:23:36.658 ********** 2026-04-03 08:10:28.564586 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:28.564596 | orchestrator | 2026-04-03 08:10:28.564610 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:10:28.564622 | orchestrator | Friday 03 April 2026 08:10:25 +0000 (0:00:01.676) 0:23:38.334 ********** 2026-04-03 08:10:28.564634 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:28.564647 | orchestrator | 2026-04-03 08:10:28.564660 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:10:28.564672 | orchestrator | Friday 03 April 2026 08:10:26 +0000 (0:00:01.153) 0:23:39.488 ********** 2026-04-03 08:10:28.564685 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:10:28.564699 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 08:10:28.564712 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 08:10:28.564724 | orchestrator | 2026-04-03 08:10:28.564737 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:10:28.564750 | orchestrator | Friday 03 April 2026 08:10:28 +0000 (0:00:01.739) 0:23:41.227 ********** 2026-04-03 08:10:28.564769 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 08:10:28.564783 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 08:10:28.564796 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 08:10:28.564809 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:10:28.564821 | orchestrator | 2026-04-03 08:10:28.564841 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:11:13.007474 | orchestrator | Friday 03 April 2026 08:10:29 +0000 (0:00:01.170) 0:23:42.398 ********** 2026-04-03 08:11:13.007584 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.007600 | orchestrator | 2026-04-03 08:11:13.007612 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:11:13.007623 | orchestrator | Friday 03 April 2026 08:10:30 +0000 (0:00:01.151) 0:23:43.549 ********** 2026-04-03 08:11:13.007633 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:11:13.007643 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:11:13.007654 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:11:13.007663 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:11:13.007673 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:11:13.007682 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:11:13.007692 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:11:13.007701 | orchestrator | 2026-04-03 08:11:13.007711 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:11:13.007721 | orchestrator | Friday 03 April 2026 08:10:32 +0000 (0:00:01.831) 0:23:45.381 ********** 2026-04-03 08:11:13.007731 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:11:13.007741 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:11:13.007750 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:11:13.007760 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:11:13.007769 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:11:13.007779 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:11:13.007788 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:11:13.007798 | orchestrator | 2026-04-03 08:11:13.007807 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:11:13.007817 | orchestrator | Friday 03 April 2026 08:10:35 +0000 (0:00:02.655) 0:23:48.037 ********** 2026-04-03 08:11:13.007841 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-03 08:11:13.007852 | orchestrator | 2026-04-03 08:11:13.007862 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:11:13.007872 | orchestrator | Friday 03 April 2026 08:10:36 +0000 (0:00:01.213) 0:23:49.250 ********** 2026-04-03 08:11:13.007881 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-03 08:11:13.007891 | orchestrator | 2026-04-03 08:11:13.007900 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:11:13.007910 | orchestrator | Friday 03 April 2026 08:10:37 +0000 (0:00:01.122) 0:23:50.372 ********** 2026-04-03 08:11:13.007919 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.007929 | orchestrator | 2026-04-03 08:11:13.007939 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:11:13.007948 | orchestrator | Friday 03 April 2026 08:10:39 +0000 (0:00:01.591) 0:23:51.964 ********** 2026-04-03 08:11:13.007977 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.007987 | orchestrator | 2026-04-03 08:11:13.007997 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:11:13.008007 | orchestrator | Friday 03 April 2026 08:10:40 +0000 (0:00:01.195) 0:23:53.160 ********** 2026-04-03 08:11:13.008019 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008030 | orchestrator | 2026-04-03 08:11:13.008041 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:11:13.008111 | orchestrator | Friday 03 April 2026 08:10:41 +0000 (0:00:01.150) 0:23:54.311 ********** 2026-04-03 08:11:13.008126 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008139 | orchestrator | 2026-04-03 08:11:13.008151 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:11:13.008162 | orchestrator | Friday 03 April 2026 08:10:42 +0000 (0:00:01.153) 0:23:55.464 ********** 2026-04-03 08:11:13.008173 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008185 | orchestrator | 2026-04-03 08:11:13.008197 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:11:13.008208 | orchestrator | Friday 03 April 2026 08:10:44 +0000 (0:00:01.573) 0:23:57.038 ********** 2026-04-03 08:11:13.008219 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008230 | orchestrator | 2026-04-03 08:11:13.008242 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:11:13.008253 | orchestrator | Friday 03 April 2026 08:10:45 +0000 (0:00:01.213) 0:23:58.252 ********** 2026-04-03 08:11:13.008264 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008275 | orchestrator | 2026-04-03 08:11:13.008287 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:11:13.008298 | orchestrator | Friday 03 April 2026 08:10:46 +0000 (0:00:01.138) 0:23:59.391 ********** 2026-04-03 08:11:13.008309 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008320 | orchestrator | 2026-04-03 08:11:13.008331 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:11:13.008342 | orchestrator | Friday 03 April 2026 08:10:48 +0000 (0:00:01.669) 0:24:01.061 ********** 2026-04-03 08:11:13.008355 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008366 | orchestrator | 2026-04-03 08:11:13.008375 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:11:13.008401 | orchestrator | Friday 03 April 2026 08:10:49 +0000 (0:00:01.576) 0:24:02.637 ********** 2026-04-03 08:11:13.008412 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008421 | orchestrator | 2026-04-03 08:11:13.008431 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:11:13.008440 | orchestrator | Friday 03 April 2026 08:10:50 +0000 (0:00:01.190) 0:24:03.828 ********** 2026-04-03 08:11:13.008449 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008459 | orchestrator | 2026-04-03 08:11:13.008468 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:11:13.008478 | orchestrator | Friday 03 April 2026 08:10:52 +0000 (0:00:01.189) 0:24:05.018 ********** 2026-04-03 08:11:13.008487 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008497 | orchestrator | 2026-04-03 08:11:13.008506 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:11:13.008515 | orchestrator | Friday 03 April 2026 08:10:53 +0000 (0:00:01.105) 0:24:06.123 ********** 2026-04-03 08:11:13.008525 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008534 | orchestrator | 2026-04-03 08:11:13.008544 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:11:13.008553 | orchestrator | Friday 03 April 2026 08:10:54 +0000 (0:00:01.160) 0:24:07.284 ********** 2026-04-03 08:11:13.008563 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008572 | orchestrator | 2026-04-03 08:11:13.008581 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:11:13.008591 | orchestrator | Friday 03 April 2026 08:10:55 +0000 (0:00:01.160) 0:24:08.445 ********** 2026-04-03 08:11:13.008609 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008619 | orchestrator | 2026-04-03 08:11:13.008628 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:11:13.008638 | orchestrator | Friday 03 April 2026 08:10:56 +0000 (0:00:01.141) 0:24:09.586 ********** 2026-04-03 08:11:13.008647 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008657 | orchestrator | 2026-04-03 08:11:13.008666 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:11:13.008676 | orchestrator | Friday 03 April 2026 08:10:57 +0000 (0:00:01.206) 0:24:10.793 ********** 2026-04-03 08:11:13.008685 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008695 | orchestrator | 2026-04-03 08:11:13.008704 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:11:13.008714 | orchestrator | Friday 03 April 2026 08:10:59 +0000 (0:00:01.150) 0:24:11.943 ********** 2026-04-03 08:11:13.008723 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008733 | orchestrator | 2026-04-03 08:11:13.008742 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:11:13.008751 | orchestrator | Friday 03 April 2026 08:11:00 +0000 (0:00:01.148) 0:24:13.092 ********** 2026-04-03 08:11:13.008767 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:11:13.008776 | orchestrator | 2026-04-03 08:11:13.008786 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:11:13.008795 | orchestrator | Friday 03 April 2026 08:11:01 +0000 (0:00:01.193) 0:24:14.286 ********** 2026-04-03 08:11:13.008805 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008814 | orchestrator | 2026-04-03 08:11:13.008823 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:11:13.008833 | orchestrator | Friday 03 April 2026 08:11:02 +0000 (0:00:01.170) 0:24:15.456 ********** 2026-04-03 08:11:13.008842 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008852 | orchestrator | 2026-04-03 08:11:13.008861 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:11:13.008870 | orchestrator | Friday 03 April 2026 08:11:03 +0000 (0:00:01.128) 0:24:16.585 ********** 2026-04-03 08:11:13.008880 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008889 | orchestrator | 2026-04-03 08:11:13.008898 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:11:13.008908 | orchestrator | Friday 03 April 2026 08:11:04 +0000 (0:00:01.130) 0:24:17.715 ********** 2026-04-03 08:11:13.008917 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008926 | orchestrator | 2026-04-03 08:11:13.008936 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:11:13.008945 | orchestrator | Friday 03 April 2026 08:11:05 +0000 (0:00:01.117) 0:24:18.833 ********** 2026-04-03 08:11:13.008955 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.008964 | orchestrator | 2026-04-03 08:11:13.008973 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:11:13.008983 | orchestrator | Friday 03 April 2026 08:11:07 +0000 (0:00:01.151) 0:24:19.984 ********** 2026-04-03 08:11:13.008992 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009001 | orchestrator | 2026-04-03 08:11:13.009011 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:11:13.009021 | orchestrator | Friday 03 April 2026 08:11:08 +0000 (0:00:01.105) 0:24:21.090 ********** 2026-04-03 08:11:13.009030 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009040 | orchestrator | 2026-04-03 08:11:13.009049 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:11:13.009111 | orchestrator | Friday 03 April 2026 08:11:09 +0000 (0:00:01.134) 0:24:22.225 ********** 2026-04-03 08:11:13.009130 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009146 | orchestrator | 2026-04-03 08:11:13.009159 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:11:13.009177 | orchestrator | Friday 03 April 2026 08:11:10 +0000 (0:00:01.120) 0:24:23.345 ********** 2026-04-03 08:11:13.009187 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009196 | orchestrator | 2026-04-03 08:11:13.009205 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:11:13.009215 | orchestrator | Friday 03 April 2026 08:11:11 +0000 (0:00:01.158) 0:24:24.504 ********** 2026-04-03 08:11:13.009224 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009233 | orchestrator | 2026-04-03 08:11:13.009243 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:11:13.009252 | orchestrator | Friday 03 April 2026 08:11:12 +0000 (0:00:01.192) 0:24:25.697 ********** 2026-04-03 08:11:13.009262 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:11:13.009271 | orchestrator | 2026-04-03 08:11:13.009288 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:12:02.604869 | orchestrator | Friday 03 April 2026 08:11:13 +0000 (0:00:01.111) 0:24:26.809 ********** 2026-04-03 08:12:02.604989 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605008 | orchestrator | 2026-04-03 08:12:02.605021 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:12:02.605034 | orchestrator | Friday 03 April 2026 08:11:15 +0000 (0:00:01.155) 0:24:27.964 ********** 2026-04-03 08:12:02.605045 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.605056 | orchestrator | 2026-04-03 08:12:02.605068 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:12:02.605079 | orchestrator | Friday 03 April 2026 08:11:17 +0000 (0:00:02.018) 0:24:29.983 ********** 2026-04-03 08:12:02.605090 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.605100 | orchestrator | 2026-04-03 08:12:02.605148 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:12:02.605159 | orchestrator | Friday 03 April 2026 08:11:19 +0000 (0:00:02.453) 0:24:32.437 ********** 2026-04-03 08:12:02.605170 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-03 08:12:02.605182 | orchestrator | 2026-04-03 08:12:02.605193 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:12:02.605204 | orchestrator | Friday 03 April 2026 08:11:20 +0000 (0:00:01.192) 0:24:33.630 ********** 2026-04-03 08:12:02.605216 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605226 | orchestrator | 2026-04-03 08:12:02.605237 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:12:02.605248 | orchestrator | Friday 03 April 2026 08:11:21 +0000 (0:00:01.187) 0:24:34.817 ********** 2026-04-03 08:12:02.605259 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605270 | orchestrator | 2026-04-03 08:12:02.605281 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:12:02.605295 | orchestrator | Friday 03 April 2026 08:11:23 +0000 (0:00:01.126) 0:24:35.944 ********** 2026-04-03 08:12:02.605306 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:12:02.605317 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:12:02.605328 | orchestrator | 2026-04-03 08:12:02.605339 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:12:02.605350 | orchestrator | Friday 03 April 2026 08:11:24 +0000 (0:00:01.899) 0:24:37.844 ********** 2026-04-03 08:12:02.605361 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.605372 | orchestrator | 2026-04-03 08:12:02.605399 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:12:02.605413 | orchestrator | Friday 03 April 2026 08:11:26 +0000 (0:00:01.464) 0:24:39.309 ********** 2026-04-03 08:12:02.605426 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605440 | orchestrator | 2026-04-03 08:12:02.605453 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:12:02.605465 | orchestrator | Friday 03 April 2026 08:11:27 +0000 (0:00:01.154) 0:24:40.463 ********** 2026-04-03 08:12:02.605514 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605539 | orchestrator | 2026-04-03 08:12:02.605553 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:12:02.605566 | orchestrator | Friday 03 April 2026 08:11:28 +0000 (0:00:01.135) 0:24:41.599 ********** 2026-04-03 08:12:02.605580 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605593 | orchestrator | 2026-04-03 08:12:02.605606 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:12:02.605619 | orchestrator | Friday 03 April 2026 08:11:29 +0000 (0:00:01.142) 0:24:42.741 ********** 2026-04-03 08:12:02.605632 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-03 08:12:02.605645 | orchestrator | 2026-04-03 08:12:02.605658 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:12:02.605671 | orchestrator | Friday 03 April 2026 08:11:31 +0000 (0:00:01.171) 0:24:43.912 ********** 2026-04-03 08:12:02.605684 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.605697 | orchestrator | 2026-04-03 08:12:02.605709 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:12:02.605723 | orchestrator | Friday 03 April 2026 08:11:32 +0000 (0:00:01.720) 0:24:45.633 ********** 2026-04-03 08:12:02.605735 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:12:02.605749 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:12:02.605762 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:12:02.605775 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605787 | orchestrator | 2026-04-03 08:12:02.605801 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:12:02.605813 | orchestrator | Friday 03 April 2026 08:11:33 +0000 (0:00:01.174) 0:24:46.807 ********** 2026-04-03 08:12:02.605824 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605835 | orchestrator | 2026-04-03 08:12:02.605847 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:12:02.605858 | orchestrator | Friday 03 April 2026 08:11:35 +0000 (0:00:01.166) 0:24:47.974 ********** 2026-04-03 08:12:02.605869 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605880 | orchestrator | 2026-04-03 08:12:02.605891 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:12:02.605902 | orchestrator | Friday 03 April 2026 08:11:36 +0000 (0:00:01.329) 0:24:49.303 ********** 2026-04-03 08:12:02.605913 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605924 | orchestrator | 2026-04-03 08:12:02.605934 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:12:02.605945 | orchestrator | Friday 03 April 2026 08:11:37 +0000 (0:00:01.127) 0:24:50.431 ********** 2026-04-03 08:12:02.605956 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.605967 | orchestrator | 2026-04-03 08:12:02.605999 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:12:02.606090 | orchestrator | Friday 03 April 2026 08:11:38 +0000 (0:00:01.139) 0:24:51.570 ********** 2026-04-03 08:12:02.606198 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606230 | orchestrator | 2026-04-03 08:12:02.606247 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:12:02.606266 | orchestrator | Friday 03 April 2026 08:11:39 +0000 (0:00:01.157) 0:24:52.728 ********** 2026-04-03 08:12:02.606286 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.606304 | orchestrator | 2026-04-03 08:12:02.606324 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:12:02.606340 | orchestrator | Friday 03 April 2026 08:11:42 +0000 (0:00:02.644) 0:24:55.373 ********** 2026-04-03 08:12:02.606351 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.606362 | orchestrator | 2026-04-03 08:12:02.606373 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:12:02.606396 | orchestrator | Friday 03 April 2026 08:11:43 +0000 (0:00:01.194) 0:24:56.567 ********** 2026-04-03 08:12:02.606406 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-03 08:12:02.606415 | orchestrator | 2026-04-03 08:12:02.606425 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:12:02.606434 | orchestrator | Friday 03 April 2026 08:11:44 +0000 (0:00:01.167) 0:24:57.734 ********** 2026-04-03 08:12:02.606444 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606453 | orchestrator | 2026-04-03 08:12:02.606463 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:12:02.606473 | orchestrator | Friday 03 April 2026 08:11:46 +0000 (0:00:01.172) 0:24:58.907 ********** 2026-04-03 08:12:02.606482 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606492 | orchestrator | 2026-04-03 08:12:02.606501 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:12:02.606511 | orchestrator | Friday 03 April 2026 08:11:47 +0000 (0:00:01.166) 0:25:00.073 ********** 2026-04-03 08:12:02.606520 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606530 | orchestrator | 2026-04-03 08:12:02.606539 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:12:02.606549 | orchestrator | Friday 03 April 2026 08:11:48 +0000 (0:00:01.126) 0:25:01.200 ********** 2026-04-03 08:12:02.606558 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606568 | orchestrator | 2026-04-03 08:12:02.606578 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:12:02.606587 | orchestrator | Friday 03 April 2026 08:11:49 +0000 (0:00:01.170) 0:25:02.370 ********** 2026-04-03 08:12:02.606604 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606614 | orchestrator | 2026-04-03 08:12:02.606624 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:12:02.606633 | orchestrator | Friday 03 April 2026 08:11:50 +0000 (0:00:01.267) 0:25:03.638 ********** 2026-04-03 08:12:02.606643 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606653 | orchestrator | 2026-04-03 08:12:02.606662 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:12:02.606672 | orchestrator | Friday 03 April 2026 08:11:52 +0000 (0:00:01.256) 0:25:04.894 ********** 2026-04-03 08:12:02.606681 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606691 | orchestrator | 2026-04-03 08:12:02.606701 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:12:02.606710 | orchestrator | Friday 03 April 2026 08:11:53 +0000 (0:00:01.159) 0:25:06.054 ********** 2026-04-03 08:12:02.606720 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:02.606729 | orchestrator | 2026-04-03 08:12:02.606739 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:12:02.606748 | orchestrator | Friday 03 April 2026 08:11:54 +0000 (0:00:01.147) 0:25:07.201 ********** 2026-04-03 08:12:02.606758 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:02.606768 | orchestrator | 2026-04-03 08:12:02.606777 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:12:02.606787 | orchestrator | Friday 03 April 2026 08:11:55 +0000 (0:00:01.206) 0:25:08.408 ********** 2026-04-03 08:12:02.606797 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-03 08:12:02.606806 | orchestrator | 2026-04-03 08:12:02.606816 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:12:02.606826 | orchestrator | Friday 03 April 2026 08:11:56 +0000 (0:00:01.243) 0:25:09.652 ********** 2026-04-03 08:12:02.606835 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-03 08:12:02.606845 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-03 08:12:02.606855 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-03 08:12:02.606864 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-03 08:12:02.606874 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-03 08:12:02.606889 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-03 08:12:02.606899 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-03 08:12:02.606908 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:12:02.606918 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:12:02.606928 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:12:02.606937 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:12:02.606947 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:12:02.606956 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:12:02.606965 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:12:02.606975 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-03 08:12:02.606985 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-03 08:12:02.606995 | orchestrator | 2026-04-03 08:12:02.607014 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:12:55.978121 | orchestrator | Friday 03 April 2026 08:12:03 +0000 (0:00:06.782) 0:25:16.434 ********** 2026-04-03 08:12:55.978278 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978296 | orchestrator | 2026-04-03 08:12:55.978311 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:12:55.978322 | orchestrator | Friday 03 April 2026 08:12:04 +0000 (0:00:01.226) 0:25:17.660 ********** 2026-04-03 08:12:55.978333 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978344 | orchestrator | 2026-04-03 08:12:55.978356 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:12:55.978367 | orchestrator | Friday 03 April 2026 08:12:06 +0000 (0:00:01.245) 0:25:18.906 ********** 2026-04-03 08:12:55.978378 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978388 | orchestrator | 2026-04-03 08:12:55.978399 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:12:55.978410 | orchestrator | Friday 03 April 2026 08:12:07 +0000 (0:00:01.199) 0:25:20.105 ********** 2026-04-03 08:12:55.978421 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978432 | orchestrator | 2026-04-03 08:12:55.978443 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:12:55.978453 | orchestrator | Friday 03 April 2026 08:12:08 +0000 (0:00:01.178) 0:25:21.284 ********** 2026-04-03 08:12:55.978464 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978475 | orchestrator | 2026-04-03 08:12:55.978486 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:12:55.978496 | orchestrator | Friday 03 April 2026 08:12:09 +0000 (0:00:01.148) 0:25:22.432 ********** 2026-04-03 08:12:55.978507 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978518 | orchestrator | 2026-04-03 08:12:55.978529 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:12:55.978541 | orchestrator | Friday 03 April 2026 08:12:10 +0000 (0:00:01.161) 0:25:23.594 ********** 2026-04-03 08:12:55.978552 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978563 | orchestrator | 2026-04-03 08:12:55.978574 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:12:55.978585 | orchestrator | Friday 03 April 2026 08:12:11 +0000 (0:00:01.174) 0:25:24.769 ********** 2026-04-03 08:12:55.978597 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978610 | orchestrator | 2026-04-03 08:12:55.978623 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:12:55.978656 | orchestrator | Friday 03 April 2026 08:12:13 +0000 (0:00:01.110) 0:25:25.879 ********** 2026-04-03 08:12:55.978669 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978682 | orchestrator | 2026-04-03 08:12:55.978695 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:12:55.978729 | orchestrator | Friday 03 April 2026 08:12:14 +0000 (0:00:01.101) 0:25:26.981 ********** 2026-04-03 08:12:55.978740 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978751 | orchestrator | 2026-04-03 08:12:55.978762 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:12:55.978773 | orchestrator | Friday 03 April 2026 08:12:15 +0000 (0:00:01.127) 0:25:28.108 ********** 2026-04-03 08:12:55.978784 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978794 | orchestrator | 2026-04-03 08:12:55.978806 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:12:55.978816 | orchestrator | Friday 03 April 2026 08:12:16 +0000 (0:00:01.122) 0:25:29.230 ********** 2026-04-03 08:12:55.978827 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978838 | orchestrator | 2026-04-03 08:12:55.978849 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:12:55.978860 | orchestrator | Friday 03 April 2026 08:12:17 +0000 (0:00:01.215) 0:25:30.446 ********** 2026-04-03 08:12:55.978871 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978882 | orchestrator | 2026-04-03 08:12:55.978893 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:12:55.978904 | orchestrator | Friday 03 April 2026 08:12:18 +0000 (0:00:01.240) 0:25:31.687 ********** 2026-04-03 08:12:55.978915 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978925 | orchestrator | 2026-04-03 08:12:55.978936 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:12:55.978947 | orchestrator | Friday 03 April 2026 08:12:19 +0000 (0:00:01.127) 0:25:32.814 ********** 2026-04-03 08:12:55.978958 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.978969 | orchestrator | 2026-04-03 08:12:55.978980 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:12:55.978991 | orchestrator | Friday 03 April 2026 08:12:21 +0000 (0:00:01.300) 0:25:34.115 ********** 2026-04-03 08:12:55.979002 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979013 | orchestrator | 2026-04-03 08:12:55.979024 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:12:55.979034 | orchestrator | Friday 03 April 2026 08:12:22 +0000 (0:00:01.173) 0:25:35.289 ********** 2026-04-03 08:12:55.979045 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979056 | orchestrator | 2026-04-03 08:12:55.979067 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:12:55.979080 | orchestrator | Friday 03 April 2026 08:12:23 +0000 (0:00:01.165) 0:25:36.454 ********** 2026-04-03 08:12:55.979090 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979101 | orchestrator | 2026-04-03 08:12:55.979112 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:12:55.979123 | orchestrator | Friday 03 April 2026 08:12:24 +0000 (0:00:01.155) 0:25:37.610 ********** 2026-04-03 08:12:55.979134 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979145 | orchestrator | 2026-04-03 08:12:55.979189 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:12:55.979201 | orchestrator | Friday 03 April 2026 08:12:25 +0000 (0:00:01.178) 0:25:38.788 ********** 2026-04-03 08:12:55.979212 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979222 | orchestrator | 2026-04-03 08:12:55.979251 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:12:55.979263 | orchestrator | Friday 03 April 2026 08:12:27 +0000 (0:00:01.110) 0:25:39.899 ********** 2026-04-03 08:12:55.979274 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979285 | orchestrator | 2026-04-03 08:12:55.979296 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:12:55.979307 | orchestrator | Friday 03 April 2026 08:12:28 +0000 (0:00:01.118) 0:25:41.017 ********** 2026-04-03 08:12:55.979318 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:12:55.979337 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:12:55.979348 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:12:55.979359 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979370 | orchestrator | 2026-04-03 08:12:55.979380 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:12:55.979391 | orchestrator | Friday 03 April 2026 08:12:29 +0000 (0:00:01.433) 0:25:42.451 ********** 2026-04-03 08:12:55.979403 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:12:55.979424 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:12:55.979445 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:12:55.979464 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979483 | orchestrator | 2026-04-03 08:12:55.979501 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:12:55.979521 | orchestrator | Friday 03 April 2026 08:12:31 +0000 (0:00:01.784) 0:25:44.236 ********** 2026-04-03 08:12:55.979539 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:12:55.979558 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:12:55.979577 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-03 08:12:55.979596 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979616 | orchestrator | 2026-04-03 08:12:55.979637 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:12:55.979657 | orchestrator | Friday 03 April 2026 08:12:33 +0000 (0:00:01.817) 0:25:46.054 ********** 2026-04-03 08:12:55.979673 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979684 | orchestrator | 2026-04-03 08:12:55.979695 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:12:55.979705 | orchestrator | Friday 03 April 2026 08:12:34 +0000 (0:00:01.156) 0:25:47.210 ********** 2026-04-03 08:12:55.979725 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-03 08:12:55.979745 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.979763 | orchestrator | 2026-04-03 08:12:55.979782 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:12:55.979800 | orchestrator | Friday 03 April 2026 08:12:35 +0000 (0:00:01.256) 0:25:48.467 ********** 2026-04-03 08:12:55.979817 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:55.979836 | orchestrator | 2026-04-03 08:12:55.979855 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:12:55.979873 | orchestrator | Friday 03 April 2026 08:12:37 +0000 (0:00:01.818) 0:25:50.285 ********** 2026-04-03 08:12:55.979890 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:12:55.979907 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:12:55.979925 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:12:55.979943 | orchestrator | 2026-04-03 08:12:55.979962 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:12:55.980001 | orchestrator | Friday 03 April 2026 08:12:39 +0000 (0:00:01.707) 0:25:51.992 ********** 2026-04-03 08:12:55.980021 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0 2026-04-03 08:12:55.980032 | orchestrator | 2026-04-03 08:12:55.980043 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-03 08:12:55.980054 | orchestrator | Friday 03 April 2026 08:12:40 +0000 (0:00:01.530) 0:25:53.523 ********** 2026-04-03 08:12:55.980064 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:55.980075 | orchestrator | 2026-04-03 08:12:55.980086 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-03 08:12:55.980096 | orchestrator | Friday 03 April 2026 08:12:42 +0000 (0:00:01.480) 0:25:55.004 ********** 2026-04-03 08:12:55.980107 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:12:55.980128 | orchestrator | 2026-04-03 08:12:55.980139 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-03 08:12:55.980170 | orchestrator | Friday 03 April 2026 08:12:43 +0000 (0:00:01.136) 0:25:56.140 ********** 2026-04-03 08:12:55.980182 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 08:12:55.980193 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 08:12:55.980203 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 08:12:55.980214 | orchestrator | ok: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-03 08:12:55.980225 | orchestrator | 2026-04-03 08:12:55.980236 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-03 08:12:55.980246 | orchestrator | Friday 03 April 2026 08:12:51 +0000 (0:00:07.871) 0:26:04.012 ********** 2026-04-03 08:12:55.980257 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:12:55.980268 | orchestrator | 2026-04-03 08:12:55.980279 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-03 08:12:55.980289 | orchestrator | Friday 03 April 2026 08:12:52 +0000 (0:00:01.228) 0:26:05.240 ********** 2026-04-03 08:12:55.980300 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 08:12:55.980311 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 08:12:55.980322 | orchestrator | 2026-04-03 08:12:55.980332 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:12:55.980343 | orchestrator | Friday 03 April 2026 08:12:55 +0000 (0:00:03.508) 0:26:08.748 ********** 2026-04-03 08:12:55.980364 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 08:13:53.232709 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 08:13:53.232827 | orchestrator | 2026-04-03 08:13:53.232846 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-03 08:13:53.232859 | orchestrator | Friday 03 April 2026 08:12:57 +0000 (0:00:02.061) 0:26:10.810 ********** 2026-04-03 08:13:53.232871 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:13:53.232882 | orchestrator | 2026-04-03 08:13:53.232893 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-03 08:13:53.232904 | orchestrator | Friday 03 April 2026 08:12:59 +0000 (0:00:01.593) 0:26:12.403 ********** 2026-04-03 08:13:53.232915 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:13:53.232926 | orchestrator | 2026-04-03 08:13:53.232938 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:13:53.232949 | orchestrator | Friday 03 April 2026 08:13:00 +0000 (0:00:01.180) 0:26:13.584 ********** 2026-04-03 08:13:53.232961 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:13:53.232971 | orchestrator | 2026-04-03 08:13:53.232982 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:13:53.232993 | orchestrator | Friday 03 April 2026 08:13:01 +0000 (0:00:01.129) 0:26:14.713 ********** 2026-04-03 08:13:53.233004 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0 2026-04-03 08:13:53.233016 | orchestrator | 2026-04-03 08:13:53.233027 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-03 08:13:53.233037 | orchestrator | Friday 03 April 2026 08:13:03 +0000 (0:00:01.464) 0:26:16.177 ********** 2026-04-03 08:13:53.233048 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:13:53.233059 | orchestrator | 2026-04-03 08:13:53.233070 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-03 08:13:53.233081 | orchestrator | Friday 03 April 2026 08:13:04 +0000 (0:00:01.157) 0:26:17.335 ********** 2026-04-03 08:13:53.233091 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:13:53.233102 | orchestrator | 2026-04-03 08:13:53.233113 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-03 08:13:53.233124 | orchestrator | Friday 03 April 2026 08:13:05 +0000 (0:00:01.164) 0:26:18.499 ********** 2026-04-03 08:13:53.233134 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0 2026-04-03 08:13:53.233145 | orchestrator | 2026-04-03 08:13:53.233156 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-03 08:13:53.233193 | orchestrator | Friday 03 April 2026 08:13:07 +0000 (0:00:01.510) 0:26:20.010 ********** 2026-04-03 08:13:53.233246 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:13:53.233259 | orchestrator | 2026-04-03 08:13:53.233272 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-03 08:13:53.233285 | orchestrator | Friday 03 April 2026 08:13:09 +0000 (0:00:02.041) 0:26:22.052 ********** 2026-04-03 08:13:53.233297 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:13:53.233310 | orchestrator | 2026-04-03 08:13:53.233323 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-03 08:13:53.233335 | orchestrator | Friday 03 April 2026 08:13:11 +0000 (0:00:01.978) 0:26:24.030 ********** 2026-04-03 08:13:53.233348 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:13:53.233360 | orchestrator | 2026-04-03 08:13:53.233372 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-03 08:13:53.233386 | orchestrator | Friday 03 April 2026 08:13:13 +0000 (0:00:02.407) 0:26:26.438 ********** 2026-04-03 08:13:53.233399 | orchestrator | changed: [testbed-node-0] 2026-04-03 08:13:53.233411 | orchestrator | 2026-04-03 08:13:53.233423 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:13:53.233437 | orchestrator | Friday 03 April 2026 08:13:17 +0000 (0:00:03.957) 0:26:30.396 ********** 2026-04-03 08:13:53.233448 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:13:53.233461 | orchestrator | 2026-04-03 08:13:53.233474 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-03 08:13:53.233487 | orchestrator | 2026-04-03 08:13:53.233500 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:13:53.233511 | orchestrator | Friday 03 April 2026 08:13:18 +0000 (0:00:00.995) 0:26:31.391 ********** 2026-04-03 08:13:53.233522 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:13:53.233532 | orchestrator | 2026-04-03 08:13:53.233543 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-03 08:13:53.233554 | orchestrator | Friday 03 April 2026 08:13:31 +0000 (0:00:12.573) 0:26:43.965 ********** 2026-04-03 08:13:53.233564 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:13:53.233575 | orchestrator | 2026-04-03 08:13:53.233585 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:13:53.233596 | orchestrator | Friday 03 April 2026 08:13:33 +0000 (0:00:01.997) 0:26:45.962 ********** 2026-04-03 08:13:53.233607 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-03 08:13:53.233618 | orchestrator | 2026-04-03 08:13:53.233628 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:13:53.233639 | orchestrator | Friday 03 April 2026 08:13:34 +0000 (0:00:01.127) 0:26:47.089 ********** 2026-04-03 08:13:53.233650 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233660 | orchestrator | 2026-04-03 08:13:53.233671 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:13:53.233682 | orchestrator | Friday 03 April 2026 08:13:35 +0000 (0:00:01.459) 0:26:48.549 ********** 2026-04-03 08:13:53.233692 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233703 | orchestrator | 2026-04-03 08:13:53.233714 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:13:53.233724 | orchestrator | Friday 03 April 2026 08:13:36 +0000 (0:00:01.162) 0:26:49.712 ********** 2026-04-03 08:13:53.233735 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233745 | orchestrator | 2026-04-03 08:13:53.233756 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:13:53.233767 | orchestrator | Friday 03 April 2026 08:13:38 +0000 (0:00:01.467) 0:26:51.179 ********** 2026-04-03 08:13:53.233777 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233787 | orchestrator | 2026-04-03 08:13:53.233815 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:13:53.233827 | orchestrator | Friday 03 April 2026 08:13:39 +0000 (0:00:01.126) 0:26:52.306 ********** 2026-04-03 08:13:53.233847 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233858 | orchestrator | 2026-04-03 08:13:53.233869 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:13:53.233879 | orchestrator | Friday 03 April 2026 08:13:40 +0000 (0:00:01.149) 0:26:53.456 ********** 2026-04-03 08:13:53.233890 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233901 | orchestrator | 2026-04-03 08:13:53.233912 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:13:53.233923 | orchestrator | Friday 03 April 2026 08:13:41 +0000 (0:00:01.181) 0:26:54.638 ********** 2026-04-03 08:13:53.233934 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:13:53.233944 | orchestrator | 2026-04-03 08:13:53.233955 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:13:53.233966 | orchestrator | Friday 03 April 2026 08:13:42 +0000 (0:00:01.167) 0:26:55.805 ********** 2026-04-03 08:13:53.233977 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.233988 | orchestrator | 2026-04-03 08:13:53.233998 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:13:53.234009 | orchestrator | Friday 03 April 2026 08:13:44 +0000 (0:00:01.114) 0:26:56.919 ********** 2026-04-03 08:13:53.234085 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:13:53.234097 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:13:53.234108 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:13:53.234119 | orchestrator | 2026-04-03 08:13:53.234130 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:13:53.234141 | orchestrator | Friday 03 April 2026 08:13:45 +0000 (0:00:01.697) 0:26:58.617 ********** 2026-04-03 08:13:53.234152 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:13:53.234162 | orchestrator | 2026-04-03 08:13:53.234174 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:13:53.234184 | orchestrator | Friday 03 April 2026 08:13:47 +0000 (0:00:01.293) 0:26:59.911 ********** 2026-04-03 08:13:53.234195 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:13:53.234225 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:13:53.234252 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:13:53.234264 | orchestrator | 2026-04-03 08:13:53.234275 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:13:53.234285 | orchestrator | Friday 03 April 2026 08:13:49 +0000 (0:00:02.909) 0:27:02.820 ********** 2026-04-03 08:13:53.234296 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 08:13:53.234307 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 08:13:53.234318 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 08:13:53.234329 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:13:53.234340 | orchestrator | 2026-04-03 08:13:53.234350 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:13:53.234361 | orchestrator | Friday 03 April 2026 08:13:51 +0000 (0:00:01.467) 0:27:04.288 ********** 2026-04-03 08:13:53.234379 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:13:53.234403 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:13:53.234423 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:13:53.234456 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:13:53.234477 | orchestrator | 2026-04-03 08:13:53.234489 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:13:53.234500 | orchestrator | Friday 03 April 2026 08:13:53 +0000 (0:00:01.721) 0:27:06.010 ********** 2026-04-03 08:13:53.234513 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:13:53.234527 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:13:53.234549 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:13.489493 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.489615 | orchestrator | 2026-04-03 08:14:13.489632 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:14:13.489646 | orchestrator | Friday 03 April 2026 08:13:54 +0000 (0:00:01.167) 0:27:07.178 ********** 2026-04-03 08:14:13.489660 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:13:47.594478', 'end': '2026-04-03 08:13:47.650086', 'delta': '0:00:00.055608', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:14:13.489693 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:13:48.196206', 'end': '2026-04-03 08:13:48.251776', 'delta': '0:00:00.055570', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:14:13.489705 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:13:48.735066', 'end': '2026-04-03 08:13:48.780965', 'delta': '0:00:00.045899', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:14:13.489738 | orchestrator | 2026-04-03 08:14:13.489750 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:14:13.489761 | orchestrator | Friday 03 April 2026 08:13:55 +0000 (0:00:01.251) 0:27:08.429 ********** 2026-04-03 08:14:13.489772 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:13.489784 | orchestrator | 2026-04-03 08:14:13.489795 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:14:13.489806 | orchestrator | Friday 03 April 2026 08:13:56 +0000 (0:00:01.320) 0:27:09.750 ********** 2026-04-03 08:14:13.489817 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.489828 | orchestrator | 2026-04-03 08:14:13.489839 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:14:13.489850 | orchestrator | Friday 03 April 2026 08:13:58 +0000 (0:00:01.305) 0:27:11.055 ********** 2026-04-03 08:14:13.489860 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:13.489871 | orchestrator | 2026-04-03 08:14:13.489882 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:14:13.489892 | orchestrator | Friday 03 April 2026 08:13:59 +0000 (0:00:01.154) 0:27:12.209 ********** 2026-04-03 08:14:13.489903 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:14:13.489913 | orchestrator | 2026-04-03 08:14:13.489924 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:14:13.489934 | orchestrator | Friday 03 April 2026 08:14:01 +0000 (0:00:02.460) 0:27:14.670 ********** 2026-04-03 08:14:13.489945 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:13.489956 | orchestrator | 2026-04-03 08:14:13.489966 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:14:13.489977 | orchestrator | Friday 03 April 2026 08:14:02 +0000 (0:00:01.173) 0:27:15.844 ********** 2026-04-03 08:14:13.489988 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.489998 | orchestrator | 2026-04-03 08:14:13.490011 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:14:13.490156 | orchestrator | Friday 03 April 2026 08:14:04 +0000 (0:00:01.166) 0:27:17.011 ********** 2026-04-03 08:14:13.490170 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490182 | orchestrator | 2026-04-03 08:14:13.490195 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:14:13.490208 | orchestrator | Friday 03 April 2026 08:14:05 +0000 (0:00:01.265) 0:27:18.277 ********** 2026-04-03 08:14:13.490261 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490274 | orchestrator | 2026-04-03 08:14:13.490324 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:14:13.490336 | orchestrator | Friday 03 April 2026 08:14:06 +0000 (0:00:01.168) 0:27:19.445 ********** 2026-04-03 08:14:13.490347 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490358 | orchestrator | 2026-04-03 08:14:13.490369 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:14:13.490379 | orchestrator | Friday 03 April 2026 08:14:07 +0000 (0:00:01.166) 0:27:20.612 ********** 2026-04-03 08:14:13.490390 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490401 | orchestrator | 2026-04-03 08:14:13.490412 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:14:13.490422 | orchestrator | Friday 03 April 2026 08:14:08 +0000 (0:00:01.139) 0:27:21.752 ********** 2026-04-03 08:14:13.490433 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490443 | orchestrator | 2026-04-03 08:14:13.490454 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:14:13.490465 | orchestrator | Friday 03 April 2026 08:14:10 +0000 (0:00:01.127) 0:27:22.879 ********** 2026-04-03 08:14:13.490475 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490497 | orchestrator | 2026-04-03 08:14:13.490508 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:14:13.490518 | orchestrator | Friday 03 April 2026 08:14:11 +0000 (0:00:01.120) 0:27:24.000 ********** 2026-04-03 08:14:13.490529 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490540 | orchestrator | 2026-04-03 08:14:13.490550 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:14:13.490562 | orchestrator | Friday 03 April 2026 08:14:12 +0000 (0:00:01.106) 0:27:25.106 ********** 2026-04-03 08:14:13.490573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:13.490584 | orchestrator | 2026-04-03 08:14:13.490594 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:14:13.490612 | orchestrator | Friday 03 April 2026 08:14:13 +0000 (0:00:01.119) 0:27:26.226 ********** 2026-04-03 08:14:13.490624 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:13.490638 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:13.490649 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:13.490661 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:14:13.490674 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:13.490686 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:13.490705 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:14.728043 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:14:14.728132 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:14.728144 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:14:14.728151 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:14.728159 | orchestrator | 2026-04-03 08:14:14.728167 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:14:14.728176 | orchestrator | Friday 03 April 2026 08:14:14 +0000 (0:00:01.247) 0:27:27.474 ********** 2026-04-03 08:14:14.728185 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728270 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728286 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728295 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-28-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728302 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728309 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728315 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:14.728335 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'd8baca43', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1', 'scsi-SQEMU_QEMU_HARDDISK_d8baca43-60dc-4fb6-9e83-dc38ea6087e4-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:49.925397 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:49.925517 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:14:49.925534 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.925548 | orchestrator | 2026-04-03 08:14:49.925561 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:14:49.925574 | orchestrator | Friday 03 April 2026 08:14:15 +0000 (0:00:01.255) 0:27:28.729 ********** 2026-04-03 08:14:49.925585 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.925597 | orchestrator | 2026-04-03 08:14:49.925631 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:14:49.925643 | orchestrator | Friday 03 April 2026 08:14:17 +0000 (0:00:01.611) 0:27:30.341 ********** 2026-04-03 08:14:49.925654 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.925665 | orchestrator | 2026-04-03 08:14:49.925676 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:14:49.925687 | orchestrator | Friday 03 April 2026 08:14:18 +0000 (0:00:01.111) 0:27:31.453 ********** 2026-04-03 08:14:49.925697 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.925708 | orchestrator | 2026-04-03 08:14:49.925719 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:14:49.925729 | orchestrator | Friday 03 April 2026 08:14:20 +0000 (0:00:01.469) 0:27:32.923 ********** 2026-04-03 08:14:49.925740 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.925751 | orchestrator | 2026-04-03 08:14:49.925762 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:14:49.925773 | orchestrator | Friday 03 April 2026 08:14:21 +0000 (0:00:01.162) 0:27:34.086 ********** 2026-04-03 08:14:49.925783 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.925794 | orchestrator | 2026-04-03 08:14:49.925805 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:14:49.925815 | orchestrator | Friday 03 April 2026 08:14:22 +0000 (0:00:01.254) 0:27:35.341 ********** 2026-04-03 08:14:49.925826 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.925837 | orchestrator | 2026-04-03 08:14:49.925848 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:14:49.925858 | orchestrator | Friday 03 April 2026 08:14:23 +0000 (0:00:01.137) 0:27:36.478 ********** 2026-04-03 08:14:49.925869 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-03 08:14:49.925880 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:14:49.925891 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-03 08:14:49.925904 | orchestrator | 2026-04-03 08:14:49.925917 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:14:49.925930 | orchestrator | Friday 03 April 2026 08:14:25 +0000 (0:00:01.799) 0:27:38.278 ********** 2026-04-03 08:14:49.925943 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-03 08:14:49.925956 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-03 08:14:49.925969 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-03 08:14:49.925982 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.925994 | orchestrator | 2026-04-03 08:14:49.926088 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:14:49.926104 | orchestrator | Friday 03 April 2026 08:14:26 +0000 (0:00:01.207) 0:27:39.485 ********** 2026-04-03 08:14:49.926118 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926131 | orchestrator | 2026-04-03 08:14:49.926145 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:14:49.926157 | orchestrator | Friday 03 April 2026 08:14:27 +0000 (0:00:01.139) 0:27:40.624 ********** 2026-04-03 08:14:49.926170 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:14:49.926183 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:14:49.926196 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:14:49.926209 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:14:49.926221 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:14:49.926232 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:14:49.926285 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:14:49.926298 | orchestrator | 2026-04-03 08:14:49.926309 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:14:49.926329 | orchestrator | Friday 03 April 2026 08:14:29 +0000 (0:00:02.176) 0:27:42.801 ********** 2026-04-03 08:14:49.926341 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:14:49.926351 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:14:49.926362 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:14:49.926373 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:14:49.926384 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:14:49.926394 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:14:49.926405 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:14:49.926416 | orchestrator | 2026-04-03 08:14:49.926427 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:14:49.926438 | orchestrator | Friday 03 April 2026 08:14:32 +0000 (0:00:02.321) 0:27:45.122 ********** 2026-04-03 08:14:49.926448 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-03 08:14:49.926460 | orchestrator | 2026-04-03 08:14:49.926471 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:14:49.926482 | orchestrator | Friday 03 April 2026 08:14:33 +0000 (0:00:01.111) 0:27:46.234 ********** 2026-04-03 08:14:49.926493 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-03 08:14:49.926504 | orchestrator | 2026-04-03 08:14:49.926515 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:14:49.926526 | orchestrator | Friday 03 April 2026 08:14:34 +0000 (0:00:01.279) 0:27:47.513 ********** 2026-04-03 08:14:49.926537 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.926548 | orchestrator | 2026-04-03 08:14:49.926558 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:14:49.926569 | orchestrator | Friday 03 April 2026 08:14:36 +0000 (0:00:01.526) 0:27:49.040 ********** 2026-04-03 08:14:49.926580 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926591 | orchestrator | 2026-04-03 08:14:49.926602 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:14:49.926613 | orchestrator | Friday 03 April 2026 08:14:37 +0000 (0:00:01.194) 0:27:50.234 ********** 2026-04-03 08:14:49.926624 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926634 | orchestrator | 2026-04-03 08:14:49.926645 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:14:49.926656 | orchestrator | Friday 03 April 2026 08:14:38 +0000 (0:00:01.144) 0:27:51.379 ********** 2026-04-03 08:14:49.926666 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926677 | orchestrator | 2026-04-03 08:14:49.926688 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:14:49.926699 | orchestrator | Friday 03 April 2026 08:14:39 +0000 (0:00:01.155) 0:27:52.534 ********** 2026-04-03 08:14:49.926710 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.926721 | orchestrator | 2026-04-03 08:14:49.926746 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:14:49.926769 | orchestrator | Friday 03 April 2026 08:14:41 +0000 (0:00:01.530) 0:27:54.065 ********** 2026-04-03 08:14:49.926780 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926791 | orchestrator | 2026-04-03 08:14:49.926802 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:14:49.926813 | orchestrator | Friday 03 April 2026 08:14:42 +0000 (0:00:01.105) 0:27:55.171 ********** 2026-04-03 08:14:49.926824 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926835 | orchestrator | 2026-04-03 08:14:49.926846 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:14:49.926865 | orchestrator | Friday 03 April 2026 08:14:43 +0000 (0:00:01.157) 0:27:56.328 ********** 2026-04-03 08:14:49.926876 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.926887 | orchestrator | 2026-04-03 08:14:49.926898 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:14:49.926909 | orchestrator | Friday 03 April 2026 08:14:45 +0000 (0:00:01.672) 0:27:58.000 ********** 2026-04-03 08:14:49.926920 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.926930 | orchestrator | 2026-04-03 08:14:49.926947 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:14:49.926958 | orchestrator | Friday 03 April 2026 08:14:46 +0000 (0:00:01.530) 0:27:59.531 ********** 2026-04-03 08:14:49.926969 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.926981 | orchestrator | 2026-04-03 08:14:49.926992 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:14:49.927003 | orchestrator | Friday 03 April 2026 08:14:47 +0000 (0:00:00.778) 0:28:00.310 ********** 2026-04-03 08:14:49.927013 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:14:49.927024 | orchestrator | 2026-04-03 08:14:49.927035 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:14:49.927046 | orchestrator | Friday 03 April 2026 08:14:48 +0000 (0:00:00.801) 0:28:01.111 ********** 2026-04-03 08:14:49.927057 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.927068 | orchestrator | 2026-04-03 08:14:49.927079 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:14:49.927090 | orchestrator | Friday 03 April 2026 08:14:49 +0000 (0:00:00.793) 0:28:01.905 ********** 2026-04-03 08:14:49.927101 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:14:49.927112 | orchestrator | 2026-04-03 08:14:49.927123 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:14:49.927134 | orchestrator | Friday 03 April 2026 08:14:49 +0000 (0:00:00.821) 0:28:02.726 ********** 2026-04-03 08:14:49.927151 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.311880 | orchestrator | 2026-04-03 08:15:30.312027 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:15:30.312046 | orchestrator | Friday 03 April 2026 08:14:50 +0000 (0:00:00.784) 0:28:03.511 ********** 2026-04-03 08:15:30.312059 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312071 | orchestrator | 2026-04-03 08:15:30.312083 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:15:30.312094 | orchestrator | Friday 03 April 2026 08:14:51 +0000 (0:00:00.814) 0:28:04.325 ********** 2026-04-03 08:15:30.312105 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312116 | orchestrator | 2026-04-03 08:15:30.312126 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:15:30.312137 | orchestrator | Friday 03 April 2026 08:14:52 +0000 (0:00:00.781) 0:28:05.107 ********** 2026-04-03 08:15:30.312148 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.312160 | orchestrator | 2026-04-03 08:15:30.312171 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:15:30.312182 | orchestrator | Friday 03 April 2026 08:14:53 +0000 (0:00:00.844) 0:28:05.951 ********** 2026-04-03 08:15:30.312192 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.312203 | orchestrator | 2026-04-03 08:15:30.312220 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:15:30.312239 | orchestrator | Friday 03 April 2026 08:14:53 +0000 (0:00:00.835) 0:28:06.787 ********** 2026-04-03 08:15:30.312258 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.312319 | orchestrator | 2026-04-03 08:15:30.312338 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:15:30.312355 | orchestrator | Friday 03 April 2026 08:14:54 +0000 (0:00:00.826) 0:28:07.614 ********** 2026-04-03 08:15:30.312374 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312394 | orchestrator | 2026-04-03 08:15:30.312412 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:15:30.312431 | orchestrator | Friday 03 April 2026 08:14:55 +0000 (0:00:00.799) 0:28:08.413 ********** 2026-04-03 08:15:30.312494 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312514 | orchestrator | 2026-04-03 08:15:30.312534 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:15:30.312555 | orchestrator | Friday 03 April 2026 08:14:56 +0000 (0:00:00.772) 0:28:09.186 ********** 2026-04-03 08:15:30.312573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312591 | orchestrator | 2026-04-03 08:15:30.312610 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:15:30.312628 | orchestrator | Friday 03 April 2026 08:14:57 +0000 (0:00:00.820) 0:28:10.007 ********** 2026-04-03 08:15:30.312644 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312662 | orchestrator | 2026-04-03 08:15:30.312681 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:15:30.312701 | orchestrator | Friday 03 April 2026 08:14:57 +0000 (0:00:00.763) 0:28:10.770 ********** 2026-04-03 08:15:30.312719 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312737 | orchestrator | 2026-04-03 08:15:30.312755 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:15:30.312774 | orchestrator | Friday 03 April 2026 08:14:58 +0000 (0:00:00.843) 0:28:11.614 ********** 2026-04-03 08:15:30.312793 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312812 | orchestrator | 2026-04-03 08:15:30.312831 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:15:30.312850 | orchestrator | Friday 03 April 2026 08:14:59 +0000 (0:00:00.835) 0:28:12.450 ********** 2026-04-03 08:15:30.312868 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312886 | orchestrator | 2026-04-03 08:15:30.312905 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:15:30.312925 | orchestrator | Friday 03 April 2026 08:15:00 +0000 (0:00:00.797) 0:28:13.247 ********** 2026-04-03 08:15:30.312945 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.312964 | orchestrator | 2026-04-03 08:15:30.312981 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:15:30.313000 | orchestrator | Friday 03 April 2026 08:15:01 +0000 (0:00:00.761) 0:28:14.009 ********** 2026-04-03 08:15:30.313020 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313039 | orchestrator | 2026-04-03 08:15:30.313057 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:15:30.313075 | orchestrator | Friday 03 April 2026 08:15:01 +0000 (0:00:00.810) 0:28:14.819 ********** 2026-04-03 08:15:30.313092 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313111 | orchestrator | 2026-04-03 08:15:30.313131 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:15:30.313175 | orchestrator | Friday 03 April 2026 08:15:02 +0000 (0:00:00.786) 0:28:15.606 ********** 2026-04-03 08:15:30.313196 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313215 | orchestrator | 2026-04-03 08:15:30.313233 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:15:30.313251 | orchestrator | Friday 03 April 2026 08:15:03 +0000 (0:00:00.772) 0:28:16.378 ********** 2026-04-03 08:15:30.313297 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313316 | orchestrator | 2026-04-03 08:15:30.313334 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:15:30.313353 | orchestrator | Friday 03 April 2026 08:15:04 +0000 (0:00:00.774) 0:28:17.153 ********** 2026-04-03 08:15:30.313371 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.313390 | orchestrator | 2026-04-03 08:15:30.313408 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:15:30.313426 | orchestrator | Friday 03 April 2026 08:15:05 +0000 (0:00:01.662) 0:28:18.815 ********** 2026-04-03 08:15:30.313445 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.313462 | orchestrator | 2026-04-03 08:15:30.313480 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:15:30.313518 | orchestrator | Friday 03 April 2026 08:15:07 +0000 (0:00:01.932) 0:28:20.748 ********** 2026-04-03 08:15:30.313537 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-03 08:15:30.313558 | orchestrator | 2026-04-03 08:15:30.313609 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:15:30.313632 | orchestrator | Friday 03 April 2026 08:15:09 +0000 (0:00:01.140) 0:28:21.888 ********** 2026-04-03 08:15:30.313651 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313670 | orchestrator | 2026-04-03 08:15:30.313688 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:15:30.313707 | orchestrator | Friday 03 April 2026 08:15:10 +0000 (0:00:01.161) 0:28:23.050 ********** 2026-04-03 08:15:30.313726 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313745 | orchestrator | 2026-04-03 08:15:30.313763 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:15:30.313781 | orchestrator | Friday 03 April 2026 08:15:11 +0000 (0:00:01.199) 0:28:24.249 ********** 2026-04-03 08:15:30.313799 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:15:30.313825 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:15:30.313845 | orchestrator | 2026-04-03 08:15:30.313864 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:15:30.313882 | orchestrator | Friday 03 April 2026 08:15:13 +0000 (0:00:01.795) 0:28:26.045 ********** 2026-04-03 08:15:30.313900 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.313917 | orchestrator | 2026-04-03 08:15:30.313936 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:15:30.313953 | orchestrator | Friday 03 April 2026 08:15:14 +0000 (0:00:01.486) 0:28:27.531 ********** 2026-04-03 08:15:30.313970 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.313987 | orchestrator | 2026-04-03 08:15:30.314005 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:15:30.314119 | orchestrator | Friday 03 April 2026 08:15:15 +0000 (0:00:01.189) 0:28:28.721 ********** 2026-04-03 08:15:30.314141 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314160 | orchestrator | 2026-04-03 08:15:30.314178 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:15:30.314196 | orchestrator | Friday 03 April 2026 08:15:16 +0000 (0:00:00.777) 0:28:29.498 ********** 2026-04-03 08:15:30.314214 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314231 | orchestrator | 2026-04-03 08:15:30.314249 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:15:30.314306 | orchestrator | Friday 03 April 2026 08:15:17 +0000 (0:00:00.779) 0:28:30.278 ********** 2026-04-03 08:15:30.314327 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-03 08:15:30.314345 | orchestrator | 2026-04-03 08:15:30.314365 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:15:30.314384 | orchestrator | Friday 03 April 2026 08:15:18 +0000 (0:00:01.100) 0:28:31.379 ********** 2026-04-03 08:15:30.314401 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.314420 | orchestrator | 2026-04-03 08:15:30.314438 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:15:30.314456 | orchestrator | Friday 03 April 2026 08:15:20 +0000 (0:00:01.742) 0:28:33.122 ********** 2026-04-03 08:15:30.314475 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:15:30.314494 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:15:30.314512 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:15:30.314531 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314550 | orchestrator | 2026-04-03 08:15:30.314568 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:15:30.314605 | orchestrator | Friday 03 April 2026 08:15:21 +0000 (0:00:01.180) 0:28:34.303 ********** 2026-04-03 08:15:30.314624 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314642 | orchestrator | 2026-04-03 08:15:30.314660 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:15:30.314680 | orchestrator | Friday 03 April 2026 08:15:22 +0000 (0:00:01.161) 0:28:35.464 ********** 2026-04-03 08:15:30.314699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314719 | orchestrator | 2026-04-03 08:15:30.314737 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:15:30.314754 | orchestrator | Friday 03 April 2026 08:15:23 +0000 (0:00:01.190) 0:28:36.655 ********** 2026-04-03 08:15:30.314772 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314790 | orchestrator | 2026-04-03 08:15:30.314808 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:15:30.314827 | orchestrator | Friday 03 April 2026 08:15:24 +0000 (0:00:01.138) 0:28:37.794 ********** 2026-04-03 08:15:30.314845 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314864 | orchestrator | 2026-04-03 08:15:30.314882 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:15:30.314900 | orchestrator | Friday 03 April 2026 08:15:26 +0000 (0:00:01.230) 0:28:39.024 ********** 2026-04-03 08:15:30.314918 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:15:30.314937 | orchestrator | 2026-04-03 08:15:30.314956 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:15:30.314974 | orchestrator | Friday 03 April 2026 08:15:26 +0000 (0:00:00.783) 0:28:39.808 ********** 2026-04-03 08:15:30.314992 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.315010 | orchestrator | 2026-04-03 08:15:30.315028 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:15:30.315047 | orchestrator | Friday 03 April 2026 08:15:29 +0000 (0:00:02.288) 0:28:42.096 ********** 2026-04-03 08:15:30.315067 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:15:30.315084 | orchestrator | 2026-04-03 08:15:30.315102 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:15:30.315121 | orchestrator | Friday 03 April 2026 08:15:30 +0000 (0:00:00.832) 0:28:42.929 ********** 2026-04-03 08:15:30.315141 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-03 08:15:30.315158 | orchestrator | 2026-04-03 08:15:30.315200 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:16:07.453760 | orchestrator | Friday 03 April 2026 08:15:31 +0000 (0:00:01.177) 0:28:44.106 ********** 2026-04-03 08:16:07.453880 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.453898 | orchestrator | 2026-04-03 08:16:07.453912 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:16:07.453973 | orchestrator | Friday 03 April 2026 08:15:32 +0000 (0:00:01.152) 0:28:45.258 ********** 2026-04-03 08:16:07.453986 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.453997 | orchestrator | 2026-04-03 08:16:07.454009 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:16:07.454103 | orchestrator | Friday 03 April 2026 08:15:33 +0000 (0:00:01.165) 0:28:46.424 ********** 2026-04-03 08:16:07.454115 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454127 | orchestrator | 2026-04-03 08:16:07.454138 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:16:07.454149 | orchestrator | Friday 03 April 2026 08:15:34 +0000 (0:00:01.135) 0:28:47.560 ********** 2026-04-03 08:16:07.454160 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454171 | orchestrator | 2026-04-03 08:16:07.454182 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:16:07.454193 | orchestrator | Friday 03 April 2026 08:15:35 +0000 (0:00:01.218) 0:28:48.778 ********** 2026-04-03 08:16:07.454204 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454214 | orchestrator | 2026-04-03 08:16:07.454249 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:16:07.454260 | orchestrator | Friday 03 April 2026 08:15:37 +0000 (0:00:01.178) 0:28:49.957 ********** 2026-04-03 08:16:07.454271 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454284 | orchestrator | 2026-04-03 08:16:07.454370 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:16:07.454386 | orchestrator | Friday 03 April 2026 08:15:38 +0000 (0:00:01.134) 0:28:51.092 ********** 2026-04-03 08:16:07.454398 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454411 | orchestrator | 2026-04-03 08:16:07.454424 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:16:07.454437 | orchestrator | Friday 03 April 2026 08:15:39 +0000 (0:00:01.181) 0:28:52.273 ********** 2026-04-03 08:16:07.454449 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454462 | orchestrator | 2026-04-03 08:16:07.454474 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:16:07.454487 | orchestrator | Friday 03 April 2026 08:15:40 +0000 (0:00:01.191) 0:28:53.464 ********** 2026-04-03 08:16:07.454500 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:16:07.454514 | orchestrator | 2026-04-03 08:16:07.454526 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:16:07.454539 | orchestrator | Friday 03 April 2026 08:15:41 +0000 (0:00:00.810) 0:28:54.274 ********** 2026-04-03 08:16:07.454552 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-03 08:16:07.454567 | orchestrator | 2026-04-03 08:16:07.454581 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:16:07.454594 | orchestrator | Friday 03 April 2026 08:15:42 +0000 (0:00:01.135) 0:28:55.410 ********** 2026-04-03 08:16:07.454607 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-03 08:16:07.454621 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-03 08:16:07.454635 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-03 08:16:07.454646 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-03 08:16:07.454657 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-03 08:16:07.454667 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-03 08:16:07.454678 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-03 08:16:07.454688 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:16:07.454699 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:16:07.454709 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:16:07.454720 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:16:07.454730 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:16:07.454741 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:16:07.454751 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:16:07.454768 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-03 08:16:07.454779 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-03 08:16:07.454790 | orchestrator | 2026-04-03 08:16:07.454800 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:16:07.454811 | orchestrator | Friday 03 April 2026 08:15:49 +0000 (0:00:06.599) 0:29:02.010 ********** 2026-04-03 08:16:07.454822 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454833 | orchestrator | 2026-04-03 08:16:07.454844 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:16:07.454855 | orchestrator | Friday 03 April 2026 08:15:49 +0000 (0:00:00.779) 0:29:02.789 ********** 2026-04-03 08:16:07.454866 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454876 | orchestrator | 2026-04-03 08:16:07.454887 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:16:07.454907 | orchestrator | Friday 03 April 2026 08:15:50 +0000 (0:00:00.845) 0:29:03.635 ********** 2026-04-03 08:16:07.454918 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454929 | orchestrator | 2026-04-03 08:16:07.454940 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:16:07.454951 | orchestrator | Friday 03 April 2026 08:15:51 +0000 (0:00:00.792) 0:29:04.428 ********** 2026-04-03 08:16:07.454961 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.454972 | orchestrator | 2026-04-03 08:16:07.454983 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:16:07.455012 | orchestrator | Friday 03 April 2026 08:15:52 +0000 (0:00:00.783) 0:29:05.211 ********** 2026-04-03 08:16:07.455024 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455035 | orchestrator | 2026-04-03 08:16:07.455046 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:16:07.455056 | orchestrator | Friday 03 April 2026 08:15:53 +0000 (0:00:00.810) 0:29:06.022 ********** 2026-04-03 08:16:07.455067 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455078 | orchestrator | 2026-04-03 08:16:07.455088 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:16:07.455100 | orchestrator | Friday 03 April 2026 08:15:53 +0000 (0:00:00.796) 0:29:06.819 ********** 2026-04-03 08:16:07.455110 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455121 | orchestrator | 2026-04-03 08:16:07.455132 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:16:07.455143 | orchestrator | Friday 03 April 2026 08:15:54 +0000 (0:00:00.793) 0:29:07.613 ********** 2026-04-03 08:16:07.455154 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455165 | orchestrator | 2026-04-03 08:16:07.455176 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:16:07.455203 | orchestrator | Friday 03 April 2026 08:15:55 +0000 (0:00:00.902) 0:29:08.515 ********** 2026-04-03 08:16:07.455225 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455236 | orchestrator | 2026-04-03 08:16:07.455247 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:16:07.455258 | orchestrator | Friday 03 April 2026 08:15:56 +0000 (0:00:00.802) 0:29:09.317 ********** 2026-04-03 08:16:07.455269 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455279 | orchestrator | 2026-04-03 08:16:07.455307 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:16:07.455319 | orchestrator | Friday 03 April 2026 08:15:57 +0000 (0:00:00.799) 0:29:10.117 ********** 2026-04-03 08:16:07.455330 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455340 | orchestrator | 2026-04-03 08:16:07.455351 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:16:07.455362 | orchestrator | Friday 03 April 2026 08:15:58 +0000 (0:00:00.785) 0:29:10.903 ********** 2026-04-03 08:16:07.455373 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455383 | orchestrator | 2026-04-03 08:16:07.455394 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:16:07.455405 | orchestrator | Friday 03 April 2026 08:15:58 +0000 (0:00:00.761) 0:29:11.665 ********** 2026-04-03 08:16:07.455416 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455427 | orchestrator | 2026-04-03 08:16:07.455438 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:16:07.455449 | orchestrator | Friday 03 April 2026 08:15:59 +0000 (0:00:00.940) 0:29:12.606 ********** 2026-04-03 08:16:07.455459 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455470 | orchestrator | 2026-04-03 08:16:07.455481 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:16:07.455491 | orchestrator | Friday 03 April 2026 08:16:00 +0000 (0:00:00.752) 0:29:13.358 ********** 2026-04-03 08:16:07.455502 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455521 | orchestrator | 2026-04-03 08:16:07.455531 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:16:07.455542 | orchestrator | Friday 03 April 2026 08:16:01 +0000 (0:00:00.895) 0:29:14.253 ********** 2026-04-03 08:16:07.455553 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455563 | orchestrator | 2026-04-03 08:16:07.455574 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:16:07.455585 | orchestrator | Friday 03 April 2026 08:16:02 +0000 (0:00:00.796) 0:29:15.050 ********** 2026-04-03 08:16:07.455596 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455606 | orchestrator | 2026-04-03 08:16:07.455617 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:16:07.455629 | orchestrator | Friday 03 April 2026 08:16:02 +0000 (0:00:00.751) 0:29:15.801 ********** 2026-04-03 08:16:07.455640 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455651 | orchestrator | 2026-04-03 08:16:07.455661 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:16:07.455672 | orchestrator | Friday 03 April 2026 08:16:03 +0000 (0:00:00.783) 0:29:16.585 ********** 2026-04-03 08:16:07.455683 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455693 | orchestrator | 2026-04-03 08:16:07.455709 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:16:07.455720 | orchestrator | Friday 03 April 2026 08:16:04 +0000 (0:00:00.767) 0:29:17.352 ********** 2026-04-03 08:16:07.455731 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455742 | orchestrator | 2026-04-03 08:16:07.455753 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:16:07.455763 | orchestrator | Friday 03 April 2026 08:16:05 +0000 (0:00:00.812) 0:29:18.165 ********** 2026-04-03 08:16:07.455774 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455785 | orchestrator | 2026-04-03 08:16:07.455796 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:16:07.455806 | orchestrator | Friday 03 April 2026 08:16:06 +0000 (0:00:00.819) 0:29:18.984 ********** 2026-04-03 08:16:07.455817 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:16:07.455828 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:16:07.455839 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:16:07.455850 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:16:07.455860 | orchestrator | 2026-04-03 08:16:07.455871 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:16:07.455882 | orchestrator | Friday 03 April 2026 08:16:07 +0000 (0:00:01.077) 0:29:20.062 ********** 2026-04-03 08:16:07.455893 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:16:07.455911 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:17:06.044418 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:17:06.044535 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.044551 | orchestrator | 2026-04-03 08:17:06.044566 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:17:06.044579 | orchestrator | Friday 03 April 2026 08:16:08 +0000 (0:00:01.063) 0:29:21.126 ********** 2026-04-03 08:17:06.044590 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-03 08:17:06.044601 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-03 08:17:06.044612 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-03 08:17:06.044623 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.044634 | orchestrator | 2026-04-03 08:17:06.044645 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:17:06.044656 | orchestrator | Friday 03 April 2026 08:16:09 +0000 (0:00:01.100) 0:29:22.226 ********** 2026-04-03 08:17:06.044668 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.044678 | orchestrator | 2026-04-03 08:17:06.044715 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:17:06.044727 | orchestrator | Friday 03 April 2026 08:16:10 +0000 (0:00:00.770) 0:29:22.997 ********** 2026-04-03 08:17:06.044738 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-03 08:17:06.044749 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.044760 | orchestrator | 2026-04-03 08:17:06.044771 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:17:06.044782 | orchestrator | Friday 03 April 2026 08:16:11 +0000 (0:00:00.946) 0:29:23.944 ********** 2026-04-03 08:17:06.044793 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.044804 | orchestrator | 2026-04-03 08:17:06.044815 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:17:06.044827 | orchestrator | Friday 03 April 2026 08:16:12 +0000 (0:00:01.399) 0:29:25.343 ********** 2026-04-03 08:17:06.044838 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:17:06.044849 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-03 08:17:06.044860 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:17:06.044871 | orchestrator | 2026-04-03 08:17:06.044882 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:17:06.044893 | orchestrator | Friday 03 April 2026 08:16:14 +0000 (0:00:01.657) 0:29:27.001 ********** 2026-04-03 08:17:06.044904 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-1 2026-04-03 08:17:06.044915 | orchestrator | 2026-04-03 08:17:06.044926 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-03 08:17:06.044936 | orchestrator | Friday 03 April 2026 08:16:15 +0000 (0:00:01.159) 0:29:28.161 ********** 2026-04-03 08:17:06.044947 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.044958 | orchestrator | 2026-04-03 08:17:06.044969 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-03 08:17:06.044980 | orchestrator | Friday 03 April 2026 08:16:16 +0000 (0:00:01.536) 0:29:29.697 ********** 2026-04-03 08:17:06.044991 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045001 | orchestrator | 2026-04-03 08:17:06.045012 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-03 08:17:06.045023 | orchestrator | Friday 03 April 2026 08:16:17 +0000 (0:00:01.145) 0:29:30.843 ********** 2026-04-03 08:17:06.045034 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:17:06.045045 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:17:06.045056 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:17:06.045066 | orchestrator | ok: [testbed-node-1 -> {{ groups[mon_group_name][0] }}] 2026-04-03 08:17:06.045077 | orchestrator | 2026-04-03 08:17:06.045088 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-03 08:17:06.045099 | orchestrator | Friday 03 April 2026 08:16:25 +0000 (0:00:07.717) 0:29:38.561 ********** 2026-04-03 08:17:06.045110 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.045121 | orchestrator | 2026-04-03 08:17:06.045132 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-03 08:17:06.045143 | orchestrator | Friday 03 April 2026 08:16:26 +0000 (0:00:01.170) 0:29:39.731 ********** 2026-04-03 08:17:06.045153 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 08:17:06.045180 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-03 08:17:06.045191 | orchestrator | 2026-04-03 08:17:06.045202 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:17:06.045213 | orchestrator | Friday 03 April 2026 08:16:30 +0000 (0:00:03.271) 0:29:43.003 ********** 2026-04-03 08:17:06.045223 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 08:17:06.045234 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-03 08:17:06.045245 | orchestrator | 2026-04-03 08:17:06.045264 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-03 08:17:06.045275 | orchestrator | Friday 03 April 2026 08:16:32 +0000 (0:00:02.040) 0:29:45.043 ********** 2026-04-03 08:17:06.045286 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.045297 | orchestrator | 2026-04-03 08:17:06.045307 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-03 08:17:06.045318 | orchestrator | Friday 03 April 2026 08:16:33 +0000 (0:00:01.500) 0:29:46.544 ********** 2026-04-03 08:17:06.045352 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045364 | orchestrator | 2026-04-03 08:17:06.045374 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:17:06.045385 | orchestrator | Friday 03 April 2026 08:16:34 +0000 (0:00:00.771) 0:29:47.316 ********** 2026-04-03 08:17:06.045396 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045407 | orchestrator | 2026-04-03 08:17:06.045418 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:17:06.045444 | orchestrator | Friday 03 April 2026 08:16:35 +0000 (0:00:00.808) 0:29:48.125 ********** 2026-04-03 08:17:06.045457 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-1 2026-04-03 08:17:06.045468 | orchestrator | 2026-04-03 08:17:06.045478 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-03 08:17:06.045489 | orchestrator | Friday 03 April 2026 08:16:36 +0000 (0:00:01.105) 0:29:49.230 ********** 2026-04-03 08:17:06.045500 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045510 | orchestrator | 2026-04-03 08:17:06.045521 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-03 08:17:06.045532 | orchestrator | Friday 03 April 2026 08:16:37 +0000 (0:00:01.169) 0:29:50.400 ********** 2026-04-03 08:17:06.045542 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045553 | orchestrator | 2026-04-03 08:17:06.045564 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-03 08:17:06.045574 | orchestrator | Friday 03 April 2026 08:16:38 +0000 (0:00:01.127) 0:29:51.528 ********** 2026-04-03 08:17:06.045585 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-1 2026-04-03 08:17:06.045596 | orchestrator | 2026-04-03 08:17:06.045607 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-03 08:17:06.045618 | orchestrator | Friday 03 April 2026 08:16:39 +0000 (0:00:01.145) 0:29:52.674 ********** 2026-04-03 08:17:06.045628 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.045639 | orchestrator | 2026-04-03 08:17:06.045650 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-03 08:17:06.045660 | orchestrator | Friday 03 April 2026 08:16:42 +0000 (0:00:02.379) 0:29:55.054 ********** 2026-04-03 08:17:06.045671 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.045682 | orchestrator | 2026-04-03 08:17:06.045693 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-03 08:17:06.045704 | orchestrator | Friday 03 April 2026 08:16:44 +0000 (0:00:01.957) 0:29:57.011 ********** 2026-04-03 08:17:06.045715 | orchestrator | ok: [testbed-node-1] 2026-04-03 08:17:06.045725 | orchestrator | 2026-04-03 08:17:06.045736 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-03 08:17:06.045747 | orchestrator | Friday 03 April 2026 08:16:46 +0000 (0:00:02.434) 0:29:59.445 ********** 2026-04-03 08:17:06.045758 | orchestrator | changed: [testbed-node-1] 2026-04-03 08:17:06.045768 | orchestrator | 2026-04-03 08:17:06.045779 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:17:06.045790 | orchestrator | Friday 03 April 2026 08:16:50 +0000 (0:00:03.539) 0:30:02.985 ********** 2026-04-03 08:17:06.045801 | orchestrator | skipping: [testbed-node-1] 2026-04-03 08:17:06.045812 | orchestrator | 2026-04-03 08:17:06.045823 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-03 08:17:06.045834 | orchestrator | 2026-04-03 08:17:06.045844 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-03 08:17:06.045862 | orchestrator | Friday 03 April 2026 08:16:51 +0000 (0:00:01.054) 0:30:04.039 ********** 2026-04-03 08:17:06.045874 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:17:06.045884 | orchestrator | 2026-04-03 08:17:06.045895 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-03 08:17:06.045906 | orchestrator | Friday 03 April 2026 08:16:53 +0000 (0:00:02.646) 0:30:06.686 ********** 2026-04-03 08:17:06.045917 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:17:06.045927 | orchestrator | 2026-04-03 08:17:06.045938 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:17:06.045949 | orchestrator | Friday 03 April 2026 08:16:55 +0000 (0:00:02.064) 0:30:08.750 ********** 2026-04-03 08:17:06.045960 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-03 08:17:06.045971 | orchestrator | 2026-04-03 08:17:06.045982 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:17:06.045992 | orchestrator | Friday 03 April 2026 08:16:57 +0000 (0:00:01.158) 0:30:09.909 ********** 2026-04-03 08:17:06.046003 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046074 | orchestrator | 2026-04-03 08:17:06.046089 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:17:06.046100 | orchestrator | Friday 03 April 2026 08:16:58 +0000 (0:00:01.470) 0:30:11.380 ********** 2026-04-03 08:17:06.046111 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046121 | orchestrator | 2026-04-03 08:17:06.046132 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:17:06.046142 | orchestrator | Friday 03 April 2026 08:16:59 +0000 (0:00:01.172) 0:30:12.552 ********** 2026-04-03 08:17:06.046159 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046170 | orchestrator | 2026-04-03 08:17:06.046181 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:17:06.046192 | orchestrator | Friday 03 April 2026 08:17:01 +0000 (0:00:01.482) 0:30:14.035 ********** 2026-04-03 08:17:06.046202 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046213 | orchestrator | 2026-04-03 08:17:06.046224 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:17:06.046235 | orchestrator | Friday 03 April 2026 08:17:02 +0000 (0:00:01.174) 0:30:15.209 ********** 2026-04-03 08:17:06.046245 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046256 | orchestrator | 2026-04-03 08:17:06.046267 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:17:06.046278 | orchestrator | Friday 03 April 2026 08:17:03 +0000 (0:00:01.155) 0:30:16.365 ********** 2026-04-03 08:17:06.046289 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046300 | orchestrator | 2026-04-03 08:17:06.046310 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:17:06.046321 | orchestrator | Friday 03 April 2026 08:17:04 +0000 (0:00:01.201) 0:30:17.566 ********** 2026-04-03 08:17:06.046361 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:06.046372 | orchestrator | 2026-04-03 08:17:06.046383 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:17:06.046394 | orchestrator | Friday 03 April 2026 08:17:05 +0000 (0:00:01.175) 0:30:18.742 ********** 2026-04-03 08:17:06.046405 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:06.046416 | orchestrator | 2026-04-03 08:17:06.046435 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:17:31.198377 | orchestrator | Friday 03 April 2026 08:17:07 +0000 (0:00:01.141) 0:30:19.884 ********** 2026-04-03 08:17:31.198510 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:17:31.198530 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:17:31.198544 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:17:31.198556 | orchestrator | 2026-04-03 08:17:31.198568 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:17:31.198612 | orchestrator | Friday 03 April 2026 08:17:08 +0000 (0:00:01.697) 0:30:21.582 ********** 2026-04-03 08:17:31.198624 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:31.198636 | orchestrator | 2026-04-03 08:17:31.198647 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:17:31.198658 | orchestrator | Friday 03 April 2026 08:17:09 +0000 (0:00:01.280) 0:30:22.862 ********** 2026-04-03 08:17:31.198669 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:17:31.198679 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:17:31.198690 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:17:31.198701 | orchestrator | 2026-04-03 08:17:31.198712 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:17:31.198722 | orchestrator | Friday 03 April 2026 08:17:13 +0000 (0:00:03.212) 0:30:26.074 ********** 2026-04-03 08:17:31.198734 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:17:31.198745 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:17:31.198756 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:17:31.198767 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.198778 | orchestrator | 2026-04-03 08:17:31.198788 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:17:31.198799 | orchestrator | Friday 03 April 2026 08:17:14 +0000 (0:00:01.376) 0:30:27.450 ********** 2026-04-03 08:17:31.198812 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198826 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198837 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198848 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.198858 | orchestrator | 2026-04-03 08:17:31.198869 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:17:31.198880 | orchestrator | Friday 03 April 2026 08:17:16 +0000 (0:00:01.986) 0:30:29.437 ********** 2026-04-03 08:17:31.198893 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198922 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198935 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:31.198946 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.198966 | orchestrator | 2026-04-03 08:17:31.198977 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:17:31.198988 | orchestrator | Friday 03 April 2026 08:17:17 +0000 (0:00:01.211) 0:30:30.649 ********** 2026-04-03 08:17:31.199024 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:17:10.536995', 'end': '2026-04-03 08:17:10.583827', 'delta': '0:00:00.046832', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:17:31.199040 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:17:11.114567', 'end': '2026-04-03 08:17:11.180023', 'delta': '0:00:00.065456', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:17:31.199051 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:17:11.988607', 'end': '2026-04-03 08:17:12.048168', 'delta': '0:00:00.059561', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:17:31.199063 | orchestrator | 2026-04-03 08:17:31.199074 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:17:31.199085 | orchestrator | Friday 03 April 2026 08:17:19 +0000 (0:00:01.266) 0:30:31.916 ********** 2026-04-03 08:17:31.199095 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:31.199106 | orchestrator | 2026-04-03 08:17:31.199117 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:17:31.199128 | orchestrator | Friday 03 April 2026 08:17:20 +0000 (0:00:01.686) 0:30:33.602 ********** 2026-04-03 08:17:31.199139 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199149 | orchestrator | 2026-04-03 08:17:31.199160 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:17:31.199171 | orchestrator | Friday 03 April 2026 08:17:22 +0000 (0:00:01.266) 0:30:34.869 ********** 2026-04-03 08:17:31.199181 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:31.199192 | orchestrator | 2026-04-03 08:17:31.199203 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:17:31.199213 | orchestrator | Friday 03 April 2026 08:17:23 +0000 (0:00:01.178) 0:30:36.048 ********** 2026-04-03 08:17:31.199224 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:17:31.199235 | orchestrator | 2026-04-03 08:17:31.199245 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:17:31.199262 | orchestrator | Friday 03 April 2026 08:17:25 +0000 (0:00:02.052) 0:30:38.100 ********** 2026-04-03 08:17:31.199279 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:31.199290 | orchestrator | 2026-04-03 08:17:31.199301 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:17:31.199312 | orchestrator | Friday 03 April 2026 08:17:26 +0000 (0:00:01.160) 0:30:39.261 ********** 2026-04-03 08:17:31.199322 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199333 | orchestrator | 2026-04-03 08:17:31.199400 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:17:31.199412 | orchestrator | Friday 03 April 2026 08:17:27 +0000 (0:00:01.148) 0:30:40.410 ********** 2026-04-03 08:17:31.199422 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199433 | orchestrator | 2026-04-03 08:17:31.199444 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:17:31.199455 | orchestrator | Friday 03 April 2026 08:17:28 +0000 (0:00:01.230) 0:30:41.640 ********** 2026-04-03 08:17:31.199465 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199476 | orchestrator | 2026-04-03 08:17:31.199487 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:17:31.199498 | orchestrator | Friday 03 April 2026 08:17:29 +0000 (0:00:01.117) 0:30:42.758 ********** 2026-04-03 08:17:31.199508 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199519 | orchestrator | 2026-04-03 08:17:31.199529 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:17:31.199540 | orchestrator | Friday 03 April 2026 08:17:31 +0000 (0:00:01.138) 0:30:43.897 ********** 2026-04-03 08:17:31.199551 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:31.199562 | orchestrator | 2026-04-03 08:17:31.199581 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:17:38.238906 | orchestrator | Friday 03 April 2026 08:17:32 +0000 (0:00:01.205) 0:30:45.102 ********** 2026-04-03 08:17:38.239015 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:38.239032 | orchestrator | 2026-04-03 08:17:38.239046 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:17:38.239058 | orchestrator | Friday 03 April 2026 08:17:33 +0000 (0:00:01.137) 0:30:46.239 ********** 2026-04-03 08:17:38.239069 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:38.239080 | orchestrator | 2026-04-03 08:17:38.239092 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:17:38.239103 | orchestrator | Friday 03 April 2026 08:17:34 +0000 (0:00:01.138) 0:30:47.378 ********** 2026-04-03 08:17:38.239114 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:38.239125 | orchestrator | 2026-04-03 08:17:38.239136 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:17:38.239148 | orchestrator | Friday 03 April 2026 08:17:35 +0000 (0:00:01.147) 0:30:48.526 ********** 2026-04-03 08:17:38.239159 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:38.239170 | orchestrator | 2026-04-03 08:17:38.239181 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:17:38.239192 | orchestrator | Friday 03 April 2026 08:17:36 +0000 (0:00:01.157) 0:30:49.684 ********** 2026-04-03 08:17:38.239205 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239220 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239254 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239268 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:17:38.239296 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239319 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239382 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:17:38.239407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:17:38.239431 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:38.239445 | orchestrator | 2026-04-03 08:17:38.239463 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:17:38.239476 | orchestrator | Friday 03 April 2026 08:17:38 +0000 (0:00:01.302) 0:30:50.986 ********** 2026-04-03 08:17:38.239490 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:38.239514 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134615 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134737 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-23-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134777 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134791 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134818 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134856 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '76b66bca', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1', 'scsi-SQEMU_QEMU_HARDDISK_76b66bca-b893-4285-9198-09d406beb848-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134879 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134896 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:17:47.134909 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:47.134922 | orchestrator | 2026-04-03 08:17:47.134935 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:17:47.134947 | orchestrator | Friday 03 April 2026 08:17:39 +0000 (0:00:01.248) 0:30:52.235 ********** 2026-04-03 08:17:47.134958 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:47.134972 | orchestrator | 2026-04-03 08:17:47.134986 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:17:47.134999 | orchestrator | Friday 03 April 2026 08:17:40 +0000 (0:00:01.500) 0:30:53.736 ********** 2026-04-03 08:17:47.135012 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:47.135024 | orchestrator | 2026-04-03 08:17:47.135037 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:17:47.135050 | orchestrator | Friday 03 April 2026 08:17:42 +0000 (0:00:01.153) 0:30:54.890 ********** 2026-04-03 08:17:47.135062 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:17:47.135075 | orchestrator | 2026-04-03 08:17:47.135089 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:17:47.135102 | orchestrator | Friday 03 April 2026 08:17:43 +0000 (0:00:01.489) 0:30:56.380 ********** 2026-04-03 08:17:47.135114 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:47.135127 | orchestrator | 2026-04-03 08:17:47.135140 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:17:47.135153 | orchestrator | Friday 03 April 2026 08:17:44 +0000 (0:00:01.176) 0:30:57.556 ********** 2026-04-03 08:17:47.135165 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:47.135178 | orchestrator | 2026-04-03 08:17:47.135191 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:17:47.135204 | orchestrator | Friday 03 April 2026 08:17:45 +0000 (0:00:01.253) 0:30:58.810 ********** 2026-04-03 08:17:47.135217 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:17:47.135230 | orchestrator | 2026-04-03 08:17:47.135242 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:17:47.135262 | orchestrator | Friday 03 April 2026 08:17:47 +0000 (0:00:01.181) 0:30:59.992 ********** 2026-04-03 08:18:24.529619 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-03 08:18:24.529755 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-03 08:18:24.529781 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:18:24.529800 | orchestrator | 2026-04-03 08:18:24.529820 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:18:24.529832 | orchestrator | Friday 03 April 2026 08:17:49 +0000 (0:00:02.053) 0:31:02.046 ********** 2026-04-03 08:18:24.529842 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-03 08:18:24.529853 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-03 08:18:24.529863 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-03 08:18:24.529872 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.529882 | orchestrator | 2026-04-03 08:18:24.529892 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:18:24.529902 | orchestrator | Friday 03 April 2026 08:17:50 +0000 (0:00:01.174) 0:31:03.221 ********** 2026-04-03 08:18:24.529912 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.529921 | orchestrator | 2026-04-03 08:18:24.529931 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:18:24.529941 | orchestrator | Friday 03 April 2026 08:17:51 +0000 (0:00:01.126) 0:31:04.347 ********** 2026-04-03 08:18:24.529950 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:18:24.529961 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:18:24.529971 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:18:24.529981 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:18:24.529991 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:18:24.530001 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:18:24.530010 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:18:24.530080 | orchestrator | 2026-04-03 08:18:24.530091 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:18:24.530100 | orchestrator | Friday 03 April 2026 08:17:53 +0000 (0:00:02.144) 0:31:06.492 ********** 2026-04-03 08:18:24.530110 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:18:24.530120 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:18:24.530130 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:18:24.530139 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:18:24.530150 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:18:24.530162 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:18:24.530172 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:18:24.530183 | orchestrator | 2026-04-03 08:18:24.530194 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:18:24.530206 | orchestrator | Friday 03 April 2026 08:17:56 +0000 (0:00:02.655) 0:31:09.147 ********** 2026-04-03 08:18:24.530217 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-03 08:18:24.530229 | orchestrator | 2026-04-03 08:18:24.530240 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:18:24.530267 | orchestrator | Friday 03 April 2026 08:17:57 +0000 (0:00:01.140) 0:31:10.288 ********** 2026-04-03 08:18:24.530279 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-03 08:18:24.530290 | orchestrator | 2026-04-03 08:18:24.530326 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:18:24.530338 | orchestrator | Friday 03 April 2026 08:17:58 +0000 (0:00:01.120) 0:31:11.408 ********** 2026-04-03 08:18:24.530349 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.530360 | orchestrator | 2026-04-03 08:18:24.530397 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:18:24.530409 | orchestrator | Friday 03 April 2026 08:18:00 +0000 (0:00:01.516) 0:31:12.925 ********** 2026-04-03 08:18:24.530420 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530432 | orchestrator | 2026-04-03 08:18:24.530445 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:18:24.530456 | orchestrator | Friday 03 April 2026 08:18:01 +0000 (0:00:01.146) 0:31:14.071 ********** 2026-04-03 08:18:24.530467 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530478 | orchestrator | 2026-04-03 08:18:24.530491 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:18:24.530502 | orchestrator | Friday 03 April 2026 08:18:02 +0000 (0:00:01.194) 0:31:15.266 ********** 2026-04-03 08:18:24.530513 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530523 | orchestrator | 2026-04-03 08:18:24.530533 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:18:24.530542 | orchestrator | Friday 03 April 2026 08:18:03 +0000 (0:00:01.138) 0:31:16.404 ********** 2026-04-03 08:18:24.530552 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.530561 | orchestrator | 2026-04-03 08:18:24.530571 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:18:24.530581 | orchestrator | Friday 03 April 2026 08:18:05 +0000 (0:00:01.616) 0:31:18.021 ********** 2026-04-03 08:18:24.530591 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530600 | orchestrator | 2026-04-03 08:18:24.530610 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:18:24.530638 | orchestrator | Friday 03 April 2026 08:18:06 +0000 (0:00:01.163) 0:31:19.184 ********** 2026-04-03 08:18:24.530648 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530658 | orchestrator | 2026-04-03 08:18:24.530667 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:18:24.530677 | orchestrator | Friday 03 April 2026 08:18:07 +0000 (0:00:01.147) 0:31:20.332 ********** 2026-04-03 08:18:24.530686 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.530696 | orchestrator | 2026-04-03 08:18:24.530706 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:18:24.530715 | orchestrator | Friday 03 April 2026 08:18:09 +0000 (0:00:01.609) 0:31:21.942 ********** 2026-04-03 08:18:24.530725 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.530734 | orchestrator | 2026-04-03 08:18:24.530744 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:18:24.530754 | orchestrator | Friday 03 April 2026 08:18:10 +0000 (0:00:01.595) 0:31:23.538 ********** 2026-04-03 08:18:24.530763 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530777 | orchestrator | 2026-04-03 08:18:24.530793 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:18:24.530805 | orchestrator | Friday 03 April 2026 08:18:11 +0000 (0:00:00.790) 0:31:24.329 ********** 2026-04-03 08:18:24.530815 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.530824 | orchestrator | 2026-04-03 08:18:24.530834 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:18:24.530843 | orchestrator | Friday 03 April 2026 08:18:12 +0000 (0:00:00.787) 0:31:25.116 ********** 2026-04-03 08:18:24.530854 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530871 | orchestrator | 2026-04-03 08:18:24.530886 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:18:24.530902 | orchestrator | Friday 03 April 2026 08:18:13 +0000 (0:00:00.750) 0:31:25.866 ********** 2026-04-03 08:18:24.530917 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.530933 | orchestrator | 2026-04-03 08:18:24.530962 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:18:24.530979 | orchestrator | Friday 03 April 2026 08:18:13 +0000 (0:00:00.778) 0:31:26.645 ********** 2026-04-03 08:18:24.530995 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531012 | orchestrator | 2026-04-03 08:18:24.531029 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:18:24.531045 | orchestrator | Friday 03 April 2026 08:18:14 +0000 (0:00:00.875) 0:31:27.521 ********** 2026-04-03 08:18:24.531061 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531072 | orchestrator | 2026-04-03 08:18:24.531081 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:18:24.531091 | orchestrator | Friday 03 April 2026 08:18:15 +0000 (0:00:00.894) 0:31:28.415 ********** 2026-04-03 08:18:24.531101 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531110 | orchestrator | 2026-04-03 08:18:24.531120 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:18:24.531130 | orchestrator | Friday 03 April 2026 08:18:16 +0000 (0:00:00.804) 0:31:29.220 ********** 2026-04-03 08:18:24.531139 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.531149 | orchestrator | 2026-04-03 08:18:24.531158 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:18:24.531168 | orchestrator | Friday 03 April 2026 08:18:17 +0000 (0:00:00.797) 0:31:30.018 ********** 2026-04-03 08:18:24.531177 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.531187 | orchestrator | 2026-04-03 08:18:24.531197 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:18:24.531206 | orchestrator | Friday 03 April 2026 08:18:17 +0000 (0:00:00.816) 0:31:30.835 ********** 2026-04-03 08:18:24.531216 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:18:24.531225 | orchestrator | 2026-04-03 08:18:24.531235 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:18:24.531244 | orchestrator | Friday 03 April 2026 08:18:18 +0000 (0:00:00.837) 0:31:31.673 ********** 2026-04-03 08:18:24.531262 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531272 | orchestrator | 2026-04-03 08:18:24.531282 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:18:24.531291 | orchestrator | Friday 03 April 2026 08:18:19 +0000 (0:00:00.816) 0:31:32.489 ********** 2026-04-03 08:18:24.531301 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531310 | orchestrator | 2026-04-03 08:18:24.531320 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:18:24.531329 | orchestrator | Friday 03 April 2026 08:18:20 +0000 (0:00:00.835) 0:31:33.325 ********** 2026-04-03 08:18:24.531339 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531348 | orchestrator | 2026-04-03 08:18:24.531358 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:18:24.531390 | orchestrator | Friday 03 April 2026 08:18:21 +0000 (0:00:00.768) 0:31:34.094 ********** 2026-04-03 08:18:24.531400 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531410 | orchestrator | 2026-04-03 08:18:24.531419 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:18:24.531429 | orchestrator | Friday 03 April 2026 08:18:22 +0000 (0:00:00.831) 0:31:34.926 ********** 2026-04-03 08:18:24.531439 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531448 | orchestrator | 2026-04-03 08:18:24.531458 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:18:24.531468 | orchestrator | Friday 03 April 2026 08:18:22 +0000 (0:00:00.828) 0:31:35.754 ********** 2026-04-03 08:18:24.531477 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531487 | orchestrator | 2026-04-03 08:18:24.531496 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:18:24.531506 | orchestrator | Friday 03 April 2026 08:18:23 +0000 (0:00:00.795) 0:31:36.550 ********** 2026-04-03 08:18:24.531515 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:18:24.531525 | orchestrator | 2026-04-03 08:18:24.531543 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:18:24.531553 | orchestrator | Friday 03 April 2026 08:18:24 +0000 (0:00:00.784) 0:31:37.335 ********** 2026-04-03 08:18:24.531572 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.408566 | orchestrator | 2026-04-03 08:19:09.408685 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:19:09.408702 | orchestrator | Friday 03 April 2026 08:18:25 +0000 (0:00:00.792) 0:31:38.128 ********** 2026-04-03 08:19:09.408714 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.408727 | orchestrator | 2026-04-03 08:19:09.408739 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:19:09.408749 | orchestrator | Friday 03 April 2026 08:18:26 +0000 (0:00:00.780) 0:31:38.908 ********** 2026-04-03 08:19:09.408760 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.408771 | orchestrator | 2026-04-03 08:19:09.408782 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:19:09.408793 | orchestrator | Friday 03 April 2026 08:18:26 +0000 (0:00:00.820) 0:31:39.729 ********** 2026-04-03 08:19:09.408804 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.408814 | orchestrator | 2026-04-03 08:19:09.408825 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:19:09.408836 | orchestrator | Friday 03 April 2026 08:18:27 +0000 (0:00:00.780) 0:31:40.510 ********** 2026-04-03 08:19:09.408846 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.408857 | orchestrator | 2026-04-03 08:19:09.408868 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:19:09.408879 | orchestrator | Friday 03 April 2026 08:18:28 +0000 (0:00:00.741) 0:31:41.252 ********** 2026-04-03 08:19:09.408889 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.408901 | orchestrator | 2026-04-03 08:19:09.408912 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:19:09.408923 | orchestrator | Friday 03 April 2026 08:18:29 +0000 (0:00:01.557) 0:31:42.810 ********** 2026-04-03 08:19:09.408934 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.408944 | orchestrator | 2026-04-03 08:19:09.408955 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:19:09.408966 | orchestrator | Friday 03 April 2026 08:18:32 +0000 (0:00:02.083) 0:31:44.894 ********** 2026-04-03 08:19:09.408977 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-03 08:19:09.408989 | orchestrator | 2026-04-03 08:19:09.409000 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:19:09.409011 | orchestrator | Friday 03 April 2026 08:18:33 +0000 (0:00:01.133) 0:31:46.027 ********** 2026-04-03 08:19:09.409022 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409033 | orchestrator | 2026-04-03 08:19:09.409043 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:19:09.409054 | orchestrator | Friday 03 April 2026 08:18:34 +0000 (0:00:01.148) 0:31:47.175 ********** 2026-04-03 08:19:09.409065 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409076 | orchestrator | 2026-04-03 08:19:09.409087 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:19:09.409100 | orchestrator | Friday 03 April 2026 08:18:35 +0000 (0:00:01.177) 0:31:48.353 ********** 2026-04-03 08:19:09.409112 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:19:09.409125 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:19:09.409139 | orchestrator | 2026-04-03 08:19:09.409153 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:19:09.409166 | orchestrator | Friday 03 April 2026 08:18:37 +0000 (0:00:01.888) 0:31:50.242 ********** 2026-04-03 08:19:09.409179 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.409192 | orchestrator | 2026-04-03 08:19:09.409204 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:19:09.409240 | orchestrator | Friday 03 April 2026 08:18:38 +0000 (0:00:01.490) 0:31:51.732 ********** 2026-04-03 08:19:09.409251 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409262 | orchestrator | 2026-04-03 08:19:09.409288 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:19:09.409299 | orchestrator | Friday 03 April 2026 08:18:40 +0000 (0:00:01.144) 0:31:52.876 ********** 2026-04-03 08:19:09.409310 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409321 | orchestrator | 2026-04-03 08:19:09.409331 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:19:09.409342 | orchestrator | Friday 03 April 2026 08:18:40 +0000 (0:00:00.760) 0:31:53.637 ********** 2026-04-03 08:19:09.409353 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409364 | orchestrator | 2026-04-03 08:19:09.409375 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:19:09.409417 | orchestrator | Friday 03 April 2026 08:18:41 +0000 (0:00:00.772) 0:31:54.409 ********** 2026-04-03 08:19:09.409429 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-03 08:19:09.409439 | orchestrator | 2026-04-03 08:19:09.409450 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:19:09.409461 | orchestrator | Friday 03 April 2026 08:18:42 +0000 (0:00:01.107) 0:31:55.517 ********** 2026-04-03 08:19:09.409472 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.409483 | orchestrator | 2026-04-03 08:19:09.409494 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:19:09.409504 | orchestrator | Friday 03 April 2026 08:18:44 +0000 (0:00:01.882) 0:31:57.400 ********** 2026-04-03 08:19:09.409515 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:19:09.409527 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:19:09.409537 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:19:09.409548 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409559 | orchestrator | 2026-04-03 08:19:09.409570 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:19:09.409580 | orchestrator | Friday 03 April 2026 08:18:45 +0000 (0:00:01.283) 0:31:58.683 ********** 2026-04-03 08:19:09.409609 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409621 | orchestrator | 2026-04-03 08:19:09.409647 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:19:09.409669 | orchestrator | Friday 03 April 2026 08:18:46 +0000 (0:00:01.103) 0:31:59.787 ********** 2026-04-03 08:19:09.409680 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409690 | orchestrator | 2026-04-03 08:19:09.409701 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:19:09.409712 | orchestrator | Friday 03 April 2026 08:18:48 +0000 (0:00:01.202) 0:32:00.989 ********** 2026-04-03 08:19:09.409722 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409733 | orchestrator | 2026-04-03 08:19:09.409744 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:19:09.409770 | orchestrator | Friday 03 April 2026 08:18:49 +0000 (0:00:01.130) 0:32:02.120 ********** 2026-04-03 08:19:09.409782 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409792 | orchestrator | 2026-04-03 08:19:09.409803 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:19:09.409814 | orchestrator | Friday 03 April 2026 08:18:50 +0000 (0:00:01.240) 0:32:03.361 ********** 2026-04-03 08:19:09.409824 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.409835 | orchestrator | 2026-04-03 08:19:09.409846 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:19:09.409857 | orchestrator | Friday 03 April 2026 08:18:51 +0000 (0:00:00.809) 0:32:04.170 ********** 2026-04-03 08:19:09.409867 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.409887 | orchestrator | 2026-04-03 08:19:09.409898 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:19:09.409909 | orchestrator | Friday 03 April 2026 08:18:53 +0000 (0:00:02.272) 0:32:06.443 ********** 2026-04-03 08:19:09.409920 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.409930 | orchestrator | 2026-04-03 08:19:09.409941 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:19:09.409952 | orchestrator | Friday 03 April 2026 08:18:54 +0000 (0:00:00.807) 0:32:07.251 ********** 2026-04-03 08:19:09.409963 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-03 08:19:09.409973 | orchestrator | 2026-04-03 08:19:09.409984 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:19:09.409995 | orchestrator | Friday 03 April 2026 08:18:55 +0000 (0:00:01.133) 0:32:08.384 ********** 2026-04-03 08:19:09.410005 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410077 | orchestrator | 2026-04-03 08:19:09.410089 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:19:09.410100 | orchestrator | Friday 03 April 2026 08:18:56 +0000 (0:00:01.112) 0:32:09.497 ********** 2026-04-03 08:19:09.410111 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410122 | orchestrator | 2026-04-03 08:19:09.410132 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:19:09.410143 | orchestrator | Friday 03 April 2026 08:18:57 +0000 (0:00:01.168) 0:32:10.665 ********** 2026-04-03 08:19:09.410154 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410164 | orchestrator | 2026-04-03 08:19:09.410175 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:19:09.410186 | orchestrator | Friday 03 April 2026 08:18:58 +0000 (0:00:01.173) 0:32:11.838 ********** 2026-04-03 08:19:09.410197 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410208 | orchestrator | 2026-04-03 08:19:09.410219 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:19:09.410229 | orchestrator | Friday 03 April 2026 08:19:00 +0000 (0:00:01.192) 0:32:13.030 ********** 2026-04-03 08:19:09.410240 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410251 | orchestrator | 2026-04-03 08:19:09.410262 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:19:09.410273 | orchestrator | Friday 03 April 2026 08:19:01 +0000 (0:00:01.183) 0:32:14.214 ********** 2026-04-03 08:19:09.410290 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410301 | orchestrator | 2026-04-03 08:19:09.410312 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:19:09.410322 | orchestrator | Friday 03 April 2026 08:19:02 +0000 (0:00:01.174) 0:32:15.389 ********** 2026-04-03 08:19:09.410333 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410344 | orchestrator | 2026-04-03 08:19:09.410355 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:19:09.410366 | orchestrator | Friday 03 April 2026 08:19:03 +0000 (0:00:01.168) 0:32:16.558 ********** 2026-04-03 08:19:09.410377 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:09.410407 | orchestrator | 2026-04-03 08:19:09.410418 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:19:09.410429 | orchestrator | Friday 03 April 2026 08:19:04 +0000 (0:00:01.190) 0:32:17.748 ********** 2026-04-03 08:19:09.410439 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:09.410450 | orchestrator | 2026-04-03 08:19:09.410461 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:19:09.410471 | orchestrator | Friday 03 April 2026 08:19:05 +0000 (0:00:00.843) 0:32:18.592 ********** 2026-04-03 08:19:09.410482 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-03 08:19:09.410493 | orchestrator | 2026-04-03 08:19:09.410504 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:19:09.410514 | orchestrator | Friday 03 April 2026 08:19:06 +0000 (0:00:01.193) 0:32:19.786 ********** 2026-04-03 08:19:09.410533 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-03 08:19:09.410544 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-03 08:19:09.410555 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-03 08:19:09.410566 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-03 08:19:09.410576 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-03 08:19:09.410587 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-03 08:19:09.410606 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-03 08:19:48.683483 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:19:48.683601 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:19:48.683618 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:19:48.683630 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:19:48.683641 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:19:48.683652 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:19:48.683663 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:19:48.683674 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-03 08:19:48.683685 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-03 08:19:48.683696 | orchestrator | 2026-04-03 08:19:48.683708 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:19:48.683719 | orchestrator | Friday 03 April 2026 08:19:13 +0000 (0:00:06.275) 0:32:26.061 ********** 2026-04-03 08:19:48.683730 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683742 | orchestrator | 2026-04-03 08:19:48.683754 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:19:48.683765 | orchestrator | Friday 03 April 2026 08:19:14 +0000 (0:00:00.803) 0:32:26.865 ********** 2026-04-03 08:19:48.683776 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683786 | orchestrator | 2026-04-03 08:19:48.683797 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:19:48.683808 | orchestrator | Friday 03 April 2026 08:19:14 +0000 (0:00:00.775) 0:32:27.640 ********** 2026-04-03 08:19:48.683819 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683830 | orchestrator | 2026-04-03 08:19:48.683840 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:19:48.683851 | orchestrator | Friday 03 April 2026 08:19:15 +0000 (0:00:00.784) 0:32:28.425 ********** 2026-04-03 08:19:48.683862 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683873 | orchestrator | 2026-04-03 08:19:48.683884 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:19:48.683894 | orchestrator | Friday 03 April 2026 08:19:16 +0000 (0:00:00.835) 0:32:29.261 ********** 2026-04-03 08:19:48.683905 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683916 | orchestrator | 2026-04-03 08:19:48.683927 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:19:48.683938 | orchestrator | Friday 03 April 2026 08:19:17 +0000 (0:00:00.775) 0:32:30.036 ********** 2026-04-03 08:19:48.683949 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.683963 | orchestrator | 2026-04-03 08:19:48.683976 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:19:48.683990 | orchestrator | Friday 03 April 2026 08:19:17 +0000 (0:00:00.784) 0:32:30.820 ********** 2026-04-03 08:19:48.684003 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684017 | orchestrator | 2026-04-03 08:19:48.684030 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:19:48.684043 | orchestrator | Friday 03 April 2026 08:19:18 +0000 (0:00:00.810) 0:32:31.631 ********** 2026-04-03 08:19:48.684079 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684092 | orchestrator | 2026-04-03 08:19:48.684105 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:19:48.684117 | orchestrator | Friday 03 April 2026 08:19:19 +0000 (0:00:00.777) 0:32:32.409 ********** 2026-04-03 08:19:48.684130 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684142 | orchestrator | 2026-04-03 08:19:48.684154 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:19:48.684182 | orchestrator | Friday 03 April 2026 08:19:20 +0000 (0:00:00.820) 0:32:33.230 ********** 2026-04-03 08:19:48.684196 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684209 | orchestrator | 2026-04-03 08:19:48.684222 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:19:48.684235 | orchestrator | Friday 03 April 2026 08:19:21 +0000 (0:00:00.782) 0:32:34.012 ********** 2026-04-03 08:19:48.684248 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684261 | orchestrator | 2026-04-03 08:19:48.684274 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:19:48.684287 | orchestrator | Friday 03 April 2026 08:19:21 +0000 (0:00:00.795) 0:32:34.808 ********** 2026-04-03 08:19:48.684301 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684312 | orchestrator | 2026-04-03 08:19:48.684323 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:19:48.684334 | orchestrator | Friday 03 April 2026 08:19:22 +0000 (0:00:00.800) 0:32:35.609 ********** 2026-04-03 08:19:48.684344 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684355 | orchestrator | 2026-04-03 08:19:48.684366 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:19:48.684376 | orchestrator | Friday 03 April 2026 08:19:23 +0000 (0:00:00.916) 0:32:36.526 ********** 2026-04-03 08:19:48.684387 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684419 | orchestrator | 2026-04-03 08:19:48.684430 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:19:48.684441 | orchestrator | Friday 03 April 2026 08:19:24 +0000 (0:00:00.788) 0:32:37.314 ********** 2026-04-03 08:19:48.684452 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684463 | orchestrator | 2026-04-03 08:19:48.684474 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:19:48.684484 | orchestrator | Friday 03 April 2026 08:19:25 +0000 (0:00:00.924) 0:32:38.238 ********** 2026-04-03 08:19:48.684495 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684506 | orchestrator | 2026-04-03 08:19:48.684516 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:19:48.684527 | orchestrator | Friday 03 April 2026 08:19:26 +0000 (0:00:00.793) 0:32:39.033 ********** 2026-04-03 08:19:48.684554 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684565 | orchestrator | 2026-04-03 08:19:48.684577 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:19:48.684589 | orchestrator | Friday 03 April 2026 08:19:26 +0000 (0:00:00.775) 0:32:39.808 ********** 2026-04-03 08:19:48.684599 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684610 | orchestrator | 2026-04-03 08:19:48.684621 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:19:48.684632 | orchestrator | Friday 03 April 2026 08:19:27 +0000 (0:00:00.841) 0:32:40.650 ********** 2026-04-03 08:19:48.684643 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684653 | orchestrator | 2026-04-03 08:19:48.684664 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:19:48.684675 | orchestrator | Friday 03 April 2026 08:19:28 +0000 (0:00:00.805) 0:32:41.456 ********** 2026-04-03 08:19:48.684686 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684696 | orchestrator | 2026-04-03 08:19:48.684707 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:19:48.684727 | orchestrator | Friday 03 April 2026 08:19:29 +0000 (0:00:00.788) 0:32:42.245 ********** 2026-04-03 08:19:48.684738 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684749 | orchestrator | 2026-04-03 08:19:48.684760 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:19:48.684771 | orchestrator | Friday 03 April 2026 08:19:30 +0000 (0:00:00.808) 0:32:43.054 ********** 2026-04-03 08:19:48.684782 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:19:48.684793 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:19:48.684803 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:19:48.684814 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684824 | orchestrator | 2026-04-03 08:19:48.684835 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:19:48.684846 | orchestrator | Friday 03 April 2026 08:19:31 +0000 (0:00:01.077) 0:32:44.131 ********** 2026-04-03 08:19:48.684857 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:19:48.684867 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:19:48.684878 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:19:48.684889 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684900 | orchestrator | 2026-04-03 08:19:48.684911 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:19:48.684921 | orchestrator | Friday 03 April 2026 08:19:32 +0000 (0:00:01.089) 0:32:45.221 ********** 2026-04-03 08:19:48.684932 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-03 08:19:48.684943 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-03 08:19:48.684953 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-03 08:19:48.684964 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.684975 | orchestrator | 2026-04-03 08:19:48.684985 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:19:48.684996 | orchestrator | Friday 03 April 2026 08:19:33 +0000 (0:00:01.045) 0:32:46.267 ********** 2026-04-03 08:19:48.685007 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.685018 | orchestrator | 2026-04-03 08:19:48.685028 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:19:48.685039 | orchestrator | Friday 03 April 2026 08:19:34 +0000 (0:00:00.787) 0:32:47.055 ********** 2026-04-03 08:19:48.685050 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-03 08:19:48.685061 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.685072 | orchestrator | 2026-04-03 08:19:48.685082 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:19:48.685098 | orchestrator | Friday 03 April 2026 08:19:35 +0000 (0:00:00.917) 0:32:47.973 ********** 2026-04-03 08:19:48.685110 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:48.685121 | orchestrator | 2026-04-03 08:19:48.685131 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:19:48.685142 | orchestrator | Friday 03 April 2026 08:19:36 +0000 (0:00:01.421) 0:32:49.394 ********** 2026-04-03 08:19:48.685153 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:19:48.685165 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:19:48.685175 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-03 08:19:48.685186 | orchestrator | 2026-04-03 08:19:48.685197 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-03 08:19:48.685208 | orchestrator | Friday 03 April 2026 08:19:38 +0000 (0:00:01.730) 0:32:51.124 ********** 2026-04-03 08:19:48.685219 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-2 2026-04-03 08:19:48.685230 | orchestrator | 2026-04-03 08:19:48.685251 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-03 08:19:48.685263 | orchestrator | Friday 03 April 2026 08:19:39 +0000 (0:00:01.300) 0:32:52.425 ********** 2026-04-03 08:19:48.685280 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:19:48.685291 | orchestrator | 2026-04-03 08:19:48.685302 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-03 08:19:48.685313 | orchestrator | Friday 03 April 2026 08:19:41 +0000 (0:00:01.521) 0:32:53.946 ********** 2026-04-03 08:19:48.685324 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:19:48.685334 | orchestrator | 2026-04-03 08:19:48.685345 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-03 08:19:48.685356 | orchestrator | Friday 03 April 2026 08:19:42 +0000 (0:00:01.139) 0:32:55.086 ********** 2026-04-03 08:19:48.685366 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:19:48.685377 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:19:48.685409 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:20:36.291845 | orchestrator | ok: [testbed-node-2 -> {{ groups[mon_group_name][0] }}] 2026-04-03 08:20:36.291940 | orchestrator | 2026-04-03 08:20:36.291957 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-03 08:20:36.291969 | orchestrator | Friday 03 April 2026 08:19:49 +0000 (0:00:07.595) 0:33:02.682 ********** 2026-04-03 08:20:36.291980 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.291992 | orchestrator | 2026-04-03 08:20:36.292003 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-03 08:20:36.292014 | orchestrator | Friday 03 April 2026 08:19:51 +0000 (0:00:01.212) 0:33:03.894 ********** 2026-04-03 08:20:36.292025 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 08:20:36.292036 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-03 08:20:36.292047 | orchestrator | 2026-04-03 08:20:36.292058 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:20:36.292068 | orchestrator | Friday 03 April 2026 08:19:54 +0000 (0:00:03.293) 0:33:07.188 ********** 2026-04-03 08:20:36.292079 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 08:20:36.292090 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-03 08:20:36.292101 | orchestrator | 2026-04-03 08:20:36.292112 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-03 08:20:36.292123 | orchestrator | Friday 03 April 2026 08:19:56 +0000 (0:00:02.055) 0:33:09.244 ********** 2026-04-03 08:20:36.292134 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292144 | orchestrator | 2026-04-03 08:20:36.292155 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-03 08:20:36.292166 | orchestrator | Friday 03 April 2026 08:19:57 +0000 (0:00:01.533) 0:33:10.777 ********** 2026-04-03 08:20:36.292177 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.292187 | orchestrator | 2026-04-03 08:20:36.292198 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-03 08:20:36.292209 | orchestrator | Friday 03 April 2026 08:19:58 +0000 (0:00:00.793) 0:33:11.571 ********** 2026-04-03 08:20:36.292220 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.292230 | orchestrator | 2026-04-03 08:20:36.292241 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-03 08:20:36.292252 | orchestrator | Friday 03 April 2026 08:19:59 +0000 (0:00:00.800) 0:33:12.372 ********** 2026-04-03 08:20:36.292263 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-2 2026-04-03 08:20:36.292274 | orchestrator | 2026-04-03 08:20:36.292284 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-03 08:20:36.292295 | orchestrator | Friday 03 April 2026 08:20:00 +0000 (0:00:01.130) 0:33:13.503 ********** 2026-04-03 08:20:36.292306 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.292316 | orchestrator | 2026-04-03 08:20:36.292327 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-03 08:20:36.292338 | orchestrator | Friday 03 April 2026 08:20:01 +0000 (0:00:01.181) 0:33:14.684 ********** 2026-04-03 08:20:36.292369 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.292380 | orchestrator | 2026-04-03 08:20:36.292391 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-03 08:20:36.292403 | orchestrator | Friday 03 April 2026 08:20:02 +0000 (0:00:01.157) 0:33:15.841 ********** 2026-04-03 08:20:36.292441 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-2 2026-04-03 08:20:36.292455 | orchestrator | 2026-04-03 08:20:36.292469 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-03 08:20:36.292481 | orchestrator | Friday 03 April 2026 08:20:04 +0000 (0:00:01.142) 0:33:16.984 ********** 2026-04-03 08:20:36.292494 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292507 | orchestrator | 2026-04-03 08:20:36.292519 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-03 08:20:36.292544 | orchestrator | Friday 03 April 2026 08:20:06 +0000 (0:00:02.075) 0:33:19.059 ********** 2026-04-03 08:20:36.292557 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292568 | orchestrator | 2026-04-03 08:20:36.292579 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-03 08:20:36.292589 | orchestrator | Friday 03 April 2026 08:20:08 +0000 (0:00:01.995) 0:33:21.055 ********** 2026-04-03 08:20:36.292600 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292610 | orchestrator | 2026-04-03 08:20:36.292621 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-03 08:20:36.292632 | orchestrator | Friday 03 April 2026 08:20:10 +0000 (0:00:02.342) 0:33:23.398 ********** 2026-04-03 08:20:36.292643 | orchestrator | changed: [testbed-node-2] 2026-04-03 08:20:36.292653 | orchestrator | 2026-04-03 08:20:36.292664 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-03 08:20:36.292675 | orchestrator | Friday 03 April 2026 08:20:13 +0000 (0:00:03.268) 0:33:26.666 ********** 2026-04-03 08:20:36.292685 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-03 08:20:36.292696 | orchestrator | 2026-04-03 08:20:36.292707 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-03 08:20:36.292717 | orchestrator | Friday 03 April 2026 08:20:15 +0000 (0:00:01.541) 0:33:28.208 ********** 2026-04-03 08:20:36.292728 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:20:36.292739 | orchestrator | 2026-04-03 08:20:36.292750 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-03 08:20:36.292761 | orchestrator | Friday 03 April 2026 08:20:17 +0000 (0:00:02.475) 0:33:30.684 ********** 2026-04-03 08:20:36.292771 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:20:36.292782 | orchestrator | 2026-04-03 08:20:36.292793 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-03 08:20:36.292803 | orchestrator | Friday 03 April 2026 08:20:20 +0000 (0:00:02.437) 0:33:33.121 ********** 2026-04-03 08:20:36.292814 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292825 | orchestrator | 2026-04-03 08:20:36.292836 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-03 08:20:36.292861 | orchestrator | Friday 03 April 2026 08:20:21 +0000 (0:00:01.330) 0:33:34.452 ********** 2026-04-03 08:20:36.292873 | orchestrator | ok: [testbed-node-2] 2026-04-03 08:20:36.292883 | orchestrator | 2026-04-03 08:20:36.292894 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-03 08:20:36.292905 | orchestrator | Friday 03 April 2026 08:20:23 +0000 (0:00:01.627) 0:33:36.080 ********** 2026-04-03 08:20:36.292916 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-03 08:20:36.292927 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-03 08:20:36.292938 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.292948 | orchestrator | 2026-04-03 08:20:36.292959 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-03 08:20:36.292970 | orchestrator | Friday 03 April 2026 08:20:24 +0000 (0:00:01.355) 0:33:37.436 ********** 2026-04-03 08:20:36.292989 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-03 08:20:36.293000 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-03 08:20:36.293011 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-03 08:20:36.293021 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-03 08:20:36.293032 | orchestrator | skipping: [testbed-node-2] 2026-04-03 08:20:36.293043 | orchestrator | 2026-04-03 08:20:36.293054 | orchestrator | PLAY [Set osd flags] *********************************************************** 2026-04-03 08:20:36.293065 | orchestrator | 2026-04-03 08:20:36.293075 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:20:36.293086 | orchestrator | Friday 03 April 2026 08:20:26 +0000 (0:00:01.935) 0:33:39.372 ********** 2026-04-03 08:20:36.293097 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:20:36.293108 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:20:36.293119 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:20:36.293130 | orchestrator | 2026-04-03 08:20:36.293141 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:20:36.293152 | orchestrator | Friday 03 April 2026 08:20:28 +0000 (0:00:01.686) 0:33:41.058 ********** 2026-04-03 08:20:36.293162 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:20:36.293173 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:20:36.293184 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:20:36.293195 | orchestrator | 2026-04-03 08:20:36.293206 | orchestrator | TASK [Get pool list] *********************************************************** 2026-04-03 08:20:36.293216 | orchestrator | Friday 03 April 2026 08:20:30 +0000 (0:00:01.836) 0:33:42.895 ********** 2026-04-03 08:20:36.293227 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:20:36.293238 | orchestrator | 2026-04-03 08:20:36.293249 | orchestrator | TASK [Get balancer module status] ********************************************** 2026-04-03 08:20:36.293260 | orchestrator | Friday 03 April 2026 08:20:33 +0000 (0:00:03.046) 0:33:45.942 ********** 2026-04-03 08:20:36.293270 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:20:36.293281 | orchestrator | 2026-04-03 08:20:36.293292 | orchestrator | TASK [Set_fact pools_pgautoscaler_mode] **************************************** 2026-04-03 08:20:36.293303 | orchestrator | Friday 03 April 2026 08:20:35 +0000 (0:00:02.860) 0:33:48.803 ********** 2026-04-03 08:20:36.293324 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 1, 'pool_name': '.mgr', 'create_time': '2026-04-03T05:42:45.680909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.293358 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 2, 'pool_name': 'cephfs_data', 'create_time': '2026-04-03T05:43:53.952311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.688701 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2026-04-03T05:43:57.756560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.688822 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 4, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2026-04-03T05:44:54.646504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '64', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.688848 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 5, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2026-04-03T05:45:00.423274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '64', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.688870 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 6, 'pool_name': 'default.rgw.control', 'create_time': '2026-04-03T05:45:06.482232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '66', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:36.688905 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 7, 'pool_name': 'default.rgw.log', 'create_time': '2026-04-03T05:45:11.797630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '182', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '66', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:37.304672 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2026-04-03T05:45:17.766176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '68', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:37.304792 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 9, 'pool_name': '.rgw.root', 'create_time': '2026-04-03T05:45:28.846935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '68', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:37.304872 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 10, 'pool_name': 'backups', 'create_time': '2026-04-03T05:46:14.335018+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:37.304906 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 11, 'pool_name': 'volumes', 'create_time': '2026-04-03T05:46:22.920710+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:20:37.304950 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 12, 'pool_name': 'images', 'create_time': '2026-04-03T05:46:31.408984+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 6, 'snap_epoch': 194, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:22:13.999238 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 13, 'pool_name': 'metrics', 'create_time': '2026-04-03T05:46:40.227122+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:22:13.999414 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 14, 'pool_name': 'vms', 'create_time': '2026-04-03T05:46:49.009480+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-03 08:22:13.999520 | orchestrator | 2026-04-03 08:22:13.999547 | orchestrator | TASK [Disable balancer] ******************************************************** 2026-04-03 08:22:13.999591 | orchestrator | Friday 03 April 2026 08:20:38 +0000 (0:00:02.696) 0:33:51.500 ********** 2026-04-03 08:22:13.999612 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:22:13.999630 | orchestrator | 2026-04-03 08:22:13.999648 | orchestrator | TASK [Disable pg autoscale on pools] ******************************************* 2026-04-03 08:22:13.999666 | orchestrator | Friday 03 April 2026 08:20:41 +0000 (0:00:02.803) 0:33:54.303 ********** 2026-04-03 08:22:13.999684 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-03 08:22:13.999704 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-03 08:22:13.999724 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-03 08:22:13.999755 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-03 08:22:13.999777 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-03 08:22:13.999796 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-03 08:22:13.999832 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-03 08:22:13.999852 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-03 08:22:13.999872 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-03 08:22:13.999891 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-03 08:22:13.999909 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-03 08:22:13.999930 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-03 08:22:13.999950 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-03 08:22:13.999970 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-03 08:22:13.999990 | orchestrator | 2026-04-03 08:22:14.000009 | orchestrator | TASK [Set osd flags] *********************************************************** 2026-04-03 08:22:14.000031 | orchestrator | Friday 03 April 2026 08:21:57 +0000 (0:01:16.426) 0:35:10.729 ********** 2026-04-03 08:22:14.000048 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-03 08:22:14.000062 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-03 08:22:14.000075 | orchestrator | 2026-04-03 08:22:14.000088 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-03 08:22:14.000099 | orchestrator | 2026-04-03 08:22:14.000117 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:22:14.000130 | orchestrator | Friday 03 April 2026 08:22:03 +0000 (0:00:05.980) 0:35:16.710 ********** 2026-04-03 08:22:14.000140 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-03 08:22:14.000151 | orchestrator | 2026-04-03 08:22:14.000162 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:22:14.000173 | orchestrator | Friday 03 April 2026 08:22:04 +0000 (0:00:01.133) 0:35:17.844 ********** 2026-04-03 08:22:14.000184 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000195 | orchestrator | 2026-04-03 08:22:14.000206 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:22:14.000216 | orchestrator | Friday 03 April 2026 08:22:06 +0000 (0:00:01.462) 0:35:19.306 ********** 2026-04-03 08:22:14.000227 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000238 | orchestrator | 2026-04-03 08:22:14.000249 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:22:14.000259 | orchestrator | Friday 03 April 2026 08:22:07 +0000 (0:00:01.168) 0:35:20.474 ********** 2026-04-03 08:22:14.000270 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000280 | orchestrator | 2026-04-03 08:22:14.000291 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:22:14.000302 | orchestrator | Friday 03 April 2026 08:22:09 +0000 (0:00:01.501) 0:35:21.976 ********** 2026-04-03 08:22:14.000313 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000323 | orchestrator | 2026-04-03 08:22:14.000334 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:22:14.000345 | orchestrator | Friday 03 April 2026 08:22:10 +0000 (0:00:01.173) 0:35:23.150 ********** 2026-04-03 08:22:14.000355 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000366 | orchestrator | 2026-04-03 08:22:14.000377 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:22:14.000388 | orchestrator | Friday 03 April 2026 08:22:11 +0000 (0:00:01.186) 0:35:24.336 ********** 2026-04-03 08:22:14.000398 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000409 | orchestrator | 2026-04-03 08:22:14.000420 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:22:14.000431 | orchestrator | Friday 03 April 2026 08:22:12 +0000 (0:00:01.193) 0:35:25.529 ********** 2026-04-03 08:22:14.000476 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:14.000487 | orchestrator | 2026-04-03 08:22:14.000498 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:22:14.000509 | orchestrator | Friday 03 April 2026 08:22:13 +0000 (0:00:01.183) 0:35:26.713 ********** 2026-04-03 08:22:14.000520 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:14.000530 | orchestrator | 2026-04-03 08:22:14.000552 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:22:40.198657 | orchestrator | Friday 03 April 2026 08:22:14 +0000 (0:00:01.144) 0:35:27.858 ********** 2026-04-03 08:22:40.198771 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:22:40.198820 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:22:40.198838 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:22:40.198856 | orchestrator | 2026-04-03 08:22:40.198876 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:22:40.198887 | orchestrator | Friday 03 April 2026 08:22:17 +0000 (0:00:02.089) 0:35:29.947 ********** 2026-04-03 08:22:40.198897 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:40.198908 | orchestrator | 2026-04-03 08:22:40.198918 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:22:40.198944 | orchestrator | Friday 03 April 2026 08:22:18 +0000 (0:00:01.257) 0:35:31.204 ********** 2026-04-03 08:22:40.198954 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:22:40.198964 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:22:40.198974 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:22:40.199048 | orchestrator | 2026-04-03 08:22:40.199060 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:22:40.199070 | orchestrator | Friday 03 April 2026 08:22:21 +0000 (0:00:03.350) 0:35:34.555 ********** 2026-04-03 08:22:40.199080 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 08:22:40.199090 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 08:22:40.199100 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 08:22:40.199109 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199119 | orchestrator | 2026-04-03 08:22:40.199129 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:22:40.199138 | orchestrator | Friday 03 April 2026 08:22:23 +0000 (0:00:01.833) 0:35:36.388 ********** 2026-04-03 08:22:40.199150 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199163 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199173 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199192 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199210 | orchestrator | 2026-04-03 08:22:40.199228 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:22:40.199249 | orchestrator | Friday 03 April 2026 08:22:25 +0000 (0:00:02.317) 0:35:38.706 ********** 2026-04-03 08:22:40.199272 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199311 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199324 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:40.199335 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199352 | orchestrator | 2026-04-03 08:22:40.199368 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:22:40.199385 | orchestrator | Friday 03 April 2026 08:22:27 +0000 (0:00:01.224) 0:35:39.931 ********** 2026-04-03 08:22:40.199429 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:22:18.891641', 'end': '2026-04-03 08:22:18.951597', 'delta': '0:00:00.059956', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:22:40.199480 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:22:19.898293', 'end': '2026-04-03 08:22:19.954677', 'delta': '0:00:00.056384', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:22:40.199501 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:22:20.482856', 'end': '2026-04-03 08:22:20.520875', 'delta': '0:00:00.038019', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:22:40.199516 | orchestrator | 2026-04-03 08:22:40.199532 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:22:40.199549 | orchestrator | Friday 03 April 2026 08:22:28 +0000 (0:00:01.206) 0:35:41.138 ********** 2026-04-03 08:22:40.199564 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:40.199588 | orchestrator | 2026-04-03 08:22:40.199603 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:22:40.199618 | orchestrator | Friday 03 April 2026 08:22:29 +0000 (0:00:01.267) 0:35:42.405 ********** 2026-04-03 08:22:40.199632 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199648 | orchestrator | 2026-04-03 08:22:40.199664 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:22:40.199678 | orchestrator | Friday 03 April 2026 08:22:30 +0000 (0:00:01.292) 0:35:43.698 ********** 2026-04-03 08:22:40.199691 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:40.199706 | orchestrator | 2026-04-03 08:22:40.199722 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:22:40.199738 | orchestrator | Friday 03 April 2026 08:22:32 +0000 (0:00:01.192) 0:35:44.891 ********** 2026-04-03 08:22:40.199754 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:22:40.199770 | orchestrator | 2026-04-03 08:22:40.199786 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:22:40.199801 | orchestrator | Friday 03 April 2026 08:22:34 +0000 (0:00:01.996) 0:35:46.888 ********** 2026-04-03 08:22:40.199817 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:40.199834 | orchestrator | 2026-04-03 08:22:40.199851 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:22:40.199867 | orchestrator | Friday 03 April 2026 08:22:35 +0000 (0:00:01.230) 0:35:48.118 ********** 2026-04-03 08:22:40.199881 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199891 | orchestrator | 2026-04-03 08:22:40.199901 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:22:40.199910 | orchestrator | Friday 03 April 2026 08:22:36 +0000 (0:00:01.269) 0:35:49.387 ********** 2026-04-03 08:22:40.199919 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199929 | orchestrator | 2026-04-03 08:22:40.199939 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:22:40.199948 | orchestrator | Friday 03 April 2026 08:22:37 +0000 (0:00:01.261) 0:35:50.649 ********** 2026-04-03 08:22:40.199958 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.199967 | orchestrator | 2026-04-03 08:22:40.199977 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:22:40.199986 | orchestrator | Friday 03 April 2026 08:22:38 +0000 (0:00:01.158) 0:35:51.808 ********** 2026-04-03 08:22:40.199996 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:40.200005 | orchestrator | 2026-04-03 08:22:40.200015 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:22:40.200025 | orchestrator | Friday 03 April 2026 08:22:40 +0000 (0:00:01.156) 0:35:52.964 ********** 2026-04-03 08:22:40.200045 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:46.228959 | orchestrator | 2026-04-03 08:22:46.229075 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:22:46.229091 | orchestrator | Friday 03 April 2026 08:22:41 +0000 (0:00:01.183) 0:35:54.148 ********** 2026-04-03 08:22:46.229103 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:46.229116 | orchestrator | 2026-04-03 08:22:46.229129 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:22:46.229150 | orchestrator | Friday 03 April 2026 08:22:42 +0000 (0:00:01.120) 0:35:55.268 ********** 2026-04-03 08:22:46.229171 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:46.229191 | orchestrator | 2026-04-03 08:22:46.229212 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:22:46.229234 | orchestrator | Friday 03 April 2026 08:22:43 +0000 (0:00:01.187) 0:35:56.456 ********** 2026-04-03 08:22:46.229253 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:46.229269 | orchestrator | 2026-04-03 08:22:46.229298 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:22:46.229310 | orchestrator | Friday 03 April 2026 08:22:44 +0000 (0:00:01.196) 0:35:57.652 ********** 2026-04-03 08:22:46.229342 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:22:46.229354 | orchestrator | 2026-04-03 08:22:46.229364 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:22:46.229375 | orchestrator | Friday 03 April 2026 08:22:46 +0000 (0:00:01.224) 0:35:58.876 ********** 2026-04-03 08:22:46.229389 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229406 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}})  2026-04-03 08:22:46.229420 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:22:46.229435 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}})  2026-04-03 08:22:46.229488 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229536 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229566 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:22:46.229598 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229619 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229637 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:46.229659 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}})  2026-04-03 08:22:46.229678 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}})  2026-04-03 08:22:46.229710 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:47.567018 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:22:47.567139 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:47.567158 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:22:47.567170 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:22:47.567184 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:22:47.567198 | orchestrator | 2026-04-03 08:22:47.567210 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:22:47.567222 | orchestrator | Friday 03 April 2026 08:22:47 +0000 (0:00:01.370) 0:36:00.246 ********** 2026-04-03 08:22:47.567252 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.567280 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.567292 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.567306 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.567319 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.567337 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685403 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685550 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685565 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685575 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685587 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685642 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685657 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685669 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685688 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:22:47.685710 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:23:27.587158 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:23:27.587279 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587297 | orchestrator | 2026-04-03 08:23:27.587311 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:23:27.587324 | orchestrator | Friday 03 April 2026 08:22:48 +0000 (0:00:01.437) 0:36:01.684 ********** 2026-04-03 08:23:27.587335 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.587347 | orchestrator | 2026-04-03 08:23:27.587358 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:23:27.587369 | orchestrator | Friday 03 April 2026 08:22:50 +0000 (0:00:01.550) 0:36:03.234 ********** 2026-04-03 08:23:27.587380 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.587391 | orchestrator | 2026-04-03 08:23:27.587402 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:23:27.587413 | orchestrator | Friday 03 April 2026 08:22:51 +0000 (0:00:01.133) 0:36:04.367 ********** 2026-04-03 08:23:27.587424 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.587434 | orchestrator | 2026-04-03 08:23:27.587445 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:23:27.587533 | orchestrator | Friday 03 April 2026 08:22:52 +0000 (0:00:01.490) 0:36:05.858 ********** 2026-04-03 08:23:27.587549 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587561 | orchestrator | 2026-04-03 08:23:27.587571 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:23:27.587582 | orchestrator | Friday 03 April 2026 08:22:54 +0000 (0:00:01.187) 0:36:07.046 ********** 2026-04-03 08:23:27.587593 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587604 | orchestrator | 2026-04-03 08:23:27.587615 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:23:27.587625 | orchestrator | Friday 03 April 2026 08:22:55 +0000 (0:00:01.341) 0:36:08.388 ********** 2026-04-03 08:23:27.587636 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587647 | orchestrator | 2026-04-03 08:23:27.587658 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:23:27.587695 | orchestrator | Friday 03 April 2026 08:22:56 +0000 (0:00:01.179) 0:36:09.567 ********** 2026-04-03 08:23:27.587706 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 08:23:27.587717 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 08:23:27.587728 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 08:23:27.587738 | orchestrator | 2026-04-03 08:23:27.587749 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:23:27.587760 | orchestrator | Friday 03 April 2026 08:22:58 +0000 (0:00:02.055) 0:36:11.623 ********** 2026-04-03 08:23:27.587771 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 08:23:27.587781 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 08:23:27.587792 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 08:23:27.587802 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587813 | orchestrator | 2026-04-03 08:23:27.587824 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:23:27.587834 | orchestrator | Friday 03 April 2026 08:22:59 +0000 (0:00:01.178) 0:36:12.802 ********** 2026-04-03 08:23:27.587845 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-03 08:23:27.587857 | orchestrator | 2026-04-03 08:23:27.587868 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:23:27.587880 | orchestrator | Friday 03 April 2026 08:23:01 +0000 (0:00:01.331) 0:36:14.134 ********** 2026-04-03 08:23:27.587891 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587901 | orchestrator | 2026-04-03 08:23:27.587912 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:23:27.587923 | orchestrator | Friday 03 April 2026 08:23:02 +0000 (0:00:01.196) 0:36:15.330 ********** 2026-04-03 08:23:27.587933 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587944 | orchestrator | 2026-04-03 08:23:27.587955 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:23:27.587965 | orchestrator | Friday 03 April 2026 08:23:03 +0000 (0:00:01.192) 0:36:16.523 ********** 2026-04-03 08:23:27.587976 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.587987 | orchestrator | 2026-04-03 08:23:27.587997 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:23:27.588008 | orchestrator | Friday 03 April 2026 08:23:04 +0000 (0:00:01.225) 0:36:17.749 ********** 2026-04-03 08:23:27.588018 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.588029 | orchestrator | 2026-04-03 08:23:27.588053 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:23:27.588064 | orchestrator | Friday 03 April 2026 08:23:06 +0000 (0:00:01.385) 0:36:19.135 ********** 2026-04-03 08:23:27.588075 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:23:27.588103 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:23:27.588114 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:23:27.588125 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.588136 | orchestrator | 2026-04-03 08:23:27.588146 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:23:27.588157 | orchestrator | Friday 03 April 2026 08:23:07 +0000 (0:00:01.390) 0:36:20.525 ********** 2026-04-03 08:23:27.588168 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:23:27.588179 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:23:27.588190 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:23:27.588200 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.588211 | orchestrator | 2026-04-03 08:23:27.588221 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:23:27.588232 | orchestrator | Friday 03 April 2026 08:23:09 +0000 (0:00:01.426) 0:36:21.952 ********** 2026-04-03 08:23:27.588251 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:23:27.588261 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:23:27.588272 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:23:27.588283 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:23:27.588310 | orchestrator | 2026-04-03 08:23:27.588333 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:23:27.588344 | orchestrator | Friday 03 April 2026 08:23:10 +0000 (0:00:01.514) 0:36:23.467 ********** 2026-04-03 08:23:27.588354 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.588365 | orchestrator | 2026-04-03 08:23:27.588376 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:23:27.588386 | orchestrator | Friday 03 April 2026 08:23:11 +0000 (0:00:01.203) 0:36:24.671 ********** 2026-04-03 08:23:27.588397 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:23:27.588408 | orchestrator | 2026-04-03 08:23:27.588418 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:23:27.588429 | orchestrator | Friday 03 April 2026 08:23:13 +0000 (0:00:01.379) 0:36:26.051 ********** 2026-04-03 08:23:27.588440 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:23:27.588450 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:23:27.588482 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:23:27.588493 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 08:23:27.588503 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:23:27.588514 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:23:27.588525 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:23:27.588535 | orchestrator | 2026-04-03 08:23:27.588546 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:23:27.588557 | orchestrator | Friday 03 April 2026 08:23:15 +0000 (0:00:02.459) 0:36:28.511 ********** 2026-04-03 08:23:27.588568 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:23:27.588579 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:23:27.588751 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:23:27.588781 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 08:23:27.588803 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:23:27.588814 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:23:27.588825 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:23:27.588835 | orchestrator | 2026-04-03 08:23:27.588846 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-03 08:23:27.588857 | orchestrator | Friday 03 April 2026 08:23:18 +0000 (0:00:02.704) 0:36:31.215 ********** 2026-04-03 08:23:27.588867 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.588878 | orchestrator | 2026-04-03 08:23:27.588889 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-03 08:23:27.588900 | orchestrator | Friday 03 April 2026 08:23:19 +0000 (0:00:01.516) 0:36:32.732 ********** 2026-04-03 08:23:27.588910 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.588921 | orchestrator | 2026-04-03 08:23:27.588932 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-03 08:23:27.588942 | orchestrator | Friday 03 April 2026 08:23:21 +0000 (0:00:01.152) 0:36:33.884 ********** 2026-04-03 08:23:27.588953 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:23:27.588972 | orchestrator | 2026-04-03 08:23:27.588983 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-03 08:23:27.588994 | orchestrator | Friday 03 April 2026 08:23:22 +0000 (0:00:01.224) 0:36:35.109 ********** 2026-04-03 08:23:27.589005 | orchestrator | changed: [testbed-node-3] => (item=1) 2026-04-03 08:23:27.589016 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-03 08:23:27.589026 | orchestrator | 2026-04-03 08:23:27.589037 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:23:27.589048 | orchestrator | Friday 03 April 2026 08:23:26 +0000 (0:00:04.187) 0:36:39.296 ********** 2026-04-03 08:23:27.589066 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-03 08:23:27.589077 | orchestrator | 2026-04-03 08:23:27.589088 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:23:27.589109 | orchestrator | Friday 03 April 2026 08:23:27 +0000 (0:00:01.143) 0:36:40.440 ********** 2026-04-03 08:24:18.387027 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-03 08:24:18.387140 | orchestrator | 2026-04-03 08:24:18.387156 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:24:18.387167 | orchestrator | Friday 03 April 2026 08:23:28 +0000 (0:00:01.128) 0:36:41.568 ********** 2026-04-03 08:24:18.387177 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387189 | orchestrator | 2026-04-03 08:24:18.387199 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:24:18.387209 | orchestrator | Friday 03 April 2026 08:23:29 +0000 (0:00:01.137) 0:36:42.706 ********** 2026-04-03 08:24:18.387219 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387229 | orchestrator | 2026-04-03 08:24:18.387239 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:24:18.387248 | orchestrator | Friday 03 April 2026 08:23:31 +0000 (0:00:01.560) 0:36:44.267 ********** 2026-04-03 08:24:18.387258 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387267 | orchestrator | 2026-04-03 08:24:18.387277 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:24:18.387286 | orchestrator | Friday 03 April 2026 08:23:32 +0000 (0:00:01.544) 0:36:45.811 ********** 2026-04-03 08:24:18.387298 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387314 | orchestrator | 2026-04-03 08:24:18.387330 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:24:18.387346 | orchestrator | Friday 03 April 2026 08:23:34 +0000 (0:00:01.500) 0:36:47.312 ********** 2026-04-03 08:24:18.387361 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387377 | orchestrator | 2026-04-03 08:24:18.387394 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:24:18.387409 | orchestrator | Friday 03 April 2026 08:23:35 +0000 (0:00:01.185) 0:36:48.497 ********** 2026-04-03 08:24:18.387425 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387442 | orchestrator | 2026-04-03 08:24:18.387460 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:24:18.387540 | orchestrator | Friday 03 April 2026 08:23:36 +0000 (0:00:01.185) 0:36:49.683 ********** 2026-04-03 08:24:18.387551 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387561 | orchestrator | 2026-04-03 08:24:18.387578 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:24:18.387594 | orchestrator | Friday 03 April 2026 08:23:37 +0000 (0:00:01.119) 0:36:50.802 ********** 2026-04-03 08:24:18.387610 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387627 | orchestrator | 2026-04-03 08:24:18.387642 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:24:18.387658 | orchestrator | Friday 03 April 2026 08:23:39 +0000 (0:00:01.594) 0:36:52.397 ********** 2026-04-03 08:24:18.387674 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387689 | orchestrator | 2026-04-03 08:24:18.387706 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:24:18.387755 | orchestrator | Friday 03 April 2026 08:23:41 +0000 (0:00:01.566) 0:36:53.963 ********** 2026-04-03 08:24:18.387773 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387789 | orchestrator | 2026-04-03 08:24:18.387807 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:24:18.387823 | orchestrator | Friday 03 April 2026 08:23:42 +0000 (0:00:01.131) 0:36:55.094 ********** 2026-04-03 08:24:18.387839 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.387853 | orchestrator | 2026-04-03 08:24:18.387868 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:24:18.387883 | orchestrator | Friday 03 April 2026 08:23:43 +0000 (0:00:01.119) 0:36:56.214 ********** 2026-04-03 08:24:18.387899 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387918 | orchestrator | 2026-04-03 08:24:18.387933 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:24:18.387951 | orchestrator | Friday 03 April 2026 08:23:44 +0000 (0:00:01.140) 0:36:57.354 ********** 2026-04-03 08:24:18.387969 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.387985 | orchestrator | 2026-04-03 08:24:18.388000 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:24:18.388015 | orchestrator | Friday 03 April 2026 08:23:45 +0000 (0:00:01.254) 0:36:58.609 ********** 2026-04-03 08:24:18.388031 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.388047 | orchestrator | 2026-04-03 08:24:18.388062 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:24:18.388078 | orchestrator | Friday 03 April 2026 08:23:46 +0000 (0:00:01.133) 0:36:59.742 ********** 2026-04-03 08:24:18.388093 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388107 | orchestrator | 2026-04-03 08:24:18.388123 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:24:18.388139 | orchestrator | Friday 03 April 2026 08:23:48 +0000 (0:00:01.172) 0:37:00.915 ********** 2026-04-03 08:24:18.388154 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388170 | orchestrator | 2026-04-03 08:24:18.388186 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:24:18.388201 | orchestrator | Friday 03 April 2026 08:23:49 +0000 (0:00:01.124) 0:37:02.040 ********** 2026-04-03 08:24:18.388217 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388233 | orchestrator | 2026-04-03 08:24:18.388248 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:24:18.388265 | orchestrator | Friday 03 April 2026 08:23:50 +0000 (0:00:01.112) 0:37:03.152 ********** 2026-04-03 08:24:18.388280 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.388297 | orchestrator | 2026-04-03 08:24:18.388314 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:24:18.388329 | orchestrator | Friday 03 April 2026 08:23:51 +0000 (0:00:01.125) 0:37:04.279 ********** 2026-04-03 08:24:18.388366 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.388383 | orchestrator | 2026-04-03 08:24:18.388400 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:24:18.388417 | orchestrator | Friday 03 April 2026 08:23:52 +0000 (0:00:01.293) 0:37:05.572 ********** 2026-04-03 08:24:18.388434 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388451 | orchestrator | 2026-04-03 08:24:18.388527 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:24:18.388556 | orchestrator | Friday 03 April 2026 08:23:53 +0000 (0:00:01.147) 0:37:06.720 ********** 2026-04-03 08:24:18.388573 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388590 | orchestrator | 2026-04-03 08:24:18.388607 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:24:18.388623 | orchestrator | Friday 03 April 2026 08:23:54 +0000 (0:00:01.138) 0:37:07.858 ********** 2026-04-03 08:24:18.388639 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388654 | orchestrator | 2026-04-03 08:24:18.388671 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:24:18.388705 | orchestrator | Friday 03 April 2026 08:23:56 +0000 (0:00:01.175) 0:37:09.033 ********** 2026-04-03 08:24:18.388727 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388748 | orchestrator | 2026-04-03 08:24:18.388764 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:24:18.388779 | orchestrator | Friday 03 April 2026 08:23:57 +0000 (0:00:01.109) 0:37:10.142 ********** 2026-04-03 08:24:18.388795 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388812 | orchestrator | 2026-04-03 08:24:18.388828 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:24:18.388844 | orchestrator | Friday 03 April 2026 08:23:58 +0000 (0:00:01.104) 0:37:11.247 ********** 2026-04-03 08:24:18.388859 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388875 | orchestrator | 2026-04-03 08:24:18.388891 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:24:18.388908 | orchestrator | Friday 03 April 2026 08:23:59 +0000 (0:00:01.103) 0:37:12.351 ********** 2026-04-03 08:24:18.388924 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.388940 | orchestrator | 2026-04-03 08:24:18.388957 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:24:18.388974 | orchestrator | Friday 03 April 2026 08:24:00 +0000 (0:00:01.136) 0:37:13.487 ********** 2026-04-03 08:24:18.388992 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389008 | orchestrator | 2026-04-03 08:24:18.389024 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:24:18.389040 | orchestrator | Friday 03 April 2026 08:24:01 +0000 (0:00:01.105) 0:37:14.592 ********** 2026-04-03 08:24:18.389055 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389071 | orchestrator | 2026-04-03 08:24:18.389088 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:24:18.389105 | orchestrator | Friday 03 April 2026 08:24:02 +0000 (0:00:01.115) 0:37:15.708 ********** 2026-04-03 08:24:18.389121 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389136 | orchestrator | 2026-04-03 08:24:18.389152 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:24:18.389169 | orchestrator | Friday 03 April 2026 08:24:03 +0000 (0:00:01.097) 0:37:16.806 ********** 2026-04-03 08:24:18.389185 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389201 | orchestrator | 2026-04-03 08:24:18.389217 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:24:18.389233 | orchestrator | Friday 03 April 2026 08:24:05 +0000 (0:00:01.111) 0:37:17.917 ********** 2026-04-03 08:24:18.389249 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389265 | orchestrator | 2026-04-03 08:24:18.389281 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:24:18.389298 | orchestrator | Friday 03 April 2026 08:24:06 +0000 (0:00:01.236) 0:37:19.154 ********** 2026-04-03 08:24:18.389313 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.389329 | orchestrator | 2026-04-03 08:24:18.389346 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:24:18.389362 | orchestrator | Friday 03 April 2026 08:24:08 +0000 (0:00:01.908) 0:37:21.063 ********** 2026-04-03 08:24:18.389379 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.389395 | orchestrator | 2026-04-03 08:24:18.389410 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:24:18.389426 | orchestrator | Friday 03 April 2026 08:24:10 +0000 (0:00:02.247) 0:37:23.311 ********** 2026-04-03 08:24:18.389443 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-03 08:24:18.389460 | orchestrator | 2026-04-03 08:24:18.389498 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:24:18.389516 | orchestrator | Friday 03 April 2026 08:24:11 +0000 (0:00:01.112) 0:37:24.423 ********** 2026-04-03 08:24:18.389532 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389560 | orchestrator | 2026-04-03 08:24:18.389570 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:24:18.389580 | orchestrator | Friday 03 April 2026 08:24:12 +0000 (0:00:01.180) 0:37:25.603 ********** 2026-04-03 08:24:18.389589 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389599 | orchestrator | 2026-04-03 08:24:18.389608 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:24:18.389618 | orchestrator | Friday 03 April 2026 08:24:13 +0000 (0:00:01.151) 0:37:26.755 ********** 2026-04-03 08:24:18.389627 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:24:18.389637 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:24:18.389647 | orchestrator | 2026-04-03 08:24:18.389656 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:24:18.389666 | orchestrator | Friday 03 April 2026 08:24:15 +0000 (0:00:01.779) 0:37:28.535 ********** 2026-04-03 08:24:18.389675 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:24:18.389684 | orchestrator | 2026-04-03 08:24:18.389701 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:24:18.389711 | orchestrator | Friday 03 April 2026 08:24:17 +0000 (0:00:01.479) 0:37:30.015 ********** 2026-04-03 08:24:18.389721 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:24:18.389730 | orchestrator | 2026-04-03 08:24:18.389740 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:24:18.389761 | orchestrator | Friday 03 April 2026 08:24:18 +0000 (0:00:01.223) 0:37:31.238 ********** 2026-04-03 08:25:04.760860 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.760955 | orchestrator | 2026-04-03 08:25:04.760968 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:25:04.760977 | orchestrator | Friday 03 April 2026 08:24:19 +0000 (0:00:01.140) 0:37:32.379 ********** 2026-04-03 08:25:04.760985 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.760992 | orchestrator | 2026-04-03 08:25:04.760999 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:25:04.761006 | orchestrator | Friday 03 April 2026 08:24:20 +0000 (0:00:01.167) 0:37:33.547 ********** 2026-04-03 08:25:04.761013 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-03 08:25:04.761020 | orchestrator | 2026-04-03 08:25:04.761027 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:25:04.761034 | orchestrator | Friday 03 April 2026 08:24:21 +0000 (0:00:01.300) 0:37:34.848 ********** 2026-04-03 08:25:04.761041 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:04.761049 | orchestrator | 2026-04-03 08:25:04.761055 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:25:04.761063 | orchestrator | Friday 03 April 2026 08:24:23 +0000 (0:00:01.715) 0:37:36.563 ********** 2026-04-03 08:25:04.761070 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:25:04.761077 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:25:04.761084 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:25:04.761090 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761097 | orchestrator | 2026-04-03 08:25:04.761104 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:25:04.761111 | orchestrator | Friday 03 April 2026 08:24:24 +0000 (0:00:01.143) 0:37:37.707 ********** 2026-04-03 08:25:04.761117 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761124 | orchestrator | 2026-04-03 08:25:04.761131 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:25:04.761138 | orchestrator | Friday 03 April 2026 08:24:26 +0000 (0:00:01.222) 0:37:38.930 ********** 2026-04-03 08:25:04.761144 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761151 | orchestrator | 2026-04-03 08:25:04.761158 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:25:04.761185 | orchestrator | Friday 03 April 2026 08:24:27 +0000 (0:00:01.224) 0:37:40.154 ********** 2026-04-03 08:25:04.761193 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761199 | orchestrator | 2026-04-03 08:25:04.761206 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:25:04.761213 | orchestrator | Friday 03 April 2026 08:24:28 +0000 (0:00:01.155) 0:37:41.310 ********** 2026-04-03 08:25:04.761220 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761226 | orchestrator | 2026-04-03 08:25:04.761233 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:25:04.761240 | orchestrator | Friday 03 April 2026 08:24:29 +0000 (0:00:01.216) 0:37:42.527 ********** 2026-04-03 08:25:04.761246 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761253 | orchestrator | 2026-04-03 08:25:04.761260 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:25:04.761266 | orchestrator | Friday 03 April 2026 08:24:30 +0000 (0:00:01.203) 0:37:43.730 ********** 2026-04-03 08:25:04.761273 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:04.761279 | orchestrator | 2026-04-03 08:25:04.761286 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:25:04.761293 | orchestrator | Friday 03 April 2026 08:24:33 +0000 (0:00:02.643) 0:37:46.374 ********** 2026-04-03 08:25:04.761300 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:04.761306 | orchestrator | 2026-04-03 08:25:04.761313 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:25:04.761320 | orchestrator | Friday 03 April 2026 08:24:34 +0000 (0:00:01.113) 0:37:47.487 ********** 2026-04-03 08:25:04.761326 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-03 08:25:04.761333 | orchestrator | 2026-04-03 08:25:04.761339 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:25:04.761346 | orchestrator | Friday 03 April 2026 08:24:35 +0000 (0:00:01.126) 0:37:48.614 ********** 2026-04-03 08:25:04.761353 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761359 | orchestrator | 2026-04-03 08:25:04.761366 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:25:04.761373 | orchestrator | Friday 03 April 2026 08:24:36 +0000 (0:00:01.124) 0:37:49.739 ********** 2026-04-03 08:25:04.761379 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761387 | orchestrator | 2026-04-03 08:25:04.761393 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:25:04.761400 | orchestrator | Friday 03 April 2026 08:24:38 +0000 (0:00:01.189) 0:37:50.929 ********** 2026-04-03 08:25:04.761407 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761413 | orchestrator | 2026-04-03 08:25:04.761420 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:25:04.761426 | orchestrator | Friday 03 April 2026 08:24:39 +0000 (0:00:01.181) 0:37:52.111 ********** 2026-04-03 08:25:04.761433 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761440 | orchestrator | 2026-04-03 08:25:04.761446 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:25:04.761453 | orchestrator | Friday 03 April 2026 08:24:40 +0000 (0:00:01.183) 0:37:53.294 ********** 2026-04-03 08:25:04.761471 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761502 | orchestrator | 2026-04-03 08:25:04.761510 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:25:04.761516 | orchestrator | Friday 03 April 2026 08:24:41 +0000 (0:00:01.167) 0:37:54.462 ********** 2026-04-03 08:25:04.761523 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761530 | orchestrator | 2026-04-03 08:25:04.761549 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:25:04.761557 | orchestrator | Friday 03 April 2026 08:24:42 +0000 (0:00:01.151) 0:37:55.613 ********** 2026-04-03 08:25:04.761563 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761576 | orchestrator | 2026-04-03 08:25:04.761583 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:25:04.761590 | orchestrator | Friday 03 April 2026 08:24:43 +0000 (0:00:01.167) 0:37:56.781 ********** 2026-04-03 08:25:04.761596 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761603 | orchestrator | 2026-04-03 08:25:04.761610 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:25:04.761617 | orchestrator | Friday 03 April 2026 08:24:45 +0000 (0:00:01.154) 0:37:57.936 ********** 2026-04-03 08:25:04.761623 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:04.761630 | orchestrator | 2026-04-03 08:25:04.761637 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:25:04.761643 | orchestrator | Friday 03 April 2026 08:24:46 +0000 (0:00:01.123) 0:37:59.060 ********** 2026-04-03 08:25:04.761650 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-03 08:25:04.761657 | orchestrator | 2026-04-03 08:25:04.761664 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:25:04.761670 | orchestrator | Friday 03 April 2026 08:24:47 +0000 (0:00:01.128) 0:38:00.188 ********** 2026-04-03 08:25:04.761677 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-03 08:25:04.761684 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-03 08:25:04.761691 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-03 08:25:04.761698 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-03 08:25:04.761705 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-03 08:25:04.761711 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-03 08:25:04.761718 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-03 08:25:04.761725 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:25:04.761731 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:25:04.761738 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:25:04.761745 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:25:04.761752 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:25:04.761758 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:25:04.761765 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:25:04.761772 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-03 08:25:04.761778 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-03 08:25:04.761785 | orchestrator | 2026-04-03 08:25:04.761792 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:25:04.761798 | orchestrator | Friday 03 April 2026 08:24:53 +0000 (0:00:06.523) 0:38:06.712 ********** 2026-04-03 08:25:04.761805 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-03 08:25:04.761812 | orchestrator | 2026-04-03 08:25:04.761819 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:25:04.761825 | orchestrator | Friday 03 April 2026 08:24:55 +0000 (0:00:01.681) 0:38:08.393 ********** 2026-04-03 08:25:04.761832 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:25:04.761840 | orchestrator | 2026-04-03 08:25:04.761846 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:25:04.761853 | orchestrator | Friday 03 April 2026 08:24:56 +0000 (0:00:01.462) 0:38:09.856 ********** 2026-04-03 08:25:04.761860 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:25:04.761867 | orchestrator | 2026-04-03 08:25:04.761873 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:25:04.761884 | orchestrator | Friday 03 April 2026 08:24:58 +0000 (0:00:01.912) 0:38:11.768 ********** 2026-04-03 08:25:04.761891 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761897 | orchestrator | 2026-04-03 08:25:04.761904 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:25:04.761911 | orchestrator | Friday 03 April 2026 08:25:00 +0000 (0:00:01.117) 0:38:12.886 ********** 2026-04-03 08:25:04.761917 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761924 | orchestrator | 2026-04-03 08:25:04.761931 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:25:04.761937 | orchestrator | Friday 03 April 2026 08:25:01 +0000 (0:00:01.138) 0:38:14.024 ********** 2026-04-03 08:25:04.761944 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761950 | orchestrator | 2026-04-03 08:25:04.761957 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:25:04.761964 | orchestrator | Friday 03 April 2026 08:25:02 +0000 (0:00:01.134) 0:38:15.159 ********** 2026-04-03 08:25:04.761970 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.761977 | orchestrator | 2026-04-03 08:25:04.761984 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:25:04.761990 | orchestrator | Friday 03 April 2026 08:25:03 +0000 (0:00:01.188) 0:38:16.347 ********** 2026-04-03 08:25:04.762000 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.762007 | orchestrator | 2026-04-03 08:25:04.762014 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:25:04.762061 | orchestrator | Friday 03 April 2026 08:25:04 +0000 (0:00:01.127) 0:38:17.474 ********** 2026-04-03 08:25:04.762068 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:04.762074 | orchestrator | 2026-04-03 08:25:04.762086 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:25:56.241119 | orchestrator | Friday 03 April 2026 08:25:05 +0000 (0:00:01.138) 0:38:18.613 ********** 2026-04-03 08:25:56.241235 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241253 | orchestrator | 2026-04-03 08:25:56.241266 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:25:56.241278 | orchestrator | Friday 03 April 2026 08:25:06 +0000 (0:00:01.108) 0:38:19.721 ********** 2026-04-03 08:25:56.241290 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241301 | orchestrator | 2026-04-03 08:25:56.241312 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:25:56.241323 | orchestrator | Friday 03 April 2026 08:25:07 +0000 (0:00:01.122) 0:38:20.843 ********** 2026-04-03 08:25:56.241334 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241344 | orchestrator | 2026-04-03 08:25:56.241355 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:25:56.241366 | orchestrator | Friday 03 April 2026 08:25:09 +0000 (0:00:01.137) 0:38:21.981 ********** 2026-04-03 08:25:56.241377 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241387 | orchestrator | 2026-04-03 08:25:56.241398 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:25:56.241409 | orchestrator | Friday 03 April 2026 08:25:10 +0000 (0:00:01.089) 0:38:23.070 ********** 2026-04-03 08:25:56.241420 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.241432 | orchestrator | 2026-04-03 08:25:56.241443 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:25:56.241453 | orchestrator | Friday 03 April 2026 08:25:11 +0000 (0:00:01.241) 0:38:24.312 ********** 2026-04-03 08:25:56.241464 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:25:56.241475 | orchestrator | 2026-04-03 08:25:56.241532 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:25:56.241546 | orchestrator | Friday 03 April 2026 08:25:15 +0000 (0:00:04.353) 0:38:28.665 ********** 2026-04-03 08:25:56.241557 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:25:56.241592 | orchestrator | 2026-04-03 08:25:56.241604 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:25:56.241614 | orchestrator | Friday 03 April 2026 08:25:16 +0000 (0:00:01.172) 0:38:29.838 ********** 2026-04-03 08:25:56.241627 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-03 08:25:56.241641 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-03 08:25:56.241655 | orchestrator | 2026-04-03 08:25:56.241668 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:25:56.241681 | orchestrator | Friday 03 April 2026 08:25:24 +0000 (0:00:07.729) 0:38:37.568 ********** 2026-04-03 08:25:56.241693 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241705 | orchestrator | 2026-04-03 08:25:56.241717 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:25:56.241729 | orchestrator | Friday 03 April 2026 08:25:25 +0000 (0:00:01.164) 0:38:38.732 ********** 2026-04-03 08:25:56.241742 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241755 | orchestrator | 2026-04-03 08:25:56.241766 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:25:56.241777 | orchestrator | Friday 03 April 2026 08:25:26 +0000 (0:00:01.118) 0:38:39.851 ********** 2026-04-03 08:25:56.241787 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241798 | orchestrator | 2026-04-03 08:25:56.241808 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:25:56.241819 | orchestrator | Friday 03 April 2026 08:25:28 +0000 (0:00:01.159) 0:38:41.011 ********** 2026-04-03 08:25:56.241829 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241840 | orchestrator | 2026-04-03 08:25:56.241851 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:25:56.241862 | orchestrator | Friday 03 April 2026 08:25:29 +0000 (0:00:01.205) 0:38:42.217 ********** 2026-04-03 08:25:56.241872 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.241883 | orchestrator | 2026-04-03 08:25:56.241893 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:25:56.241904 | orchestrator | Friday 03 April 2026 08:25:30 +0000 (0:00:01.174) 0:38:43.391 ********** 2026-04-03 08:25:56.241914 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.241925 | orchestrator | 2026-04-03 08:25:56.241936 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:25:56.241961 | orchestrator | Friday 03 April 2026 08:25:31 +0000 (0:00:01.261) 0:38:44.653 ********** 2026-04-03 08:25:56.241972 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:25:56.241983 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:25:56.241993 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:25:56.242004 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242015 | orchestrator | 2026-04-03 08:25:56.242094 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:25:56.242123 | orchestrator | Friday 03 April 2026 08:25:33 +0000 (0:00:01.454) 0:38:46.107 ********** 2026-04-03 08:25:56.242134 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:25:56.242145 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:25:56.242165 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:25:56.242176 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242186 | orchestrator | 2026-04-03 08:25:56.242197 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:25:56.242208 | orchestrator | Friday 03 April 2026 08:25:35 +0000 (0:00:01.823) 0:38:47.931 ********** 2026-04-03 08:25:56.242219 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:25:56.242230 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:25:56.242240 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:25:56.242251 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242262 | orchestrator | 2026-04-03 08:25:56.242272 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:25:56.242283 | orchestrator | Friday 03 April 2026 08:25:36 +0000 (0:00:01.893) 0:38:49.824 ********** 2026-04-03 08:25:56.242295 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.242305 | orchestrator | 2026-04-03 08:25:56.242316 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:25:56.242327 | orchestrator | Friday 03 April 2026 08:25:38 +0000 (0:00:01.226) 0:38:51.050 ********** 2026-04-03 08:25:56.242338 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:25:56.242348 | orchestrator | 2026-04-03 08:25:56.242359 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:25:56.242370 | orchestrator | Friday 03 April 2026 08:25:39 +0000 (0:00:01.403) 0:38:52.454 ********** 2026-04-03 08:25:56.242381 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.242391 | orchestrator | 2026-04-03 08:25:56.242402 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-03 08:25:56.242413 | orchestrator | Friday 03 April 2026 08:25:41 +0000 (0:00:01.810) 0:38:54.264 ********** 2026-04-03 08:25:56.242424 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.242434 | orchestrator | 2026-04-03 08:25:56.242445 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:25:56.242456 | orchestrator | Friday 03 April 2026 08:25:42 +0000 (0:00:01.159) 0:38:55.424 ********** 2026-04-03 08:25:56.242467 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:25:56.242479 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:25:56.242516 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:25:56.242527 | orchestrator | 2026-04-03 08:25:56.242538 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-03 08:25:56.242549 | orchestrator | Friday 03 April 2026 08:25:44 +0000 (0:00:01.704) 0:38:57.129 ********** 2026-04-03 08:25:56.242559 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3 2026-04-03 08:25:56.242570 | orchestrator | 2026-04-03 08:25:56.242580 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-03 08:25:56.242591 | orchestrator | Friday 03 April 2026 08:25:45 +0000 (0:00:01.495) 0:38:58.624 ********** 2026-04-03 08:25:56.242601 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242612 | orchestrator | 2026-04-03 08:25:56.242623 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-03 08:25:56.242633 | orchestrator | Friday 03 April 2026 08:25:46 +0000 (0:00:01.177) 0:38:59.802 ********** 2026-04-03 08:25:56.242643 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242654 | orchestrator | 2026-04-03 08:25:56.242664 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-03 08:25:56.242675 | orchestrator | Friday 03 April 2026 08:25:48 +0000 (0:00:01.130) 0:39:00.932 ********** 2026-04-03 08:25:56.242685 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.242696 | orchestrator | 2026-04-03 08:25:56.242707 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-03 08:25:56.242717 | orchestrator | Friday 03 April 2026 08:25:49 +0000 (0:00:01.460) 0:39:02.393 ********** 2026-04-03 08:25:56.242735 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:25:56.242746 | orchestrator | 2026-04-03 08:25:56.242756 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-03 08:25:56.242767 | orchestrator | Friday 03 April 2026 08:25:50 +0000 (0:00:01.174) 0:39:03.568 ********** 2026-04-03 08:25:56.242777 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 08:25:56.242788 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 08:25:56.242799 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 08:25:56.242809 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 08:25:56.242820 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 08:25:56.242830 | orchestrator | 2026-04-03 08:25:56.242841 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-03 08:25:56.242857 | orchestrator | Friday 03 April 2026 08:25:54 +0000 (0:00:04.051) 0:39:07.620 ********** 2026-04-03 08:25:56.242868 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:25:56.242878 | orchestrator | 2026-04-03 08:25:56.242889 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-03 08:25:56.242899 | orchestrator | Friday 03 April 2026 08:25:56 +0000 (0:00:01.254) 0:39:08.874 ********** 2026-04-03 08:25:56.242910 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3 2026-04-03 08:25:56.242920 | orchestrator | 2026-04-03 08:25:56.242931 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-03 08:27:04.570484 | orchestrator | Friday 03 April 2026 08:25:57 +0000 (0:00:01.468) 0:39:10.343 ********** 2026-04-03 08:27:04.570700 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 08:27:04.570720 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-03 08:27:04.570733 | orchestrator | 2026-04-03 08:27:04.570747 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-03 08:27:04.570758 | orchestrator | Friday 03 April 2026 08:25:59 +0000 (0:00:01.876) 0:39:12.219 ********** 2026-04-03 08:27:04.570770 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:27:04.570781 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 08:27:04.570792 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:27:04.570803 | orchestrator | 2026-04-03 08:27:04.570815 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:27:04.570826 | orchestrator | Friday 03 April 2026 08:26:02 +0000 (0:00:03.322) 0:39:15.541 ********** 2026-04-03 08:27:04.570837 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 08:27:04.570848 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 08:27:04.570859 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.570871 | orchestrator | 2026-04-03 08:27:04.570882 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-03 08:27:04.570892 | orchestrator | Friday 03 April 2026 08:26:04 +0000 (0:00:02.013) 0:39:17.555 ********** 2026-04-03 08:27:04.570903 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.570914 | orchestrator | 2026-04-03 08:27:04.570925 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-03 08:27:04.570936 | orchestrator | Friday 03 April 2026 08:26:05 +0000 (0:00:01.262) 0:39:18.818 ********** 2026-04-03 08:27:04.570947 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.570958 | orchestrator | 2026-04-03 08:27:04.570968 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-03 08:27:04.570979 | orchestrator | Friday 03 April 2026 08:26:07 +0000 (0:00:01.135) 0:39:19.953 ********** 2026-04-03 08:27:04.570990 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571002 | orchestrator | 2026-04-03 08:27:04.571038 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-03 08:27:04.571050 | orchestrator | Friday 03 April 2026 08:26:08 +0000 (0:00:01.137) 0:39:21.091 ********** 2026-04-03 08:27:04.571061 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3 2026-04-03 08:27:04.571073 | orchestrator | 2026-04-03 08:27:04.571083 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-03 08:27:04.571094 | orchestrator | Friday 03 April 2026 08:26:09 +0000 (0:00:01.474) 0:39:22.566 ********** 2026-04-03 08:27:04.571105 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.571115 | orchestrator | 2026-04-03 08:27:04.571126 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-03 08:27:04.571137 | orchestrator | Friday 03 April 2026 08:26:11 +0000 (0:00:01.443) 0:39:24.009 ********** 2026-04-03 08:27:04.571148 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.571158 | orchestrator | 2026-04-03 08:27:04.571169 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-03 08:27:04.571180 | orchestrator | Friday 03 April 2026 08:26:14 +0000 (0:00:03.410) 0:39:27.420 ********** 2026-04-03 08:27:04.571190 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3 2026-04-03 08:27:04.571201 | orchestrator | 2026-04-03 08:27:04.571211 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-03 08:27:04.571222 | orchestrator | Friday 03 April 2026 08:26:16 +0000 (0:00:01.640) 0:39:29.060 ********** 2026-04-03 08:27:04.571233 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.571243 | orchestrator | 2026-04-03 08:27:04.571254 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-03 08:27:04.571265 | orchestrator | Friday 03 April 2026 08:26:18 +0000 (0:00:02.077) 0:39:31.138 ********** 2026-04-03 08:27:04.571275 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.571286 | orchestrator | 2026-04-03 08:27:04.571297 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-03 08:27:04.571307 | orchestrator | Friday 03 April 2026 08:26:20 +0000 (0:00:01.958) 0:39:33.096 ********** 2026-04-03 08:27:04.571318 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:27:04.571328 | orchestrator | 2026-04-03 08:27:04.571339 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-03 08:27:04.571350 | orchestrator | Friday 03 April 2026 08:26:22 +0000 (0:00:02.253) 0:39:35.349 ********** 2026-04-03 08:27:04.571360 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571371 | orchestrator | 2026-04-03 08:27:04.571382 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-03 08:27:04.571392 | orchestrator | Friday 03 April 2026 08:26:23 +0000 (0:00:01.146) 0:39:36.495 ********** 2026-04-03 08:27:04.571403 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571414 | orchestrator | 2026-04-03 08:27:04.571425 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-03 08:27:04.571435 | orchestrator | Friday 03 April 2026 08:26:24 +0000 (0:00:01.262) 0:39:37.758 ********** 2026-04-03 08:27:04.571446 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-03 08:27:04.571457 | orchestrator | ok: [testbed-node-3] => (item=1) 2026-04-03 08:27:04.571468 | orchestrator | 2026-04-03 08:27:04.571479 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-03 08:27:04.571525 | orchestrator | Friday 03 April 2026 08:26:26 +0000 (0:00:01.845) 0:39:39.604 ********** 2026-04-03 08:27:04.571537 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-03 08:27:04.571548 | orchestrator | ok: [testbed-node-3] => (item=1) 2026-04-03 08:27:04.571562 | orchestrator | 2026-04-03 08:27:04.571581 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-03 08:27:04.571601 | orchestrator | Friday 03 April 2026 08:26:29 +0000 (0:00:02.915) 0:39:42.519 ********** 2026-04-03 08:27:04.571620 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-03 08:27:04.571664 | orchestrator | changed: [testbed-node-3] => (item=1) 2026-04-03 08:27:04.571698 | orchestrator | 2026-04-03 08:27:04.571713 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-03 08:27:04.571724 | orchestrator | Friday 03 April 2026 08:26:34 +0000 (0:00:04.793) 0:39:47.313 ********** 2026-04-03 08:27:04.571735 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571745 | orchestrator | 2026-04-03 08:27:04.571756 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-03 08:27:04.571767 | orchestrator | Friday 03 April 2026 08:26:35 +0000 (0:00:01.227) 0:39:48.540 ********** 2026-04-03 08:27:04.571778 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571788 | orchestrator | 2026-04-03 08:27:04.571799 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-03 08:27:04.571810 | orchestrator | Friday 03 April 2026 08:26:36 +0000 (0:00:01.245) 0:39:49.786 ********** 2026-04-03 08:27:04.571821 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571831 | orchestrator | 2026-04-03 08:27:04.571842 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-03 08:27:04.571853 | orchestrator | Friday 03 April 2026 08:26:38 +0000 (0:00:01.308) 0:39:51.095 ********** 2026-04-03 08:27:04.571863 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571874 | orchestrator | 2026-04-03 08:27:04.571885 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-03 08:27:04.571895 | orchestrator | Friday 03 April 2026 08:26:39 +0000 (0:00:01.151) 0:39:52.247 ********** 2026-04-03 08:27:04.571906 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:27:04.571917 | orchestrator | 2026-04-03 08:27:04.571928 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-03 08:27:04.571938 | orchestrator | Friday 03 April 2026 08:26:40 +0000 (0:00:01.121) 0:39:53.369 ********** 2026-04-03 08:27:04.571949 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-03 08:27:04.571961 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-03 08:27:04.571972 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-03 08:27:04.571983 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:27:04.571993 | orchestrator | 2026-04-03 08:27:04.572004 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-03 08:27:04.572015 | orchestrator | 2026-04-03 08:27:04.572026 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:27:04.572037 | orchestrator | Friday 03 April 2026 08:26:51 +0000 (0:00:11.041) 0:40:04.411 ********** 2026-04-03 08:27:04.572048 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-03 08:27:04.572059 | orchestrator | 2026-04-03 08:27:04.572070 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:27:04.572081 | orchestrator | Friday 03 April 2026 08:26:52 +0000 (0:00:01.168) 0:40:05.579 ********** 2026-04-03 08:27:04.572097 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572115 | orchestrator | 2026-04-03 08:27:04.572133 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:27:04.572153 | orchestrator | Friday 03 April 2026 08:26:54 +0000 (0:00:01.416) 0:40:06.995 ********** 2026-04-03 08:27:04.572170 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572188 | orchestrator | 2026-04-03 08:27:04.572200 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:27:04.572211 | orchestrator | Friday 03 April 2026 08:26:55 +0000 (0:00:01.138) 0:40:08.134 ********** 2026-04-03 08:27:04.572221 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572232 | orchestrator | 2026-04-03 08:27:04.572243 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:27:04.572253 | orchestrator | Friday 03 April 2026 08:26:56 +0000 (0:00:01.431) 0:40:09.566 ********** 2026-04-03 08:27:04.572264 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572282 | orchestrator | 2026-04-03 08:27:04.572292 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:27:04.572303 | orchestrator | Friday 03 April 2026 08:26:57 +0000 (0:00:01.162) 0:40:10.728 ********** 2026-04-03 08:27:04.572314 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572325 | orchestrator | 2026-04-03 08:27:04.572335 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:27:04.572346 | orchestrator | Friday 03 April 2026 08:26:59 +0000 (0:00:01.148) 0:40:11.877 ********** 2026-04-03 08:27:04.572356 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572367 | orchestrator | 2026-04-03 08:27:04.572378 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:27:04.572389 | orchestrator | Friday 03 April 2026 08:27:00 +0000 (0:00:01.195) 0:40:13.072 ********** 2026-04-03 08:27:04.572399 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:04.572410 | orchestrator | 2026-04-03 08:27:04.572421 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:27:04.572432 | orchestrator | Friday 03 April 2026 08:27:01 +0000 (0:00:01.332) 0:40:14.405 ********** 2026-04-03 08:27:04.572442 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:04.572453 | orchestrator | 2026-04-03 08:27:04.572464 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:27:04.572474 | orchestrator | Friday 03 April 2026 08:27:02 +0000 (0:00:01.157) 0:40:15.563 ********** 2026-04-03 08:27:04.572491 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:27:04.572521 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:27:04.572532 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:27:04.572542 | orchestrator | 2026-04-03 08:27:04.572554 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:27:04.572564 | orchestrator | Friday 03 April 2026 08:27:04 +0000 (0:00:01.674) 0:40:17.237 ********** 2026-04-03 08:27:04.572583 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.515680 | orchestrator | 2026-04-03 08:27:29.515757 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:27:29.515764 | orchestrator | Friday 03 April 2026 08:27:05 +0000 (0:00:01.360) 0:40:18.598 ********** 2026-04-03 08:27:29.515769 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:27:29.515774 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:27:29.515778 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:27:29.515782 | orchestrator | 2026-04-03 08:27:29.515786 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:27:29.515790 | orchestrator | Friday 03 April 2026 08:27:08 +0000 (0:00:02.854) 0:40:21.452 ********** 2026-04-03 08:27:29.515795 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:27:29.515799 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:27:29.515803 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:27:29.515807 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.515811 | orchestrator | 2026-04-03 08:27:29.515815 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:27:29.515819 | orchestrator | Friday 03 April 2026 08:27:10 +0000 (0:00:01.491) 0:40:22.944 ********** 2026-04-03 08:27:29.515823 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515830 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515847 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515851 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.515855 | orchestrator | 2026-04-03 08:27:29.515859 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:27:29.515863 | orchestrator | Friday 03 April 2026 08:27:11 +0000 (0:00:01.681) 0:40:24.625 ********** 2026-04-03 08:27:29.515868 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515874 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515878 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:29.515882 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.515886 | orchestrator | 2026-04-03 08:27:29.515889 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:27:29.515893 | orchestrator | Friday 03 April 2026 08:27:12 +0000 (0:00:01.161) 0:40:25.786 ********** 2026-04-03 08:27:29.515916 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:27:06.274125', 'end': '2026-04-03 08:27:06.320056', 'delta': '0:00:00.045931', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:27:29.515922 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:27:06.807317', 'end': '2026-04-03 08:27:06.851626', 'delta': '0:00:00.044309', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:27:29.515927 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:27:07.402500', 'end': '2026-04-03 08:27:07.438168', 'delta': '0:00:00.035668', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:27:29.515934 | orchestrator | 2026-04-03 08:27:29.515938 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:27:29.515942 | orchestrator | Friday 03 April 2026 08:27:14 +0000 (0:00:01.194) 0:40:26.981 ********** 2026-04-03 08:27:29.515946 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.515950 | orchestrator | 2026-04-03 08:27:29.515954 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:27:29.515957 | orchestrator | Friday 03 April 2026 08:27:15 +0000 (0:00:01.377) 0:40:28.359 ********** 2026-04-03 08:27:29.515961 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.515965 | orchestrator | 2026-04-03 08:27:29.515969 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:27:29.515973 | orchestrator | Friday 03 April 2026 08:27:16 +0000 (0:00:01.215) 0:40:29.574 ********** 2026-04-03 08:27:29.515976 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.515980 | orchestrator | 2026-04-03 08:27:29.515984 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:27:29.515987 | orchestrator | Friday 03 April 2026 08:27:17 +0000 (0:00:01.135) 0:40:30.710 ********** 2026-04-03 08:27:29.515991 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:27:29.515995 | orchestrator | 2026-04-03 08:27:29.515999 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:27:29.516002 | orchestrator | Friday 03 April 2026 08:27:20 +0000 (0:00:02.320) 0:40:33.030 ********** 2026-04-03 08:27:29.516006 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.516010 | orchestrator | 2026-04-03 08:27:29.516014 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:27:29.516017 | orchestrator | Friday 03 April 2026 08:27:21 +0000 (0:00:01.239) 0:40:34.270 ********** 2026-04-03 08:27:29.516021 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.516025 | orchestrator | 2026-04-03 08:27:29.516029 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:27:29.516032 | orchestrator | Friday 03 April 2026 08:27:22 +0000 (0:00:01.103) 0:40:35.374 ********** 2026-04-03 08:27:29.516036 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.516040 | orchestrator | 2026-04-03 08:27:29.516043 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:27:29.516047 | orchestrator | Friday 03 April 2026 08:27:23 +0000 (0:00:01.220) 0:40:36.594 ********** 2026-04-03 08:27:29.516051 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.516055 | orchestrator | 2026-04-03 08:27:29.516058 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:27:29.516062 | orchestrator | Friday 03 April 2026 08:27:24 +0000 (0:00:01.160) 0:40:37.755 ********** 2026-04-03 08:27:29.516066 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.516070 | orchestrator | 2026-04-03 08:27:29.516073 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:27:29.516077 | orchestrator | Friday 03 April 2026 08:27:26 +0000 (0:00:01.127) 0:40:38.883 ********** 2026-04-03 08:27:29.516081 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.516085 | orchestrator | 2026-04-03 08:27:29.516088 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:27:29.516095 | orchestrator | Friday 03 April 2026 08:27:27 +0000 (0:00:01.155) 0:40:40.039 ********** 2026-04-03 08:27:29.516098 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:29.516105 | orchestrator | 2026-04-03 08:27:29.516109 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:27:29.516113 | orchestrator | Friday 03 April 2026 08:27:28 +0000 (0:00:01.103) 0:40:41.143 ********** 2026-04-03 08:27:29.516116 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:29.516120 | orchestrator | 2026-04-03 08:27:29.516124 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:27:29.516130 | orchestrator | Friday 03 April 2026 08:27:29 +0000 (0:00:01.224) 0:40:42.368 ********** 2026-04-03 08:27:32.042667 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:32.042785 | orchestrator | 2026-04-03 08:27:32.042809 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:27:32.042828 | orchestrator | Friday 03 April 2026 08:27:30 +0000 (0:00:01.120) 0:40:43.488 ********** 2026-04-03 08:27:32.042848 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:32.042867 | orchestrator | 2026-04-03 08:27:32.042884 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:27:32.042900 | orchestrator | Friday 03 April 2026 08:27:31 +0000 (0:00:01.155) 0:40:44.644 ********** 2026-04-03 08:27:32.042921 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.042944 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}})  2026-04-03 08:27:32.042967 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:27:32.042987 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}})  2026-04-03 08:27:32.043004 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043068 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043109 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:27:32.043129 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043148 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043166 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043184 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}})  2026-04-03 08:27:32.043204 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}})  2026-04-03 08:27:32.043241 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:32.043279 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:27:33.388697 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:33.388789 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:27:33.388805 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:27:33.388843 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:33.388856 | orchestrator | 2026-04-03 08:27:33.388867 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:27:33.388878 | orchestrator | Friday 03 April 2026 08:27:33 +0000 (0:00:01.405) 0:40:46.050 ********** 2026-04-03 08:27:33.388905 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.388918 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.388929 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.388954 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.388978 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.388990 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.389063 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.389077 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:33.389095 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885845 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885933 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885951 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885957 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885973 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885985 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885990 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885995 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:27:38.885999 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:27:38.886005 | orchestrator | 2026-04-03 08:27:38.886010 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:27:38.886052 | orchestrator | Friday 03 April 2026 08:27:34 +0000 (0:00:01.486) 0:40:47.537 ********** 2026-04-03 08:27:38.886056 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:38.886061 | orchestrator | 2026-04-03 08:27:38.886065 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:27:38.886069 | orchestrator | Friday 03 April 2026 08:27:36 +0000 (0:00:01.535) 0:40:49.073 ********** 2026-04-03 08:27:38.886072 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:38.886076 | orchestrator | 2026-04-03 08:27:38.886080 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:27:38.886084 | orchestrator | Friday 03 April 2026 08:27:37 +0000 (0:00:01.205) 0:40:50.278 ********** 2026-04-03 08:27:38.886088 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:27:38.886091 | orchestrator | 2026-04-03 08:27:38.886095 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:27:38.886105 | orchestrator | Friday 03 April 2026 08:27:38 +0000 (0:00:01.465) 0:40:51.743 ********** 2026-04-03 08:28:19.881814 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.881935 | orchestrator | 2026-04-03 08:28:19.881951 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:28:19.881965 | orchestrator | Friday 03 April 2026 08:27:40 +0000 (0:00:01.167) 0:40:52.910 ********** 2026-04-03 08:28:19.881976 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.881987 | orchestrator | 2026-04-03 08:28:19.881999 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:28:19.882010 | orchestrator | Friday 03 April 2026 08:27:41 +0000 (0:00:01.290) 0:40:54.201 ********** 2026-04-03 08:28:19.882106 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882118 | orchestrator | 2026-04-03 08:28:19.882129 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:28:19.882140 | orchestrator | Friday 03 April 2026 08:27:42 +0000 (0:00:01.173) 0:40:55.374 ********** 2026-04-03 08:28:19.882151 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 08:28:19.882163 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 08:28:19.882174 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 08:28:19.882185 | orchestrator | 2026-04-03 08:28:19.882196 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:28:19.882207 | orchestrator | Friday 03 April 2026 08:27:44 +0000 (0:00:01.708) 0:40:57.083 ********** 2026-04-03 08:28:19.882218 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:28:19.882229 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:28:19.882240 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:28:19.882251 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882261 | orchestrator | 2026-04-03 08:28:19.882272 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:28:19.882283 | orchestrator | Friday 03 April 2026 08:27:45 +0000 (0:00:01.153) 0:40:58.237 ********** 2026-04-03 08:28:19.882294 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-03 08:28:19.882305 | orchestrator | 2026-04-03 08:28:19.882317 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:28:19.882331 | orchestrator | Friday 03 April 2026 08:27:46 +0000 (0:00:01.140) 0:40:59.378 ********** 2026-04-03 08:28:19.882345 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882358 | orchestrator | 2026-04-03 08:28:19.882371 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:28:19.882400 | orchestrator | Friday 03 April 2026 08:27:47 +0000 (0:00:01.144) 0:41:00.522 ********** 2026-04-03 08:28:19.882414 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882427 | orchestrator | 2026-04-03 08:28:19.882439 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:28:19.882451 | orchestrator | Friday 03 April 2026 08:27:48 +0000 (0:00:01.120) 0:41:01.642 ********** 2026-04-03 08:28:19.882464 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882477 | orchestrator | 2026-04-03 08:28:19.882489 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:28:19.882520 | orchestrator | Friday 03 April 2026 08:27:49 +0000 (0:00:01.150) 0:41:02.794 ********** 2026-04-03 08:28:19.882534 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.882547 | orchestrator | 2026-04-03 08:28:19.882559 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:28:19.882572 | orchestrator | Friday 03 April 2026 08:27:51 +0000 (0:00:01.261) 0:41:04.055 ********** 2026-04-03 08:28:19.882585 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:28:19.882597 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:28:19.882610 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:28:19.882646 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882659 | orchestrator | 2026-04-03 08:28:19.882672 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:28:19.882685 | orchestrator | Friday 03 April 2026 08:27:53 +0000 (0:00:01.824) 0:41:05.879 ********** 2026-04-03 08:28:19.882696 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:28:19.882707 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:28:19.882717 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:28:19.882728 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882738 | orchestrator | 2026-04-03 08:28:19.882749 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:28:19.882760 | orchestrator | Friday 03 April 2026 08:27:54 +0000 (0:00:01.388) 0:41:07.267 ********** 2026-04-03 08:28:19.882771 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:28:19.882781 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:28:19.882792 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:28:19.882803 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.882814 | orchestrator | 2026-04-03 08:28:19.882825 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:28:19.882836 | orchestrator | Friday 03 April 2026 08:27:55 +0000 (0:00:01.515) 0:41:08.783 ********** 2026-04-03 08:28:19.882847 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.882857 | orchestrator | 2026-04-03 08:28:19.882868 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:28:19.882879 | orchestrator | Friday 03 April 2026 08:27:57 +0000 (0:00:01.183) 0:41:09.966 ********** 2026-04-03 08:28:19.882890 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:28:19.882901 | orchestrator | 2026-04-03 08:28:19.882911 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:28:19.882922 | orchestrator | Friday 03 April 2026 08:27:58 +0000 (0:00:01.388) 0:41:11.355 ********** 2026-04-03 08:28:19.882951 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:28:19.882963 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:28:19.882973 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:28:19.882984 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:28:19.882995 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:28:19.883006 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:28:19.883016 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:28:19.883027 | orchestrator | 2026-04-03 08:28:19.883037 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:28:19.883048 | orchestrator | Friday 03 April 2026 08:28:00 +0000 (0:00:01.815) 0:41:13.171 ********** 2026-04-03 08:28:19.883059 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:28:19.883069 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:28:19.883080 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:28:19.883090 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:28:19.883101 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:28:19.883112 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:28:19.883122 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:28:19.883133 | orchestrator | 2026-04-03 08:28:19.883144 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-03 08:28:19.883162 | orchestrator | Friday 03 April 2026 08:28:02 +0000 (0:00:02.248) 0:41:15.420 ********** 2026-04-03 08:28:19.883173 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883183 | orchestrator | 2026-04-03 08:28:19.883194 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-03 08:28:19.883205 | orchestrator | Friday 03 April 2026 08:28:03 +0000 (0:00:01.131) 0:41:16.551 ********** 2026-04-03 08:28:19.883216 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883226 | orchestrator | 2026-04-03 08:28:19.883237 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-03 08:28:19.883254 | orchestrator | Friday 03 April 2026 08:28:04 +0000 (0:00:00.795) 0:41:17.346 ********** 2026-04-03 08:28:19.883265 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883276 | orchestrator | 2026-04-03 08:28:19.883287 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-03 08:28:19.883297 | orchestrator | Friday 03 April 2026 08:28:05 +0000 (0:00:00.913) 0:41:18.260 ********** 2026-04-03 08:28:19.883308 | orchestrator | changed: [testbed-node-4] => (item=0) 2026-04-03 08:28:19.883319 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-03 08:28:19.883330 | orchestrator | 2026-04-03 08:28:19.883341 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:28:19.883352 | orchestrator | Friday 03 April 2026 08:28:09 +0000 (0:00:03.767) 0:41:22.027 ********** 2026-04-03 08:28:19.883362 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-03 08:28:19.883373 | orchestrator | 2026-04-03 08:28:19.883384 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:28:19.883395 | orchestrator | Friday 03 April 2026 08:28:10 +0000 (0:00:01.359) 0:41:23.386 ********** 2026-04-03 08:28:19.883406 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-03 08:28:19.883416 | orchestrator | 2026-04-03 08:28:19.883427 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:28:19.883438 | orchestrator | Friday 03 April 2026 08:28:11 +0000 (0:00:01.122) 0:41:24.509 ********** 2026-04-03 08:28:19.883449 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.883460 | orchestrator | 2026-04-03 08:28:19.883471 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:28:19.883481 | orchestrator | Friday 03 April 2026 08:28:12 +0000 (0:00:01.152) 0:41:25.662 ********** 2026-04-03 08:28:19.883492 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883520 | orchestrator | 2026-04-03 08:28:19.883532 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:28:19.883542 | orchestrator | Friday 03 April 2026 08:28:14 +0000 (0:00:01.499) 0:41:27.162 ********** 2026-04-03 08:28:19.883553 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883564 | orchestrator | 2026-04-03 08:28:19.883574 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:28:19.883585 | orchestrator | Friday 03 April 2026 08:28:15 +0000 (0:00:01.572) 0:41:28.734 ********** 2026-04-03 08:28:19.883596 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:28:19.883606 | orchestrator | 2026-04-03 08:28:19.883617 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:28:19.883628 | orchestrator | Friday 03 April 2026 08:28:17 +0000 (0:00:01.565) 0:41:30.300 ********** 2026-04-03 08:28:19.883638 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.883649 | orchestrator | 2026-04-03 08:28:19.883660 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:28:19.883671 | orchestrator | Friday 03 April 2026 08:28:18 +0000 (0:00:01.139) 0:41:31.439 ********** 2026-04-03 08:28:19.883681 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.883692 | orchestrator | 2026-04-03 08:28:19.883703 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:28:19.883714 | orchestrator | Friday 03 April 2026 08:28:19 +0000 (0:00:01.142) 0:41:32.582 ********** 2026-04-03 08:28:19.883731 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:28:19.883742 | orchestrator | 2026-04-03 08:28:19.883760 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:29:00.347423 | orchestrator | Friday 03 April 2026 08:28:20 +0000 (0:00:01.186) 0:41:33.768 ********** 2026-04-03 08:29:00.347569 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.347594 | orchestrator | 2026-04-03 08:29:00.347610 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:29:00.347624 | orchestrator | Friday 03 April 2026 08:28:22 +0000 (0:00:01.525) 0:41:35.294 ********** 2026-04-03 08:29:00.347654 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.347668 | orchestrator | 2026-04-03 08:29:00.347682 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:29:00.347695 | orchestrator | Friday 03 April 2026 08:28:24 +0000 (0:00:01.595) 0:41:36.889 ********** 2026-04-03 08:29:00.347709 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.347725 | orchestrator | 2026-04-03 08:29:00.347740 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:29:00.347755 | orchestrator | Friday 03 April 2026 08:28:24 +0000 (0:00:00.801) 0:41:37.691 ********** 2026-04-03 08:29:00.347769 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.347783 | orchestrator | 2026-04-03 08:29:00.347797 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:29:00.347811 | orchestrator | Friday 03 April 2026 08:28:25 +0000 (0:00:00.884) 0:41:38.576 ********** 2026-04-03 08:29:00.347825 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.347840 | orchestrator | 2026-04-03 08:29:00.347854 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:29:00.347869 | orchestrator | Friday 03 April 2026 08:28:26 +0000 (0:00:00.834) 0:41:39.410 ********** 2026-04-03 08:29:00.347884 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.347898 | orchestrator | 2026-04-03 08:29:00.347914 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:29:00.347929 | orchestrator | Friday 03 April 2026 08:28:27 +0000 (0:00:00.849) 0:41:40.259 ********** 2026-04-03 08:29:00.347944 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.347959 | orchestrator | 2026-04-03 08:29:00.347973 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:29:00.347987 | orchestrator | Friday 03 April 2026 08:28:28 +0000 (0:00:00.794) 0:41:41.054 ********** 2026-04-03 08:29:00.348003 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348017 | orchestrator | 2026-04-03 08:29:00.348032 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:29:00.348048 | orchestrator | Friday 03 April 2026 08:28:28 +0000 (0:00:00.773) 0:41:41.828 ********** 2026-04-03 08:29:00.348062 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348078 | orchestrator | 2026-04-03 08:29:00.348110 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:29:00.348132 | orchestrator | Friday 03 April 2026 08:28:29 +0000 (0:00:00.840) 0:41:42.668 ********** 2026-04-03 08:29:00.348146 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348161 | orchestrator | 2026-04-03 08:29:00.348177 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:29:00.348193 | orchestrator | Friday 03 April 2026 08:28:30 +0000 (0:00:00.831) 0:41:43.500 ********** 2026-04-03 08:29:00.348208 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.348223 | orchestrator | 2026-04-03 08:29:00.348239 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:29:00.348254 | orchestrator | Friday 03 April 2026 08:28:31 +0000 (0:00:00.792) 0:41:44.292 ********** 2026-04-03 08:29:00.348271 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.348287 | orchestrator | 2026-04-03 08:29:00.348302 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:29:00.348317 | orchestrator | Friday 03 April 2026 08:28:32 +0000 (0:00:00.915) 0:41:45.208 ********** 2026-04-03 08:29:00.348357 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348374 | orchestrator | 2026-04-03 08:29:00.348391 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:29:00.348406 | orchestrator | Friday 03 April 2026 08:28:33 +0000 (0:00:00.779) 0:41:45.988 ********** 2026-04-03 08:29:00.348422 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348436 | orchestrator | 2026-04-03 08:29:00.348451 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:29:00.348467 | orchestrator | Friday 03 April 2026 08:28:33 +0000 (0:00:00.789) 0:41:46.777 ********** 2026-04-03 08:29:00.348482 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348497 | orchestrator | 2026-04-03 08:29:00.348540 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:29:00.348554 | orchestrator | Friday 03 April 2026 08:28:34 +0000 (0:00:00.777) 0:41:47.555 ********** 2026-04-03 08:29:00.348567 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348579 | orchestrator | 2026-04-03 08:29:00.348592 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:29:00.348606 | orchestrator | Friday 03 April 2026 08:28:35 +0000 (0:00:00.779) 0:41:48.335 ********** 2026-04-03 08:29:00.348620 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348632 | orchestrator | 2026-04-03 08:29:00.348645 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:29:00.348657 | orchestrator | Friday 03 April 2026 08:28:36 +0000 (0:00:00.820) 0:41:49.156 ********** 2026-04-03 08:29:00.348671 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348685 | orchestrator | 2026-04-03 08:29:00.348698 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:29:00.348710 | orchestrator | Friday 03 April 2026 08:28:37 +0000 (0:00:00.786) 0:41:49.942 ********** 2026-04-03 08:29:00.348723 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348737 | orchestrator | 2026-04-03 08:29:00.348750 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:29:00.348766 | orchestrator | Friday 03 April 2026 08:28:37 +0000 (0:00:00.738) 0:41:50.681 ********** 2026-04-03 08:29:00.348797 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348824 | orchestrator | 2026-04-03 08:29:00.348840 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:29:00.348855 | orchestrator | Friday 03 April 2026 08:28:38 +0000 (0:00:00.770) 0:41:51.452 ********** 2026-04-03 08:29:00.348895 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348910 | orchestrator | 2026-04-03 08:29:00.348923 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:29:00.348938 | orchestrator | Friday 03 April 2026 08:28:39 +0000 (0:00:00.810) 0:41:52.262 ********** 2026-04-03 08:29:00.348953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.348968 | orchestrator | 2026-04-03 08:29:00.348982 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:29:00.348997 | orchestrator | Friday 03 April 2026 08:28:40 +0000 (0:00:00.760) 0:41:53.022 ********** 2026-04-03 08:29:00.349011 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349027 | orchestrator | 2026-04-03 08:29:00.349041 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:29:00.349055 | orchestrator | Friday 03 April 2026 08:28:40 +0000 (0:00:00.781) 0:41:53.804 ********** 2026-04-03 08:29:00.349068 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349082 | orchestrator | 2026-04-03 08:29:00.349097 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:29:00.349111 | orchestrator | Friday 03 April 2026 08:28:41 +0000 (0:00:00.829) 0:41:54.634 ********** 2026-04-03 08:29:00.349123 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.349136 | orchestrator | 2026-04-03 08:29:00.349148 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:29:00.349174 | orchestrator | Friday 03 April 2026 08:28:43 +0000 (0:00:01.550) 0:41:56.185 ********** 2026-04-03 08:29:00.349186 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.349197 | orchestrator | 2026-04-03 08:29:00.349209 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:29:00.349220 | orchestrator | Friday 03 April 2026 08:28:45 +0000 (0:00:01.847) 0:41:58.033 ********** 2026-04-03 08:29:00.349230 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-03 08:29:00.349243 | orchestrator | 2026-04-03 08:29:00.349255 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:29:00.349267 | orchestrator | Friday 03 April 2026 08:28:46 +0000 (0:00:01.188) 0:41:59.222 ********** 2026-04-03 08:29:00.349278 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349290 | orchestrator | 2026-04-03 08:29:00.349302 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:29:00.349315 | orchestrator | Friday 03 April 2026 08:28:47 +0000 (0:00:01.255) 0:42:00.478 ********** 2026-04-03 08:29:00.349327 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349340 | orchestrator | 2026-04-03 08:29:00.349352 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:29:00.349371 | orchestrator | Friday 03 April 2026 08:28:48 +0000 (0:00:01.112) 0:42:01.590 ********** 2026-04-03 08:29:00.349382 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:29:00.349393 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:29:00.349404 | orchestrator | 2026-04-03 08:29:00.349415 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:29:00.349426 | orchestrator | Friday 03 April 2026 08:28:50 +0000 (0:00:01.852) 0:42:03.442 ********** 2026-04-03 08:29:00.349437 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.349450 | orchestrator | 2026-04-03 08:29:00.349461 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:29:00.349473 | orchestrator | Friday 03 April 2026 08:28:52 +0000 (0:00:01.434) 0:42:04.877 ********** 2026-04-03 08:29:00.349485 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349497 | orchestrator | 2026-04-03 08:29:00.349553 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:29:00.349568 | orchestrator | Friday 03 April 2026 08:28:53 +0000 (0:00:01.243) 0:42:06.121 ********** 2026-04-03 08:29:00.349580 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349593 | orchestrator | 2026-04-03 08:29:00.349605 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:29:00.349617 | orchestrator | Friday 03 April 2026 08:28:54 +0000 (0:00:00.807) 0:42:06.928 ********** 2026-04-03 08:29:00.349629 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349641 | orchestrator | 2026-04-03 08:29:00.349653 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:29:00.349664 | orchestrator | Friday 03 April 2026 08:28:54 +0000 (0:00:00.786) 0:42:07.714 ********** 2026-04-03 08:29:00.349677 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-03 08:29:00.349689 | orchestrator | 2026-04-03 08:29:00.349703 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:29:00.349717 | orchestrator | Friday 03 April 2026 08:28:56 +0000 (0:00:01.187) 0:42:08.902 ********** 2026-04-03 08:29:00.349730 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:00.349743 | orchestrator | 2026-04-03 08:29:00.349755 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:29:00.349768 | orchestrator | Friday 03 April 2026 08:28:57 +0000 (0:00:01.846) 0:42:10.749 ********** 2026-04-03 08:29:00.349779 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:29:00.349791 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:29:00.349813 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:29:00.349827 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349840 | orchestrator | 2026-04-03 08:29:00.349853 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:29:00.349867 | orchestrator | Friday 03 April 2026 08:28:59 +0000 (0:00:01.219) 0:42:11.969 ********** 2026-04-03 08:29:00.349880 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:00.349892 | orchestrator | 2026-04-03 08:29:00.349904 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:29:00.349917 | orchestrator | Friday 03 April 2026 08:29:00 +0000 (0:00:01.129) 0:42:13.098 ********** 2026-04-03 08:29:00.349940 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979150 | orchestrator | 2026-04-03 08:29:44.979265 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:29:44.979282 | orchestrator | Friday 03 April 2026 08:29:01 +0000 (0:00:01.196) 0:42:14.295 ********** 2026-04-03 08:29:44.979294 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979307 | orchestrator | 2026-04-03 08:29:44.979321 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:29:44.979340 | orchestrator | Friday 03 April 2026 08:29:02 +0000 (0:00:01.220) 0:42:15.515 ********** 2026-04-03 08:29:44.979359 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979378 | orchestrator | 2026-04-03 08:29:44.979398 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:29:44.979417 | orchestrator | Friday 03 April 2026 08:29:03 +0000 (0:00:01.140) 0:42:16.656 ********** 2026-04-03 08:29:44.979434 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979447 | orchestrator | 2026-04-03 08:29:44.979458 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:29:44.979469 | orchestrator | Friday 03 April 2026 08:29:04 +0000 (0:00:00.802) 0:42:17.459 ********** 2026-04-03 08:29:44.979481 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:44.979493 | orchestrator | 2026-04-03 08:29:44.979504 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:29:44.979569 | orchestrator | Friday 03 April 2026 08:29:06 +0000 (0:00:02.131) 0:42:19.591 ********** 2026-04-03 08:29:44.979581 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:44.979592 | orchestrator | 2026-04-03 08:29:44.979603 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:29:44.979614 | orchestrator | Friday 03 April 2026 08:29:07 +0000 (0:00:00.787) 0:42:20.378 ********** 2026-04-03 08:29:44.979625 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-03 08:29:44.979636 | orchestrator | 2026-04-03 08:29:44.979647 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:29:44.979658 | orchestrator | Friday 03 April 2026 08:29:08 +0000 (0:00:01.135) 0:42:21.514 ********** 2026-04-03 08:29:44.979668 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979679 | orchestrator | 2026-04-03 08:29:44.979691 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:29:44.979704 | orchestrator | Friday 03 April 2026 08:29:09 +0000 (0:00:01.194) 0:42:22.709 ********** 2026-04-03 08:29:44.979717 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979730 | orchestrator | 2026-04-03 08:29:44.979758 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:29:44.979772 | orchestrator | Friday 03 April 2026 08:29:11 +0000 (0:00:01.223) 0:42:23.933 ********** 2026-04-03 08:29:44.979784 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979797 | orchestrator | 2026-04-03 08:29:44.979809 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:29:44.979821 | orchestrator | Friday 03 April 2026 08:29:12 +0000 (0:00:01.177) 0:42:25.110 ********** 2026-04-03 08:29:44.979835 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979848 | orchestrator | 2026-04-03 08:29:44.979861 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:29:44.979894 | orchestrator | Friday 03 April 2026 08:29:13 +0000 (0:00:01.155) 0:42:26.266 ********** 2026-04-03 08:29:44.979907 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979919 | orchestrator | 2026-04-03 08:29:44.979932 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:29:44.979945 | orchestrator | Friday 03 April 2026 08:29:14 +0000 (0:00:01.315) 0:42:27.581 ********** 2026-04-03 08:29:44.979957 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.979969 | orchestrator | 2026-04-03 08:29:44.979982 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:29:44.979995 | orchestrator | Friday 03 April 2026 08:29:15 +0000 (0:00:01.146) 0:42:28.728 ********** 2026-04-03 08:29:44.980008 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980021 | orchestrator | 2026-04-03 08:29:44.980034 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:29:44.980046 | orchestrator | Friday 03 April 2026 08:29:17 +0000 (0:00:01.202) 0:42:29.931 ********** 2026-04-03 08:29:44.980057 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980068 | orchestrator | 2026-04-03 08:29:44.980079 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:29:44.980089 | orchestrator | Friday 03 April 2026 08:29:18 +0000 (0:00:01.131) 0:42:31.063 ********** 2026-04-03 08:29:44.980100 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:44.980111 | orchestrator | 2026-04-03 08:29:44.980121 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:29:44.980132 | orchestrator | Friday 03 April 2026 08:29:18 +0000 (0:00:00.795) 0:42:31.858 ********** 2026-04-03 08:29:44.980143 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-03 08:29:44.980155 | orchestrator | 2026-04-03 08:29:44.980166 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:29:44.980176 | orchestrator | Friday 03 April 2026 08:29:20 +0000 (0:00:01.122) 0:42:32.981 ********** 2026-04-03 08:29:44.980187 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-03 08:29:44.980199 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-03 08:29:44.980210 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-03 08:29:44.980220 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-03 08:29:44.980231 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-03 08:29:44.980242 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-03 08:29:44.980252 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-03 08:29:44.980263 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:29:44.980274 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:29:44.980303 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:29:44.980315 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:29:44.980326 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:29:44.980336 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:29:44.980347 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:29:44.980358 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-03 08:29:44.980369 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-03 08:29:44.980379 | orchestrator | 2026-04-03 08:29:44.980391 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:29:44.980402 | orchestrator | Friday 03 April 2026 08:29:26 +0000 (0:00:06.165) 0:42:39.146 ********** 2026-04-03 08:29:44.980412 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-03 08:29:44.980423 | orchestrator | 2026-04-03 08:29:44.980434 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:29:44.980452 | orchestrator | Friday 03 April 2026 08:29:27 +0000 (0:00:01.123) 0:42:40.271 ********** 2026-04-03 08:29:44.980463 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:29:44.980475 | orchestrator | 2026-04-03 08:29:44.980486 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:29:44.980496 | orchestrator | Friday 03 April 2026 08:29:28 +0000 (0:00:01.521) 0:42:41.792 ********** 2026-04-03 08:29:44.980507 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:29:44.980557 | orchestrator | 2026-04-03 08:29:44.980568 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:29:44.980579 | orchestrator | Friday 03 April 2026 08:29:30 +0000 (0:00:01.678) 0:42:43.470 ********** 2026-04-03 08:29:44.980589 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980600 | orchestrator | 2026-04-03 08:29:44.980611 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:29:44.980621 | orchestrator | Friday 03 April 2026 08:29:31 +0000 (0:00:00.839) 0:42:44.310 ********** 2026-04-03 08:29:44.980632 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980642 | orchestrator | 2026-04-03 08:29:44.980659 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:29:44.980670 | orchestrator | Friday 03 April 2026 08:29:32 +0000 (0:00:00.842) 0:42:45.152 ********** 2026-04-03 08:29:44.980681 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980692 | orchestrator | 2026-04-03 08:29:44.980702 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:29:44.980713 | orchestrator | Friday 03 April 2026 08:29:33 +0000 (0:00:00.805) 0:42:45.958 ********** 2026-04-03 08:29:44.980724 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980734 | orchestrator | 2026-04-03 08:29:44.980745 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:29:44.980756 | orchestrator | Friday 03 April 2026 08:29:33 +0000 (0:00:00.842) 0:42:46.801 ********** 2026-04-03 08:29:44.980766 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980777 | orchestrator | 2026-04-03 08:29:44.980788 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:29:44.980799 | orchestrator | Friday 03 April 2026 08:29:34 +0000 (0:00:00.811) 0:42:47.612 ********** 2026-04-03 08:29:44.980809 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980820 | orchestrator | 2026-04-03 08:29:44.980831 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:29:44.980842 | orchestrator | Friday 03 April 2026 08:29:35 +0000 (0:00:00.857) 0:42:48.469 ********** 2026-04-03 08:29:44.980852 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980863 | orchestrator | 2026-04-03 08:29:44.980874 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:29:44.980885 | orchestrator | Friday 03 April 2026 08:29:36 +0000 (0:00:00.814) 0:42:49.284 ********** 2026-04-03 08:29:44.980896 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980906 | orchestrator | 2026-04-03 08:29:44.980917 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:29:44.980928 | orchestrator | Friday 03 April 2026 08:29:37 +0000 (0:00:00.798) 0:42:50.082 ********** 2026-04-03 08:29:44.980938 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980949 | orchestrator | 2026-04-03 08:29:44.980960 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:29:44.980971 | orchestrator | Friday 03 April 2026 08:29:37 +0000 (0:00:00.768) 0:42:50.851 ********** 2026-04-03 08:29:44.980981 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:29:44.980992 | orchestrator | 2026-04-03 08:29:44.981003 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:29:44.981021 | orchestrator | Friday 03 April 2026 08:29:38 +0000 (0:00:00.832) 0:42:51.684 ********** 2026-04-03 08:29:44.981032 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:29:44.981043 | orchestrator | 2026-04-03 08:29:44.981054 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:29:44.981064 | orchestrator | Friday 03 April 2026 08:29:39 +0000 (0:00:00.887) 0:42:52.571 ********** 2026-04-03 08:29:44.981075 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:29:44.981086 | orchestrator | 2026-04-03 08:29:44.981097 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:29:44.981108 | orchestrator | Friday 03 April 2026 08:29:44 +0000 (0:00:05.160) 0:42:57.732 ********** 2026-04-03 08:29:44.981126 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:30:26.697140 | orchestrator | 2026-04-03 08:30:26.697278 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:30:26.697306 | orchestrator | Friday 03 April 2026 08:29:45 +0000 (0:00:00.866) 0:42:58.599 ********** 2026-04-03 08:30:26.697327 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-03 08:30:26.697350 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-03 08:30:26.697368 | orchestrator | 2026-04-03 08:30:26.697386 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:30:26.697403 | orchestrator | Friday 03 April 2026 08:29:53 +0000 (0:00:07.346) 0:43:05.945 ********** 2026-04-03 08:30:26.697420 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697438 | orchestrator | 2026-04-03 08:30:26.697456 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:30:26.697473 | orchestrator | Friday 03 April 2026 08:29:53 +0000 (0:00:00.773) 0:43:06.719 ********** 2026-04-03 08:30:26.697489 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697506 | orchestrator | 2026-04-03 08:30:26.697550 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:30:26.697570 | orchestrator | Friday 03 April 2026 08:29:54 +0000 (0:00:00.818) 0:43:07.537 ********** 2026-04-03 08:30:26.697585 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697602 | orchestrator | 2026-04-03 08:30:26.697618 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:30:26.697634 | orchestrator | Friday 03 April 2026 08:29:55 +0000 (0:00:00.908) 0:43:08.446 ********** 2026-04-03 08:30:26.697649 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697664 | orchestrator | 2026-04-03 08:30:26.697702 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:30:26.697720 | orchestrator | Friday 03 April 2026 08:29:56 +0000 (0:00:00.801) 0:43:09.247 ********** 2026-04-03 08:30:26.697737 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697754 | orchestrator | 2026-04-03 08:30:26.697771 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:30:26.697788 | orchestrator | Friday 03 April 2026 08:29:57 +0000 (0:00:00.787) 0:43:10.035 ********** 2026-04-03 08:30:26.697801 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.697811 | orchestrator | 2026-04-03 08:30:26.697821 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:30:26.697831 | orchestrator | Friday 03 April 2026 08:29:58 +0000 (0:00:00.890) 0:43:10.926 ********** 2026-04-03 08:30:26.697866 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:30:26.697877 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:30:26.697887 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:30:26.697897 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697906 | orchestrator | 2026-04-03 08:30:26.697916 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:30:26.697926 | orchestrator | Friday 03 April 2026 08:29:59 +0000 (0:00:01.081) 0:43:12.008 ********** 2026-04-03 08:30:26.697935 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:30:26.697945 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:30:26.697954 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:30:26.697964 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.697973 | orchestrator | 2026-04-03 08:30:26.697983 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:30:26.697992 | orchestrator | Friday 03 April 2026 08:30:00 +0000 (0:00:01.102) 0:43:13.110 ********** 2026-04-03 08:30:26.698002 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:30:26.698011 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:30:26.698084 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:30:26.698094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.698104 | orchestrator | 2026-04-03 08:30:26.698113 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:30:26.698123 | orchestrator | Friday 03 April 2026 08:30:01 +0000 (0:00:01.080) 0:43:14.190 ********** 2026-04-03 08:30:26.698133 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.698178 | orchestrator | 2026-04-03 08:30:26.698188 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:30:26.698198 | orchestrator | Friday 03 April 2026 08:30:02 +0000 (0:00:00.835) 0:43:15.026 ********** 2026-04-03 08:30:26.698207 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:30:26.698217 | orchestrator | 2026-04-03 08:30:26.698227 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:30:26.698236 | orchestrator | Friday 03 April 2026 08:30:03 +0000 (0:00:01.015) 0:43:16.041 ********** 2026-04-03 08:30:26.698246 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.698255 | orchestrator | 2026-04-03 08:30:26.698265 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-03 08:30:26.698276 | orchestrator | Friday 03 April 2026 08:30:04 +0000 (0:00:01.443) 0:43:17.485 ********** 2026-04-03 08:30:26.698292 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.698309 | orchestrator | 2026-04-03 08:30:26.698350 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:30:26.698367 | orchestrator | Friday 03 April 2026 08:30:05 +0000 (0:00:00.782) 0:43:18.267 ********** 2026-04-03 08:30:26.698383 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:30:26.698399 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:30:26.698415 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:30:26.698430 | orchestrator | 2026-04-03 08:30:26.698447 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-03 08:30:26.698462 | orchestrator | Friday 03 April 2026 08:30:07 +0000 (0:00:01.658) 0:43:19.926 ********** 2026-04-03 08:30:26.698480 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-4 2026-04-03 08:30:26.698497 | orchestrator | 2026-04-03 08:30:26.698542 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-03 08:30:26.698555 | orchestrator | Friday 03 April 2026 08:30:08 +0000 (0:00:01.115) 0:43:21.042 ********** 2026-04-03 08:30:26.698577 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.698586 | orchestrator | 2026-04-03 08:30:26.698596 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-03 08:30:26.698605 | orchestrator | Friday 03 April 2026 08:30:09 +0000 (0:00:01.147) 0:43:22.189 ********** 2026-04-03 08:30:26.698615 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.698624 | orchestrator | 2026-04-03 08:30:26.698634 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-03 08:30:26.698644 | orchestrator | Friday 03 April 2026 08:30:10 +0000 (0:00:01.266) 0:43:23.456 ********** 2026-04-03 08:30:26.698653 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.698663 | orchestrator | 2026-04-03 08:30:26.698672 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-03 08:30:26.698682 | orchestrator | Friday 03 April 2026 08:30:12 +0000 (0:00:01.443) 0:43:24.900 ********** 2026-04-03 08:30:26.698691 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.698700 | orchestrator | 2026-04-03 08:30:26.698710 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-03 08:30:26.698719 | orchestrator | Friday 03 April 2026 08:30:13 +0000 (0:00:01.193) 0:43:26.093 ********** 2026-04-03 08:30:26.698736 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 08:30:26.698747 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 08:30:26.698757 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 08:30:26.698766 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 08:30:26.698776 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 08:30:26.698785 | orchestrator | 2026-04-03 08:30:26.698795 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-03 08:30:26.698804 | orchestrator | Friday 03 April 2026 08:30:15 +0000 (0:00:02.519) 0:43:28.613 ********** 2026-04-03 08:30:26.698813 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.698823 | orchestrator | 2026-04-03 08:30:26.698833 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-03 08:30:26.698842 | orchestrator | Friday 03 April 2026 08:30:16 +0000 (0:00:00.784) 0:43:29.398 ********** 2026-04-03 08:30:26.698851 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-4 2026-04-03 08:30:26.698861 | orchestrator | 2026-04-03 08:30:26.698870 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-03 08:30:26.698880 | orchestrator | Friday 03 April 2026 08:30:17 +0000 (0:00:01.133) 0:43:30.531 ********** 2026-04-03 08:30:26.698889 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 08:30:26.698899 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-03 08:30:26.698908 | orchestrator | 2026-04-03 08:30:26.698918 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-03 08:30:26.698927 | orchestrator | Friday 03 April 2026 08:30:19 +0000 (0:00:01.778) 0:43:32.310 ********** 2026-04-03 08:30:26.698937 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:30:26.698947 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:30:26.698956 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:30:26.698966 | orchestrator | 2026-04-03 08:30:26.698976 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:30:26.698985 | orchestrator | Friday 03 April 2026 08:30:23 +0000 (0:00:03.701) 0:43:36.012 ********** 2026-04-03 08:30:26.698995 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 08:30:26.699004 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:30:26.699014 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:30:26.699024 | orchestrator | 2026-04-03 08:30:26.699033 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-03 08:30:26.699049 | orchestrator | Friday 03 April 2026 08:30:24 +0000 (0:00:01.687) 0:43:37.700 ********** 2026-04-03 08:30:26.699059 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.699068 | orchestrator | 2026-04-03 08:30:26.699078 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-03 08:30:26.699087 | orchestrator | Friday 03 April 2026 08:30:25 +0000 (0:00:00.909) 0:43:38.610 ********** 2026-04-03 08:30:26.699097 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.699106 | orchestrator | 2026-04-03 08:30:26.699116 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-03 08:30:26.699125 | orchestrator | Friday 03 April 2026 08:30:26 +0000 (0:00:00.785) 0:43:39.395 ********** 2026-04-03 08:30:26.699135 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:30:26.699144 | orchestrator | 2026-04-03 08:30:26.699162 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-03 08:31:31.070371 | orchestrator | Friday 03 April 2026 08:30:27 +0000 (0:00:00.804) 0:43:40.200 ********** 2026-04-03 08:31:31.070484 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-4 2026-04-03 08:31:31.070500 | orchestrator | 2026-04-03 08:31:31.070514 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-03 08:31:31.070596 | orchestrator | Friday 03 April 2026 08:30:28 +0000 (0:00:01.096) 0:43:41.297 ********** 2026-04-03 08:31:31.070608 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:31:31.070620 | orchestrator | 2026-04-03 08:31:31.070632 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-03 08:31:31.070643 | orchestrator | Friday 03 April 2026 08:30:29 +0000 (0:00:01.475) 0:43:42.773 ********** 2026-04-03 08:31:31.070654 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:31:31.070665 | orchestrator | 2026-04-03 08:31:31.070676 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-03 08:31:31.070687 | orchestrator | Friday 03 April 2026 08:30:33 +0000 (0:00:03.347) 0:43:46.120 ********** 2026-04-03 08:31:31.070698 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-4 2026-04-03 08:31:31.070709 | orchestrator | 2026-04-03 08:31:31.070720 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-03 08:31:31.070731 | orchestrator | Friday 03 April 2026 08:30:34 +0000 (0:00:01.148) 0:43:47.268 ********** 2026-04-03 08:31:31.070741 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:31:31.070752 | orchestrator | 2026-04-03 08:31:31.070763 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-03 08:31:31.070774 | orchestrator | Friday 03 April 2026 08:30:36 +0000 (0:00:01.906) 0:43:49.175 ********** 2026-04-03 08:31:31.070785 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:31:31.070796 | orchestrator | 2026-04-03 08:31:31.070807 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-03 08:31:31.070817 | orchestrator | Friday 03 April 2026 08:30:38 +0000 (0:00:01.956) 0:43:51.132 ********** 2026-04-03 08:31:31.070828 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:31:31.070839 | orchestrator | 2026-04-03 08:31:31.070850 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-03 08:31:31.070860 | orchestrator | Friday 03 April 2026 08:30:40 +0000 (0:00:02.313) 0:43:53.445 ********** 2026-04-03 08:31:31.070871 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.070883 | orchestrator | 2026-04-03 08:31:31.070915 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-03 08:31:31.070935 | orchestrator | Friday 03 April 2026 08:30:41 +0000 (0:00:01.144) 0:43:54.589 ********** 2026-04-03 08:31:31.070954 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.070974 | orchestrator | 2026-04-03 08:31:31.070994 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-03 08:31:31.071013 | orchestrator | Friday 03 April 2026 08:30:42 +0000 (0:00:01.225) 0:43:55.815 ********** 2026-04-03 08:31:31.071033 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:31:31.071070 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-03 08:31:31.071081 | orchestrator | 2026-04-03 08:31:31.071092 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-03 08:31:31.071103 | orchestrator | Friday 03 April 2026 08:30:44 +0000 (0:00:01.806) 0:43:57.622 ********** 2026-04-03 08:31:31.071114 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:31:31.071125 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-03 08:31:31.071135 | orchestrator | 2026-04-03 08:31:31.071146 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-03 08:31:31.071157 | orchestrator | Friday 03 April 2026 08:30:47 +0000 (0:00:02.933) 0:44:00.555 ********** 2026-04-03 08:31:31.071167 | orchestrator | changed: [testbed-node-4] => (item=0) 2026-04-03 08:31:31.071179 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-03 08:31:31.071189 | orchestrator | 2026-04-03 08:31:31.071200 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-03 08:31:31.071211 | orchestrator | Friday 03 April 2026 08:30:51 +0000 (0:00:04.248) 0:44:04.804 ********** 2026-04-03 08:31:31.071222 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.071232 | orchestrator | 2026-04-03 08:31:31.071243 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-03 08:31:31.071254 | orchestrator | Friday 03 April 2026 08:30:52 +0000 (0:00:00.906) 0:44:05.711 ********** 2026-04-03 08:31:31.071265 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.071275 | orchestrator | 2026-04-03 08:31:31.071286 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-03 08:31:31.071297 | orchestrator | Friday 03 April 2026 08:30:53 +0000 (0:00:00.888) 0:44:06.599 ********** 2026-04-03 08:31:31.071308 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.071318 | orchestrator | 2026-04-03 08:31:31.071330 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-03 08:31:31.071341 | orchestrator | Friday 03 April 2026 08:30:54 +0000 (0:00:00.981) 0:44:07.580 ********** 2026-04-03 08:31:31.071352 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.071362 | orchestrator | 2026-04-03 08:31:31.071374 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-03 08:31:31.071385 | orchestrator | Friday 03 April 2026 08:30:55 +0000 (0:00:00.828) 0:44:08.409 ********** 2026-04-03 08:31:31.071396 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:31:31.071406 | orchestrator | 2026-04-03 08:31:31.071417 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-03 08:31:31.071428 | orchestrator | Friday 03 April 2026 08:30:56 +0000 (0:00:00.785) 0:44:09.195 ********** 2026-04-03 08:31:31.071439 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-03 08:31:31.071451 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-03 08:31:31.071462 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-03 08:31:31.071491 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (597 retries left). 2026-04-03 08:31:31.071502 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:31:31.071513 | orchestrator | 2026-04-03 08:31:31.071554 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-03 08:31:31.071565 | orchestrator | 2026-04-03 08:31:31.071576 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:31:31.071588 | orchestrator | Friday 03 April 2026 08:31:10 +0000 (0:00:14.240) 0:44:23.436 ********** 2026-04-03 08:31:31.071598 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-03 08:31:31.071609 | orchestrator | 2026-04-03 08:31:31.071620 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:31:31.071630 | orchestrator | Friday 03 April 2026 08:31:11 +0000 (0:00:01.320) 0:44:24.757 ********** 2026-04-03 08:31:31.071649 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071660 | orchestrator | 2026-04-03 08:31:31.071671 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:31:31.071682 | orchestrator | Friday 03 April 2026 08:31:13 +0000 (0:00:01.479) 0:44:26.236 ********** 2026-04-03 08:31:31.071693 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071703 | orchestrator | 2026-04-03 08:31:31.071714 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:31:31.071725 | orchestrator | Friday 03 April 2026 08:31:14 +0000 (0:00:01.126) 0:44:27.362 ********** 2026-04-03 08:31:31.071735 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071746 | orchestrator | 2026-04-03 08:31:31.071757 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:31:31.071768 | orchestrator | Friday 03 April 2026 08:31:15 +0000 (0:00:01.438) 0:44:28.801 ********** 2026-04-03 08:31:31.071779 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071789 | orchestrator | 2026-04-03 08:31:31.071800 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:31:31.071811 | orchestrator | Friday 03 April 2026 08:31:17 +0000 (0:00:01.134) 0:44:29.936 ********** 2026-04-03 08:31:31.071822 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071833 | orchestrator | 2026-04-03 08:31:31.071843 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:31:31.071854 | orchestrator | Friday 03 April 2026 08:31:18 +0000 (0:00:01.154) 0:44:31.090 ********** 2026-04-03 08:31:31.071865 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071875 | orchestrator | 2026-04-03 08:31:31.071893 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:31:31.071904 | orchestrator | Friday 03 April 2026 08:31:19 +0000 (0:00:01.152) 0:44:32.243 ********** 2026-04-03 08:31:31.071915 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:31.071926 | orchestrator | 2026-04-03 08:31:31.071937 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:31:31.071953 | orchestrator | Friday 03 April 2026 08:31:20 +0000 (0:00:01.175) 0:44:33.419 ********** 2026-04-03 08:31:31.071972 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.071991 | orchestrator | 2026-04-03 08:31:31.072011 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:31:31.072030 | orchestrator | Friday 03 April 2026 08:31:21 +0000 (0:00:01.112) 0:44:34.531 ********** 2026-04-03 08:31:31.072049 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:31:31.072063 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:31:31.072073 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:31:31.072084 | orchestrator | 2026-04-03 08:31:31.072095 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:31:31.072106 | orchestrator | Friday 03 April 2026 08:31:23 +0000 (0:00:02.021) 0:44:36.553 ********** 2026-04-03 08:31:31.072117 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:31.072127 | orchestrator | 2026-04-03 08:31:31.072138 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:31:31.072149 | orchestrator | Friday 03 April 2026 08:31:24 +0000 (0:00:01.271) 0:44:37.825 ********** 2026-04-03 08:31:31.072160 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:31:31.072170 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:31:31.072181 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:31:31.072192 | orchestrator | 2026-04-03 08:31:31.072202 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:31:31.072213 | orchestrator | Friday 03 April 2026 08:31:28 +0000 (0:00:03.436) 0:44:41.261 ********** 2026-04-03 08:31:31.072224 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:31:31.072242 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:31:31.072254 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:31:31.072264 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:31.072275 | orchestrator | 2026-04-03 08:31:31.072286 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:31:31.072297 | orchestrator | Friday 03 April 2026 08:31:30 +0000 (0:00:01.863) 0:44:43.125 ********** 2026-04-03 08:31:31.072309 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:31:31.072331 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:31:52.499484 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:31:52.499628 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.499642 | orchestrator | 2026-04-03 08:31:52.499651 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:31:52.499659 | orchestrator | Friday 03 April 2026 08:31:32 +0000 (0:00:02.089) 0:44:45.215 ********** 2026-04-03 08:31:52.499667 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:52.499677 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:52.499697 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:52.499704 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.499710 | orchestrator | 2026-04-03 08:31:52.499717 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:31:52.499724 | orchestrator | Friday 03 April 2026 08:31:33 +0000 (0:00:01.178) 0:44:46.393 ********** 2026-04-03 08:31:52.499731 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:31:25.605846', 'end': '2026-04-03 08:31:25.670021', 'delta': '0:00:00.064175', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:31:52.499756 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:31:26.557594', 'end': '2026-04-03 08:31:26.600678', 'delta': '0:00:00.043084', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:31:52.499776 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:31:27.163180', 'end': '2026-04-03 08:31:27.197828', 'delta': '0:00:00.034648', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:31:52.499783 | orchestrator | 2026-04-03 08:31:52.499790 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:31:52.499799 | orchestrator | Friday 03 April 2026 08:31:34 +0000 (0:00:01.303) 0:44:47.697 ********** 2026-04-03 08:31:52.499809 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.499820 | orchestrator | 2026-04-03 08:31:52.499830 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:31:52.499840 | orchestrator | Friday 03 April 2026 08:31:36 +0000 (0:00:01.310) 0:44:49.007 ********** 2026-04-03 08:31:52.499850 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.499859 | orchestrator | 2026-04-03 08:31:52.499869 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:31:52.499879 | orchestrator | Friday 03 April 2026 08:31:37 +0000 (0:00:01.276) 0:44:50.284 ********** 2026-04-03 08:31:52.499889 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.499900 | orchestrator | 2026-04-03 08:31:52.499909 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:31:52.499919 | orchestrator | Friday 03 April 2026 08:31:38 +0000 (0:00:01.138) 0:44:51.422 ********** 2026-04-03 08:31:52.499929 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:31:52.499938 | orchestrator | 2026-04-03 08:31:52.499947 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:31:52.499957 | orchestrator | Friday 03 April 2026 08:31:40 +0000 (0:00:02.109) 0:44:53.532 ********** 2026-04-03 08:31:52.499967 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.499976 | orchestrator | 2026-04-03 08:31:52.499987 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:31:52.499996 | orchestrator | Friday 03 April 2026 08:31:41 +0000 (0:00:01.153) 0:44:54.685 ********** 2026-04-03 08:31:52.500008 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500018 | orchestrator | 2026-04-03 08:31:52.500027 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:31:52.500034 | orchestrator | Friday 03 April 2026 08:31:42 +0000 (0:00:01.132) 0:44:55.818 ********** 2026-04-03 08:31:52.500040 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500047 | orchestrator | 2026-04-03 08:31:52.500054 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:31:52.500068 | orchestrator | Friday 03 April 2026 08:31:44 +0000 (0:00:01.227) 0:44:57.046 ********** 2026-04-03 08:31:52.500083 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500091 | orchestrator | 2026-04-03 08:31:52.500098 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:31:52.500105 | orchestrator | Friday 03 April 2026 08:31:45 +0000 (0:00:01.239) 0:44:58.285 ********** 2026-04-03 08:31:52.500112 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500120 | orchestrator | 2026-04-03 08:31:52.500127 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:31:52.500134 | orchestrator | Friday 03 April 2026 08:31:46 +0000 (0:00:01.142) 0:44:59.428 ********** 2026-04-03 08:31:52.500141 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.500149 | orchestrator | 2026-04-03 08:31:52.500157 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:31:52.500163 | orchestrator | Friday 03 April 2026 08:31:47 +0000 (0:00:01.179) 0:45:00.608 ********** 2026-04-03 08:31:52.500170 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500177 | orchestrator | 2026-04-03 08:31:52.500184 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:31:52.500192 | orchestrator | Friday 03 April 2026 08:31:48 +0000 (0:00:01.143) 0:45:01.752 ********** 2026-04-03 08:31:52.500199 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.500206 | orchestrator | 2026-04-03 08:31:52.500213 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:31:52.500220 | orchestrator | Friday 03 April 2026 08:31:50 +0000 (0:00:01.169) 0:45:02.922 ********** 2026-04-03 08:31:52.500227 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:52.500234 | orchestrator | 2026-04-03 08:31:52.500242 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:31:52.500250 | orchestrator | Friday 03 April 2026 08:31:51 +0000 (0:00:01.150) 0:45:04.072 ********** 2026-04-03 08:31:52.500256 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:52.500264 | orchestrator | 2026-04-03 08:31:52.500271 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:31:52.500278 | orchestrator | Friday 03 April 2026 08:31:52 +0000 (0:00:01.161) 0:45:05.233 ********** 2026-04-03 08:31:52.500286 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.500302 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}})  2026-04-03 08:31:52.615444 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:31:52.615573 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}})  2026-04-03 08:31:52.615616 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615628 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615637 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:31:52.615645 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615653 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615675 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615684 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}})  2026-04-03 08:31:52.615701 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}})  2026-04-03 08:31:52.615709 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:52.615726 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:31:54.004145 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:54.004303 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:31:54.004353 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:31:54.004382 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:54.004406 | orchestrator | 2026-04-03 08:31:54.004429 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:31:54.004451 | orchestrator | Friday 03 April 2026 08:31:53 +0000 (0:00:01.433) 0:45:06.667 ********** 2026-04-03 08:31:54.004472 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004494 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004551 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004619 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004660 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004687 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004710 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004733 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:54.004766 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.492941 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493049 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493063 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493074 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493104 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493134 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493143 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493152 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:31:59.493161 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:31:59.493171 | orchestrator | 2026-04-03 08:31:59.493180 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:31:59.493196 | orchestrator | Friday 03 April 2026 08:31:55 +0000 (0:00:01.508) 0:45:08.176 ********** 2026-04-03 08:31:59.493204 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:59.493212 | orchestrator | 2026-04-03 08:31:59.493220 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:31:59.493228 | orchestrator | Friday 03 April 2026 08:31:56 +0000 (0:00:01.526) 0:45:09.702 ********** 2026-04-03 08:31:59.493236 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:59.493243 | orchestrator | 2026-04-03 08:31:59.493251 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:31:59.493259 | orchestrator | Friday 03 April 2026 08:31:57 +0000 (0:00:01.117) 0:45:10.820 ********** 2026-04-03 08:31:59.493267 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:31:59.493274 | orchestrator | 2026-04-03 08:31:59.493282 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:31:59.493295 | orchestrator | Friday 03 April 2026 08:31:59 +0000 (0:00:01.527) 0:45:12.347 ********** 2026-04-03 08:32:41.245866 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246005 | orchestrator | 2026-04-03 08:32:41.246112 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:32:41.246134 | orchestrator | Friday 03 April 2026 08:32:00 +0000 (0:00:01.129) 0:45:13.477 ********** 2026-04-03 08:32:41.246145 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246155 | orchestrator | 2026-04-03 08:32:41.246166 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:32:41.246176 | orchestrator | Friday 03 April 2026 08:32:01 +0000 (0:00:01.267) 0:45:14.744 ********** 2026-04-03 08:32:41.246186 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246195 | orchestrator | 2026-04-03 08:32:41.246205 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:32:41.246215 | orchestrator | Friday 03 April 2026 08:32:03 +0000 (0:00:01.143) 0:45:15.888 ********** 2026-04-03 08:32:41.246226 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 08:32:41.246236 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 08:32:41.246246 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 08:32:41.246256 | orchestrator | 2026-04-03 08:32:41.246265 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:32:41.246275 | orchestrator | Friday 03 April 2026 08:32:05 +0000 (0:00:02.070) 0:45:17.958 ********** 2026-04-03 08:32:41.246285 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:32:41.246295 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:32:41.246305 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:32:41.246314 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246324 | orchestrator | 2026-04-03 08:32:41.246349 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:32:41.246359 | orchestrator | Friday 03 April 2026 08:32:06 +0000 (0:00:01.238) 0:45:19.197 ********** 2026-04-03 08:32:41.246369 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-03 08:32:41.246380 | orchestrator | 2026-04-03 08:32:41.246390 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:32:41.246403 | orchestrator | Friday 03 April 2026 08:32:07 +0000 (0:00:01.171) 0:45:20.369 ********** 2026-04-03 08:32:41.246417 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246429 | orchestrator | 2026-04-03 08:32:41.246442 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:32:41.246455 | orchestrator | Friday 03 April 2026 08:32:08 +0000 (0:00:01.169) 0:45:21.539 ********** 2026-04-03 08:32:41.246468 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246480 | orchestrator | 2026-04-03 08:32:41.246493 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:32:41.246554 | orchestrator | Friday 03 April 2026 08:32:09 +0000 (0:00:01.138) 0:45:22.678 ********** 2026-04-03 08:32:41.246569 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246582 | orchestrator | 2026-04-03 08:32:41.246594 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:32:41.246606 | orchestrator | Friday 03 April 2026 08:32:10 +0000 (0:00:01.144) 0:45:23.822 ********** 2026-04-03 08:32:41.246619 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.246632 | orchestrator | 2026-04-03 08:32:41.246645 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:32:41.246658 | orchestrator | Friday 03 April 2026 08:32:12 +0000 (0:00:01.243) 0:45:25.066 ********** 2026-04-03 08:32:41.246670 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:32:41.246683 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:32:41.246696 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:32:41.246709 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246721 | orchestrator | 2026-04-03 08:32:41.246735 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:32:41.246747 | orchestrator | Friday 03 April 2026 08:32:13 +0000 (0:00:01.427) 0:45:26.493 ********** 2026-04-03 08:32:41.246760 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:32:41.246771 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:32:41.246782 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:32:41.246793 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246804 | orchestrator | 2026-04-03 08:32:41.246815 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:32:41.246825 | orchestrator | Friday 03 April 2026 08:32:15 +0000 (0:00:01.389) 0:45:27.882 ********** 2026-04-03 08:32:41.246836 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:32:41.246847 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:32:41.246858 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:32:41.246868 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.246879 | orchestrator | 2026-04-03 08:32:41.246890 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:32:41.246901 | orchestrator | Friday 03 April 2026 08:32:16 +0000 (0:00:01.432) 0:45:29.315 ********** 2026-04-03 08:32:41.246911 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.246922 | orchestrator | 2026-04-03 08:32:41.246933 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:32:41.246944 | orchestrator | Friday 03 April 2026 08:32:17 +0000 (0:00:01.263) 0:45:30.579 ********** 2026-04-03 08:32:41.246955 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 08:32:41.246965 | orchestrator | 2026-04-03 08:32:41.246976 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:32:41.246987 | orchestrator | Friday 03 April 2026 08:32:19 +0000 (0:00:01.363) 0:45:31.943 ********** 2026-04-03 08:32:41.247019 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:32:41.247034 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:32:41.247053 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:32:41.247070 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:32:41.247088 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:32:41.247106 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:32:41.247123 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:32:41.247139 | orchestrator | 2026-04-03 08:32:41.247157 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:32:41.247188 | orchestrator | Friday 03 April 2026 08:32:21 +0000 (0:00:02.195) 0:45:34.138 ********** 2026-04-03 08:32:41.247207 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:32:41.247224 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:32:41.247242 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:32:41.247260 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:32:41.247279 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:32:41.247307 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:32:41.247328 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:32:41.247346 | orchestrator | 2026-04-03 08:32:41.247365 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-03 08:32:41.247376 | orchestrator | Friday 03 April 2026 08:32:23 +0000 (0:00:02.675) 0:45:36.814 ********** 2026-04-03 08:32:41.247387 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.247398 | orchestrator | 2026-04-03 08:32:41.247409 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-03 08:32:41.247420 | orchestrator | Friday 03 April 2026 08:32:25 +0000 (0:00:01.139) 0:45:37.953 ********** 2026-04-03 08:32:41.247436 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.247455 | orchestrator | 2026-04-03 08:32:41.247472 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-03 08:32:41.247490 | orchestrator | Friday 03 April 2026 08:32:25 +0000 (0:00:00.803) 0:45:38.756 ********** 2026-04-03 08:32:41.247508 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.247563 | orchestrator | 2026-04-03 08:32:41.247585 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-03 08:32:41.247604 | orchestrator | Friday 03 April 2026 08:32:26 +0000 (0:00:00.883) 0:45:39.640 ********** 2026-04-03 08:32:41.247623 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-03 08:32:41.247641 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-03 08:32:41.247661 | orchestrator | 2026-04-03 08:32:41.247680 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:32:41.247699 | orchestrator | Friday 03 April 2026 08:32:30 +0000 (0:00:03.778) 0:45:43.418 ********** 2026-04-03 08:32:41.247716 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-03 08:32:41.247735 | orchestrator | 2026-04-03 08:32:41.247756 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:32:41.247775 | orchestrator | Friday 03 April 2026 08:32:31 +0000 (0:00:01.148) 0:45:44.567 ********** 2026-04-03 08:32:41.247796 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-03 08:32:41.247818 | orchestrator | 2026-04-03 08:32:41.247838 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:32:41.247853 | orchestrator | Friday 03 April 2026 08:32:32 +0000 (0:00:01.100) 0:45:45.668 ********** 2026-04-03 08:32:41.247864 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.247875 | orchestrator | 2026-04-03 08:32:41.247885 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:32:41.247896 | orchestrator | Friday 03 April 2026 08:32:33 +0000 (0:00:01.109) 0:45:46.777 ********** 2026-04-03 08:32:41.247907 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.247918 | orchestrator | 2026-04-03 08:32:41.247928 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:32:41.247939 | orchestrator | Friday 03 April 2026 08:32:35 +0000 (0:00:01.528) 0:45:48.306 ********** 2026-04-03 08:32:41.247950 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.247961 | orchestrator | 2026-04-03 08:32:41.247971 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:32:41.247994 | orchestrator | Friday 03 April 2026 08:32:36 +0000 (0:00:01.495) 0:45:49.801 ********** 2026-04-03 08:32:41.248005 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:32:41.248015 | orchestrator | 2026-04-03 08:32:41.248026 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:32:41.248037 | orchestrator | Friday 03 April 2026 08:32:38 +0000 (0:00:01.838) 0:45:51.639 ********** 2026-04-03 08:32:41.248048 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.248058 | orchestrator | 2026-04-03 08:32:41.248069 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:32:41.248080 | orchestrator | Friday 03 April 2026 08:32:39 +0000 (0:00:01.174) 0:45:52.813 ********** 2026-04-03 08:32:41.248090 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.248101 | orchestrator | 2026-04-03 08:32:41.248112 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:32:41.248122 | orchestrator | Friday 03 April 2026 08:32:41 +0000 (0:00:01.148) 0:45:53.962 ********** 2026-04-03 08:32:41.248133 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:32:41.248144 | orchestrator | 2026-04-03 08:32:41.248168 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:33:21.395681 | orchestrator | Friday 03 April 2026 08:32:42 +0000 (0:00:01.160) 0:45:55.122 ********** 2026-04-03 08:33:21.395821 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.395849 | orchestrator | 2026-04-03 08:33:21.395869 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:33:21.395888 | orchestrator | Friday 03 April 2026 08:32:43 +0000 (0:00:01.523) 0:45:56.645 ********** 2026-04-03 08:33:21.395906 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.395924 | orchestrator | 2026-04-03 08:33:21.395940 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:33:21.395957 | orchestrator | Friday 03 April 2026 08:32:45 +0000 (0:00:01.560) 0:45:58.206 ********** 2026-04-03 08:33:21.395976 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.395996 | orchestrator | 2026-04-03 08:33:21.396015 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:33:21.396034 | orchestrator | Friday 03 April 2026 08:32:46 +0000 (0:00:00.792) 0:45:58.999 ********** 2026-04-03 08:33:21.396054 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396067 | orchestrator | 2026-04-03 08:33:21.396078 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:33:21.396088 | orchestrator | Friday 03 April 2026 08:32:46 +0000 (0:00:00.778) 0:45:59.777 ********** 2026-04-03 08:33:21.396099 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.396110 | orchestrator | 2026-04-03 08:33:21.396125 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:33:21.396145 | orchestrator | Friday 03 April 2026 08:32:47 +0000 (0:00:00.855) 0:46:00.632 ********** 2026-04-03 08:33:21.396163 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.396182 | orchestrator | 2026-04-03 08:33:21.396223 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:33:21.396242 | orchestrator | Friday 03 April 2026 08:32:48 +0000 (0:00:00.774) 0:46:01.407 ********** 2026-04-03 08:33:21.396260 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.396278 | orchestrator | 2026-04-03 08:33:21.396290 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:33:21.396300 | orchestrator | Friday 03 April 2026 08:32:49 +0000 (0:00:00.793) 0:46:02.201 ********** 2026-04-03 08:33:21.396311 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396322 | orchestrator | 2026-04-03 08:33:21.396333 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:33:21.396345 | orchestrator | Friday 03 April 2026 08:32:50 +0000 (0:00:00.818) 0:46:03.019 ********** 2026-04-03 08:33:21.396365 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396382 | orchestrator | 2026-04-03 08:33:21.396400 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:33:21.396449 | orchestrator | Friday 03 April 2026 08:32:50 +0000 (0:00:00.810) 0:46:03.830 ********** 2026-04-03 08:33:21.396468 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396486 | orchestrator | 2026-04-03 08:33:21.396504 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:33:21.396548 | orchestrator | Friday 03 April 2026 08:32:51 +0000 (0:00:00.866) 0:46:04.697 ********** 2026-04-03 08:33:21.396569 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.396588 | orchestrator | 2026-04-03 08:33:21.396610 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:33:21.396629 | orchestrator | Friday 03 April 2026 08:32:52 +0000 (0:00:00.817) 0:46:05.514 ********** 2026-04-03 08:33:21.396647 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.396658 | orchestrator | 2026-04-03 08:33:21.396668 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:33:21.396679 | orchestrator | Friday 03 April 2026 08:32:53 +0000 (0:00:00.793) 0:46:06.308 ********** 2026-04-03 08:33:21.396690 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396701 | orchestrator | 2026-04-03 08:33:21.396711 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:33:21.396723 | orchestrator | Friday 03 April 2026 08:32:54 +0000 (0:00:00.767) 0:46:07.075 ********** 2026-04-03 08:33:21.396742 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396756 | orchestrator | 2026-04-03 08:33:21.396766 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:33:21.396777 | orchestrator | Friday 03 April 2026 08:32:55 +0000 (0:00:00.843) 0:46:07.919 ********** 2026-04-03 08:33:21.396787 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396798 | orchestrator | 2026-04-03 08:33:21.396809 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:33:21.396819 | orchestrator | Friday 03 April 2026 08:32:55 +0000 (0:00:00.828) 0:46:08.748 ********** 2026-04-03 08:33:21.396830 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396840 | orchestrator | 2026-04-03 08:33:21.396851 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:33:21.396862 | orchestrator | Friday 03 April 2026 08:32:56 +0000 (0:00:00.765) 0:46:09.514 ********** 2026-04-03 08:33:21.396873 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396884 | orchestrator | 2026-04-03 08:33:21.396895 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:33:21.396905 | orchestrator | Friday 03 April 2026 08:32:57 +0000 (0:00:00.765) 0:46:10.279 ********** 2026-04-03 08:33:21.396916 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396926 | orchestrator | 2026-04-03 08:33:21.396937 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:33:21.396948 | orchestrator | Friday 03 April 2026 08:32:58 +0000 (0:00:00.765) 0:46:11.045 ********** 2026-04-03 08:33:21.396958 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.396969 | orchestrator | 2026-04-03 08:33:21.396980 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:33:21.396992 | orchestrator | Friday 03 April 2026 08:32:59 +0000 (0:00:00.859) 0:46:11.904 ********** 2026-04-03 08:33:21.397002 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397013 | orchestrator | 2026-04-03 08:33:21.397024 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:33:21.397034 | orchestrator | Friday 03 April 2026 08:32:59 +0000 (0:00:00.827) 0:46:12.732 ********** 2026-04-03 08:33:21.397065 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397077 | orchestrator | 2026-04-03 08:33:21.397087 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:33:21.397098 | orchestrator | Friday 03 April 2026 08:33:00 +0000 (0:00:00.836) 0:46:13.568 ********** 2026-04-03 08:33:21.397113 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397130 | orchestrator | 2026-04-03 08:33:21.397150 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:33:21.397181 | orchestrator | Friday 03 April 2026 08:33:01 +0000 (0:00:00.853) 0:46:14.422 ********** 2026-04-03 08:33:21.397198 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397209 | orchestrator | 2026-04-03 08:33:21.397220 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:33:21.397231 | orchestrator | Friday 03 April 2026 08:33:02 +0000 (0:00:00.823) 0:46:15.246 ********** 2026-04-03 08:33:21.397242 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397252 | orchestrator | 2026-04-03 08:33:21.397263 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:33:21.397274 | orchestrator | Friday 03 April 2026 08:33:03 +0000 (0:00:00.780) 0:46:16.026 ********** 2026-04-03 08:33:21.397285 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.397295 | orchestrator | 2026-04-03 08:33:21.397306 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:33:21.397317 | orchestrator | Friday 03 April 2026 08:33:04 +0000 (0:00:01.562) 0:46:17.588 ********** 2026-04-03 08:33:21.397327 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.397338 | orchestrator | 2026-04-03 08:33:21.397348 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:33:21.397367 | orchestrator | Friday 03 April 2026 08:33:06 +0000 (0:00:01.825) 0:46:19.413 ********** 2026-04-03 08:33:21.397378 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-03 08:33:21.397390 | orchestrator | 2026-04-03 08:33:21.397401 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:33:21.397411 | orchestrator | Friday 03 April 2026 08:33:07 +0000 (0:00:01.142) 0:46:20.556 ********** 2026-04-03 08:33:21.397422 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397433 | orchestrator | 2026-04-03 08:33:21.397443 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:33:21.397454 | orchestrator | Friday 03 April 2026 08:33:08 +0000 (0:00:01.172) 0:46:21.728 ********** 2026-04-03 08:33:21.397465 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397475 | orchestrator | 2026-04-03 08:33:21.397486 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:33:21.397497 | orchestrator | Friday 03 April 2026 08:33:10 +0000 (0:00:01.201) 0:46:22.930 ********** 2026-04-03 08:33:21.397507 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:33:21.397518 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:33:21.397557 | orchestrator | 2026-04-03 08:33:21.397568 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:33:21.397578 | orchestrator | Friday 03 April 2026 08:33:11 +0000 (0:00:01.827) 0:46:24.758 ********** 2026-04-03 08:33:21.397589 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.397600 | orchestrator | 2026-04-03 08:33:21.397610 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:33:21.397621 | orchestrator | Friday 03 April 2026 08:33:13 +0000 (0:00:01.436) 0:46:26.194 ********** 2026-04-03 08:33:21.397632 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397642 | orchestrator | 2026-04-03 08:33:21.397653 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:33:21.397663 | orchestrator | Friday 03 April 2026 08:33:14 +0000 (0:00:01.165) 0:46:27.360 ********** 2026-04-03 08:33:21.397674 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397685 | orchestrator | 2026-04-03 08:33:21.397695 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:33:21.397706 | orchestrator | Friday 03 April 2026 08:33:15 +0000 (0:00:00.822) 0:46:28.183 ********** 2026-04-03 08:33:21.397716 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397727 | orchestrator | 2026-04-03 08:33:21.397738 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:33:21.397748 | orchestrator | Friday 03 April 2026 08:33:16 +0000 (0:00:00.842) 0:46:29.025 ********** 2026-04-03 08:33:21.397766 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-03 08:33:21.397777 | orchestrator | 2026-04-03 08:33:21.397787 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:33:21.397798 | orchestrator | Friday 03 April 2026 08:33:17 +0000 (0:00:01.130) 0:46:30.156 ********** 2026-04-03 08:33:21.397808 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:33:21.397819 | orchestrator | 2026-04-03 08:33:21.397830 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:33:21.397840 | orchestrator | Friday 03 April 2026 08:33:18 +0000 (0:00:01.688) 0:46:31.845 ********** 2026-04-03 08:33:21.397851 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:33:21.397862 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:33:21.397872 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:33:21.397883 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397894 | orchestrator | 2026-04-03 08:33:21.397904 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:33:21.397915 | orchestrator | Friday 03 April 2026 08:33:20 +0000 (0:00:01.141) 0:46:32.987 ********** 2026-04-03 08:33:21.397926 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:33:21.397936 | orchestrator | 2026-04-03 08:33:21.397947 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:33:21.397958 | orchestrator | Friday 03 April 2026 08:33:21 +0000 (0:00:01.176) 0:46:34.163 ********** 2026-04-03 08:33:21.397976 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.370454 | orchestrator | 2026-04-03 08:34:04.370629 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:34:04.370648 | orchestrator | Friday 03 April 2026 08:33:22 +0000 (0:00:01.233) 0:46:35.397 ********** 2026-04-03 08:34:04.370660 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.370672 | orchestrator | 2026-04-03 08:34:04.370683 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:34:04.370695 | orchestrator | Friday 03 April 2026 08:33:23 +0000 (0:00:01.195) 0:46:36.593 ********** 2026-04-03 08:34:04.370705 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.370716 | orchestrator | 2026-04-03 08:34:04.370727 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:34:04.370738 | orchestrator | Friday 03 April 2026 08:33:24 +0000 (0:00:01.132) 0:46:37.726 ********** 2026-04-03 08:34:04.370749 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.370760 | orchestrator | 2026-04-03 08:34:04.370771 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:34:04.370781 | orchestrator | Friday 03 April 2026 08:33:25 +0000 (0:00:00.803) 0:46:38.530 ********** 2026-04-03 08:34:04.370792 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:04.370804 | orchestrator | 2026-04-03 08:34:04.370815 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:34:04.370827 | orchestrator | Friday 03 April 2026 08:33:27 +0000 (0:00:02.073) 0:46:40.603 ********** 2026-04-03 08:34:04.370838 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:04.370849 | orchestrator | 2026-04-03 08:34:04.370860 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:34:04.370887 | orchestrator | Friday 03 April 2026 08:33:28 +0000 (0:00:00.814) 0:46:41.417 ********** 2026-04-03 08:34:04.370899 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-03 08:34:04.370909 | orchestrator | 2026-04-03 08:34:04.370920 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:34:04.370931 | orchestrator | Friday 03 April 2026 08:33:29 +0000 (0:00:01.290) 0:46:42.708 ********** 2026-04-03 08:34:04.370942 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.370976 | orchestrator | 2026-04-03 08:34:04.370988 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:34:04.371002 | orchestrator | Friday 03 April 2026 08:33:30 +0000 (0:00:01.135) 0:46:43.844 ********** 2026-04-03 08:34:04.371015 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371028 | orchestrator | 2026-04-03 08:34:04.371041 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:34:04.371055 | orchestrator | Friday 03 April 2026 08:33:32 +0000 (0:00:01.133) 0:46:44.978 ********** 2026-04-03 08:34:04.371068 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371081 | orchestrator | 2026-04-03 08:34:04.371093 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:34:04.371106 | orchestrator | Friday 03 April 2026 08:33:33 +0000 (0:00:01.103) 0:46:46.081 ********** 2026-04-03 08:34:04.371118 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371136 | orchestrator | 2026-04-03 08:34:04.371155 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:34:04.371174 | orchestrator | Friday 03 April 2026 08:33:34 +0000 (0:00:01.118) 0:46:47.200 ********** 2026-04-03 08:34:04.371194 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371214 | orchestrator | 2026-04-03 08:34:04.371233 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:34:04.371244 | orchestrator | Friday 03 April 2026 08:33:35 +0000 (0:00:01.156) 0:46:48.356 ********** 2026-04-03 08:34:04.371255 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371266 | orchestrator | 2026-04-03 08:34:04.371277 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:34:04.371287 | orchestrator | Friday 03 April 2026 08:33:36 +0000 (0:00:01.154) 0:46:49.511 ********** 2026-04-03 08:34:04.371298 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371309 | orchestrator | 2026-04-03 08:34:04.371319 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:34:04.371330 | orchestrator | Friday 03 April 2026 08:33:37 +0000 (0:00:01.133) 0:46:50.645 ********** 2026-04-03 08:34:04.371341 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371351 | orchestrator | 2026-04-03 08:34:04.371362 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:34:04.371373 | orchestrator | Friday 03 April 2026 08:33:38 +0000 (0:00:01.160) 0:46:51.805 ********** 2026-04-03 08:34:04.371383 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:04.371394 | orchestrator | 2026-04-03 08:34:04.371405 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:34:04.371415 | orchestrator | Friday 03 April 2026 08:33:39 +0000 (0:00:00.808) 0:46:52.614 ********** 2026-04-03 08:34:04.371426 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-03 08:34:04.371437 | orchestrator | 2026-04-03 08:34:04.371448 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:34:04.371459 | orchestrator | Friday 03 April 2026 08:33:40 +0000 (0:00:01.243) 0:46:53.858 ********** 2026-04-03 08:34:04.371470 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-03 08:34:04.371481 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-03 08:34:04.371492 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-03 08:34:04.371503 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-03 08:34:04.371513 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-03 08:34:04.371549 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-03 08:34:04.371562 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-03 08:34:04.371573 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:34:04.371585 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:34:04.371615 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:34:04.371626 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:34:04.371647 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:34:04.371658 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:34:04.371669 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:34:04.371680 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-03 08:34:04.371691 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-03 08:34:04.371702 | orchestrator | 2026-04-03 08:34:04.371713 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:34:04.371724 | orchestrator | Friday 03 April 2026 08:33:47 +0000 (0:00:06.184) 0:47:00.042 ********** 2026-04-03 08:34:04.371735 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-03 08:34:04.371746 | orchestrator | 2026-04-03 08:34:04.371757 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:34:04.371767 | orchestrator | Friday 03 April 2026 08:33:48 +0000 (0:00:01.110) 0:47:01.153 ********** 2026-04-03 08:34:04.371778 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:34:04.371790 | orchestrator | 2026-04-03 08:34:04.371801 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:34:04.371819 | orchestrator | Friday 03 April 2026 08:33:49 +0000 (0:00:01.545) 0:47:02.699 ********** 2026-04-03 08:34:04.371830 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:34:04.371841 | orchestrator | 2026-04-03 08:34:04.371852 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:34:04.371863 | orchestrator | Friday 03 April 2026 08:33:51 +0000 (0:00:01.646) 0:47:04.346 ********** 2026-04-03 08:34:04.371874 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371885 | orchestrator | 2026-04-03 08:34:04.371896 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:34:04.371906 | orchestrator | Friday 03 April 2026 08:33:52 +0000 (0:00:00.793) 0:47:05.139 ********** 2026-04-03 08:34:04.371917 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371928 | orchestrator | 2026-04-03 08:34:04.371939 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:34:04.371950 | orchestrator | Friday 03 April 2026 08:33:53 +0000 (0:00:00.795) 0:47:05.935 ********** 2026-04-03 08:34:04.371961 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.371972 | orchestrator | 2026-04-03 08:34:04.371983 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:34:04.371993 | orchestrator | Friday 03 April 2026 08:33:53 +0000 (0:00:00.777) 0:47:06.712 ********** 2026-04-03 08:34:04.372004 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372015 | orchestrator | 2026-04-03 08:34:04.372026 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:34:04.372037 | orchestrator | Friday 03 April 2026 08:33:54 +0000 (0:00:00.783) 0:47:07.496 ********** 2026-04-03 08:34:04.372047 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372058 | orchestrator | 2026-04-03 08:34:04.372069 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:34:04.372080 | orchestrator | Friday 03 April 2026 08:33:55 +0000 (0:00:00.792) 0:47:08.289 ********** 2026-04-03 08:34:04.372091 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372102 | orchestrator | 2026-04-03 08:34:04.372112 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:34:04.372124 | orchestrator | Friday 03 April 2026 08:33:56 +0000 (0:00:00.757) 0:47:09.047 ********** 2026-04-03 08:34:04.372134 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372145 | orchestrator | 2026-04-03 08:34:04.372156 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:34:04.372174 | orchestrator | Friday 03 April 2026 08:33:56 +0000 (0:00:00.786) 0:47:09.833 ********** 2026-04-03 08:34:04.372185 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372196 | orchestrator | 2026-04-03 08:34:04.372207 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:34:04.372218 | orchestrator | Friday 03 April 2026 08:33:57 +0000 (0:00:00.806) 0:47:10.640 ********** 2026-04-03 08:34:04.372228 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372239 | orchestrator | 2026-04-03 08:34:04.372250 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:34:04.372260 | orchestrator | Friday 03 April 2026 08:33:58 +0000 (0:00:00.804) 0:47:11.445 ********** 2026-04-03 08:34:04.372271 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:04.372282 | orchestrator | 2026-04-03 08:34:04.372293 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:34:04.372304 | orchestrator | Friday 03 April 2026 08:33:59 +0000 (0:00:00.891) 0:47:12.336 ********** 2026-04-03 08:34:04.372315 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:04.372326 | orchestrator | 2026-04-03 08:34:04.372336 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:34:04.372347 | orchestrator | Friday 03 April 2026 08:34:00 +0000 (0:00:00.856) 0:47:13.192 ********** 2026-04-03 08:34:04.372358 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:34:04.372369 | orchestrator | 2026-04-03 08:34:04.372380 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:34:04.372390 | orchestrator | Friday 03 April 2026 08:34:04 +0000 (0:00:03.930) 0:47:17.123 ********** 2026-04-03 08:34:04.372407 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:34:47.232087 | orchestrator | 2026-04-03 08:34:47.232177 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:34:47.232191 | orchestrator | Friday 03 April 2026 08:34:05 +0000 (0:00:00.864) 0:47:17.987 ********** 2026-04-03 08:34:47.232200 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-03 08:34:47.232209 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-03 08:34:47.232217 | orchestrator | 2026-04-03 08:34:47.232224 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:34:47.232230 | orchestrator | Friday 03 April 2026 08:34:12 +0000 (0:00:07.202) 0:47:25.190 ********** 2026-04-03 08:34:47.232236 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232244 | orchestrator | 2026-04-03 08:34:47.232265 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:34:47.232272 | orchestrator | Friday 03 April 2026 08:34:13 +0000 (0:00:00.769) 0:47:25.960 ********** 2026-04-03 08:34:47.232279 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232285 | orchestrator | 2026-04-03 08:34:47.232292 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:34:47.232300 | orchestrator | Friday 03 April 2026 08:34:13 +0000 (0:00:00.813) 0:47:26.774 ********** 2026-04-03 08:34:47.232307 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232313 | orchestrator | 2026-04-03 08:34:47.232318 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:34:47.232344 | orchestrator | Friday 03 April 2026 08:34:14 +0000 (0:00:00.859) 0:47:27.633 ********** 2026-04-03 08:34:47.232352 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232358 | orchestrator | 2026-04-03 08:34:47.232364 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:34:47.232370 | orchestrator | Friday 03 April 2026 08:34:15 +0000 (0:00:00.862) 0:47:28.495 ********** 2026-04-03 08:34:47.232375 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232381 | orchestrator | 2026-04-03 08:34:47.232386 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:34:47.232392 | orchestrator | Friday 03 April 2026 08:34:16 +0000 (0:00:00.821) 0:47:29.317 ********** 2026-04-03 08:34:47.232398 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232405 | orchestrator | 2026-04-03 08:34:47.232410 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:34:47.232417 | orchestrator | Friday 03 April 2026 08:34:17 +0000 (0:00:00.901) 0:47:30.218 ********** 2026-04-03 08:34:47.232423 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:34:47.232430 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:34:47.232436 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:34:47.232442 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232448 | orchestrator | 2026-04-03 08:34:47.232453 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:34:47.232457 | orchestrator | Friday 03 April 2026 08:34:18 +0000 (0:00:01.429) 0:47:31.647 ********** 2026-04-03 08:34:47.232461 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:34:47.232465 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:34:47.232469 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:34:47.232472 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232476 | orchestrator | 2026-04-03 08:34:47.232480 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:34:47.232483 | orchestrator | Friday 03 April 2026 08:34:20 +0000 (0:00:01.445) 0:47:33.093 ********** 2026-04-03 08:34:47.232487 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:34:47.232491 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:34:47.232495 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:34:47.232498 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232502 | orchestrator | 2026-04-03 08:34:47.232506 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:34:47.232509 | orchestrator | Friday 03 April 2026 08:34:21 +0000 (0:00:01.531) 0:47:34.624 ********** 2026-04-03 08:34:47.232513 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232517 | orchestrator | 2026-04-03 08:34:47.232521 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:34:47.232554 | orchestrator | Friday 03 April 2026 08:34:22 +0000 (0:00:00.810) 0:47:35.435 ********** 2026-04-03 08:34:47.232558 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 08:34:47.232562 | orchestrator | 2026-04-03 08:34:47.232566 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:34:47.232570 | orchestrator | Friday 03 April 2026 08:34:23 +0000 (0:00:01.012) 0:47:36.447 ********** 2026-04-03 08:34:47.232573 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232577 | orchestrator | 2026-04-03 08:34:47.232581 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-03 08:34:47.232585 | orchestrator | Friday 03 April 2026 08:34:24 +0000 (0:00:01.387) 0:47:37.835 ********** 2026-04-03 08:34:47.232589 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232592 | orchestrator | 2026-04-03 08:34:47.232611 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-03 08:34:47.232615 | orchestrator | Friday 03 April 2026 08:34:25 +0000 (0:00:00.797) 0:47:38.632 ********** 2026-04-03 08:34:47.232627 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:34:47.232635 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:34:47.232642 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:34:47.232648 | orchestrator | 2026-04-03 08:34:47.232655 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-03 08:34:47.232661 | orchestrator | Friday 03 April 2026 08:34:27 +0000 (0:00:01.321) 0:47:39.954 ********** 2026-04-03 08:34:47.232668 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-5 2026-04-03 08:34:47.232675 | orchestrator | 2026-04-03 08:34:47.232682 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-03 08:34:47.232689 | orchestrator | Friday 03 April 2026 08:34:28 +0000 (0:00:01.135) 0:47:41.089 ********** 2026-04-03 08:34:47.232696 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232701 | orchestrator | 2026-04-03 08:34:47.232705 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-03 08:34:47.232710 | orchestrator | Friday 03 April 2026 08:34:29 +0000 (0:00:01.136) 0:47:42.226 ********** 2026-04-03 08:34:47.232714 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232719 | orchestrator | 2026-04-03 08:34:47.232729 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-03 08:34:47.232734 | orchestrator | Friday 03 April 2026 08:34:30 +0000 (0:00:01.099) 0:47:43.326 ********** 2026-04-03 08:34:47.232738 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232743 | orchestrator | 2026-04-03 08:34:47.232747 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-03 08:34:47.232752 | orchestrator | Friday 03 April 2026 08:34:31 +0000 (0:00:01.424) 0:47:44.750 ********** 2026-04-03 08:34:47.232756 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232760 | orchestrator | 2026-04-03 08:34:47.232765 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-03 08:34:47.232769 | orchestrator | Friday 03 April 2026 08:34:33 +0000 (0:00:01.170) 0:47:45.921 ********** 2026-04-03 08:34:47.232773 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-03 08:34:47.232779 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-03 08:34:47.232784 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-03 08:34:47.232788 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-03 08:34:47.232792 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-03 08:34:47.232797 | orchestrator | 2026-04-03 08:34:47.232801 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-03 08:34:47.232805 | orchestrator | Friday 03 April 2026 08:34:36 +0000 (0:00:03.440) 0:47:49.362 ********** 2026-04-03 08:34:47.232810 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232814 | orchestrator | 2026-04-03 08:34:47.232819 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-03 08:34:47.232823 | orchestrator | Friday 03 April 2026 08:34:37 +0000 (0:00:00.777) 0:47:50.139 ********** 2026-04-03 08:34:47.232827 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-5 2026-04-03 08:34:47.232831 | orchestrator | 2026-04-03 08:34:47.232836 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-03 08:34:47.232840 | orchestrator | Friday 03 April 2026 08:34:38 +0000 (0:00:01.149) 0:47:51.288 ********** 2026-04-03 08:34:47.232845 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-03 08:34:47.232849 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-03 08:34:47.232853 | orchestrator | 2026-04-03 08:34:47.232858 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-03 08:34:47.232867 | orchestrator | Friday 03 April 2026 08:34:40 +0000 (0:00:01.990) 0:47:53.279 ********** 2026-04-03 08:34:47.232871 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:34:47.232876 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 08:34:47.232880 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:34:47.232884 | orchestrator | 2026-04-03 08:34:47.232889 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:34:47.232893 | orchestrator | Friday 03 April 2026 08:34:43 +0000 (0:00:03.349) 0:47:56.629 ********** 2026-04-03 08:34:47.232898 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 08:34:47.232903 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 08:34:47.232907 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:34:47.232911 | orchestrator | 2026-04-03 08:34:47.232916 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-03 08:34:47.232920 | orchestrator | Friday 03 April 2026 08:34:45 +0000 (0:00:01.650) 0:47:58.280 ********** 2026-04-03 08:34:47.232934 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232938 | orchestrator | 2026-04-03 08:34:47.232943 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-03 08:34:47.232947 | orchestrator | Friday 03 April 2026 08:34:46 +0000 (0:00:00.859) 0:47:59.140 ********** 2026-04-03 08:34:47.232951 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232956 | orchestrator | 2026-04-03 08:34:47.232960 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-03 08:34:47.232965 | orchestrator | Friday 03 April 2026 08:34:47 +0000 (0:00:00.773) 0:47:59.913 ********** 2026-04-03 08:34:47.232969 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:34:47.232973 | orchestrator | 2026-04-03 08:34:47.232981 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-03 08:37:07.968887 | orchestrator | Friday 03 April 2026 08:34:47 +0000 (0:00:00.805) 0:48:00.718 ********** 2026-04-03 08:37:07.968969 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-5 2026-04-03 08:37:07.968977 | orchestrator | 2026-04-03 08:37:07.968982 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-03 08:37:07.968986 | orchestrator | Friday 03 April 2026 08:34:48 +0000 (0:00:01.121) 0:48:01.840 ********** 2026-04-03 08:37:07.968991 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.968996 | orchestrator | 2026-04-03 08:37:07.969000 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-03 08:37:07.969004 | orchestrator | Friday 03 April 2026 08:34:50 +0000 (0:00:01.477) 0:48:03.317 ********** 2026-04-03 08:37:07.969008 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969012 | orchestrator | 2026-04-03 08:37:07.969016 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-03 08:37:07.969020 | orchestrator | Friday 03 April 2026 08:34:53 +0000 (0:00:03.294) 0:48:06.612 ********** 2026-04-03 08:37:07.969024 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-5 2026-04-03 08:37:07.969028 | orchestrator | 2026-04-03 08:37:07.969031 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-03 08:37:07.969035 | orchestrator | Friday 03 April 2026 08:34:54 +0000 (0:00:01.154) 0:48:07.766 ********** 2026-04-03 08:37:07.969039 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969043 | orchestrator | 2026-04-03 08:37:07.969057 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-03 08:37:07.969061 | orchestrator | Friday 03 April 2026 08:34:56 +0000 (0:00:01.999) 0:48:09.766 ********** 2026-04-03 08:37:07.969065 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969069 | orchestrator | 2026-04-03 08:37:07.969073 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-03 08:37:07.969077 | orchestrator | Friday 03 April 2026 08:34:58 +0000 (0:00:01.937) 0:48:11.703 ********** 2026-04-03 08:37:07.969080 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969098 | orchestrator | 2026-04-03 08:37:07.969102 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-03 08:37:07.969106 | orchestrator | Friday 03 April 2026 08:35:01 +0000 (0:00:02.201) 0:48:13.905 ********** 2026-04-03 08:37:07.969109 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969115 | orchestrator | 2026-04-03 08:37:07.969118 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-03 08:37:07.969122 | orchestrator | Friday 03 April 2026 08:35:02 +0000 (0:00:01.140) 0:48:15.046 ********** 2026-04-03 08:37:07.969126 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969130 | orchestrator | 2026-04-03 08:37:07.969134 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-03 08:37:07.969137 | orchestrator | Friday 03 April 2026 08:35:03 +0000 (0:00:01.123) 0:48:16.170 ********** 2026-04-03 08:37:07.969141 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-03 08:37:07.969145 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-03 08:37:07.969149 | orchestrator | 2026-04-03 08:37:07.969153 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-03 08:37:07.969157 | orchestrator | Friday 03 April 2026 08:35:05 +0000 (0:00:01.934) 0:48:18.104 ********** 2026-04-03 08:37:07.969161 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-03 08:37:07.969165 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-03 08:37:07.969169 | orchestrator | 2026-04-03 08:37:07.969172 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-03 08:37:07.969176 | orchestrator | Friday 03 April 2026 08:35:08 +0000 (0:00:02.790) 0:48:20.895 ********** 2026-04-03 08:37:07.969180 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-03 08:37:07.969184 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-03 08:37:07.969188 | orchestrator | 2026-04-03 08:37:07.969191 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-03 08:37:07.969195 | orchestrator | Friday 03 April 2026 08:35:12 +0000 (0:00:04.226) 0:48:25.121 ********** 2026-04-03 08:37:07.969199 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969203 | orchestrator | 2026-04-03 08:37:07.969207 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-03 08:37:07.969210 | orchestrator | Friday 03 April 2026 08:35:13 +0000 (0:00:00.873) 0:48:25.995 ********** 2026-04-03 08:37:07.969214 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-03 08:37:07.969219 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:37:07.969223 | orchestrator | 2026-04-03 08:37:07.969227 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-03 08:37:07.969231 | orchestrator | Friday 03 April 2026 08:35:26 +0000 (0:00:13.397) 0:48:39.392 ********** 2026-04-03 08:37:07.969234 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969238 | orchestrator | 2026-04-03 08:37:07.969242 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-03 08:37:07.969246 | orchestrator | Friday 03 April 2026 08:35:27 +0000 (0:00:00.887) 0:48:40.280 ********** 2026-04-03 08:37:07.969249 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969253 | orchestrator | 2026-04-03 08:37:07.969257 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-03 08:37:07.969261 | orchestrator | Friday 03 April 2026 08:35:28 +0000 (0:00:00.827) 0:48:41.108 ********** 2026-04-03 08:37:07.969264 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:37:07.969268 | orchestrator | 2026-04-03 08:37:07.969272 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-03 08:37:07.969276 | orchestrator | Friday 03 April 2026 08:35:29 +0000 (0:00:00.801) 0:48:41.909 ********** 2026-04-03 08:37:07.969279 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:37:07.969283 | orchestrator | 2026-04-03 08:37:07.969287 | orchestrator | PLAY [Complete osd upgrade] **************************************************** 2026-04-03 08:37:07.969295 | orchestrator | 2026-04-03 08:37:07.969308 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:37:07.969312 | orchestrator | Friday 03 April 2026 08:35:31 +0000 (0:00:02.560) 0:48:44.470 ********** 2026-04-03 08:37:07.969316 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:37:07.969320 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:37:07.969324 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969328 | orchestrator | 2026-04-03 08:37:07.969331 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:37:07.969335 | orchestrator | Friday 03 April 2026 08:35:33 +0000 (0:00:01.684) 0:48:46.154 ********** 2026-04-03 08:37:07.969339 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:37:07.969343 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:37:07.969346 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:37:07.969350 | orchestrator | 2026-04-03 08:37:07.969354 | orchestrator | TASK [Re-enable pg autoscale on pools] ***************************************** 2026-04-03 08:37:07.969358 | orchestrator | Friday 03 April 2026 08:35:34 +0000 (0:00:01.653) 0:48:47.808 ********** 2026-04-03 08:37:07.969362 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-03 08:37:07.969365 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-03 08:37:07.969370 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-03 08:37:07.969377 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-03 08:37:07.969382 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-03 08:37:07.969386 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-03 08:37:07.969390 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-03 08:37:07.969394 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-03 08:37:07.969398 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-03 08:37:07.969401 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-03 08:37:07.969405 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-03 08:37:07.969409 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-03 08:37:07.969413 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-03 08:37:07.969417 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-03 08:37:07.969420 | orchestrator | 2026-04-03 08:37:07.969424 | orchestrator | TASK [Unset osd flags] ********************************************************* 2026-04-03 08:37:07.969428 | orchestrator | Friday 03 April 2026 08:36:51 +0000 (0:01:16.587) 0:50:04.396 ********** 2026-04-03 08:37:07.969432 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-03 08:37:07.969436 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-03 08:37:07.969439 | orchestrator | 2026-04-03 08:37:07.969443 | orchestrator | TASK [Re-enable balancer] ****************************************************** 2026-04-03 08:37:07.969447 | orchestrator | Friday 03 April 2026 08:36:56 +0000 (0:00:05.358) 0:50:09.754 ********** 2026-04-03 08:37:07.969451 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:37:07.969454 | orchestrator | 2026-04-03 08:37:07.969458 | orchestrator | PLAY [Upgrade ceph mdss cluster, deactivate all rank > 0] ********************** 2026-04-03 08:37:07.969462 | orchestrator | 2026-04-03 08:37:07.969466 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:37:07.969473 | orchestrator | Friday 03 April 2026 08:37:00 +0000 (0:00:03.406) 0:50:13.160 ********** 2026-04-03 08:37:07.969477 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-03 08:37:07.969481 | orchestrator | 2026-04-03 08:37:07.969485 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:37:07.969488 | orchestrator | Friday 03 April 2026 08:37:01 +0000 (0:00:01.150) 0:50:14.310 ********** 2026-04-03 08:37:07.969492 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:07.969496 | orchestrator | 2026-04-03 08:37:07.969500 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:37:07.969504 | orchestrator | Friday 03 April 2026 08:37:02 +0000 (0:00:01.496) 0:50:15.807 ********** 2026-04-03 08:37:07.969508 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:07.969511 | orchestrator | 2026-04-03 08:37:07.969515 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:37:07.969519 | orchestrator | Friday 03 April 2026 08:37:04 +0000 (0:00:01.164) 0:50:16.971 ********** 2026-04-03 08:37:07.969523 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:07.969573 | orchestrator | 2026-04-03 08:37:07.969578 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:37:07.969582 | orchestrator | Friday 03 April 2026 08:37:05 +0000 (0:00:01.498) 0:50:18.469 ********** 2026-04-03 08:37:07.969586 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:07.969590 | orchestrator | 2026-04-03 08:37:07.969593 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:37:07.969597 | orchestrator | Friday 03 April 2026 08:37:06 +0000 (0:00:01.168) 0:50:19.638 ********** 2026-04-03 08:37:07.969602 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:07.969609 | orchestrator | 2026-04-03 08:37:07.969615 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:37:07.969625 | orchestrator | Friday 03 April 2026 08:37:07 +0000 (0:00:01.181) 0:50:20.820 ********** 2026-04-03 08:37:33.644226 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.644339 | orchestrator | 2026-04-03 08:37:33.644356 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:37:33.644368 | orchestrator | Friday 03 April 2026 08:37:09 +0000 (0:00:01.245) 0:50:22.066 ********** 2026-04-03 08:37:33.644380 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.644391 | orchestrator | 2026-04-03 08:37:33.644401 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:37:33.644411 | orchestrator | Friday 03 April 2026 08:37:10 +0000 (0:00:01.155) 0:50:23.221 ********** 2026-04-03 08:37:33.644421 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.644431 | orchestrator | 2026-04-03 08:37:33.644441 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:37:33.644451 | orchestrator | Friday 03 April 2026 08:37:11 +0000 (0:00:01.136) 0:50:24.358 ********** 2026-04-03 08:37:33.644461 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:37:33.644471 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:37:33.644481 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:37:33.644490 | orchestrator | 2026-04-03 08:37:33.644500 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:37:33.644524 | orchestrator | Friday 03 April 2026 08:37:13 +0000 (0:00:01.714) 0:50:26.072 ********** 2026-04-03 08:37:33.644569 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.644579 | orchestrator | 2026-04-03 08:37:33.644589 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:37:33.644599 | orchestrator | Friday 03 April 2026 08:37:14 +0000 (0:00:01.295) 0:50:27.368 ********** 2026-04-03 08:37:33.644608 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:37:33.644618 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:37:33.644649 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:37:33.644659 | orchestrator | 2026-04-03 08:37:33.644669 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:37:33.644679 | orchestrator | Friday 03 April 2026 08:37:17 +0000 (0:00:03.030) 0:50:30.399 ********** 2026-04-03 08:37:33.644688 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 08:37:33.644698 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 08:37:33.644708 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 08:37:33.644717 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.644727 | orchestrator | 2026-04-03 08:37:33.644736 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:37:33.644746 | orchestrator | Friday 03 April 2026 08:37:19 +0000 (0:00:01.517) 0:50:31.916 ********** 2026-04-03 08:37:33.644757 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644770 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644783 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644794 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.644805 | orchestrator | 2026-04-03 08:37:33.644816 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:37:33.644827 | orchestrator | Friday 03 April 2026 08:37:21 +0000 (0:00:02.126) 0:50:34.042 ********** 2026-04-03 08:37:33.644840 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644855 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644884 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:33.644897 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.644908 | orchestrator | 2026-04-03 08:37:33.644920 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:37:33.644931 | orchestrator | Friday 03 April 2026 08:37:22 +0000 (0:00:01.228) 0:50:35.271 ********** 2026-04-03 08:37:33.644952 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:37:15.097825', 'end': '2026-04-03 08:37:15.141143', 'delta': '0:00:00.043318', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:37:33.644976 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:37:15.720828', 'end': '2026-04-03 08:37:15.765610', 'delta': '0:00:00.044782', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:37:33.644989 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:37:16.322071', 'end': '2026-04-03 08:37:16.376486', 'delta': '0:00:00.054415', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:37:33.645008 | orchestrator | 2026-04-03 08:37:33.645026 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:37:33.645045 | orchestrator | Friday 03 April 2026 08:37:23 +0000 (0:00:01.289) 0:50:36.561 ********** 2026-04-03 08:37:33.645062 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.645079 | orchestrator | 2026-04-03 08:37:33.645097 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:37:33.645114 | orchestrator | Friday 03 April 2026 08:37:24 +0000 (0:00:01.275) 0:50:37.837 ********** 2026-04-03 08:37:33.645131 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.645148 | orchestrator | 2026-04-03 08:37:33.645165 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:37:33.645180 | orchestrator | Friday 03 April 2026 08:37:26 +0000 (0:00:01.798) 0:50:39.635 ********** 2026-04-03 08:37:33.645197 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.645214 | orchestrator | 2026-04-03 08:37:33.645231 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:37:33.645250 | orchestrator | Friday 03 April 2026 08:37:27 +0000 (0:00:01.172) 0:50:40.807 ********** 2026-04-03 08:37:33.645267 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.645284 | orchestrator | 2026-04-03 08:37:33.645301 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:37:33.645318 | orchestrator | Friday 03 April 2026 08:37:29 +0000 (0:00:02.027) 0:50:42.835 ********** 2026-04-03 08:37:33.645337 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:33.645354 | orchestrator | 2026-04-03 08:37:33.645372 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:37:33.645391 | orchestrator | Friday 03 April 2026 08:37:31 +0000 (0:00:01.207) 0:50:44.043 ********** 2026-04-03 08:37:33.645409 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.645427 | orchestrator | 2026-04-03 08:37:33.645438 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:37:33.645458 | orchestrator | Friday 03 April 2026 08:37:32 +0000 (0:00:01.171) 0:50:45.215 ********** 2026-04-03 08:37:33.645467 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:33.645477 | orchestrator | 2026-04-03 08:37:33.645486 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:37:33.645508 | orchestrator | Friday 03 April 2026 08:37:33 +0000 (0:00:01.278) 0:50:46.494 ********** 2026-04-03 08:37:43.333167 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333265 | orchestrator | 2026-04-03 08:37:43.333279 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:37:43.333290 | orchestrator | Friday 03 April 2026 08:37:34 +0000 (0:00:01.141) 0:50:47.635 ********** 2026-04-03 08:37:43.333299 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333309 | orchestrator | 2026-04-03 08:37:43.333318 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:37:43.333327 | orchestrator | Friday 03 April 2026 08:37:35 +0000 (0:00:01.199) 0:50:48.835 ********** 2026-04-03 08:37:43.333336 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333345 | orchestrator | 2026-04-03 08:37:43.333353 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:37:43.333362 | orchestrator | Friday 03 April 2026 08:37:37 +0000 (0:00:01.155) 0:50:49.991 ********** 2026-04-03 08:37:43.333371 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333381 | orchestrator | 2026-04-03 08:37:43.333395 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:37:43.333410 | orchestrator | Friday 03 April 2026 08:37:38 +0000 (0:00:01.122) 0:50:51.113 ********** 2026-04-03 08:37:43.333424 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333437 | orchestrator | 2026-04-03 08:37:43.333450 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:37:43.333481 | orchestrator | Friday 03 April 2026 08:37:39 +0000 (0:00:01.145) 0:50:52.259 ********** 2026-04-03 08:37:43.333497 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333512 | orchestrator | 2026-04-03 08:37:43.333584 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:37:43.333598 | orchestrator | Friday 03 April 2026 08:37:40 +0000 (0:00:01.157) 0:50:53.416 ********** 2026-04-03 08:37:43.333608 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333617 | orchestrator | 2026-04-03 08:37:43.333626 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:37:43.333635 | orchestrator | Friday 03 April 2026 08:37:41 +0000 (0:00:01.166) 0:50:54.583 ********** 2026-04-03 08:37:43.333647 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333660 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333681 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:37:43.333716 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333745 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333780 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:37:43.333795 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:37:43.333824 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:43.333835 | orchestrator | 2026-04-03 08:37:43.333846 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:37:43.333858 | orchestrator | Friday 03 April 2026 08:37:43 +0000 (0:00:01.517) 0:50:56.100 ********** 2026-04-03 08:37:43.333877 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868065 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868152 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868159 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-21-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868164 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868181 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868185 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868206 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'bb34e97f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1', 'scsi-SQEMU_QEMU_HARDDISK_bb34e97f-be4f-4e74-a2f5-2996b020f327-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868216 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868221 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:37:48.868225 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:37:48.868230 | orchestrator | 2026-04-03 08:37:48.868235 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:37:48.868240 | orchestrator | Friday 03 April 2026 08:37:44 +0000 (0:00:01.351) 0:50:57.451 ********** 2026-04-03 08:37:48.868244 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:48.868249 | orchestrator | 2026-04-03 08:37:48.868253 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:37:48.868257 | orchestrator | Friday 03 April 2026 08:37:46 +0000 (0:00:01.574) 0:50:59.026 ********** 2026-04-03 08:37:48.868260 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:48.868264 | orchestrator | 2026-04-03 08:37:48.868268 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:37:48.868271 | orchestrator | Friday 03 April 2026 08:37:47 +0000 (0:00:01.195) 0:51:00.222 ********** 2026-04-03 08:37:48.868275 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:37:48.868279 | orchestrator | 2026-04-03 08:37:48.868282 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:37:48.868289 | orchestrator | Friday 03 April 2026 08:37:48 +0000 (0:00:01.500) 0:51:01.723 ********** 2026-04-03 08:38:42.287204 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:38:42.287408 | orchestrator | 2026-04-03 08:38:42.287430 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:38:42.287447 | orchestrator | Friday 03 April 2026 08:37:50 +0000 (0:00:01.221) 0:51:02.944 ********** 2026-04-03 08:38:42.287461 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:38:42.287475 | orchestrator | 2026-04-03 08:38:42.287489 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:38:42.287503 | orchestrator | Friday 03 April 2026 08:37:51 +0000 (0:00:01.396) 0:51:04.341 ********** 2026-04-03 08:38:42.287517 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:38:42.287556 | orchestrator | 2026-04-03 08:38:42.287570 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:38:42.287583 | orchestrator | Friday 03 April 2026 08:37:52 +0000 (0:00:01.183) 0:51:05.525 ********** 2026-04-03 08:38:42.287597 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:38:42.287612 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 08:38:42.287626 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 08:38:42.287640 | orchestrator | 2026-04-03 08:38:42.287669 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:38:42.287681 | orchestrator | Friday 03 April 2026 08:37:54 +0000 (0:00:02.081) 0:51:07.607 ********** 2026-04-03 08:38:42.287693 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-03 08:38:42.287729 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-03 08:38:42.287741 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-03 08:38:42.287754 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:38:42.287767 | orchestrator | 2026-04-03 08:38:42.287779 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:38:42.287792 | orchestrator | Friday 03 April 2026 08:37:56 +0000 (0:00:01.280) 0:51:08.888 ********** 2026-04-03 08:38:42.287805 | orchestrator | skipping: [testbed-node-0] 2026-04-03 08:38:42.287817 | orchestrator | 2026-04-03 08:38:42.287830 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:38:42.287843 | orchestrator | Friday 03 April 2026 08:37:57 +0000 (0:00:01.134) 0:51:10.023 ********** 2026-04-03 08:38:42.287856 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:38:42.287869 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:38:42.287882 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:38:42.287895 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:38:42.287908 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:38:42.287920 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:38:42.287933 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:38:42.287946 | orchestrator | 2026-04-03 08:38:42.287958 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:38:42.287971 | orchestrator | Friday 03 April 2026 08:37:59 +0000 (0:00:02.221) 0:51:12.244 ********** 2026-04-03 08:38:42.287984 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 08:38:42.287997 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:38:42.288009 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:38:42.288022 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:38:42.288034 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:38:42.288047 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:38:42.288060 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:38:42.288072 | orchestrator | 2026-04-03 08:38:42.288085 | orchestrator | TASK [Set max_mds 1 on ceph fs] ************************************************ 2026-04-03 08:38:42.288098 | orchestrator | Friday 03 April 2026 08:38:02 +0000 (0:00:02.838) 0:51:15.083 ********** 2026-04-03 08:38:42.288110 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:38:42.288122 | orchestrator | 2026-04-03 08:38:42.288134 | orchestrator | TASK [Wait until only rank 0 is up] ******************************************** 2026-04-03 08:38:42.288145 | orchestrator | Friday 03 April 2026 08:38:05 +0000 (0:00:03.322) 0:51:18.406 ********** 2026-04-03 08:38:42.288157 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:38:42.288169 | orchestrator | 2026-04-03 08:38:42.288180 | orchestrator | TASK [Get name of remaining active mds] **************************************** 2026-04-03 08:38:42.288192 | orchestrator | Friday 03 April 2026 08:38:08 +0000 (0:00:03.059) 0:51:21.465 ********** 2026-04-03 08:38:42.288204 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:38:42.288215 | orchestrator | 2026-04-03 08:38:42.288227 | orchestrator | TASK [Set_fact mds_active_name] ************************************************ 2026-04-03 08:38:42.288238 | orchestrator | Friday 03 April 2026 08:38:10 +0000 (0:00:02.196) 0:51:23.662 ********** 2026-04-03 08:38:42.288273 | orchestrator | ok: [testbed-node-0] => (item={'key': 'gid_4773', 'value': {'gid': 4773, 'name': 'testbed-node-5', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '192.168.16.15:6817/1319503126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '192.168.16.15:6816', 'nonce': 1319503126}, {'type': 'v1', 'addr': '192.168.16.15:6817', 'nonce': 1319503126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}) 2026-04-03 08:38:42.288296 | orchestrator | 2026-04-03 08:38:42.288308 | orchestrator | TASK [Set_fact mds_active_host] ************************************************ 2026-04-03 08:38:42.288320 | orchestrator | Friday 03 April 2026 08:38:12 +0000 (0:00:01.257) 0:51:24.919 ********** 2026-04-03 08:38:42.288331 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-03 08:38:42.288342 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-03 08:38:42.288354 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-5) 2026-04-03 08:38:42.288366 | orchestrator | 2026-04-03 08:38:42.288383 | orchestrator | TASK [Create standby_mdss group] *********************************************** 2026-04-03 08:38:42.288394 | orchestrator | Friday 03 April 2026 08:38:13 +0000 (0:00:01.548) 0:51:26.468 ********** 2026-04-03 08:38:42.288406 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-4) 2026-04-03 08:38:42.288417 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-3) 2026-04-03 08:38:42.288429 | orchestrator | 2026-04-03 08:38:42.288441 | orchestrator | TASK [Stop standby ceph mds] *************************************************** 2026-04-03 08:38:42.288452 | orchestrator | Friday 03 April 2026 08:38:15 +0000 (0:00:01.578) 0:51:28.047 ********** 2026-04-03 08:38:42.288464 | orchestrator | changed: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:38:42.288475 | orchestrator | changed: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:38:42.288487 | orchestrator | 2026-04-03 08:38:42.288498 | orchestrator | TASK [Mask systemd units for standby ceph mds] ********************************* 2026-04-03 08:38:42.288510 | orchestrator | Friday 03 April 2026 08:38:24 +0000 (0:00:09.033) 0:51:37.080 ********** 2026-04-03 08:38:42.288522 | orchestrator | changed: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:38:42.288555 | orchestrator | changed: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:38:42.288568 | orchestrator | 2026-04-03 08:38:42.288579 | orchestrator | TASK [Wait until all standbys mds are stopped] ********************************* 2026-04-03 08:38:42.288591 | orchestrator | Friday 03 April 2026 08:38:28 +0000 (0:00:03.787) 0:51:40.868 ********** 2026-04-03 08:38:42.288602 | orchestrator | ok: [testbed-node-0] 2026-04-03 08:38:42.288614 | orchestrator | 2026-04-03 08:38:42.288626 | orchestrator | TASK [Create active_mdss group] ************************************************ 2026-04-03 08:38:42.288638 | orchestrator | Friday 03 April 2026 08:38:30 +0000 (0:00:02.099) 0:51:42.967 ********** 2026-04-03 08:38:42.288649 | orchestrator | changed: [testbed-node-0] 2026-04-03 08:38:42.288661 | orchestrator | 2026-04-03 08:38:42.288672 | orchestrator | PLAY [Upgrade active mds] ****************************************************** 2026-04-03 08:38:42.288684 | orchestrator | 2026-04-03 08:38:42.288695 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:38:42.288707 | orchestrator | Friday 03 April 2026 08:38:31 +0000 (0:00:01.667) 0:51:44.635 ********** 2026-04-03 08:38:42.288718 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-03 08:38:42.288730 | orchestrator | 2026-04-03 08:38:42.288741 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:38:42.288753 | orchestrator | Friday 03 April 2026 08:38:33 +0000 (0:00:01.454) 0:51:46.089 ********** 2026-04-03 08:38:42.288764 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.288783 | orchestrator | 2026-04-03 08:38:42.288794 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:38:42.288806 | orchestrator | Friday 03 April 2026 08:38:34 +0000 (0:00:01.418) 0:51:47.508 ********** 2026-04-03 08:38:42.288817 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.288829 | orchestrator | 2026-04-03 08:38:42.288841 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:38:42.288852 | orchestrator | Friday 03 April 2026 08:38:35 +0000 (0:00:01.210) 0:51:48.719 ********** 2026-04-03 08:38:42.288863 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.288875 | orchestrator | 2026-04-03 08:38:42.288886 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:38:42.288898 | orchestrator | Friday 03 April 2026 08:38:37 +0000 (0:00:01.475) 0:51:50.195 ********** 2026-04-03 08:38:42.288909 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.288921 | orchestrator | 2026-04-03 08:38:42.288932 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:38:42.288944 | orchestrator | Friday 03 April 2026 08:38:38 +0000 (0:00:01.158) 0:51:51.353 ********** 2026-04-03 08:38:42.288955 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.288967 | orchestrator | 2026-04-03 08:38:42.288978 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:38:42.288990 | orchestrator | Friday 03 April 2026 08:38:39 +0000 (0:00:01.199) 0:51:52.553 ********** 2026-04-03 08:38:42.289001 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.289013 | orchestrator | 2026-04-03 08:38:42.289024 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:38:42.289036 | orchestrator | Friday 03 April 2026 08:38:40 +0000 (0:00:01.178) 0:51:53.731 ********** 2026-04-03 08:38:42.289047 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:38:42.289059 | orchestrator | 2026-04-03 08:38:42.289070 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:38:42.289082 | orchestrator | Friday 03 April 2026 08:38:42 +0000 (0:00:01.253) 0:51:54.984 ********** 2026-04-03 08:38:42.289093 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:38:42.289105 | orchestrator | 2026-04-03 08:38:42.289122 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:39:08.054928 | orchestrator | Friday 03 April 2026 08:38:43 +0000 (0:00:01.132) 0:51:56.117 ********** 2026-04-03 08:39:08.055037 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:39:08.055054 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:39:08.055065 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:39:08.055077 | orchestrator | 2026-04-03 08:39:08.055090 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:39:08.055101 | orchestrator | Friday 03 April 2026 08:38:45 +0000 (0:00:02.082) 0:51:58.199 ********** 2026-04-03 08:39:08.055112 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:08.055124 | orchestrator | 2026-04-03 08:39:08.055136 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:39:08.055147 | orchestrator | Friday 03 April 2026 08:38:46 +0000 (0:00:01.219) 0:51:59.419 ********** 2026-04-03 08:39:08.055174 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:39:08.055186 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:39:08.055196 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:39:08.055207 | orchestrator | 2026-04-03 08:39:08.055218 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:39:08.055229 | orchestrator | Friday 03 April 2026 08:38:49 +0000 (0:00:03.256) 0:52:02.675 ********** 2026-04-03 08:39:08.055240 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:39:08.055252 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:39:08.055284 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:39:08.055295 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.055306 | orchestrator | 2026-04-03 08:39:08.055317 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:39:08.055328 | orchestrator | Friday 03 April 2026 08:38:51 +0000 (0:00:01.872) 0:52:04.548 ********** 2026-04-03 08:39:08.055345 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055359 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055370 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055381 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.055392 | orchestrator | 2026-04-03 08:39:08.055404 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:39:08.055415 | orchestrator | Friday 03 April 2026 08:38:53 +0000 (0:00:02.149) 0:52:06.698 ********** 2026-04-03 08:39:08.055428 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055442 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055453 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:08.055465 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.055479 | orchestrator | 2026-04-03 08:39:08.055493 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:39:08.055506 | orchestrator | Friday 03 April 2026 08:38:54 +0000 (0:00:01.157) 0:52:07.855 ********** 2026-04-03 08:39:08.055564 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:38:47.112557', 'end': '2026-04-03 08:38:47.171056', 'delta': '0:00:00.058499', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:39:08.055588 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:38:48.065042', 'end': '2026-04-03 08:38:48.115604', 'delta': '0:00:00.050562', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:39:08.055611 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:38:48.604557', 'end': '2026-04-03 08:38:48.646993', 'delta': '0:00:00.042436', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:39:08.055624 | orchestrator | 2026-04-03 08:39:08.055638 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:39:08.055650 | orchestrator | Friday 03 April 2026 08:38:56 +0000 (0:00:01.199) 0:52:09.055 ********** 2026-04-03 08:39:08.055663 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:08.055676 | orchestrator | 2026-04-03 08:39:08.055689 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:39:08.055703 | orchestrator | Friday 03 April 2026 08:38:57 +0000 (0:00:01.324) 0:52:10.379 ********** 2026-04-03 08:39:08.055717 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.055730 | orchestrator | 2026-04-03 08:39:08.055743 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:39:08.055756 | orchestrator | Friday 03 April 2026 08:38:58 +0000 (0:00:01.296) 0:52:11.676 ********** 2026-04-03 08:39:08.055769 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:08.055782 | orchestrator | 2026-04-03 08:39:08.055795 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:39:08.055809 | orchestrator | Friday 03 April 2026 08:38:59 +0000 (0:00:01.177) 0:52:12.854 ********** 2026-04-03 08:39:08.055822 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:39:08.055833 | orchestrator | 2026-04-03 08:39:08.055845 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:39:08.055855 | orchestrator | Friday 03 April 2026 08:39:02 +0000 (0:00:02.086) 0:52:14.940 ********** 2026-04-03 08:39:08.055874 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:08.055895 | orchestrator | 2026-04-03 08:39:08.055916 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:39:08.055936 | orchestrator | Friday 03 April 2026 08:39:03 +0000 (0:00:01.146) 0:52:16.087 ********** 2026-04-03 08:39:08.055956 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.055976 | orchestrator | 2026-04-03 08:39:08.055996 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:39:08.056015 | orchestrator | Friday 03 April 2026 08:39:04 +0000 (0:00:01.158) 0:52:17.245 ********** 2026-04-03 08:39:08.056034 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.056054 | orchestrator | 2026-04-03 08:39:08.056072 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:39:08.056094 | orchestrator | Friday 03 April 2026 08:39:05 +0000 (0:00:01.308) 0:52:18.554 ********** 2026-04-03 08:39:08.056114 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.056147 | orchestrator | 2026-04-03 08:39:08.056166 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:39:08.056187 | orchestrator | Friday 03 April 2026 08:39:06 +0000 (0:00:01.128) 0:52:19.682 ********** 2026-04-03 08:39:08.056207 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:08.056229 | orchestrator | 2026-04-03 08:39:08.056250 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:39:08.056268 | orchestrator | Friday 03 April 2026 08:39:07 +0000 (0:00:01.128) 0:52:20.811 ********** 2026-04-03 08:39:08.056290 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:14.100993 | orchestrator | 2026-04-03 08:39:14.101129 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:39:14.101155 | orchestrator | Friday 03 April 2026 08:39:09 +0000 (0:00:01.227) 0:52:22.039 ********** 2026-04-03 08:39:14.101168 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:14.101180 | orchestrator | 2026-04-03 08:39:14.101192 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:39:14.101203 | orchestrator | Friday 03 April 2026 08:39:10 +0000 (0:00:01.114) 0:52:23.153 ********** 2026-04-03 08:39:14.101215 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:14.101227 | orchestrator | 2026-04-03 08:39:14.101238 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:39:14.101248 | orchestrator | Friday 03 April 2026 08:39:11 +0000 (0:00:01.259) 0:52:24.413 ********** 2026-04-03 08:39:14.101259 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:14.101270 | orchestrator | 2026-04-03 08:39:14.101281 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:39:14.101309 | orchestrator | Friday 03 April 2026 08:39:12 +0000 (0:00:01.163) 0:52:25.576 ********** 2026-04-03 08:39:14.101320 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:14.101330 | orchestrator | 2026-04-03 08:39:14.101341 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:39:14.101352 | orchestrator | Friday 03 April 2026 08:39:13 +0000 (0:00:01.184) 0:52:26.761 ********** 2026-04-03 08:39:14.101366 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101383 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}})  2026-04-03 08:39:14.101397 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:39:14.101410 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}})  2026-04-03 08:39:14.101442 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101474 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101492 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:39:14.101505 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101516 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101558 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:14.101575 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}})  2026-04-03 08:39:14.101597 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}})  2026-04-03 08:39:14.101620 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:15.434386 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:39:15.434472 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:15.434499 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:39:15.434505 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:39:15.434512 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:15.434517 | orchestrator | 2026-04-03 08:39:15.434522 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:39:15.434592 | orchestrator | Friday 03 April 2026 08:39:15 +0000 (0:00:01.355) 0:52:28.116 ********** 2026-04-03 08:39:15.434616 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.434627 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.434633 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.434638 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.434649 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.434657 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566743 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566847 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566863 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566904 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566917 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566959 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566975 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.566989 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.567009 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:15.567033 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:52.030892 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:39:52.031011 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031035 | orchestrator | 2026-04-03 08:39:52.031048 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:39:52.031084 | orchestrator | Friday 03 April 2026 08:39:16 +0000 (0:00:01.454) 0:52:29.570 ********** 2026-04-03 08:39:52.031096 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.031107 | orchestrator | 2026-04-03 08:39:52.031119 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:39:52.031130 | orchestrator | Friday 03 April 2026 08:39:18 +0000 (0:00:01.502) 0:52:31.073 ********** 2026-04-03 08:39:52.031141 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.031151 | orchestrator | 2026-04-03 08:39:52.031162 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:39:52.031173 | orchestrator | Friday 03 April 2026 08:39:19 +0000 (0:00:01.111) 0:52:32.184 ********** 2026-04-03 08:39:52.031184 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.031194 | orchestrator | 2026-04-03 08:39:52.031205 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:39:52.031216 | orchestrator | Friday 03 April 2026 08:39:20 +0000 (0:00:01.506) 0:52:33.691 ********** 2026-04-03 08:39:52.031234 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031246 | orchestrator | 2026-04-03 08:39:52.031257 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:39:52.031267 | orchestrator | Friday 03 April 2026 08:39:21 +0000 (0:00:01.160) 0:52:34.852 ********** 2026-04-03 08:39:52.031278 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031289 | orchestrator | 2026-04-03 08:39:52.031299 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:39:52.031310 | orchestrator | Friday 03 April 2026 08:39:23 +0000 (0:00:01.258) 0:52:36.111 ********** 2026-04-03 08:39:52.031321 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031331 | orchestrator | 2026-04-03 08:39:52.031342 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:39:52.031353 | orchestrator | Friday 03 April 2026 08:39:24 +0000 (0:00:01.160) 0:52:37.271 ********** 2026-04-03 08:39:52.031363 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 08:39:52.031375 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 08:39:52.031385 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 08:39:52.031396 | orchestrator | 2026-04-03 08:39:52.031410 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:39:52.031430 | orchestrator | Friday 03 April 2026 08:39:26 +0000 (0:00:02.138) 0:52:39.409 ********** 2026-04-03 08:39:52.031444 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:39:52.031457 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:39:52.031470 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:39:52.031482 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031495 | orchestrator | 2026-04-03 08:39:52.031509 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:39:52.031521 | orchestrator | Friday 03 April 2026 08:39:27 +0000 (0:00:01.197) 0:52:40.607 ********** 2026-04-03 08:39:52.031606 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-03 08:39:52.031620 | orchestrator | 2026-04-03 08:39:52.031633 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:39:52.031648 | orchestrator | Friday 03 April 2026 08:39:29 +0000 (0:00:01.290) 0:52:41.898 ********** 2026-04-03 08:39:52.031661 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031674 | orchestrator | 2026-04-03 08:39:52.031693 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:39:52.031707 | orchestrator | Friday 03 April 2026 08:39:30 +0000 (0:00:01.134) 0:52:43.032 ********** 2026-04-03 08:39:52.031720 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031733 | orchestrator | 2026-04-03 08:39:52.031746 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:39:52.031759 | orchestrator | Friday 03 April 2026 08:39:31 +0000 (0:00:01.169) 0:52:44.201 ********** 2026-04-03 08:39:52.031779 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031790 | orchestrator | 2026-04-03 08:39:52.031801 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:39:52.031812 | orchestrator | Friday 03 April 2026 08:39:32 +0000 (0:00:01.123) 0:52:45.325 ********** 2026-04-03 08:39:52.031822 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.031833 | orchestrator | 2026-04-03 08:39:52.031844 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:39:52.031868 | orchestrator | Friday 03 April 2026 08:39:33 +0000 (0:00:01.219) 0:52:46.545 ********** 2026-04-03 08:39:52.031879 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:39:52.031912 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:39:52.031931 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:39:52.031948 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.031965 | orchestrator | 2026-04-03 08:39:52.031981 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:39:52.031992 | orchestrator | Friday 03 April 2026 08:39:35 +0000 (0:00:01.441) 0:52:47.987 ********** 2026-04-03 08:39:52.032003 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:39:52.032014 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:39:52.032025 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:39:52.032036 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.032047 | orchestrator | 2026-04-03 08:39:52.032057 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:39:52.032068 | orchestrator | Friday 03 April 2026 08:39:36 +0000 (0:00:01.449) 0:52:49.437 ********** 2026-04-03 08:39:52.032079 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:39:52.032090 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:39:52.032100 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:39:52.032111 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.032122 | orchestrator | 2026-04-03 08:39:52.032133 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:39:52.032143 | orchestrator | Friday 03 April 2026 08:39:37 +0000 (0:00:01.411) 0:52:50.848 ********** 2026-04-03 08:39:52.032154 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.032165 | orchestrator | 2026-04-03 08:39:52.032176 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:39:52.032187 | orchestrator | Friday 03 April 2026 08:39:39 +0000 (0:00:01.164) 0:52:52.012 ********** 2026-04-03 08:39:52.032197 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 08:39:52.032208 | orchestrator | 2026-04-03 08:39:52.032219 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:39:52.032230 | orchestrator | Friday 03 April 2026 08:39:40 +0000 (0:00:01.392) 0:52:53.405 ********** 2026-04-03 08:39:52.032240 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:39:52.032251 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:39:52.032262 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:39:52.032273 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:39:52.032284 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:39:52.032294 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:39:52.032305 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:39:52.032316 | orchestrator | 2026-04-03 08:39:52.032326 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:39:52.032337 | orchestrator | Friday 03 April 2026 08:39:42 +0000 (0:00:02.253) 0:52:55.659 ********** 2026-04-03 08:39:52.032356 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:39:52.032367 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:39:52.032378 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:39:52.032389 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:39:52.032399 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:39:52.032410 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:39:52.032421 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:39:52.032434 | orchestrator | 2026-04-03 08:39:52.032453 | orchestrator | TASK [Prevent restart from the packaging] ************************************** 2026-04-03 08:39:52.032464 | orchestrator | Friday 03 April 2026 08:39:45 +0000 (0:00:03.082) 0:52:58.741 ********** 2026-04-03 08:39:52.032475 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.032486 | orchestrator | 2026-04-03 08:39:52.032497 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:39:52.032508 | orchestrator | Friday 03 April 2026 08:39:47 +0000 (0:00:01.130) 0:52:59.872 ********** 2026-04-03 08:39:52.032518 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-03 08:39:52.032555 | orchestrator | 2026-04-03 08:39:52.032566 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:39:52.032577 | orchestrator | Friday 03 April 2026 08:39:48 +0000 (0:00:01.153) 0:53:01.025 ********** 2026-04-03 08:39:52.032588 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-03 08:39:52.032599 | orchestrator | 2026-04-03 08:39:52.032610 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:39:52.032621 | orchestrator | Friday 03 April 2026 08:39:49 +0000 (0:00:01.164) 0:53:02.189 ********** 2026-04-03 08:39:52.032631 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:39:52.032642 | orchestrator | 2026-04-03 08:39:52.032653 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:39:52.032664 | orchestrator | Friday 03 April 2026 08:39:50 +0000 (0:00:01.193) 0:53:03.383 ********** 2026-04-03 08:39:52.032681 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:39:52.032692 | orchestrator | 2026-04-03 08:39:52.032703 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:39:52.032721 | orchestrator | Friday 03 April 2026 08:39:52 +0000 (0:00:01.498) 0:53:04.881 ********** 2026-04-03 08:40:42.539845 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.539987 | orchestrator | 2026-04-03 08:40:42.540002 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:40:42.540014 | orchestrator | Friday 03 April 2026 08:39:53 +0000 (0:00:01.547) 0:53:06.429 ********** 2026-04-03 08:40:42.540024 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540034 | orchestrator | 2026-04-03 08:40:42.540045 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:40:42.540055 | orchestrator | Friday 03 April 2026 08:39:55 +0000 (0:00:01.629) 0:53:08.059 ********** 2026-04-03 08:40:42.540065 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540075 | orchestrator | 2026-04-03 08:40:42.540085 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:40:42.540095 | orchestrator | Friday 03 April 2026 08:39:56 +0000 (0:00:01.234) 0:53:09.293 ********** 2026-04-03 08:40:42.540104 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540114 | orchestrator | 2026-04-03 08:40:42.540124 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:40:42.540133 | orchestrator | Friday 03 April 2026 08:39:57 +0000 (0:00:01.118) 0:53:10.411 ********** 2026-04-03 08:40:42.540169 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540179 | orchestrator | 2026-04-03 08:40:42.540189 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:40:42.540198 | orchestrator | Friday 03 April 2026 08:39:58 +0000 (0:00:01.115) 0:53:11.527 ********** 2026-04-03 08:40:42.540209 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540219 | orchestrator | 2026-04-03 08:40:42.540229 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:40:42.540238 | orchestrator | Friday 03 April 2026 08:40:00 +0000 (0:00:01.551) 0:53:13.078 ********** 2026-04-03 08:40:42.540247 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540257 | orchestrator | 2026-04-03 08:40:42.540267 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:40:42.540276 | orchestrator | Friday 03 April 2026 08:40:01 +0000 (0:00:01.572) 0:53:14.651 ********** 2026-04-03 08:40:42.540286 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540295 | orchestrator | 2026-04-03 08:40:42.540304 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:40:42.540314 | orchestrator | Friday 03 April 2026 08:40:02 +0000 (0:00:01.141) 0:53:15.792 ********** 2026-04-03 08:40:42.540323 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540333 | orchestrator | 2026-04-03 08:40:42.540342 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:40:42.540352 | orchestrator | Friday 03 April 2026 08:40:04 +0000 (0:00:01.148) 0:53:16.941 ********** 2026-04-03 08:40:42.540363 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540374 | orchestrator | 2026-04-03 08:40:42.540386 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:40:42.540398 | orchestrator | Friday 03 April 2026 08:40:05 +0000 (0:00:01.190) 0:53:18.131 ********** 2026-04-03 08:40:42.540409 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540420 | orchestrator | 2026-04-03 08:40:42.540431 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:40:42.540442 | orchestrator | Friday 03 April 2026 08:40:06 +0000 (0:00:01.230) 0:53:19.361 ********** 2026-04-03 08:40:42.540476 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540487 | orchestrator | 2026-04-03 08:40:42.540498 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:40:42.540509 | orchestrator | Friday 03 April 2026 08:40:07 +0000 (0:00:01.160) 0:53:20.521 ********** 2026-04-03 08:40:42.540520 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540530 | orchestrator | 2026-04-03 08:40:42.540541 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:40:42.540552 | orchestrator | Friday 03 April 2026 08:40:08 +0000 (0:00:01.133) 0:53:21.655 ********** 2026-04-03 08:40:42.540563 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540575 | orchestrator | 2026-04-03 08:40:42.540586 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:40:42.540597 | orchestrator | Friday 03 April 2026 08:40:09 +0000 (0:00:01.143) 0:53:22.799 ********** 2026-04-03 08:40:42.540609 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540619 | orchestrator | 2026-04-03 08:40:42.540630 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:40:42.540641 | orchestrator | Friday 03 April 2026 08:40:11 +0000 (0:00:01.163) 0:53:23.962 ********** 2026-04-03 08:40:42.540653 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540664 | orchestrator | 2026-04-03 08:40:42.540675 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:40:42.540687 | orchestrator | Friday 03 April 2026 08:40:12 +0000 (0:00:01.140) 0:53:25.103 ********** 2026-04-03 08:40:42.540697 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.540709 | orchestrator | 2026-04-03 08:40:42.540718 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:40:42.540728 | orchestrator | Friday 03 April 2026 08:40:13 +0000 (0:00:01.116) 0:53:26.219 ********** 2026-04-03 08:40:42.540737 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540754 | orchestrator | 2026-04-03 08:40:42.540763 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:40:42.540773 | orchestrator | Friday 03 April 2026 08:40:14 +0000 (0:00:01.122) 0:53:27.341 ********** 2026-04-03 08:40:42.540783 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540792 | orchestrator | 2026-04-03 08:40:42.540802 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:40:42.540811 | orchestrator | Friday 03 April 2026 08:40:15 +0000 (0:00:01.165) 0:53:28.506 ********** 2026-04-03 08:40:42.540820 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540830 | orchestrator | 2026-04-03 08:40:42.540839 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:40:42.540865 | orchestrator | Friday 03 April 2026 08:40:16 +0000 (0:00:01.125) 0:53:29.632 ********** 2026-04-03 08:40:42.540875 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540884 | orchestrator | 2026-04-03 08:40:42.540894 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:40:42.540922 | orchestrator | Friday 03 April 2026 08:40:17 +0000 (0:00:01.099) 0:53:30.731 ********** 2026-04-03 08:40:42.540932 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540942 | orchestrator | 2026-04-03 08:40:42.540951 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:40:42.540961 | orchestrator | Friday 03 April 2026 08:40:19 +0000 (0:00:01.177) 0:53:31.909 ********** 2026-04-03 08:40:42.540970 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.540979 | orchestrator | 2026-04-03 08:40:42.540989 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:40:42.540998 | orchestrator | Friday 03 April 2026 08:40:20 +0000 (0:00:01.169) 0:53:33.079 ********** 2026-04-03 08:40:42.541007 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541017 | orchestrator | 2026-04-03 08:40:42.541026 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:40:42.541038 | orchestrator | Friday 03 April 2026 08:40:21 +0000 (0:00:01.113) 0:53:34.193 ********** 2026-04-03 08:40:42.541047 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541056 | orchestrator | 2026-04-03 08:40:42.541066 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:40:42.541075 | orchestrator | Friday 03 April 2026 08:40:22 +0000 (0:00:01.213) 0:53:35.406 ********** 2026-04-03 08:40:42.541084 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541094 | orchestrator | 2026-04-03 08:40:42.541103 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:40:42.541113 | orchestrator | Friday 03 April 2026 08:40:23 +0000 (0:00:01.138) 0:53:36.545 ********** 2026-04-03 08:40:42.541122 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541132 | orchestrator | 2026-04-03 08:40:42.541141 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:40:42.541151 | orchestrator | Friday 03 April 2026 08:40:24 +0000 (0:00:01.138) 0:53:37.683 ********** 2026-04-03 08:40:42.541160 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541169 | orchestrator | 2026-04-03 08:40:42.541178 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:40:42.541188 | orchestrator | Friday 03 April 2026 08:40:25 +0000 (0:00:01.154) 0:53:38.837 ********** 2026-04-03 08:40:42.541197 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541206 | orchestrator | 2026-04-03 08:40:42.541216 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:40:42.541225 | orchestrator | Friday 03 April 2026 08:40:27 +0000 (0:00:01.120) 0:53:39.958 ********** 2026-04-03 08:40:42.541235 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.541244 | orchestrator | 2026-04-03 08:40:42.541253 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:40:42.541263 | orchestrator | Friday 03 April 2026 08:40:28 +0000 (0:00:01.887) 0:53:41.846 ********** 2026-04-03 08:40:42.541279 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.541288 | orchestrator | 2026-04-03 08:40:42.541298 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:40:42.541308 | orchestrator | Friday 03 April 2026 08:40:31 +0000 (0:00:02.278) 0:53:44.125 ********** 2026-04-03 08:40:42.541317 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-03 08:40:42.541326 | orchestrator | 2026-04-03 08:40:42.541336 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:40:42.541345 | orchestrator | Friday 03 April 2026 08:40:32 +0000 (0:00:01.145) 0:53:45.271 ********** 2026-04-03 08:40:42.541355 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541364 | orchestrator | 2026-04-03 08:40:42.541373 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:40:42.541383 | orchestrator | Friday 03 April 2026 08:40:33 +0000 (0:00:01.151) 0:53:46.423 ********** 2026-04-03 08:40:42.541392 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541401 | orchestrator | 2026-04-03 08:40:42.541411 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:40:42.541420 | orchestrator | Friday 03 April 2026 08:40:34 +0000 (0:00:01.136) 0:53:47.559 ********** 2026-04-03 08:40:42.541429 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:40:42.541439 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:40:42.541448 | orchestrator | 2026-04-03 08:40:42.541474 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:40:42.541484 | orchestrator | Friday 03 April 2026 08:40:36 +0000 (0:00:01.824) 0:53:49.384 ********** 2026-04-03 08:40:42.541493 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:40:42.541502 | orchestrator | 2026-04-03 08:40:42.541512 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:40:42.541521 | orchestrator | Friday 03 April 2026 08:40:37 +0000 (0:00:01.431) 0:53:50.816 ********** 2026-04-03 08:40:42.541531 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541540 | orchestrator | 2026-04-03 08:40:42.541550 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:40:42.541560 | orchestrator | Friday 03 April 2026 08:40:39 +0000 (0:00:01.147) 0:53:51.964 ********** 2026-04-03 08:40:42.541569 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541578 | orchestrator | 2026-04-03 08:40:42.541588 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:40:42.541598 | orchestrator | Friday 03 April 2026 08:40:40 +0000 (0:00:01.143) 0:53:53.107 ********** 2026-04-03 08:40:42.541607 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:40:42.541617 | orchestrator | 2026-04-03 08:40:42.541626 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:40:42.541636 | orchestrator | Friday 03 April 2026 08:40:41 +0000 (0:00:01.121) 0:53:54.229 ********** 2026-04-03 08:40:42.541651 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-03 08:40:42.541660 | orchestrator | 2026-04-03 08:40:42.541670 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:40:42.541685 | orchestrator | Friday 03 April 2026 08:40:42 +0000 (0:00:01.162) 0:53:55.392 ********** 2026-04-03 08:41:28.516895 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:41:28.517012 | orchestrator | 2026-04-03 08:41:28.517029 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:41:28.517041 | orchestrator | Friday 03 April 2026 08:40:44 +0000 (0:00:01.669) 0:53:57.061 ********** 2026-04-03 08:41:28.517052 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:41:28.517062 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:41:28.517072 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:41:28.517104 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517115 | orchestrator | 2026-04-03 08:41:28.517125 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:41:28.517135 | orchestrator | Friday 03 April 2026 08:40:45 +0000 (0:00:01.178) 0:53:58.240 ********** 2026-04-03 08:41:28.517145 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517154 | orchestrator | 2026-04-03 08:41:28.517164 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:41:28.517174 | orchestrator | Friday 03 April 2026 08:40:46 +0000 (0:00:01.154) 0:53:59.394 ********** 2026-04-03 08:41:28.517183 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517193 | orchestrator | 2026-04-03 08:41:28.517203 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:41:28.517212 | orchestrator | Friday 03 April 2026 08:40:47 +0000 (0:00:01.210) 0:54:00.605 ********** 2026-04-03 08:41:28.517222 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517231 | orchestrator | 2026-04-03 08:41:28.517241 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:41:28.517251 | orchestrator | Friday 03 April 2026 08:40:48 +0000 (0:00:01.150) 0:54:01.755 ********** 2026-04-03 08:41:28.517261 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517270 | orchestrator | 2026-04-03 08:41:28.517280 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:41:28.517289 | orchestrator | Friday 03 April 2026 08:40:50 +0000 (0:00:01.180) 0:54:02.936 ********** 2026-04-03 08:41:28.517300 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517309 | orchestrator | 2026-04-03 08:41:28.517319 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:41:28.517329 | orchestrator | Friday 03 April 2026 08:40:51 +0000 (0:00:01.173) 0:54:04.109 ********** 2026-04-03 08:41:28.517338 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:41:28.517348 | orchestrator | 2026-04-03 08:41:28.517357 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:41:28.517367 | orchestrator | Friday 03 April 2026 08:40:53 +0000 (0:00:02.498) 0:54:06.608 ********** 2026-04-03 08:41:28.517376 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:41:28.517386 | orchestrator | 2026-04-03 08:41:28.517423 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:41:28.517435 | orchestrator | Friday 03 April 2026 08:40:54 +0000 (0:00:01.147) 0:54:07.755 ********** 2026-04-03 08:41:28.517447 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-03 08:41:28.517458 | orchestrator | 2026-04-03 08:41:28.517470 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:41:28.517480 | orchestrator | Friday 03 April 2026 08:40:56 +0000 (0:00:01.217) 0:54:08.973 ********** 2026-04-03 08:41:28.517492 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517502 | orchestrator | 2026-04-03 08:41:28.517513 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:41:28.517524 | orchestrator | Friday 03 April 2026 08:40:57 +0000 (0:00:01.138) 0:54:10.112 ********** 2026-04-03 08:41:28.517535 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517546 | orchestrator | 2026-04-03 08:41:28.517557 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:41:28.517568 | orchestrator | Friday 03 April 2026 08:40:58 +0000 (0:00:01.137) 0:54:11.249 ********** 2026-04-03 08:41:28.517579 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517591 | orchestrator | 2026-04-03 08:41:28.517602 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:41:28.517612 | orchestrator | Friday 03 April 2026 08:40:59 +0000 (0:00:01.133) 0:54:12.383 ********** 2026-04-03 08:41:28.517623 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517634 | orchestrator | 2026-04-03 08:41:28.517646 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:41:28.517668 | orchestrator | Friday 03 April 2026 08:41:00 +0000 (0:00:01.214) 0:54:13.598 ********** 2026-04-03 08:41:28.517679 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517690 | orchestrator | 2026-04-03 08:41:28.517702 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:41:28.517713 | orchestrator | Friday 03 April 2026 08:41:01 +0000 (0:00:01.172) 0:54:14.771 ********** 2026-04-03 08:41:28.517724 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517735 | orchestrator | 2026-04-03 08:41:28.517746 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:41:28.517758 | orchestrator | Friday 03 April 2026 08:41:03 +0000 (0:00:01.189) 0:54:15.961 ********** 2026-04-03 08:41:28.517769 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517780 | orchestrator | 2026-04-03 08:41:28.517792 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:41:28.517803 | orchestrator | Friday 03 April 2026 08:41:04 +0000 (0:00:01.163) 0:54:17.124 ********** 2026-04-03 08:41:28.517812 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.517822 | orchestrator | 2026-04-03 08:41:28.517831 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:41:28.517854 | orchestrator | Friday 03 April 2026 08:41:05 +0000 (0:00:01.223) 0:54:18.347 ********** 2026-04-03 08:41:28.517864 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:41:28.517873 | orchestrator | 2026-04-03 08:41:28.517883 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:41:28.517909 | orchestrator | Friday 03 April 2026 08:41:06 +0000 (0:00:01.182) 0:54:19.530 ********** 2026-04-03 08:41:28.517919 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-03 08:41:28.517930 | orchestrator | 2026-04-03 08:41:28.517940 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:41:28.517950 | orchestrator | Friday 03 April 2026 08:41:07 +0000 (0:00:01.119) 0:54:20.650 ********** 2026-04-03 08:41:28.517959 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-03 08:41:28.517969 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-03 08:41:28.517979 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-03 08:41:28.517989 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-03 08:41:28.517998 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-03 08:41:28.518008 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-03 08:41:28.518072 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-03 08:41:28.518085 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:41:28.518094 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:41:28.518104 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:41:28.518114 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:41:28.518124 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:41:28.518133 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:41:28.518143 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:41:28.518153 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-03 08:41:28.518162 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-03 08:41:28.518172 | orchestrator | 2026-04-03 08:41:28.518182 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:41:28.518192 | orchestrator | Friday 03 April 2026 08:41:14 +0000 (0:00:06.587) 0:54:27.238 ********** 2026-04-03 08:41:28.518201 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-03 08:41:28.518211 | orchestrator | 2026-04-03 08:41:28.518221 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:41:28.518231 | orchestrator | Friday 03 April 2026 08:41:15 +0000 (0:00:01.201) 0:54:28.439 ********** 2026-04-03 08:41:28.518248 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:41:28.518259 | orchestrator | 2026-04-03 08:41:28.518269 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:41:28.518278 | orchestrator | Friday 03 April 2026 08:41:17 +0000 (0:00:01.541) 0:54:29.981 ********** 2026-04-03 08:41:28.518288 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:41:28.518298 | orchestrator | 2026-04-03 08:41:28.518308 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:41:28.518318 | orchestrator | Friday 03 April 2026 08:41:19 +0000 (0:00:02.056) 0:54:32.039 ********** 2026-04-03 08:41:28.518327 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518337 | orchestrator | 2026-04-03 08:41:28.518347 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:41:28.518356 | orchestrator | Friday 03 April 2026 08:41:20 +0000 (0:00:01.141) 0:54:33.181 ********** 2026-04-03 08:41:28.518446 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518457 | orchestrator | 2026-04-03 08:41:28.518466 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:41:28.518476 | orchestrator | Friday 03 April 2026 08:41:21 +0000 (0:00:01.161) 0:54:34.343 ********** 2026-04-03 08:41:28.518485 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518495 | orchestrator | 2026-04-03 08:41:28.518505 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:41:28.518515 | orchestrator | Friday 03 April 2026 08:41:22 +0000 (0:00:01.175) 0:54:35.519 ********** 2026-04-03 08:41:28.518524 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518534 | orchestrator | 2026-04-03 08:41:28.518543 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:41:28.518553 | orchestrator | Friday 03 April 2026 08:41:23 +0000 (0:00:01.146) 0:54:36.666 ********** 2026-04-03 08:41:28.518562 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518572 | orchestrator | 2026-04-03 08:41:28.518582 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:41:28.518592 | orchestrator | Friday 03 April 2026 08:41:24 +0000 (0:00:01.124) 0:54:37.790 ********** 2026-04-03 08:41:28.518601 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518611 | orchestrator | 2026-04-03 08:41:28.518621 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:41:28.518631 | orchestrator | Friday 03 April 2026 08:41:26 +0000 (0:00:01.142) 0:54:38.933 ********** 2026-04-03 08:41:28.518640 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518650 | orchestrator | 2026-04-03 08:41:28.518660 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:41:28.518669 | orchestrator | Friday 03 April 2026 08:41:27 +0000 (0:00:01.142) 0:54:40.075 ********** 2026-04-03 08:41:28.518679 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518688 | orchestrator | 2026-04-03 08:41:28.518704 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:41:28.518714 | orchestrator | Friday 03 April 2026 08:41:28 +0000 (0:00:01.140) 0:54:41.215 ********** 2026-04-03 08:41:28.518724 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:41:28.518734 | orchestrator | 2026-04-03 08:41:28.518752 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:42:25.150639 | orchestrator | Friday 03 April 2026 08:41:29 +0000 (0:00:01.132) 0:54:42.348 ********** 2026-04-03 08:42:25.150755 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.150771 | orchestrator | 2026-04-03 08:42:25.150784 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:42:25.150796 | orchestrator | Friday 03 April 2026 08:41:30 +0000 (0:00:01.140) 0:54:43.488 ********** 2026-04-03 08:42:25.150832 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.150844 | orchestrator | 2026-04-03 08:42:25.150855 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:42:25.150866 | orchestrator | Friday 03 April 2026 08:41:31 +0000 (0:00:01.209) 0:54:44.697 ********** 2026-04-03 08:42:25.150876 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:42:25.150887 | orchestrator | 2026-04-03 08:42:25.150898 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:42:25.150909 | orchestrator | Friday 03 April 2026 08:41:36 +0000 (0:00:04.309) 0:54:49.007 ********** 2026-04-03 08:42:25.150920 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:42:25.150933 | orchestrator | 2026-04-03 08:42:25.150944 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:42:25.150955 | orchestrator | Friday 03 April 2026 08:41:37 +0000 (0:00:01.227) 0:54:50.235 ********** 2026-04-03 08:42:25.150968 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-03 08:42:25.150983 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-03 08:42:25.150994 | orchestrator | 2026-04-03 08:42:25.151005 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:42:25.151016 | orchestrator | Friday 03 April 2026 08:41:42 +0000 (0:00:05.227) 0:54:55.463 ********** 2026-04-03 08:42:25.151027 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151037 | orchestrator | 2026-04-03 08:42:25.151048 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:42:25.151059 | orchestrator | Friday 03 April 2026 08:41:43 +0000 (0:00:01.124) 0:54:56.588 ********** 2026-04-03 08:42:25.151069 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151080 | orchestrator | 2026-04-03 08:42:25.151091 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:42:25.151101 | orchestrator | Friday 03 April 2026 08:41:44 +0000 (0:00:01.140) 0:54:57.728 ********** 2026-04-03 08:42:25.151112 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151123 | orchestrator | 2026-04-03 08:42:25.151134 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:42:25.151145 | orchestrator | Friday 03 April 2026 08:41:46 +0000 (0:00:01.240) 0:54:58.969 ********** 2026-04-03 08:42:25.151159 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151172 | orchestrator | 2026-04-03 08:42:25.151185 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:42:25.151198 | orchestrator | Friday 03 April 2026 08:41:47 +0000 (0:00:01.205) 0:55:00.175 ********** 2026-04-03 08:42:25.151210 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151222 | orchestrator | 2026-04-03 08:42:25.151235 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:42:25.151248 | orchestrator | Friday 03 April 2026 08:41:48 +0000 (0:00:01.172) 0:55:01.347 ********** 2026-04-03 08:42:25.151260 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.151274 | orchestrator | 2026-04-03 08:42:25.151287 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:42:25.151299 | orchestrator | Friday 03 April 2026 08:41:49 +0000 (0:00:01.283) 0:55:02.630 ********** 2026-04-03 08:42:25.151341 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:42:25.151356 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:42:25.151369 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:42:25.151382 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151395 | orchestrator | 2026-04-03 08:42:25.151407 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:42:25.151420 | orchestrator | Friday 03 April 2026 08:41:51 +0000 (0:00:01.448) 0:55:04.079 ********** 2026-04-03 08:42:25.151433 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:42:25.151445 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:42:25.151458 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:42:25.151471 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151483 | orchestrator | 2026-04-03 08:42:25.151513 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:42:25.151526 | orchestrator | Friday 03 April 2026 08:41:52 +0000 (0:00:01.435) 0:55:05.515 ********** 2026-04-03 08:42:25.151537 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:42:25.151548 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:42:25.151559 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:42:25.151587 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151599 | orchestrator | 2026-04-03 08:42:25.151610 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:42:25.151620 | orchestrator | Friday 03 April 2026 08:41:54 +0000 (0:00:01.475) 0:55:06.990 ********** 2026-04-03 08:42:25.151631 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.151642 | orchestrator | 2026-04-03 08:42:25.151653 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:42:25.151664 | orchestrator | Friday 03 April 2026 08:41:55 +0000 (0:00:01.297) 0:55:08.288 ********** 2026-04-03 08:42:25.151675 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 08:42:25.151685 | orchestrator | 2026-04-03 08:42:25.151696 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:42:25.151707 | orchestrator | Friday 03 April 2026 08:41:56 +0000 (0:00:01.386) 0:55:09.674 ********** 2026-04-03 08:42:25.151718 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.151728 | orchestrator | 2026-04-03 08:42:25.151739 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-03 08:42:25.151750 | orchestrator | Friday 03 April 2026 08:41:59 +0000 (0:00:02.295) 0:55:11.969 ********** 2026-04-03 08:42:25.151761 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.151771 | orchestrator | 2026-04-03 08:42:25.151782 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-03 08:42:25.151793 | orchestrator | Friday 03 April 2026 08:42:00 +0000 (0:00:01.142) 0:55:13.112 ********** 2026-04-03 08:42:25.151804 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-5 2026-04-03 08:42:25.151814 | orchestrator | 2026-04-03 08:42:25.151825 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-03 08:42:25.151836 | orchestrator | Friday 03 April 2026 08:42:01 +0000 (0:00:01.563) 0:55:14.676 ********** 2026-04-03 08:42:25.151847 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 08:42:25.151857 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-03 08:42:25.151868 | orchestrator | 2026-04-03 08:42:25.151879 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-03 08:42:25.151889 | orchestrator | Friday 03 April 2026 08:42:03 +0000 (0:00:01.945) 0:55:16.621 ********** 2026-04-03 08:42:25.151900 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:42:25.151911 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 08:42:25.151922 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:42:25.151941 | orchestrator | 2026-04-03 08:42:25.151952 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:42:25.151962 | orchestrator | Friday 03 April 2026 08:42:07 +0000 (0:00:03.316) 0:55:19.938 ********** 2026-04-03 08:42:25.151973 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 08:42:25.151984 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 08:42:25.151995 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152006 | orchestrator | 2026-04-03 08:42:25.152017 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-03 08:42:25.152027 | orchestrator | Friday 03 April 2026 08:42:09 +0000 (0:00:01.998) 0:55:21.936 ********** 2026-04-03 08:42:25.152038 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152049 | orchestrator | 2026-04-03 08:42:25.152060 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-03 08:42:25.152070 | orchestrator | Friday 03 April 2026 08:42:10 +0000 (0:00:01.483) 0:55:23.420 ********** 2026-04-03 08:42:25.152081 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:42:25.152092 | orchestrator | 2026-04-03 08:42:25.152103 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-03 08:42:25.152113 | orchestrator | Friday 03 April 2026 08:42:11 +0000 (0:00:01.139) 0:55:24.560 ********** 2026-04-03 08:42:25.152124 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-5 2026-04-03 08:42:25.152136 | orchestrator | 2026-04-03 08:42:25.152147 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-03 08:42:25.152157 | orchestrator | Friday 03 April 2026 08:42:13 +0000 (0:00:01.464) 0:55:26.024 ********** 2026-04-03 08:42:25.152168 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-5 2026-04-03 08:42:25.152178 | orchestrator | 2026-04-03 08:42:25.152190 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-03 08:42:25.152200 | orchestrator | Friday 03 April 2026 08:42:14 +0000 (0:00:01.633) 0:55:27.658 ********** 2026-04-03 08:42:25.152211 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152222 | orchestrator | 2026-04-03 08:42:25.152232 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-03 08:42:25.152243 | orchestrator | Friday 03 April 2026 08:42:16 +0000 (0:00:02.013) 0:55:29.672 ********** 2026-04-03 08:42:25.152254 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152265 | orchestrator | 2026-04-03 08:42:25.152276 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-03 08:42:25.152286 | orchestrator | Friday 03 April 2026 08:42:18 +0000 (0:00:01.989) 0:55:31.661 ********** 2026-04-03 08:42:25.152297 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152308 | orchestrator | 2026-04-03 08:42:25.152348 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-03 08:42:25.152360 | orchestrator | Friday 03 April 2026 08:42:21 +0000 (0:00:02.312) 0:55:33.974 ********** 2026-04-03 08:42:25.152371 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152381 | orchestrator | 2026-04-03 08:42:25.152398 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-03 08:42:25.152409 | orchestrator | Friday 03 April 2026 08:42:23 +0000 (0:00:02.315) 0:55:36.290 ********** 2026-04-03 08:42:25.152419 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:42:25.152430 | orchestrator | 2026-04-03 08:42:25.152441 | orchestrator | TASK [Restart ceph mds] ******************************************************** 2026-04-03 08:42:25.152452 | orchestrator | Friday 03 April 2026 08:42:25 +0000 (0:00:01.675) 0:55:37.965 ********** 2026-04-03 08:42:25.152470 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:43:00.709105 | orchestrator | 2026-04-03 08:43:00.709219 | orchestrator | TASK [Restart active mds] ****************************************************** 2026-04-03 08:43:00.709237 | orchestrator | Friday 03 April 2026 08:42:26 +0000 (0:00:01.183) 0:55:39.149 ********** 2026-04-03 08:43:00.709249 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:43:00.709262 | orchestrator | 2026-04-03 08:43:00.709368 | orchestrator | PLAY [Upgrade standbys ceph mdss cluster] ************************************** 2026-04-03 08:43:00.709385 | orchestrator | 2026-04-03 08:43:00.709396 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:43:00.709407 | orchestrator | Friday 03 April 2026 08:42:37 +0000 (0:00:10.845) 0:55:49.995 ********** 2026-04-03 08:43:00.709418 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4, testbed-node-3 2026-04-03 08:43:00.709430 | orchestrator | 2026-04-03 08:43:00.709441 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:43:00.709451 | orchestrator | Friday 03 April 2026 08:42:38 +0000 (0:00:01.460) 0:55:51.456 ********** 2026-04-03 08:43:00.709462 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709473 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709484 | orchestrator | 2026-04-03 08:43:00.709495 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:43:00.709506 | orchestrator | Friday 03 April 2026 08:42:40 +0000 (0:00:01.564) 0:55:53.020 ********** 2026-04-03 08:43:00.709516 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709527 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709538 | orchestrator | 2026-04-03 08:43:00.709549 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:43:00.709560 | orchestrator | Friday 03 April 2026 08:42:41 +0000 (0:00:01.319) 0:55:54.340 ********** 2026-04-03 08:43:00.709571 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709581 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709592 | orchestrator | 2026-04-03 08:43:00.709603 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:43:00.709614 | orchestrator | Friday 03 April 2026 08:42:43 +0000 (0:00:01.580) 0:55:55.920 ********** 2026-04-03 08:43:00.709625 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709638 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709650 | orchestrator | 2026-04-03 08:43:00.709663 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:43:00.709677 | orchestrator | Friday 03 April 2026 08:42:44 +0000 (0:00:01.315) 0:55:57.236 ********** 2026-04-03 08:43:00.709690 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709704 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709717 | orchestrator | 2026-04-03 08:43:00.709730 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:43:00.709743 | orchestrator | Friday 03 April 2026 08:42:45 +0000 (0:00:01.298) 0:55:58.534 ********** 2026-04-03 08:43:00.709756 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709769 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709782 | orchestrator | 2026-04-03 08:43:00.709796 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:43:00.709810 | orchestrator | Friday 03 April 2026 08:42:46 +0000 (0:00:01.299) 0:55:59.834 ********** 2026-04-03 08:43:00.709823 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:00.709837 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:00.709849 | orchestrator | 2026-04-03 08:43:00.709863 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:43:00.709876 | orchestrator | Friday 03 April 2026 08:42:48 +0000 (0:00:01.288) 0:56:01.122 ********** 2026-04-03 08:43:00.709888 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.709902 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.709914 | orchestrator | 2026-04-03 08:43:00.709927 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:43:00.709940 | orchestrator | Friday 03 April 2026 08:42:49 +0000 (0:00:01.237) 0:56:02.360 ********** 2026-04-03 08:43:00.709953 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:43:00.709965 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:43:00.709979 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:43:00.710000 | orchestrator | 2026-04-03 08:43:00.710071 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:43:00.710085 | orchestrator | Friday 03 April 2026 08:42:51 +0000 (0:00:01.710) 0:56:04.071 ********** 2026-04-03 08:43:00.710096 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:00.710107 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:00.710118 | orchestrator | 2026-04-03 08:43:00.710128 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:43:00.710139 | orchestrator | Friday 03 April 2026 08:42:52 +0000 (0:00:01.425) 0:56:05.496 ********** 2026-04-03 08:43:00.710160 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:43:00.710171 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:43:00.710182 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:43:00.710193 | orchestrator | 2026-04-03 08:43:00.710204 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:43:00.710215 | orchestrator | Friday 03 April 2026 08:42:55 +0000 (0:00:03.289) 0:56:08.786 ********** 2026-04-03 08:43:00.710226 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:43:00.710237 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:43:00.710248 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:43:00.710260 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:00.710271 | orchestrator | 2026-04-03 08:43:00.710307 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:43:00.710319 | orchestrator | Friday 03 April 2026 08:42:57 +0000 (0:00:01.468) 0:56:10.255 ********** 2026-04-03 08:43:00.710351 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710367 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710379 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710390 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:00.710401 | orchestrator | 2026-04-03 08:43:00.710457 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:43:00.710470 | orchestrator | Friday 03 April 2026 08:42:59 +0000 (0:00:01.949) 0:56:12.204 ********** 2026-04-03 08:43:00.710483 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710497 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710508 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:00.710529 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:00.710540 | orchestrator | 2026-04-03 08:43:00.710551 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:43:00.710562 | orchestrator | Friday 03 April 2026 08:43:00 +0000 (0:00:01.238) 0:56:13.443 ********** 2026-04-03 08:43:00.710575 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:42:53.148046', 'end': '2026-04-03 08:42:53.188928', 'delta': '0:00:00.040882', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:43:00.710594 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:42:53.693041', 'end': '2026-04-03 08:42:53.740311', 'delta': '0:00:00.047270', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:43:00.710615 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:42:54.606500', 'end': '2026-04-03 08:42:54.653248', 'delta': '0:00:00.046748', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:43:21.334111 | orchestrator | 2026-04-03 08:43:21.334229 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:43:21.334247 | orchestrator | Friday 03 April 2026 08:43:01 +0000 (0:00:01.205) 0:56:14.649 ********** 2026-04-03 08:43:21.334317 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.334331 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.334342 | orchestrator | 2026-04-03 08:43:21.334354 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:43:21.334365 | orchestrator | Friday 03 April 2026 08:43:03 +0000 (0:00:01.816) 0:56:16.466 ********** 2026-04-03 08:43:21.334376 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334388 | orchestrator | 2026-04-03 08:43:21.334399 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:43:21.334409 | orchestrator | Friday 03 April 2026 08:43:04 +0000 (0:00:01.257) 0:56:17.723 ********** 2026-04-03 08:43:21.334420 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.334431 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.334442 | orchestrator | 2026-04-03 08:43:21.334453 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:43:21.334489 | orchestrator | Friday 03 April 2026 08:43:06 +0000 (0:00:01.379) 0:56:19.103 ********** 2026-04-03 08:43:21.334501 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:43:21.334512 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:43:21.334523 | orchestrator | 2026-04-03 08:43:21.334534 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:43:21.334545 | orchestrator | Friday 03 April 2026 08:43:08 +0000 (0:00:02.326) 0:56:21.430 ********** 2026-04-03 08:43:21.334555 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.334566 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.334577 | orchestrator | 2026-04-03 08:43:21.334590 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:43:21.334604 | orchestrator | Friday 03 April 2026 08:43:09 +0000 (0:00:01.236) 0:56:22.666 ********** 2026-04-03 08:43:21.334616 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334628 | orchestrator | 2026-04-03 08:43:21.334641 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:43:21.334653 | orchestrator | Friday 03 April 2026 08:43:10 +0000 (0:00:01.168) 0:56:23.835 ********** 2026-04-03 08:43:21.334665 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334693 | orchestrator | 2026-04-03 08:43:21.334707 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:43:21.334720 | orchestrator | Friday 03 April 2026 08:43:12 +0000 (0:00:01.310) 0:56:25.146 ********** 2026-04-03 08:43:21.334744 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334757 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:21.334769 | orchestrator | 2026-04-03 08:43:21.334783 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:43:21.334796 | orchestrator | Friday 03 April 2026 08:43:13 +0000 (0:00:01.230) 0:56:26.377 ********** 2026-04-03 08:43:21.334807 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334818 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:21.334829 | orchestrator | 2026-04-03 08:43:21.334840 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:43:21.334851 | orchestrator | Friday 03 April 2026 08:43:14 +0000 (0:00:01.273) 0:56:27.650 ********** 2026-04-03 08:43:21.334861 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.334872 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.334883 | orchestrator | 2026-04-03 08:43:21.334894 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:43:21.334905 | orchestrator | Friday 03 April 2026 08:43:16 +0000 (0:00:01.279) 0:56:28.930 ********** 2026-04-03 08:43:21.334916 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.334927 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:21.334937 | orchestrator | 2026-04-03 08:43:21.334948 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:43:21.334959 | orchestrator | Friday 03 April 2026 08:43:17 +0000 (0:00:01.229) 0:56:30.159 ********** 2026-04-03 08:43:21.334970 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.334981 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.334991 | orchestrator | 2026-04-03 08:43:21.335002 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:43:21.335013 | orchestrator | Friday 03 April 2026 08:43:18 +0000 (0:00:01.283) 0:56:31.442 ********** 2026-04-03 08:43:21.335024 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.335035 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:21.335046 | orchestrator | 2026-04-03 08:43:21.335058 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:43:21.335069 | orchestrator | Friday 03 April 2026 08:43:19 +0000 (0:00:01.249) 0:56:32.691 ********** 2026-04-03 08:43:21.335080 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:21.335091 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:21.335102 | orchestrator | 2026-04-03 08:43:21.335127 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:43:21.335148 | orchestrator | Friday 03 April 2026 08:43:21 +0000 (0:00:01.304) 0:56:33.996 ********** 2026-04-03 08:43:21.335163 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.335196 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}})  2026-04-03 08:43:21.335212 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:43:21.335224 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}})  2026-04-03 08:43:21.335236 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.335248 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.335285 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:43:21.335306 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.335326 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:43:21.423849 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.423945 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}})  2026-04-03 08:43:21.423961 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}})  2026-04-03 08:43:21.423974 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.423986 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.424035 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}})  2026-04-03 08:43:21.424070 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:43:21.424085 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:43:21.424097 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}})  2026-04-03 08:43:21.424122 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.424134 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.424153 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542335 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542424 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542436 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:43:21.542444 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542452 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:21.542462 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542504 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542512 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}})  2026-04-03 08:43:21.542536 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}})  2026-04-03 08:43:21.542544 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542559 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:43:21.542573 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542582 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:43:21.542594 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:43:23.256826 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:23.256935 | orchestrator | 2026-04-03 08:43:23.256953 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:43:23.256967 | orchestrator | Friday 03 April 2026 08:43:22 +0000 (0:00:01.534) 0:56:35.531 ********** 2026-04-03 08:43:23.256981 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.256997 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257048 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257061 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257095 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257108 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257121 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257139 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257156 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257168 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.257186 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329035 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329159 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329192 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329226 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329239 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329304 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329323 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329335 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.329355 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473530 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:23.473624 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473665 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473678 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473703 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473714 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473745 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473755 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473774 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473790 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473801 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:23.473821 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:51.325480 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:51.325632 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:51.325663 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:43:51.325685 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.325705 | orchestrator | 2026-04-03 08:43:51.325724 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:43:51.325744 | orchestrator | Friday 03 April 2026 08:43:24 +0000 (0:00:02.014) 0:56:37.545 ********** 2026-04-03 08:43:51.325762 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:51.325780 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:51.325796 | orchestrator | 2026-04-03 08:43:51.325815 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:43:51.325831 | orchestrator | Friday 03 April 2026 08:43:26 +0000 (0:00:01.556) 0:56:39.102 ********** 2026-04-03 08:43:51.325879 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:51.325898 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:51.325917 | orchestrator | 2026-04-03 08:43:51.325934 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:43:51.325952 | orchestrator | Friday 03 April 2026 08:43:27 +0000 (0:00:01.243) 0:56:40.346 ********** 2026-04-03 08:43:51.325971 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:51.325990 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:51.326010 | orchestrator | 2026-04-03 08:43:51.326086 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:43:51.326098 | orchestrator | Friday 03 April 2026 08:43:29 +0000 (0:00:01.606) 0:56:41.953 ********** 2026-04-03 08:43:51.326108 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326119 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326130 | orchestrator | 2026-04-03 08:43:51.326141 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:43:51.326152 | orchestrator | Friday 03 April 2026 08:43:30 +0000 (0:00:01.373) 0:56:43.326 ********** 2026-04-03 08:43:51.326163 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326174 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326185 | orchestrator | 2026-04-03 08:43:51.326195 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:43:51.326206 | orchestrator | Friday 03 April 2026 08:43:31 +0000 (0:00:01.377) 0:56:44.704 ********** 2026-04-03 08:43:51.326217 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326250 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326262 | orchestrator | 2026-04-03 08:43:51.326273 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:43:51.326283 | orchestrator | Friday 03 April 2026 08:43:33 +0000 (0:00:01.320) 0:56:46.025 ********** 2026-04-03 08:43:51.326294 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 08:43:51.326306 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 08:43:51.326316 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 08:43:51.326327 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 08:43:51.326337 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 08:43:51.326348 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 08:43:51.326359 | orchestrator | 2026-04-03 08:43:51.326370 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:43:51.326381 | orchestrator | Friday 03 April 2026 08:43:34 +0000 (0:00:01.802) 0:56:47.827 ********** 2026-04-03 08:43:51.326414 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:43:51.326426 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:43:51.326437 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:43:51.326447 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326458 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 08:43:51.326468 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 08:43:51.326479 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 08:43:51.326490 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326500 | orchestrator | 2026-04-03 08:43:51.326511 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:43:51.326522 | orchestrator | Friday 03 April 2026 08:43:36 +0000 (0:00:01.383) 0:56:49.211 ********** 2026-04-03 08:43:51.326542 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4, testbed-node-3 2026-04-03 08:43:51.326554 | orchestrator | 2026-04-03 08:43:51.326565 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:43:51.326578 | orchestrator | Friday 03 April 2026 08:43:37 +0000 (0:00:01.221) 0:56:50.432 ********** 2026-04-03 08:43:51.326601 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326612 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326622 | orchestrator | 2026-04-03 08:43:51.326633 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:43:51.326644 | orchestrator | Friday 03 April 2026 08:43:38 +0000 (0:00:01.232) 0:56:51.665 ********** 2026-04-03 08:43:51.326657 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326676 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326693 | orchestrator | 2026-04-03 08:43:51.326712 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:43:51.326731 | orchestrator | Friday 03 April 2026 08:43:40 +0000 (0:00:01.235) 0:56:52.901 ********** 2026-04-03 08:43:51.326749 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326767 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:43:51.326787 | orchestrator | 2026-04-03 08:43:51.326806 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:43:51.326826 | orchestrator | Friday 03 April 2026 08:43:41 +0000 (0:00:01.608) 0:56:54.509 ********** 2026-04-03 08:43:51.326838 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:51.326848 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:51.326859 | orchestrator | 2026-04-03 08:43:51.326870 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:43:51.326881 | orchestrator | Friday 03 April 2026 08:43:43 +0000 (0:00:01.436) 0:56:55.946 ********** 2026-04-03 08:43:51.326891 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:43:51.326902 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:43:51.326912 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:43:51.326923 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.326934 | orchestrator | 2026-04-03 08:43:51.326944 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:43:51.326955 | orchestrator | Friday 03 April 2026 08:43:44 +0000 (0:00:01.479) 0:56:57.425 ********** 2026-04-03 08:43:51.326966 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:43:51.326976 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:43:51.326988 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:43:51.326998 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.327009 | orchestrator | 2026-04-03 08:43:51.327020 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:43:51.327031 | orchestrator | Friday 03 April 2026 08:43:45 +0000 (0:00:01.436) 0:56:58.862 ********** 2026-04-03 08:43:51.327041 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:43:51.327052 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:43:51.327062 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:43:51.327073 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:43:51.327083 | orchestrator | 2026-04-03 08:43:51.327094 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:43:51.327105 | orchestrator | Friday 03 April 2026 08:43:47 +0000 (0:00:01.478) 0:57:00.341 ********** 2026-04-03 08:43:51.327116 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:43:51.327126 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:43:51.327137 | orchestrator | 2026-04-03 08:43:51.327148 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:43:51.327158 | orchestrator | Friday 03 April 2026 08:43:48 +0000 (0:00:01.234) 0:57:01.576 ********** 2026-04-03 08:43:51.327169 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:43:51.327180 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:43:51.327190 | orchestrator | 2026-04-03 08:43:51.327201 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:43:51.327212 | orchestrator | Friday 03 April 2026 08:43:50 +0000 (0:00:01.435) 0:57:03.012 ********** 2026-04-03 08:43:51.327254 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:43:51.327266 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:43:51.327277 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:43:51.327288 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:43:51.327298 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:43:51.327309 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:43:51.327328 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:44:36.916584 | orchestrator | 2026-04-03 08:44:36.916689 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:44:36.916704 | orchestrator | Friday 03 April 2026 08:43:52 +0000 (0:00:02.278) 0:57:05.291 ********** 2026-04-03 08:44:36.916715 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:44:36.916726 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:44:36.916736 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:44:36.916746 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:44:36.916756 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:44:36.916784 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:44:36.916794 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:44:36.916804 | orchestrator | 2026-04-03 08:44:36.916814 | orchestrator | TASK [Prevent restarts from the packaging] ************************************* 2026-04-03 08:44:36.916823 | orchestrator | Friday 03 April 2026 08:43:55 +0000 (0:00:02.889) 0:57:08.181 ********** 2026-04-03 08:44:36.916833 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.916844 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.916854 | orchestrator | 2026-04-03 08:44:36.916863 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:44:36.916873 | orchestrator | Friday 03 April 2026 08:43:56 +0000 (0:00:01.299) 0:57:09.480 ********** 2026-04-03 08:44:36.916883 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4, testbed-node-3 2026-04-03 08:44:36.916893 | orchestrator | 2026-04-03 08:44:36.916902 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:44:36.916912 | orchestrator | Friday 03 April 2026 08:43:57 +0000 (0:00:01.230) 0:57:10.711 ********** 2026-04-03 08:44:36.916922 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4, testbed-node-3 2026-04-03 08:44:36.916932 | orchestrator | 2026-04-03 08:44:36.916941 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:44:36.916951 | orchestrator | Friday 03 April 2026 08:43:59 +0000 (0:00:01.256) 0:57:11.968 ********** 2026-04-03 08:44:36.916961 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.916970 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.916980 | orchestrator | 2026-04-03 08:44:36.916990 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:44:36.916999 | orchestrator | Friday 03 April 2026 08:44:00 +0000 (0:00:01.369) 0:57:13.337 ********** 2026-04-03 08:44:36.917009 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917019 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917028 | orchestrator | 2026-04-03 08:44:36.917038 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:44:36.917048 | orchestrator | Friday 03 April 2026 08:44:02 +0000 (0:00:01.648) 0:57:14.986 ********** 2026-04-03 08:44:36.917057 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917087 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917099 | orchestrator | 2026-04-03 08:44:36.917111 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:44:36.917122 | orchestrator | Friday 03 April 2026 08:44:03 +0000 (0:00:01.779) 0:57:16.765 ********** 2026-04-03 08:44:36.917134 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917145 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917157 | orchestrator | 2026-04-03 08:44:36.917168 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:44:36.917203 | orchestrator | Friday 03 April 2026 08:44:05 +0000 (0:00:01.670) 0:57:18.435 ********** 2026-04-03 08:44:36.917215 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.917227 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.917238 | orchestrator | 2026-04-03 08:44:36.917250 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:44:36.917261 | orchestrator | Friday 03 April 2026 08:44:06 +0000 (0:00:01.246) 0:57:19.682 ********** 2026-04-03 08:44:36.917272 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.917284 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.917295 | orchestrator | 2026-04-03 08:44:36.917306 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:44:36.917317 | orchestrator | Friday 03 April 2026 08:44:08 +0000 (0:00:01.295) 0:57:20.978 ********** 2026-04-03 08:44:36.917329 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.917346 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.917362 | orchestrator | 2026-04-03 08:44:36.917379 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:44:36.917395 | orchestrator | Friday 03 April 2026 08:44:09 +0000 (0:00:01.265) 0:57:22.244 ********** 2026-04-03 08:44:36.917412 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917428 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917444 | orchestrator | 2026-04-03 08:44:36.917459 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:44:36.917476 | orchestrator | Friday 03 April 2026 08:44:11 +0000 (0:00:02.155) 0:57:24.399 ********** 2026-04-03 08:44:36.917491 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917507 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917522 | orchestrator | 2026-04-03 08:44:36.917537 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:44:36.917553 | orchestrator | Friday 03 April 2026 08:44:13 +0000 (0:00:01.675) 0:57:26.074 ********** 2026-04-03 08:44:36.917569 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.917585 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.917600 | orchestrator | 2026-04-03 08:44:36.917616 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:44:36.917633 | orchestrator | Friday 03 April 2026 08:44:14 +0000 (0:00:01.269) 0:57:27.344 ********** 2026-04-03 08:44:36.917648 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.917686 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.917703 | orchestrator | 2026-04-03 08:44:36.917717 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:44:36.917735 | orchestrator | Friday 03 April 2026 08:44:15 +0000 (0:00:01.264) 0:57:28.609 ********** 2026-04-03 08:44:36.917750 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917765 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917780 | orchestrator | 2026-04-03 08:44:36.917796 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:44:36.917811 | orchestrator | Friday 03 April 2026 08:44:17 +0000 (0:00:01.254) 0:57:29.864 ********** 2026-04-03 08:44:36.917827 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917845 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917861 | orchestrator | 2026-04-03 08:44:36.917878 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:44:36.917905 | orchestrator | Friday 03 April 2026 08:44:18 +0000 (0:00:01.272) 0:57:31.136 ********** 2026-04-03 08:44:36.917938 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.917956 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.917972 | orchestrator | 2026-04-03 08:44:36.917989 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:44:36.918006 | orchestrator | Friday 03 April 2026 08:44:19 +0000 (0:00:01.217) 0:57:32.354 ********** 2026-04-03 08:44:36.918094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918114 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918173 | orchestrator | 2026-04-03 08:44:36.918219 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:44:36.918239 | orchestrator | Friday 03 April 2026 08:44:21 +0000 (0:00:01.569) 0:57:33.923 ********** 2026-04-03 08:44:36.918257 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918274 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918292 | orchestrator | 2026-04-03 08:44:36.918311 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:44:36.918328 | orchestrator | Friday 03 April 2026 08:44:22 +0000 (0:00:01.274) 0:57:35.198 ********** 2026-04-03 08:44:36.918346 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918365 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918383 | orchestrator | 2026-04-03 08:44:36.918401 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:44:36.918419 | orchestrator | Friday 03 April 2026 08:44:23 +0000 (0:00:01.314) 0:57:36.513 ********** 2026-04-03 08:44:36.918437 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.918454 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.918472 | orchestrator | 2026-04-03 08:44:36.918489 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:44:36.918507 | orchestrator | Friday 03 April 2026 08:44:24 +0000 (0:00:01.292) 0:57:37.805 ********** 2026-04-03 08:44:36.918525 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:44:36.918541 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:44:36.918559 | orchestrator | 2026-04-03 08:44:36.918577 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:44:36.918595 | orchestrator | Friday 03 April 2026 08:44:26 +0000 (0:00:01.305) 0:57:39.111 ********** 2026-04-03 08:44:36.918611 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918627 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918645 | orchestrator | 2026-04-03 08:44:36.918663 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:44:36.918680 | orchestrator | Friday 03 April 2026 08:44:27 +0000 (0:00:01.284) 0:57:40.395 ********** 2026-04-03 08:44:36.918698 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918713 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918729 | orchestrator | 2026-04-03 08:44:36.918744 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:44:36.918762 | orchestrator | Friday 03 April 2026 08:44:28 +0000 (0:00:01.215) 0:57:41.611 ********** 2026-04-03 08:44:36.918780 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918798 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918815 | orchestrator | 2026-04-03 08:44:36.918833 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:44:36.918850 | orchestrator | Friday 03 April 2026 08:44:30 +0000 (0:00:01.257) 0:57:42.868 ********** 2026-04-03 08:44:36.918867 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918884 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918900 | orchestrator | 2026-04-03 08:44:36.918916 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:44:36.918933 | orchestrator | Friday 03 April 2026 08:44:31 +0000 (0:00:01.246) 0:57:44.115 ********** 2026-04-03 08:44:36.918950 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.918968 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.918985 | orchestrator | 2026-04-03 08:44:36.919003 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:44:36.919021 | orchestrator | Friday 03 April 2026 08:44:32 +0000 (0:00:01.291) 0:57:45.406 ********** 2026-04-03 08:44:36.919054 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.919073 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.919090 | orchestrator | 2026-04-03 08:44:36.919106 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:44:36.919122 | orchestrator | Friday 03 April 2026 08:44:33 +0000 (0:00:01.271) 0:57:46.677 ********** 2026-04-03 08:44:36.919138 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.919155 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.919171 | orchestrator | 2026-04-03 08:44:36.919251 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:44:36.919271 | orchestrator | Friday 03 April 2026 08:44:35 +0000 (0:00:01.244) 0:57:47.922 ********** 2026-04-03 08:44:36.919288 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.919305 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.919321 | orchestrator | 2026-04-03 08:44:36.919338 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:44:36.919355 | orchestrator | Friday 03 April 2026 08:44:36 +0000 (0:00:01.613) 0:57:49.535 ********** 2026-04-03 08:44:36.919371 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:44:36.919387 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:44:36.919403 | orchestrator | 2026-04-03 08:44:36.919439 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:45:22.967238 | orchestrator | Friday 03 April 2026 08:44:37 +0000 (0:00:01.272) 0:57:50.808 ********** 2026-04-03 08:45:22.967339 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967353 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967362 | orchestrator | 2026-04-03 08:45:22.967372 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:45:22.967381 | orchestrator | Friday 03 April 2026 08:44:39 +0000 (0:00:01.234) 0:57:52.043 ********** 2026-04-03 08:45:22.967389 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967397 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967405 | orchestrator | 2026-04-03 08:45:22.967414 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:45:22.967422 | orchestrator | Friday 03 April 2026 08:44:40 +0000 (0:00:01.350) 0:57:53.393 ********** 2026-04-03 08:45:22.967444 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967453 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967461 | orchestrator | 2026-04-03 08:45:22.967469 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:45:22.967477 | orchestrator | Friday 03 April 2026 08:44:41 +0000 (0:00:01.233) 0:57:54.626 ********** 2026-04-03 08:45:22.967490 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.967505 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.967519 | orchestrator | 2026-04-03 08:45:22.967533 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:45:22.967547 | orchestrator | Friday 03 April 2026 08:44:43 +0000 (0:00:01.989) 0:57:56.616 ********** 2026-04-03 08:45:22.967560 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.967575 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.967588 | orchestrator | 2026-04-03 08:45:22.967603 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:45:22.967618 | orchestrator | Friday 03 April 2026 08:44:46 +0000 (0:00:02.776) 0:57:59.392 ********** 2026-04-03 08:45:22.967634 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4, testbed-node-3 2026-04-03 08:45:22.967649 | orchestrator | 2026-04-03 08:45:22.967664 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:45:22.967673 | orchestrator | Friday 03 April 2026 08:44:47 +0000 (0:00:01.255) 0:58:00.648 ********** 2026-04-03 08:45:22.967681 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967697 | orchestrator | 2026-04-03 08:45:22.967728 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:45:22.967737 | orchestrator | Friday 03 April 2026 08:44:49 +0000 (0:00:01.268) 0:58:01.917 ********** 2026-04-03 08:45:22.967745 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967753 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967762 | orchestrator | 2026-04-03 08:45:22.967771 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:45:22.967781 | orchestrator | Friday 03 April 2026 08:44:50 +0000 (0:00:01.221) 0:58:03.138 ********** 2026-04-03 08:45:22.967790 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:45:22.967800 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:45:22.967809 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:45:22.967818 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:45:22.967828 | orchestrator | 2026-04-03 08:45:22.967837 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:45:22.967846 | orchestrator | Friday 03 April 2026 08:44:52 +0000 (0:00:01.887) 0:58:05.026 ********** 2026-04-03 08:45:22.967856 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.967864 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.967874 | orchestrator | 2026-04-03 08:45:22.967883 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:45:22.967892 | orchestrator | Friday 03 April 2026 08:44:53 +0000 (0:00:01.663) 0:58:06.690 ********** 2026-04-03 08:45:22.967901 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967911 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967920 | orchestrator | 2026-04-03 08:45:22.967929 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:45:22.967938 | orchestrator | Friday 03 April 2026 08:44:55 +0000 (0:00:01.263) 0:58:07.953 ********** 2026-04-03 08:45:22.967947 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.967958 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.967967 | orchestrator | 2026-04-03 08:45:22.967976 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:45:22.967986 | orchestrator | Friday 03 April 2026 08:44:56 +0000 (0:00:01.309) 0:58:09.263 ********** 2026-04-03 08:45:22.967995 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968004 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968013 | orchestrator | 2026-04-03 08:45:22.968022 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:45:22.968031 | orchestrator | Friday 03 April 2026 08:44:57 +0000 (0:00:01.251) 0:58:10.515 ********** 2026-04-03 08:45:22.968041 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4, testbed-node-3 2026-04-03 08:45:22.968050 | orchestrator | 2026-04-03 08:45:22.968060 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:45:22.968069 | orchestrator | Friday 03 April 2026 08:44:58 +0000 (0:00:01.240) 0:58:11.755 ********** 2026-04-03 08:45:22.968077 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.968087 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.968096 | orchestrator | 2026-04-03 08:45:22.968106 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:45:22.968115 | orchestrator | Friday 03 April 2026 08:45:00 +0000 (0:00:01.863) 0:58:13.619 ********** 2026-04-03 08:45:22.968124 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:45:22.968170 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:45:22.968180 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:45:22.968188 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968196 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:45:22.968211 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:45:22.968219 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:45:22.968227 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968235 | orchestrator | 2026-04-03 08:45:22.968243 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:45:22.968257 | orchestrator | Friday 03 April 2026 08:45:02 +0000 (0:00:01.621) 0:58:15.240 ********** 2026-04-03 08:45:22.968265 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968273 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968280 | orchestrator | 2026-04-03 08:45:22.968289 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:45:22.968297 | orchestrator | Friday 03 April 2026 08:45:03 +0000 (0:00:01.256) 0:58:16.497 ********** 2026-04-03 08:45:22.968304 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968312 | orchestrator | 2026-04-03 08:45:22.968320 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:45:22.968328 | orchestrator | Friday 03 April 2026 08:45:04 +0000 (0:00:01.256) 0:58:17.753 ********** 2026-04-03 08:45:22.968336 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968344 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968352 | orchestrator | 2026-04-03 08:45:22.968359 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:45:22.968367 | orchestrator | Friday 03 April 2026 08:45:06 +0000 (0:00:01.368) 0:58:19.122 ********** 2026-04-03 08:45:22.968375 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968383 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968391 | orchestrator | 2026-04-03 08:45:22.968399 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:45:22.968407 | orchestrator | Friday 03 April 2026 08:45:07 +0000 (0:00:01.299) 0:58:20.422 ********** 2026-04-03 08:45:22.968414 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968422 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968430 | orchestrator | 2026-04-03 08:45:22.968438 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:45:22.968446 | orchestrator | Friday 03 April 2026 08:45:08 +0000 (0:00:01.204) 0:58:21.627 ********** 2026-04-03 08:45:22.968454 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.968464 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.968479 | orchestrator | 2026-04-03 08:45:22.968493 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:45:22.968507 | orchestrator | Friday 03 April 2026 08:45:11 +0000 (0:00:02.856) 0:58:24.484 ********** 2026-04-03 08:45:22.968522 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:45:22.968535 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:45:22.968549 | orchestrator | 2026-04-03 08:45:22.968563 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:45:22.968577 | orchestrator | Friday 03 April 2026 08:45:13 +0000 (0:00:01.618) 0:58:26.102 ********** 2026-04-03 08:45:22.968592 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4, testbed-node-3 2026-04-03 08:45:22.968607 | orchestrator | 2026-04-03 08:45:22.968623 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:45:22.968638 | orchestrator | Friday 03 April 2026 08:45:14 +0000 (0:00:01.277) 0:58:27.380 ********** 2026-04-03 08:45:22.968653 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968668 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968684 | orchestrator | 2026-04-03 08:45:22.968698 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:45:22.968714 | orchestrator | Friday 03 April 2026 08:45:15 +0000 (0:00:01.347) 0:58:28.728 ********** 2026-04-03 08:45:22.968727 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968742 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968765 | orchestrator | 2026-04-03 08:45:22.968780 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:45:22.968795 | orchestrator | Friday 03 April 2026 08:45:17 +0000 (0:00:01.352) 0:58:30.080 ********** 2026-04-03 08:45:22.968810 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968823 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968836 | orchestrator | 2026-04-03 08:45:22.968849 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:45:22.968862 | orchestrator | Friday 03 April 2026 08:45:18 +0000 (0:00:01.265) 0:58:31.346 ********** 2026-04-03 08:45:22.968876 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968889 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968903 | orchestrator | 2026-04-03 08:45:22.968916 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:45:22.968929 | orchestrator | Friday 03 April 2026 08:45:19 +0000 (0:00:01.263) 0:58:32.609 ********** 2026-04-03 08:45:22.968942 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.968956 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.968968 | orchestrator | 2026-04-03 08:45:22.968982 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:45:22.968995 | orchestrator | Friday 03 April 2026 08:45:21 +0000 (0:00:01.646) 0:58:34.256 ********** 2026-04-03 08:45:22.969008 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.969023 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.969037 | orchestrator | 2026-04-03 08:45:22.969050 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:45:22.969063 | orchestrator | Friday 03 April 2026 08:45:22 +0000 (0:00:01.290) 0:58:35.547 ********** 2026-04-03 08:45:22.969076 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:45:22.969090 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:45:22.969103 | orchestrator | 2026-04-03 08:45:22.969126 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:46:01.934292 | orchestrator | Friday 03 April 2026 08:45:24 +0000 (0:00:01.316) 0:58:36.863 ********** 2026-04-03 08:46:01.934377 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934386 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934391 | orchestrator | 2026-04-03 08:46:01.934397 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:46:01.934403 | orchestrator | Friday 03 April 2026 08:45:25 +0000 (0:00:01.247) 0:58:38.111 ********** 2026-04-03 08:46:01.934408 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:01.934413 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:01.934418 | orchestrator | 2026-04-03 08:46:01.934423 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:46:01.934428 | orchestrator | Friday 03 April 2026 08:45:26 +0000 (0:00:01.266) 0:58:39.378 ********** 2026-04-03 08:46:01.934446 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4, testbed-node-3 2026-04-03 08:46:01.934451 | orchestrator | 2026-04-03 08:46:01.934459 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:46:01.934468 | orchestrator | Friday 03 April 2026 08:45:27 +0000 (0:00:01.433) 0:58:40.811 ********** 2026-04-03 08:46:01.934478 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-03 08:46:01.934486 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-03 08:46:01.934494 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-03 08:46:01.934503 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-03 08:46:01.934511 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-03 08:46:01.934519 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-03 08:46:01.934526 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-03 08:46:01.934533 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-03 08:46:01.934540 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-03 08:46:01.934570 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-03 08:46:01.934580 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-03 08:46:01.934587 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-03 08:46:01.934595 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-03 08:46:01.934602 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-03 08:46:01.934610 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:46:01.934618 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:46:01.934626 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:46:01.934635 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:46:01.934644 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:46:01.934653 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:46:01.934658 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:46:01.934662 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:46:01.934667 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:46:01.934671 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:46:01.934676 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:46:01.934680 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:46:01.934685 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:46:01.934690 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:46:01.934694 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-03 08:46:01.934699 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-03 08:46:01.934703 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-03 08:46:01.934708 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-03 08:46:01.934712 | orchestrator | 2026-04-03 08:46:01.934717 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:46:01.934722 | orchestrator | Friday 03 April 2026 08:45:34 +0000 (0:00:06.654) 0:58:47.465 ********** 2026-04-03 08:46:01.934726 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4, testbed-node-3 2026-04-03 08:46:01.934731 | orchestrator | 2026-04-03 08:46:01.934735 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:46:01.934741 | orchestrator | Friday 03 April 2026 08:45:35 +0000 (0:00:01.343) 0:58:48.809 ********** 2026-04-03 08:46:01.934746 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.934752 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.934757 | orchestrator | 2026-04-03 08:46:01.934761 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:46:01.934766 | orchestrator | Friday 03 April 2026 08:45:37 +0000 (0:00:01.566) 0:58:50.375 ********** 2026-04-03 08:46:01.934770 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.934775 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.934780 | orchestrator | 2026-04-03 08:46:01.934784 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:46:01.934801 | orchestrator | Friday 03 April 2026 08:45:39 +0000 (0:00:02.097) 0:58:52.473 ********** 2026-04-03 08:46:01.934806 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934811 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934821 | orchestrator | 2026-04-03 08:46:01.934826 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:46:01.934831 | orchestrator | Friday 03 April 2026 08:45:41 +0000 (0:00:01.544) 0:58:54.018 ********** 2026-04-03 08:46:01.934835 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934840 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934844 | orchestrator | 2026-04-03 08:46:01.934849 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:46:01.934853 | orchestrator | Friday 03 April 2026 08:45:42 +0000 (0:00:01.222) 0:58:55.240 ********** 2026-04-03 08:46:01.934862 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934867 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934871 | orchestrator | 2026-04-03 08:46:01.934876 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:46:01.934881 | orchestrator | Friday 03 April 2026 08:45:43 +0000 (0:00:01.302) 0:58:56.542 ********** 2026-04-03 08:46:01.934885 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934890 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934894 | orchestrator | 2026-04-03 08:46:01.934899 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:46:01.934903 | orchestrator | Friday 03 April 2026 08:45:44 +0000 (0:00:01.232) 0:58:57.775 ********** 2026-04-03 08:46:01.934908 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934912 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934917 | orchestrator | 2026-04-03 08:46:01.934922 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:46:01.934926 | orchestrator | Friday 03 April 2026 08:45:46 +0000 (0:00:01.273) 0:58:59.049 ********** 2026-04-03 08:46:01.934931 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934935 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934940 | orchestrator | 2026-04-03 08:46:01.934944 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:46:01.934949 | orchestrator | Friday 03 April 2026 08:45:47 +0000 (0:00:01.257) 0:59:00.307 ********** 2026-04-03 08:46:01.934953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934958 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934962 | orchestrator | 2026-04-03 08:46:01.934967 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:46:01.934972 | orchestrator | Friday 03 April 2026 08:45:48 +0000 (0:00:01.290) 0:59:01.598 ********** 2026-04-03 08:46:01.934976 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.934981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.934985 | orchestrator | 2026-04-03 08:46:01.934990 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:46:01.934994 | orchestrator | Friday 03 April 2026 08:45:49 +0000 (0:00:01.254) 0:59:02.852 ********** 2026-04-03 08:46:01.934999 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.935003 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.935008 | orchestrator | 2026-04-03 08:46:01.935012 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:46:01.935017 | orchestrator | Friday 03 April 2026 08:45:51 +0000 (0:00:01.300) 0:59:04.153 ********** 2026-04-03 08:46:01.935021 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.935026 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.935030 | orchestrator | 2026-04-03 08:46:01.935035 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:46:01.935040 | orchestrator | Friday 03 April 2026 08:45:52 +0000 (0:00:01.213) 0:59:05.366 ********** 2026-04-03 08:46:01.935045 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:01.935050 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:01.935055 | orchestrator | 2026-04-03 08:46:01.935060 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:46:01.935069 | orchestrator | Friday 03 April 2026 08:45:53 +0000 (0:00:01.284) 0:59:06.651 ********** 2026-04-03 08:46:01.935074 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:46:01.935079 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:46:01.935084 | orchestrator | 2026-04-03 08:46:01.935090 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:46:01.935095 | orchestrator | Friday 03 April 2026 08:45:58 +0000 (0:00:04.485) 0:59:11.137 ********** 2026-04-03 08:46:01.935100 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.935122 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:46:01.935127 | orchestrator | 2026-04-03 08:46:01.935133 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:46:01.935138 | orchestrator | Friday 03 April 2026 08:45:59 +0000 (0:00:01.295) 0:59:12.433 ********** 2026-04-03 08:46:01.935144 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-03 08:46:01.935156 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-03 08:46:52.657281 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-03 08:46:52.657432 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-03 08:46:52.657451 | orchestrator | 2026-04-03 08:46:52.657465 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:46:52.657478 | orchestrator | Friday 03 April 2026 08:46:04 +0000 (0:00:05.412) 0:59:17.846 ********** 2026-04-03 08:46:52.657525 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657540 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.657551 | orchestrator | 2026-04-03 08:46:52.657562 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:46:52.657574 | orchestrator | Friday 03 April 2026 08:46:06 +0000 (0:00:01.271) 0:59:19.117 ********** 2026-04-03 08:46:52.657585 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657596 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.657607 | orchestrator | 2026-04-03 08:46:52.657618 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:46:52.657630 | orchestrator | Friday 03 April 2026 08:46:07 +0000 (0:00:01.239) 0:59:20.357 ********** 2026-04-03 08:46:52.657641 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657652 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.657663 | orchestrator | 2026-04-03 08:46:52.657674 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:46:52.657685 | orchestrator | Friday 03 April 2026 08:46:08 +0000 (0:00:01.281) 0:59:21.639 ********** 2026-04-03 08:46:52.657697 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657733 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.657745 | orchestrator | 2026-04-03 08:46:52.657755 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:46:52.657766 | orchestrator | Friday 03 April 2026 08:46:10 +0000 (0:00:01.349) 0:59:22.988 ********** 2026-04-03 08:46:52.657777 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657788 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.657799 | orchestrator | 2026-04-03 08:46:52.657813 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:46:52.657825 | orchestrator | Friday 03 April 2026 08:46:11 +0000 (0:00:01.300) 0:59:24.289 ********** 2026-04-03 08:46:52.657837 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.657851 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.657863 | orchestrator | 2026-04-03 08:46:52.657875 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:46:52.657888 | orchestrator | Friday 03 April 2026 08:46:12 +0000 (0:00:01.386) 0:59:25.676 ********** 2026-04-03 08:46:52.657901 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:46:52.657913 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:46:52.657926 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:46:52.657938 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.657951 | orchestrator | 2026-04-03 08:46:52.657963 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:46:52.657975 | orchestrator | Friday 03 April 2026 08:46:14 +0000 (0:00:01.926) 0:59:27.602 ********** 2026-04-03 08:46:52.657988 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:46:52.658000 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:46:52.658013 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:46:52.658094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.658108 | orchestrator | 2026-04-03 08:46:52.658121 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:46:52.658134 | orchestrator | Friday 03 April 2026 08:46:16 +0000 (0:00:01.466) 0:59:29.069 ********** 2026-04-03 08:46:52.658155 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:46:52.658172 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:46:52.658190 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:46:52.658207 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.658225 | orchestrator | 2026-04-03 08:46:52.658242 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:46:52.658259 | orchestrator | Friday 03 April 2026 08:46:17 +0000 (0:00:01.467) 0:59:30.536 ********** 2026-04-03 08:46:52.658277 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.658294 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.658312 | orchestrator | 2026-04-03 08:46:52.658328 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:46:52.658345 | orchestrator | Friday 03 April 2026 08:46:18 +0000 (0:00:01.258) 0:59:31.795 ********** 2026-04-03 08:46:52.658363 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:46:52.658381 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:46:52.658399 | orchestrator | 2026-04-03 08:46:52.658417 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:46:52.658436 | orchestrator | Friday 03 April 2026 08:46:20 +0000 (0:00:01.534) 0:59:33.329 ********** 2026-04-03 08:46:52.658453 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.658471 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.658489 | orchestrator | 2026-04-03 08:46:52.658527 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-03 08:46:52.658545 | orchestrator | Friday 03 April 2026 08:46:22 +0000 (0:00:01.892) 0:59:35.222 ********** 2026-04-03 08:46:52.658563 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.658598 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.658616 | orchestrator | 2026-04-03 08:46:52.658636 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-03 08:46:52.658655 | orchestrator | Friday 03 April 2026 08:46:24 +0000 (0:00:01.672) 0:59:36.895 ********** 2026-04-03 08:46:52.658676 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-4, testbed-node-3 2026-04-03 08:46:52.658689 | orchestrator | 2026-04-03 08:46:52.658708 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-03 08:46:52.658719 | orchestrator | Friday 03 April 2026 08:46:25 +0000 (0:00:01.318) 0:59:38.214 ********** 2026-04-03 08:46:52.658730 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 08:46:52.658741 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-03 08:46:52.658752 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-03 08:46:52.658762 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-03 08:46:52.658773 | orchestrator | 2026-04-03 08:46:52.658784 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-03 08:46:52.658795 | orchestrator | Friday 03 April 2026 08:46:27 +0000 (0:00:01.942) 0:59:40.157 ********** 2026-04-03 08:46:52.658805 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:46:52.658816 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:46:52.658827 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:46:52.658838 | orchestrator | 2026-04-03 08:46:52.658849 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:46:52.658859 | orchestrator | Friday 03 April 2026 08:46:30 +0000 (0:00:03.359) 0:59:43.516 ********** 2026-04-03 08:46:52.658870 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 08:46:52.658881 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:46:52.658892 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.658903 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 08:46:52.658914 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 08:46:52.658924 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.658935 | orchestrator | 2026-04-03 08:46:52.658946 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-03 08:46:52.658957 | orchestrator | Friday 03 April 2026 08:46:32 +0000 (0:00:02.066) 0:59:45.583 ********** 2026-04-03 08:46:52.658968 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.658979 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.658990 | orchestrator | 2026-04-03 08:46:52.659001 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-03 08:46:52.659011 | orchestrator | Friday 03 April 2026 08:46:34 +0000 (0:00:01.660) 0:59:47.243 ********** 2026-04-03 08:46:52.659025 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.659044 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:46:52.659062 | orchestrator | 2026-04-03 08:46:52.659117 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-03 08:46:52.659136 | orchestrator | Friday 03 April 2026 08:46:36 +0000 (0:00:01.667) 0:59:48.910 ********** 2026-04-03 08:46:52.659155 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-4, testbed-node-3 2026-04-03 08:46:52.659175 | orchestrator | 2026-04-03 08:46:52.659193 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-03 08:46:52.659213 | orchestrator | Friday 03 April 2026 08:46:37 +0000 (0:00:01.208) 0:59:50.120 ********** 2026-04-03 08:46:52.659231 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-4, testbed-node-3 2026-04-03 08:46:52.659250 | orchestrator | 2026-04-03 08:46:52.659262 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-03 08:46:52.659272 | orchestrator | Friday 03 April 2026 08:46:38 +0000 (0:00:01.222) 0:59:51.342 ********** 2026-04-03 08:46:52.659293 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.659304 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.659315 | orchestrator | 2026-04-03 08:46:52.659326 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-03 08:46:52.659336 | orchestrator | Friday 03 April 2026 08:46:40 +0000 (0:00:02.133) 0:59:53.476 ********** 2026-04-03 08:46:52.659347 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.659358 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.659369 | orchestrator | 2026-04-03 08:46:52.659380 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-03 08:46:52.659390 | orchestrator | Friday 03 April 2026 08:46:42 +0000 (0:00:02.161) 0:59:55.638 ********** 2026-04-03 08:46:52.659401 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.659412 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.659423 | orchestrator | 2026-04-03 08:46:52.659442 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-03 08:46:52.659456 | orchestrator | Friday 03 April 2026 08:46:45 +0000 (0:00:02.329) 0:59:57.968 ********** 2026-04-03 08:46:52.659466 | orchestrator | changed: [testbed-node-4] 2026-04-03 08:46:52.659477 | orchestrator | changed: [testbed-node-3] 2026-04-03 08:46:52.659488 | orchestrator | 2026-04-03 08:46:52.659499 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-03 08:46:52.659510 | orchestrator | Friday 03 April 2026 08:46:48 +0000 (0:00:03.508) 1:00:01.477 ********** 2026-04-03 08:46:52.659521 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:46:52.659532 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:46:52.659542 | orchestrator | 2026-04-03 08:46:52.659553 | orchestrator | TASK [Set max_mds] ************************************************************* 2026-04-03 08:46:52.659564 | orchestrator | Friday 03 April 2026 08:46:50 +0000 (0:00:01.771) 1:00:03.249 ********** 2026-04-03 08:46:52.659575 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:46:52.659596 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:47:17.342113 | orchestrator | 2026-04-03 08:47:17.342234 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-03 08:47:17.342251 | orchestrator | 2026-04-03 08:47:17.342265 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:47:17.342277 | orchestrator | Friday 03 April 2026 08:46:53 +0000 (0:00:03.569) 1:00:06.818 ********** 2026-04-03 08:47:17.342288 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-03 08:47:17.342299 | orchestrator | 2026-04-03 08:47:17.342310 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:47:17.342336 | orchestrator | Friday 03 April 2026 08:46:55 +0000 (0:00:01.422) 1:00:08.241 ********** 2026-04-03 08:47:17.342348 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342361 | orchestrator | 2026-04-03 08:47:17.342373 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:47:17.342384 | orchestrator | Friday 03 April 2026 08:46:56 +0000 (0:00:01.419) 1:00:09.661 ********** 2026-04-03 08:47:17.342394 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342405 | orchestrator | 2026-04-03 08:47:17.342416 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:47:17.342427 | orchestrator | Friday 03 April 2026 08:46:57 +0000 (0:00:01.133) 1:00:10.794 ********** 2026-04-03 08:47:17.342438 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342449 | orchestrator | 2026-04-03 08:47:17.342460 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:47:17.342471 | orchestrator | Friday 03 April 2026 08:46:59 +0000 (0:00:01.422) 1:00:12.217 ********** 2026-04-03 08:47:17.342482 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342492 | orchestrator | 2026-04-03 08:47:17.342504 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:47:17.342514 | orchestrator | Friday 03 April 2026 08:47:00 +0000 (0:00:01.129) 1:00:13.347 ********** 2026-04-03 08:47:17.342525 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342561 | orchestrator | 2026-04-03 08:47:17.342575 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:47:17.342587 | orchestrator | Friday 03 April 2026 08:47:01 +0000 (0:00:01.121) 1:00:14.468 ********** 2026-04-03 08:47:17.342599 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342613 | orchestrator | 2026-04-03 08:47:17.342626 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:47:17.342639 | orchestrator | Friday 03 April 2026 08:47:02 +0000 (0:00:01.128) 1:00:15.597 ********** 2026-04-03 08:47:17.342652 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:17.342665 | orchestrator | 2026-04-03 08:47:17.342678 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:47:17.342691 | orchestrator | Friday 03 April 2026 08:47:03 +0000 (0:00:01.142) 1:00:16.740 ********** 2026-04-03 08:47:17.342704 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342716 | orchestrator | 2026-04-03 08:47:17.342729 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:47:17.342740 | orchestrator | Friday 03 April 2026 08:47:05 +0000 (0:00:01.143) 1:00:17.883 ********** 2026-04-03 08:47:17.342753 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:47:17.342766 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:47:17.342779 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:47:17.342791 | orchestrator | 2026-04-03 08:47:17.342804 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:47:17.342817 | orchestrator | Friday 03 April 2026 08:47:07 +0000 (0:00:02.091) 1:00:19.974 ********** 2026-04-03 08:47:17.342829 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:17.342843 | orchestrator | 2026-04-03 08:47:17.342856 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:47:17.342868 | orchestrator | Friday 03 April 2026 08:47:08 +0000 (0:00:01.261) 1:00:21.235 ********** 2026-04-03 08:47:17.342881 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:47:17.342893 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:47:17.342905 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:47:17.342919 | orchestrator | 2026-04-03 08:47:17.342932 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:47:17.342944 | orchestrator | Friday 03 April 2026 08:47:11 +0000 (0:00:03.433) 1:00:24.669 ********** 2026-04-03 08:47:17.342955 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 08:47:17.342966 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 08:47:17.342977 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 08:47:17.342988 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:17.342998 | orchestrator | 2026-04-03 08:47:17.343009 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:47:17.343020 | orchestrator | Friday 03 April 2026 08:47:13 +0000 (0:00:01.846) 1:00:26.516 ********** 2026-04-03 08:47:17.343032 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343045 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343111 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343133 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:17.343155 | orchestrator | 2026-04-03 08:47:17.343167 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:47:17.343178 | orchestrator | Friday 03 April 2026 08:47:15 +0000 (0:00:02.292) 1:00:28.808 ********** 2026-04-03 08:47:17.343196 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343210 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343221 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:17.343232 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:17.343243 | orchestrator | 2026-04-03 08:47:17.343254 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:47:17.343265 | orchestrator | Friday 03 April 2026 08:47:17 +0000 (0:00:01.169) 1:00:29.978 ********** 2026-04-03 08:47:17.343279 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:47:08.894298', 'end': '2026-04-03 08:47:08.946184', 'delta': '0:00:00.051886', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:47:17.343293 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:47:09.911790', 'end': '2026-04-03 08:47:09.968131', 'delta': '0:00:00.056341', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:47:17.343305 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:47:10.539274', 'end': '2026-04-03 08:47:10.584493', 'delta': '0:00:00.045219', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:47:17.343324 | orchestrator | 2026-04-03 08:47:17.343342 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:47:36.010506 | orchestrator | Friday 03 April 2026 08:47:18 +0000 (0:00:01.193) 1:00:31.172 ********** 2026-04-03 08:47:36.010613 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010629 | orchestrator | 2026-04-03 08:47:36.010639 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:47:36.010645 | orchestrator | Friday 03 April 2026 08:47:19 +0000 (0:00:01.268) 1:00:32.441 ********** 2026-04-03 08:47:36.010650 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010656 | orchestrator | 2026-04-03 08:47:36.010674 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:47:36.010679 | orchestrator | Friday 03 April 2026 08:47:20 +0000 (0:00:01.323) 1:00:33.765 ********** 2026-04-03 08:47:36.010684 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010689 | orchestrator | 2026-04-03 08:47:36.010693 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:47:36.010698 | orchestrator | Friday 03 April 2026 08:47:22 +0000 (0:00:01.170) 1:00:34.935 ********** 2026-04-03 08:47:36.010703 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:47:36.010707 | orchestrator | 2026-04-03 08:47:36.010712 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:47:36.010717 | orchestrator | Friday 03 April 2026 08:47:24 +0000 (0:00:01.957) 1:00:36.892 ********** 2026-04-03 08:47:36.010721 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010726 | orchestrator | 2026-04-03 08:47:36.010730 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:47:36.010735 | orchestrator | Friday 03 April 2026 08:47:25 +0000 (0:00:01.167) 1:00:38.060 ********** 2026-04-03 08:47:36.010739 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010744 | orchestrator | 2026-04-03 08:47:36.010749 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:47:36.010753 | orchestrator | Friday 03 April 2026 08:47:26 +0000 (0:00:01.140) 1:00:39.200 ********** 2026-04-03 08:47:36.010758 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010762 | orchestrator | 2026-04-03 08:47:36.010767 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:47:36.010772 | orchestrator | Friday 03 April 2026 08:47:27 +0000 (0:00:01.223) 1:00:40.424 ********** 2026-04-03 08:47:36.010776 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010781 | orchestrator | 2026-04-03 08:47:36.010785 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:47:36.010790 | orchestrator | Friday 03 April 2026 08:47:28 +0000 (0:00:01.127) 1:00:41.551 ********** 2026-04-03 08:47:36.010795 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010799 | orchestrator | 2026-04-03 08:47:36.010804 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:47:36.010808 | orchestrator | Friday 03 April 2026 08:47:29 +0000 (0:00:01.121) 1:00:42.673 ********** 2026-04-03 08:47:36.010813 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010817 | orchestrator | 2026-04-03 08:47:36.010822 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:47:36.010826 | orchestrator | Friday 03 April 2026 08:47:31 +0000 (0:00:01.217) 1:00:43.891 ********** 2026-04-03 08:47:36.010831 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010836 | orchestrator | 2026-04-03 08:47:36.010841 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:47:36.010845 | orchestrator | Friday 03 April 2026 08:47:32 +0000 (0:00:01.236) 1:00:45.127 ********** 2026-04-03 08:47:36.010850 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010872 | orchestrator | 2026-04-03 08:47:36.010877 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:47:36.010882 | orchestrator | Friday 03 April 2026 08:47:33 +0000 (0:00:01.157) 1:00:46.285 ********** 2026-04-03 08:47:36.010886 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:36.010891 | orchestrator | 2026-04-03 08:47:36.010896 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:47:36.010901 | orchestrator | Friday 03 April 2026 08:47:34 +0000 (0:00:01.154) 1:00:47.439 ********** 2026-04-03 08:47:36.010906 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:47:36.010911 | orchestrator | 2026-04-03 08:47:36.010915 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:47:36.010920 | orchestrator | Friday 03 April 2026 08:47:35 +0000 (0:00:01.237) 1:00:48.677 ********** 2026-04-03 08:47:36.010926 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:36.010934 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}})  2026-04-03 08:47:36.010957 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:47:36.010964 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}})  2026-04-03 08:47:36.010970 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:36.010975 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:36.010988 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:47:36.010994 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:36.010998 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:47:36.011007 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:37.309367 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}})  2026-04-03 08:47:37.309472 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}})  2026-04-03 08:47:37.309529 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:37.309556 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:47:37.309612 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:37.309634 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:47:37.309656 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:47:37.309689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:47:37.309708 | orchestrator | 2026-04-03 08:47:37.309721 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:47:37.309734 | orchestrator | Friday 03 April 2026 08:47:37 +0000 (0:00:01.349) 1:00:50.027 ********** 2026-04-03 08:47:37.309746 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.309759 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb', 'dm-uuid-LVM-nwlnc3o7bbP70VD5tqVUP8hYQdFer57dA7nX3tW3fAssG0Seqta4cbvcGuoNgFDu'], 'uuids': ['1d628847-789b-4546-82fb-a455293452ad'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.309771 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065', 'scsi-SQEMU_QEMU_HARDDISK_39f44498-82eb-430b-ac9b-87a602481065'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '39f44498', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.309800 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-4SAM3j-0y0U-ISGn-KIwF-MhlI-kKDF-XsuMih', 'scsi-0QEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9', 'scsi-SQEMU_QEMU_HARDDISK_294f1b92-5dea-47ac-b0f9-6e803f64e9c9'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431142 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431262 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431276 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-25-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431285 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431294 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF', 'dm-uuid-CRYPT-LUKS2-3d78caa0f0914dc48510054d7dc3d31d-DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431317 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431346 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--6e05808f--fb53--52d6--a83f--27c91ff5177e-osd--block--6e05808f--fb53--52d6--a83f--27c91ff5177e', 'dm-uuid-LVM-IH52qSodtMXjJv6fuWqL2orBmCqfJ23qDTbXbmXtgaMYnBg1C0t9BNa73asEeSqF'], 'uuids': ['3d78caa0-f091-4dc4-8510-054d7dc3d31d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '294f1b92', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['DTbXbm-Xtga-MYnB-g1C0-t9BN-a73a-sEeSqF']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431362 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l260eu-ZujN-atcV-CtgU-fDaK-cRcn-QLST7y', 'scsi-0QEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733', 'scsi-SQEMU_QEMU_HARDDISK_1ef1650e-19aa-44b7-85c9-c2ec4bb32733'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1ef1650e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--dc85739a--96e8--5e43--9ed8--b11ad01343fb-osd--block--dc85739a--96e8--5e43--9ed8--b11ad01343fb']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431374 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:47:37.431396 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '02c42445', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1', 'scsi-SQEMU_QEMU_HARDDISK_02c42445-0e82-4fea-8ba6-22ba4a17af8a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:48:07.271156 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:48:07.271262 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:48:07.271274 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu', 'dm-uuid-CRYPT-LUKS2-1d628847789b454682fba455293452ad-A7nX3t-W3fA-ssG0-Seqt-a4cb-vcGu-oNgFDu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:48:07.271281 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271289 | orchestrator | 2026-04-03 08:48:07.271296 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:48:07.271303 | orchestrator | Friday 03 April 2026 08:47:38 +0000 (0:00:01.417) 1:00:51.445 ********** 2026-04-03 08:48:07.271309 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:48:07.271317 | orchestrator | 2026-04-03 08:48:07.271323 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:48:07.271330 | orchestrator | Friday 03 April 2026 08:47:40 +0000 (0:00:01.479) 1:00:52.924 ********** 2026-04-03 08:48:07.271336 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:48:07.271341 | orchestrator | 2026-04-03 08:48:07.271347 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:48:07.271354 | orchestrator | Friday 03 April 2026 08:47:41 +0000 (0:00:01.132) 1:00:54.057 ********** 2026-04-03 08:48:07.271361 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:48:07.271368 | orchestrator | 2026-04-03 08:48:07.271373 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:48:07.271380 | orchestrator | Friday 03 April 2026 08:47:42 +0000 (0:00:01.498) 1:00:55.555 ********** 2026-04-03 08:48:07.271386 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271393 | orchestrator | 2026-04-03 08:48:07.271415 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:48:07.271438 | orchestrator | Friday 03 April 2026 08:47:43 +0000 (0:00:01.172) 1:00:56.728 ********** 2026-04-03 08:48:07.271442 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271446 | orchestrator | 2026-04-03 08:48:07.271450 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:48:07.271453 | orchestrator | Friday 03 April 2026 08:47:45 +0000 (0:00:01.284) 1:00:58.013 ********** 2026-04-03 08:48:07.271457 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271461 | orchestrator | 2026-04-03 08:48:07.271465 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:48:07.271468 | orchestrator | Friday 03 April 2026 08:47:46 +0000 (0:00:01.135) 1:00:59.149 ********** 2026-04-03 08:48:07.271473 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-03 08:48:07.271477 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-03 08:48:07.271481 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-03 08:48:07.271485 | orchestrator | 2026-04-03 08:48:07.271489 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:48:07.271493 | orchestrator | Friday 03 April 2026 08:47:48 +0000 (0:00:02.150) 1:01:01.300 ********** 2026-04-03 08:48:07.271497 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-03 08:48:07.271502 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-03 08:48:07.271505 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-03 08:48:07.271509 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271513 | orchestrator | 2026-04-03 08:48:07.271517 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:48:07.271520 | orchestrator | Friday 03 April 2026 08:47:49 +0000 (0:00:01.409) 1:01:02.710 ********** 2026-04-03 08:48:07.271537 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-03 08:48:07.271542 | orchestrator | 2026-04-03 08:48:07.271547 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:48:07.271551 | orchestrator | Friday 03 April 2026 08:47:51 +0000 (0:00:01.218) 1:01:03.929 ********** 2026-04-03 08:48:07.271555 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271559 | orchestrator | 2026-04-03 08:48:07.271563 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:48:07.271567 | orchestrator | Friday 03 April 2026 08:47:52 +0000 (0:00:01.179) 1:01:05.109 ********** 2026-04-03 08:48:07.271571 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271574 | orchestrator | 2026-04-03 08:48:07.271578 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:48:07.271582 | orchestrator | Friday 03 April 2026 08:47:53 +0000 (0:00:01.224) 1:01:06.333 ********** 2026-04-03 08:48:07.271586 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271590 | orchestrator | 2026-04-03 08:48:07.271593 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:48:07.271597 | orchestrator | Friday 03 April 2026 08:47:54 +0000 (0:00:01.158) 1:01:07.492 ********** 2026-04-03 08:48:07.271601 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:48:07.271605 | orchestrator | 2026-04-03 08:48:07.271608 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:48:07.271612 | orchestrator | Friday 03 April 2026 08:47:55 +0000 (0:00:01.324) 1:01:08.816 ********** 2026-04-03 08:48:07.271616 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:48:07.271620 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:48:07.271623 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:48:07.271627 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271631 | orchestrator | 2026-04-03 08:48:07.271635 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:48:07.271638 | orchestrator | Friday 03 April 2026 08:47:57 +0000 (0:00:01.418) 1:01:10.235 ********** 2026-04-03 08:48:07.271646 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:48:07.271650 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:48:07.271653 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:48:07.271657 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271661 | orchestrator | 2026-04-03 08:48:07.271665 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:48:07.271668 | orchestrator | Friday 03 April 2026 08:47:58 +0000 (0:00:01.403) 1:01:11.639 ********** 2026-04-03 08:48:07.271673 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:48:07.271678 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:48:07.271682 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:48:07.271686 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:48:07.271691 | orchestrator | 2026-04-03 08:48:07.271696 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:48:07.271700 | orchestrator | Friday 03 April 2026 08:48:00 +0000 (0:00:01.406) 1:01:13.046 ********** 2026-04-03 08:48:07.271705 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:48:07.271709 | orchestrator | 2026-04-03 08:48:07.271714 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:48:07.271719 | orchestrator | Friday 03 April 2026 08:48:01 +0000 (0:00:01.150) 1:01:14.196 ********** 2026-04-03 08:48:07.271723 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:48:07.271728 | orchestrator | 2026-04-03 08:48:07.271732 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:48:07.271737 | orchestrator | Friday 03 April 2026 08:48:02 +0000 (0:00:01.338) 1:01:15.535 ********** 2026-04-03 08:48:07.271742 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:48:07.271749 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:48:07.271754 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:48:07.271759 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 08:48:07.271764 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:48:07.271768 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:48:07.271773 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:48:07.271777 | orchestrator | 2026-04-03 08:48:07.271782 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:48:07.271786 | orchestrator | Friday 03 April 2026 08:48:04 +0000 (0:00:02.194) 1:01:17.729 ********** 2026-04-03 08:48:07.271791 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:48:07.271796 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:48:07.271800 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:48:07.271805 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-03 08:48:07.271809 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:48:07.271814 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:48:07.271818 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:48:07.271823 | orchestrator | 2026-04-03 08:48:07.271830 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-03 08:49:00.850663 | orchestrator | Friday 03 April 2026 08:48:07 +0000 (0:00:03.097) 1:01:20.827 ********** 2026-04-03 08:49:00.850782 | orchestrator | changed: [testbed-node-3] 2026-04-03 08:49:00.850800 | orchestrator | 2026-04-03 08:49:00.850836 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-03 08:49:00.850849 | orchestrator | Friday 03 April 2026 08:48:10 +0000 (0:00:02.263) 1:01:23.090 ********** 2026-04-03 08:49:00.850860 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:49:00.850873 | orchestrator | 2026-04-03 08:49:00.850885 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-03 08:49:00.850897 | orchestrator | Friday 03 April 2026 08:48:13 +0000 (0:00:02.790) 1:01:25.881 ********** 2026-04-03 08:49:00.850908 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:49:00.850920 | orchestrator | 2026-04-03 08:49:00.850931 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:49:00.850942 | orchestrator | Friday 03 April 2026 08:48:15 +0000 (0:00:02.298) 1:01:28.180 ********** 2026-04-03 08:49:00.850953 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-03 08:49:00.850964 | orchestrator | 2026-04-03 08:49:00.850975 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:49:00.851018 | orchestrator | Friday 03 April 2026 08:48:16 +0000 (0:00:01.133) 1:01:29.314 ********** 2026-04-03 08:49:00.851029 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-03 08:49:00.851040 | orchestrator | 2026-04-03 08:49:00.851051 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:49:00.851062 | orchestrator | Friday 03 April 2026 08:48:17 +0000 (0:00:01.135) 1:01:30.450 ********** 2026-04-03 08:49:00.851074 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851085 | orchestrator | 2026-04-03 08:49:00.851096 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:49:00.851107 | orchestrator | Friday 03 April 2026 08:48:18 +0000 (0:00:01.109) 1:01:31.559 ********** 2026-04-03 08:49:00.851118 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851142 | orchestrator | 2026-04-03 08:49:00.851154 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:49:00.851166 | orchestrator | Friday 03 April 2026 08:48:20 +0000 (0:00:01.511) 1:01:33.071 ********** 2026-04-03 08:49:00.851176 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851188 | orchestrator | 2026-04-03 08:49:00.851201 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:49:00.851215 | orchestrator | Friday 03 April 2026 08:48:21 +0000 (0:00:01.535) 1:01:34.607 ********** 2026-04-03 08:49:00.851228 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851240 | orchestrator | 2026-04-03 08:49:00.851254 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:49:00.851267 | orchestrator | Friday 03 April 2026 08:48:23 +0000 (0:00:01.539) 1:01:36.147 ********** 2026-04-03 08:49:00.851280 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851293 | orchestrator | 2026-04-03 08:49:00.851306 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:49:00.851319 | orchestrator | Friday 03 April 2026 08:48:24 +0000 (0:00:01.132) 1:01:37.279 ********** 2026-04-03 08:49:00.851332 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851345 | orchestrator | 2026-04-03 08:49:00.851358 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:49:00.851371 | orchestrator | Friday 03 April 2026 08:48:25 +0000 (0:00:01.190) 1:01:38.469 ********** 2026-04-03 08:49:00.851384 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851397 | orchestrator | 2026-04-03 08:49:00.851409 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:49:00.851423 | orchestrator | Friday 03 April 2026 08:48:26 +0000 (0:00:01.124) 1:01:39.594 ********** 2026-04-03 08:49:00.851451 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851480 | orchestrator | 2026-04-03 08:49:00.851501 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:49:00.851522 | orchestrator | Friday 03 April 2026 08:48:28 +0000 (0:00:01.494) 1:01:41.089 ********** 2026-04-03 08:49:00.851539 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851558 | orchestrator | 2026-04-03 08:49:00.851577 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:49:00.851596 | orchestrator | Friday 03 April 2026 08:48:29 +0000 (0:00:01.568) 1:01:42.657 ********** 2026-04-03 08:49:00.851614 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851633 | orchestrator | 2026-04-03 08:49:00.851651 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:49:00.851670 | orchestrator | Friday 03 April 2026 08:48:30 +0000 (0:00:01.154) 1:01:43.811 ********** 2026-04-03 08:49:00.851689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851708 | orchestrator | 2026-04-03 08:49:00.851727 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:49:00.851747 | orchestrator | Friday 03 April 2026 08:48:32 +0000 (0:00:01.130) 1:01:44.942 ********** 2026-04-03 08:49:00.851766 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851784 | orchestrator | 2026-04-03 08:49:00.851796 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:49:00.851806 | orchestrator | Friday 03 April 2026 08:48:33 +0000 (0:00:01.177) 1:01:46.120 ********** 2026-04-03 08:49:00.851817 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851828 | orchestrator | 2026-04-03 08:49:00.851838 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:49:00.851849 | orchestrator | Friday 03 April 2026 08:48:34 +0000 (0:00:01.179) 1:01:47.299 ********** 2026-04-03 08:49:00.851860 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.851871 | orchestrator | 2026-04-03 08:49:00.851902 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:49:00.851914 | orchestrator | Friday 03 April 2026 08:48:35 +0000 (0:00:01.191) 1:01:48.491 ********** 2026-04-03 08:49:00.851925 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851936 | orchestrator | 2026-04-03 08:49:00.851947 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:49:00.851958 | orchestrator | Friday 03 April 2026 08:48:36 +0000 (0:00:01.114) 1:01:49.606 ********** 2026-04-03 08:49:00.851968 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.851979 | orchestrator | 2026-04-03 08:49:00.852031 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:49:00.852043 | orchestrator | Friday 03 April 2026 08:48:37 +0000 (0:00:01.209) 1:01:50.815 ********** 2026-04-03 08:49:00.852053 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852064 | orchestrator | 2026-04-03 08:49:00.852075 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:49:00.852086 | orchestrator | Friday 03 April 2026 08:48:39 +0000 (0:00:01.149) 1:01:51.964 ********** 2026-04-03 08:49:00.852097 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.852108 | orchestrator | 2026-04-03 08:49:00.852119 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:49:00.852130 | orchestrator | Friday 03 April 2026 08:48:40 +0000 (0:00:01.181) 1:01:53.146 ********** 2026-04-03 08:49:00.852141 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.852152 | orchestrator | 2026-04-03 08:49:00.852163 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:49:00.852174 | orchestrator | Friday 03 April 2026 08:48:41 +0000 (0:00:01.300) 1:01:54.447 ********** 2026-04-03 08:49:00.852185 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852195 | orchestrator | 2026-04-03 08:49:00.852206 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:49:00.852217 | orchestrator | Friday 03 April 2026 08:48:42 +0000 (0:00:01.154) 1:01:55.601 ********** 2026-04-03 08:49:00.852228 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852238 | orchestrator | 2026-04-03 08:49:00.852259 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:49:00.852271 | orchestrator | Friday 03 April 2026 08:48:43 +0000 (0:00:01.115) 1:01:56.716 ********** 2026-04-03 08:49:00.852281 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852292 | orchestrator | 2026-04-03 08:49:00.852303 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:49:00.852314 | orchestrator | Friday 03 April 2026 08:48:44 +0000 (0:00:01.145) 1:01:57.862 ********** 2026-04-03 08:49:00.852325 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852336 | orchestrator | 2026-04-03 08:49:00.852346 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:49:00.852357 | orchestrator | Friday 03 April 2026 08:48:46 +0000 (0:00:01.177) 1:01:59.039 ********** 2026-04-03 08:49:00.852368 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852379 | orchestrator | 2026-04-03 08:49:00.852390 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:49:00.852401 | orchestrator | Friday 03 April 2026 08:48:47 +0000 (0:00:01.139) 1:02:00.179 ********** 2026-04-03 08:49:00.852412 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852423 | orchestrator | 2026-04-03 08:49:00.852434 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:49:00.852445 | orchestrator | Friday 03 April 2026 08:48:48 +0000 (0:00:01.147) 1:02:01.326 ********** 2026-04-03 08:49:00.852456 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852466 | orchestrator | 2026-04-03 08:49:00.852478 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:49:00.852490 | orchestrator | Friday 03 April 2026 08:48:49 +0000 (0:00:01.114) 1:02:02.441 ********** 2026-04-03 08:49:00.852500 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852511 | orchestrator | 2026-04-03 08:49:00.852522 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:49:00.852533 | orchestrator | Friday 03 April 2026 08:48:50 +0000 (0:00:01.155) 1:02:03.597 ********** 2026-04-03 08:49:00.852544 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852555 | orchestrator | 2026-04-03 08:49:00.852566 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:49:00.852584 | orchestrator | Friday 03 April 2026 08:48:51 +0000 (0:00:01.121) 1:02:04.718 ********** 2026-04-03 08:49:00.852595 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852606 | orchestrator | 2026-04-03 08:49:00.852617 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:49:00.852628 | orchestrator | Friday 03 April 2026 08:48:52 +0000 (0:00:01.135) 1:02:05.854 ********** 2026-04-03 08:49:00.852638 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852649 | orchestrator | 2026-04-03 08:49:00.852660 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:49:00.852671 | orchestrator | Friday 03 April 2026 08:48:54 +0000 (0:00:01.177) 1:02:07.032 ********** 2026-04-03 08:49:00.852682 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:00.852693 | orchestrator | 2026-04-03 08:49:00.852704 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:49:00.852715 | orchestrator | Friday 03 April 2026 08:48:55 +0000 (0:00:01.347) 1:02:08.379 ********** 2026-04-03 08:49:00.852726 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.852736 | orchestrator | 2026-04-03 08:49:00.852747 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:49:00.852758 | orchestrator | Friday 03 April 2026 08:48:57 +0000 (0:00:01.989) 1:02:10.369 ********** 2026-04-03 08:49:00.852769 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:00.852780 | orchestrator | 2026-04-03 08:49:00.852790 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:49:00.852801 | orchestrator | Friday 03 April 2026 08:48:59 +0000 (0:00:02.229) 1:02:12.598 ********** 2026-04-03 08:49:00.852812 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-03 08:49:00.852829 | orchestrator | 2026-04-03 08:49:00.852840 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:49:00.852858 | orchestrator | Friday 03 April 2026 08:49:00 +0000 (0:00:01.104) 1:02:13.703 ********** 2026-04-03 08:49:47.880446 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.880558 | orchestrator | 2026-04-03 08:49:47.880574 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:49:47.880588 | orchestrator | Friday 03 April 2026 08:49:01 +0000 (0:00:01.129) 1:02:14.833 ********** 2026-04-03 08:49:47.880599 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.880610 | orchestrator | 2026-04-03 08:49:47.880621 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:49:47.880632 | orchestrator | Friday 03 April 2026 08:49:03 +0000 (0:00:01.134) 1:02:15.967 ********** 2026-04-03 08:49:47.880643 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:49:47.880654 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:49:47.880665 | orchestrator | 2026-04-03 08:49:47.880676 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:49:47.880687 | orchestrator | Friday 03 April 2026 08:49:04 +0000 (0:00:01.795) 1:02:17.763 ********** 2026-04-03 08:49:47.880697 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:47.880709 | orchestrator | 2026-04-03 08:49:47.880720 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:49:47.880730 | orchestrator | Friday 03 April 2026 08:49:06 +0000 (0:00:01.503) 1:02:19.266 ********** 2026-04-03 08:49:47.880742 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.880753 | orchestrator | 2026-04-03 08:49:47.880763 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:49:47.880774 | orchestrator | Friday 03 April 2026 08:49:07 +0000 (0:00:01.142) 1:02:20.409 ********** 2026-04-03 08:49:47.880785 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.880796 | orchestrator | 2026-04-03 08:49:47.880807 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:49:47.880817 | orchestrator | Friday 03 April 2026 08:49:08 +0000 (0:00:01.151) 1:02:21.560 ********** 2026-04-03 08:49:47.880828 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.880839 | orchestrator | 2026-04-03 08:49:47.880849 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:49:47.880860 | orchestrator | Friday 03 April 2026 08:49:09 +0000 (0:00:01.135) 1:02:22.696 ********** 2026-04-03 08:49:47.880871 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-03 08:49:47.880882 | orchestrator | 2026-04-03 08:49:47.880893 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:49:47.880903 | orchestrator | Friday 03 April 2026 08:49:11 +0000 (0:00:01.288) 1:02:23.984 ********** 2026-04-03 08:49:47.880914 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:47.880925 | orchestrator | 2026-04-03 08:49:47.880935 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:49:47.880946 | orchestrator | Friday 03 April 2026 08:49:12 +0000 (0:00:01.713) 1:02:25.697 ********** 2026-04-03 08:49:47.880999 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:49:47.881014 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:49:47.881027 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:49:47.881039 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881051 | orchestrator | 2026-04-03 08:49:47.881064 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:49:47.881076 | orchestrator | Friday 03 April 2026 08:49:13 +0000 (0:00:01.163) 1:02:26.861 ********** 2026-04-03 08:49:47.881089 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881127 | orchestrator | 2026-04-03 08:49:47.881140 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:49:47.881153 | orchestrator | Friday 03 April 2026 08:49:15 +0000 (0:00:01.230) 1:02:28.092 ********** 2026-04-03 08:49:47.881165 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881178 | orchestrator | 2026-04-03 08:49:47.881205 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:49:47.881218 | orchestrator | Friday 03 April 2026 08:49:16 +0000 (0:00:01.238) 1:02:29.331 ********** 2026-04-03 08:49:47.881230 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881243 | orchestrator | 2026-04-03 08:49:47.881256 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:49:47.881268 | orchestrator | Friday 03 April 2026 08:49:17 +0000 (0:00:01.131) 1:02:30.463 ********** 2026-04-03 08:49:47.881281 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881294 | orchestrator | 2026-04-03 08:49:47.881306 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:49:47.881319 | orchestrator | Friday 03 April 2026 08:49:18 +0000 (0:00:01.136) 1:02:31.599 ********** 2026-04-03 08:49:47.881332 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881345 | orchestrator | 2026-04-03 08:49:47.881356 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:49:47.881366 | orchestrator | Friday 03 April 2026 08:49:19 +0000 (0:00:01.180) 1:02:32.779 ********** 2026-04-03 08:49:47.881377 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:47.881387 | orchestrator | 2026-04-03 08:49:47.881398 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:49:47.881409 | orchestrator | Friday 03 April 2026 08:49:22 +0000 (0:00:02.539) 1:02:35.319 ********** 2026-04-03 08:49:47.881419 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:47.881430 | orchestrator | 2026-04-03 08:49:47.881441 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:49:47.881452 | orchestrator | Friday 03 April 2026 08:49:23 +0000 (0:00:01.124) 1:02:36.444 ********** 2026-04-03 08:49:47.881463 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-03 08:49:47.881473 | orchestrator | 2026-04-03 08:49:47.881484 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:49:47.881512 | orchestrator | Friday 03 April 2026 08:49:24 +0000 (0:00:01.132) 1:02:37.578 ********** 2026-04-03 08:49:47.881524 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881534 | orchestrator | 2026-04-03 08:49:47.881545 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:49:47.881556 | orchestrator | Friday 03 April 2026 08:49:25 +0000 (0:00:01.234) 1:02:38.812 ********** 2026-04-03 08:49:47.881567 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881577 | orchestrator | 2026-04-03 08:49:47.881588 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:49:47.881599 | orchestrator | Friday 03 April 2026 08:49:27 +0000 (0:00:01.255) 1:02:40.067 ********** 2026-04-03 08:49:47.881610 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881620 | orchestrator | 2026-04-03 08:49:47.881631 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:49:47.881642 | orchestrator | Friday 03 April 2026 08:49:28 +0000 (0:00:01.146) 1:02:41.214 ********** 2026-04-03 08:49:47.881652 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881663 | orchestrator | 2026-04-03 08:49:47.881674 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:49:47.881684 | orchestrator | Friday 03 April 2026 08:49:29 +0000 (0:00:01.187) 1:02:42.402 ********** 2026-04-03 08:49:47.881712 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881733 | orchestrator | 2026-04-03 08:49:47.881745 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:49:47.881756 | orchestrator | Friday 03 April 2026 08:49:30 +0000 (0:00:01.170) 1:02:43.573 ********** 2026-04-03 08:49:47.881775 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881785 | orchestrator | 2026-04-03 08:49:47.881796 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:49:47.881807 | orchestrator | Friday 03 April 2026 08:49:31 +0000 (0:00:01.140) 1:02:44.714 ********** 2026-04-03 08:49:47.881817 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881841 | orchestrator | 2026-04-03 08:49:47.881863 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:49:47.881875 | orchestrator | Friday 03 April 2026 08:49:32 +0000 (0:00:01.134) 1:02:45.848 ********** 2026-04-03 08:49:47.881886 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:49:47.881896 | orchestrator | 2026-04-03 08:49:47.881907 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:49:47.881918 | orchestrator | Friday 03 April 2026 08:49:34 +0000 (0:00:01.175) 1:02:47.024 ********** 2026-04-03 08:49:47.881928 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:49:47.881939 | orchestrator | 2026-04-03 08:49:47.881950 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:49:47.881987 | orchestrator | Friday 03 April 2026 08:49:35 +0000 (0:00:01.331) 1:02:48.356 ********** 2026-04-03 08:49:47.881998 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-03 08:49:47.882009 | orchestrator | 2026-04-03 08:49:47.882079 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:49:47.882090 | orchestrator | Friday 03 April 2026 08:49:36 +0000 (0:00:01.114) 1:02:49.471 ********** 2026-04-03 08:49:47.882101 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-03 08:49:47.882112 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-03 08:49:47.882123 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-03 08:49:47.882134 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-03 08:49:47.882144 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-03 08:49:47.882155 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-03 08:49:47.882165 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-03 08:49:47.882176 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:49:47.882187 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:49:47.882197 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:49:47.882208 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:49:47.882226 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:49:47.882237 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:49:47.882247 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:49:47.882258 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-03 08:49:47.882268 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-03 08:49:47.882279 | orchestrator | 2026-04-03 08:49:47.882290 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:49:47.882300 | orchestrator | Friday 03 April 2026 08:49:43 +0000 (0:00:06.494) 1:02:55.965 ********** 2026-04-03 08:49:47.882311 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-03 08:49:47.882322 | orchestrator | 2026-04-03 08:49:47.882332 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:49:47.882343 | orchestrator | Friday 03 April 2026 08:49:44 +0000 (0:00:01.298) 1:02:57.264 ********** 2026-04-03 08:49:47.882354 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:49:47.882365 | orchestrator | 2026-04-03 08:49:47.882376 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:49:47.882395 | orchestrator | Friday 03 April 2026 08:49:45 +0000 (0:00:01.537) 1:02:58.802 ********** 2026-04-03 08:49:47.882406 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:49:47.882416 | orchestrator | 2026-04-03 08:49:47.882427 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:49:47.882445 | orchestrator | Friday 03 April 2026 08:49:47 +0000 (0:00:01.929) 1:03:00.731 ********** 2026-04-03 08:50:37.353004 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353121 | orchestrator | 2026-04-03 08:50:37.353153 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:50:37.353167 | orchestrator | Friday 03 April 2026 08:49:48 +0000 (0:00:01.103) 1:03:01.835 ********** 2026-04-03 08:50:37.353178 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353189 | orchestrator | 2026-04-03 08:50:37.353201 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:50:37.353212 | orchestrator | Friday 03 April 2026 08:49:50 +0000 (0:00:01.127) 1:03:02.962 ********** 2026-04-03 08:50:37.353224 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353235 | orchestrator | 2026-04-03 08:50:37.353246 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:50:37.353257 | orchestrator | Friday 03 April 2026 08:49:51 +0000 (0:00:01.143) 1:03:04.106 ********** 2026-04-03 08:50:37.353269 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353280 | orchestrator | 2026-04-03 08:50:37.353291 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:50:37.353302 | orchestrator | Friday 03 April 2026 08:49:52 +0000 (0:00:01.126) 1:03:05.232 ********** 2026-04-03 08:50:37.353313 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353324 | orchestrator | 2026-04-03 08:50:37.353335 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:50:37.353357 | orchestrator | Friday 03 April 2026 08:49:53 +0000 (0:00:01.182) 1:03:06.415 ********** 2026-04-03 08:50:37.353368 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353379 | orchestrator | 2026-04-03 08:50:37.353391 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:50:37.353402 | orchestrator | Friday 03 April 2026 08:49:54 +0000 (0:00:01.148) 1:03:07.564 ********** 2026-04-03 08:50:37.353413 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353424 | orchestrator | 2026-04-03 08:50:37.353436 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:50:37.353447 | orchestrator | Friday 03 April 2026 08:49:55 +0000 (0:00:01.218) 1:03:08.782 ********** 2026-04-03 08:50:37.353458 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353469 | orchestrator | 2026-04-03 08:50:37.353481 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:50:37.353492 | orchestrator | Friday 03 April 2026 08:49:57 +0000 (0:00:01.140) 1:03:09.923 ********** 2026-04-03 08:50:37.353505 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353518 | orchestrator | 2026-04-03 08:50:37.353531 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:50:37.353544 | orchestrator | Friday 03 April 2026 08:49:58 +0000 (0:00:01.134) 1:03:11.057 ********** 2026-04-03 08:50:37.353557 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353569 | orchestrator | 2026-04-03 08:50:37.353582 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:50:37.353595 | orchestrator | Friday 03 April 2026 08:49:59 +0000 (0:00:01.213) 1:03:12.271 ********** 2026-04-03 08:50:37.353608 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353622 | orchestrator | 2026-04-03 08:50:37.353634 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:50:37.353648 | orchestrator | Friday 03 April 2026 08:50:00 +0000 (0:00:01.295) 1:03:13.566 ********** 2026-04-03 08:50:37.353685 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:50:37.353698 | orchestrator | 2026-04-03 08:50:37.353712 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:50:37.353725 | orchestrator | Friday 03 April 2026 08:50:05 +0000 (0:00:04.434) 1:03:18.001 ********** 2026-04-03 08:50:37.353744 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:50:37.353766 | orchestrator | 2026-04-03 08:50:37.353802 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:50:37.353815 | orchestrator | Friday 03 April 2026 08:50:06 +0000 (0:00:01.178) 1:03:19.179 ********** 2026-04-03 08:50:37.353837 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-03 08:50:37.353852 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-03 08:50:37.353864 | orchestrator | 2026-04-03 08:50:37.353875 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:50:37.353886 | orchestrator | Friday 03 April 2026 08:50:11 +0000 (0:00:04.782) 1:03:23.961 ********** 2026-04-03 08:50:37.353897 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353907 | orchestrator | 2026-04-03 08:50:37.353918 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:50:37.353951 | orchestrator | Friday 03 April 2026 08:50:12 +0000 (0:00:01.137) 1:03:25.099 ********** 2026-04-03 08:50:37.353963 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.353974 | orchestrator | 2026-04-03 08:50:37.353985 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:50:37.354014 | orchestrator | Friday 03 April 2026 08:50:13 +0000 (0:00:01.158) 1:03:26.258 ********** 2026-04-03 08:50:37.354075 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354087 | orchestrator | 2026-04-03 08:50:37.354097 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:50:37.354108 | orchestrator | Friday 03 April 2026 08:50:14 +0000 (0:00:01.157) 1:03:27.415 ********** 2026-04-03 08:50:37.354119 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354130 | orchestrator | 2026-04-03 08:50:37.354140 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:50:37.354151 | orchestrator | Friday 03 April 2026 08:50:15 +0000 (0:00:01.256) 1:03:28.671 ********** 2026-04-03 08:50:37.354162 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354182 | orchestrator | 2026-04-03 08:50:37.354196 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:50:37.354207 | orchestrator | Friday 03 April 2026 08:50:17 +0000 (0:00:01.237) 1:03:29.908 ********** 2026-04-03 08:50:37.354217 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:50:37.354229 | orchestrator | 2026-04-03 08:50:37.354240 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:50:37.354251 | orchestrator | Friday 03 April 2026 08:50:18 +0000 (0:00:01.266) 1:03:31.175 ********** 2026-04-03 08:50:37.354262 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:50:37.354273 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:50:37.354284 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:50:37.354294 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354305 | orchestrator | 2026-04-03 08:50:37.354327 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:50:37.354338 | orchestrator | Friday 03 April 2026 08:50:19 +0000 (0:00:01.427) 1:03:32.602 ********** 2026-04-03 08:50:37.354349 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:50:37.354359 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:50:37.354370 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:50:37.354381 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354392 | orchestrator | 2026-04-03 08:50:37.354403 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:50:37.354413 | orchestrator | Friday 03 April 2026 08:50:21 +0000 (0:00:01.575) 1:03:34.177 ********** 2026-04-03 08:50:37.354424 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-03 08:50:37.354435 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-03 08:50:37.354446 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-03 08:50:37.354456 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354467 | orchestrator | 2026-04-03 08:50:37.354478 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:50:37.354489 | orchestrator | Friday 03 April 2026 08:50:22 +0000 (0:00:01.587) 1:03:35.765 ********** 2026-04-03 08:50:37.354499 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:50:37.354510 | orchestrator | 2026-04-03 08:50:37.354521 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:50:37.354532 | orchestrator | Friday 03 April 2026 08:50:24 +0000 (0:00:01.278) 1:03:37.044 ********** 2026-04-03 08:50:37.354543 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-03 08:50:37.354554 | orchestrator | 2026-04-03 08:50:37.354565 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:50:37.354575 | orchestrator | Friday 03 April 2026 08:50:25 +0000 (0:00:01.450) 1:03:38.494 ********** 2026-04-03 08:50:37.354586 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:50:37.354597 | orchestrator | 2026-04-03 08:50:37.354607 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-03 08:50:37.354618 | orchestrator | Friday 03 April 2026 08:50:27 +0000 (0:00:01.800) 1:03:40.295 ********** 2026-04-03 08:50:37.354629 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3 2026-04-03 08:50:37.354640 | orchestrator | 2026-04-03 08:50:37.354657 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 08:50:37.354668 | orchestrator | Friday 03 April 2026 08:50:28 +0000 (0:00:01.476) 1:03:41.771 ********** 2026-04-03 08:50:37.354678 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:50:37.354689 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 08:50:37.354700 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:50:37.354710 | orchestrator | 2026-04-03 08:50:37.354722 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:50:37.354732 | orchestrator | Friday 03 April 2026 08:50:32 +0000 (0:00:03.246) 1:03:45.018 ********** 2026-04-03 08:50:37.354743 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 08:50:37.354754 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-03 08:50:37.354765 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:50:37.354776 | orchestrator | 2026-04-03 08:50:37.354787 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-03 08:50:37.354798 | orchestrator | Friday 03 April 2026 08:50:34 +0000 (0:00:01.986) 1:03:47.005 ********** 2026-04-03 08:50:37.354808 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:50:37.354819 | orchestrator | 2026-04-03 08:50:37.354830 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-03 08:50:37.354840 | orchestrator | Friday 03 April 2026 08:50:35 +0000 (0:00:01.187) 1:03:48.193 ********** 2026-04-03 08:50:37.354851 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3 2026-04-03 08:50:37.354869 | orchestrator | 2026-04-03 08:50:37.354880 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-03 08:50:37.354890 | orchestrator | Friday 03 April 2026 08:50:36 +0000 (0:00:01.471) 1:03:49.665 ********** 2026-04-03 08:50:37.354909 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:51:53.849274 | orchestrator | 2026-04-03 08:51:53.849389 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-03 08:51:53.849408 | orchestrator | Friday 03 April 2026 08:50:38 +0000 (0:00:01.632) 1:03:51.298 ********** 2026-04-03 08:51:53.849419 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:51:53.849432 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 08:51:53.849444 | orchestrator | 2026-04-03 08:51:53.849455 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 08:51:53.849466 | orchestrator | Friday 03 April 2026 08:50:44 +0000 (0:00:05.791) 1:03:57.089 ********** 2026-04-03 08:51:53.849477 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:51:53.849488 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:51:53.849499 | orchestrator | 2026-04-03 08:51:53.849510 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:51:53.849520 | orchestrator | Friday 03 April 2026 08:50:47 +0000 (0:00:03.234) 1:04:00.324 ********** 2026-04-03 08:51:53.849531 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 08:51:53.849542 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:51:53.849554 | orchestrator | 2026-04-03 08:51:53.849565 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-03 08:51:53.849576 | orchestrator | Friday 03 April 2026 08:50:49 +0000 (0:00:02.006) 1:04:02.331 ********** 2026-04-03 08:51:53.849586 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-03 08:51:53.849597 | orchestrator | 2026-04-03 08:51:53.849607 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-03 08:51:53.849618 | orchestrator | Friday 03 April 2026 08:50:51 +0000 (0:00:01.585) 1:04:03.917 ********** 2026-04-03 08:51:53.849629 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849640 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849651 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849662 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849673 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849683 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:51:53.849694 | orchestrator | 2026-04-03 08:51:53.849705 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-03 08:51:53.849715 | orchestrator | Friday 03 April 2026 08:50:52 +0000 (0:00:01.679) 1:04:05.596 ********** 2026-04-03 08:51:53.849726 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849737 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849748 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849802 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849816 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:51:53.849829 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:51:53.849842 | orchestrator | 2026-04-03 08:51:53.849855 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-03 08:51:53.849868 | orchestrator | Friday 03 April 2026 08:50:54 +0000 (0:00:01.638) 1:04:07.235 ********** 2026-04-03 08:51:53.849908 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:51:53.849932 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:51:53.849954 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:51:53.849972 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:51:53.849992 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:51:53.850004 | orchestrator | 2026-04-03 08:51:53.850071 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-03 08:51:53.850105 | orchestrator | Friday 03 April 2026 08:51:26 +0000 (0:00:32.087) 1:04:39.323 ********** 2026-04-03 08:51:53.850117 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:51:53.850127 | orchestrator | 2026-04-03 08:51:53.850138 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-03 08:51:53.850149 | orchestrator | Friday 03 April 2026 08:51:27 +0000 (0:00:01.129) 1:04:40.453 ********** 2026-04-03 08:51:53.850159 | orchestrator | skipping: [testbed-node-3] 2026-04-03 08:51:53.850170 | orchestrator | 2026-04-03 08:51:53.850180 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-03 08:51:53.850191 | orchestrator | Friday 03 April 2026 08:51:28 +0000 (0:00:01.173) 1:04:41.627 ********** 2026-04-03 08:51:53.850202 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3 2026-04-03 08:51:53.850213 | orchestrator | 2026-04-03 08:51:53.850223 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-03 08:51:53.850234 | orchestrator | Friday 03 April 2026 08:51:30 +0000 (0:00:01.488) 1:04:43.115 ********** 2026-04-03 08:51:53.850244 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3 2026-04-03 08:51:53.850255 | orchestrator | 2026-04-03 08:51:53.850266 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-03 08:51:53.850276 | orchestrator | Friday 03 April 2026 08:51:31 +0000 (0:00:01.604) 1:04:44.719 ********** 2026-04-03 08:51:53.850287 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:51:53.850297 | orchestrator | 2026-04-03 08:51:53.850308 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-03 08:51:53.850320 | orchestrator | Friday 03 April 2026 08:51:33 +0000 (0:00:02.034) 1:04:46.754 ********** 2026-04-03 08:51:53.850331 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:51:53.850341 | orchestrator | 2026-04-03 08:51:53.850352 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-03 08:51:53.850363 | orchestrator | Friday 03 April 2026 08:51:35 +0000 (0:00:01.937) 1:04:48.691 ********** 2026-04-03 08:51:53.850373 | orchestrator | ok: [testbed-node-3] 2026-04-03 08:51:53.850384 | orchestrator | 2026-04-03 08:51:53.850395 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-03 08:51:53.850416 | orchestrator | Friday 03 April 2026 08:51:38 +0000 (0:00:02.229) 1:04:50.921 ********** 2026-04-03 08:51:53.850427 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-03 08:51:53.850441 | orchestrator | 2026-04-03 08:51:53.850461 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-03 08:51:53.850483 | orchestrator | 2026-04-03 08:51:53.850503 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:51:53.850522 | orchestrator | Friday 03 April 2026 08:51:41 +0000 (0:00:02.950) 1:04:53.872 ********** 2026-04-03 08:51:53.850541 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-03 08:51:53.850561 | orchestrator | 2026-04-03 08:51:53.850583 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:51:53.850595 | orchestrator | Friday 03 April 2026 08:51:42 +0000 (0:00:01.106) 1:04:54.978 ********** 2026-04-03 08:51:53.850606 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850616 | orchestrator | 2026-04-03 08:51:53.850627 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:51:53.850638 | orchestrator | Friday 03 April 2026 08:51:43 +0000 (0:00:01.498) 1:04:56.477 ********** 2026-04-03 08:51:53.850648 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850659 | orchestrator | 2026-04-03 08:51:53.850670 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:51:53.850680 | orchestrator | Friday 03 April 2026 08:51:44 +0000 (0:00:01.120) 1:04:57.597 ********** 2026-04-03 08:51:53.850690 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850701 | orchestrator | 2026-04-03 08:51:53.850712 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:51:53.850729 | orchestrator | Friday 03 April 2026 08:51:46 +0000 (0:00:01.445) 1:04:59.043 ********** 2026-04-03 08:51:53.850740 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850751 | orchestrator | 2026-04-03 08:51:53.850761 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:51:53.850772 | orchestrator | Friday 03 April 2026 08:51:47 +0000 (0:00:01.167) 1:05:00.210 ********** 2026-04-03 08:51:53.850782 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850793 | orchestrator | 2026-04-03 08:51:53.850804 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:51:53.850814 | orchestrator | Friday 03 April 2026 08:51:48 +0000 (0:00:01.194) 1:05:01.405 ********** 2026-04-03 08:51:53.850825 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850835 | orchestrator | 2026-04-03 08:51:53.850846 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:51:53.850857 | orchestrator | Friday 03 April 2026 08:51:49 +0000 (0:00:01.175) 1:05:02.581 ********** 2026-04-03 08:51:53.850867 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:51:53.850878 | orchestrator | 2026-04-03 08:51:53.850914 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:51:53.850926 | orchestrator | Friday 03 April 2026 08:51:50 +0000 (0:00:01.191) 1:05:03.772 ********** 2026-04-03 08:51:53.850936 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:51:53.850947 | orchestrator | 2026-04-03 08:51:53.850958 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:51:53.850968 | orchestrator | Friday 03 April 2026 08:51:52 +0000 (0:00:01.176) 1:05:04.949 ********** 2026-04-03 08:51:53.850979 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:51:53.850990 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:51:53.851001 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:51:53.851011 | orchestrator | 2026-04-03 08:51:53.851022 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:51:53.851041 | orchestrator | Friday 03 April 2026 08:51:53 +0000 (0:00:01.752) 1:05:06.701 ********** 2026-04-03 08:52:18.992718 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.992815 | orchestrator | 2026-04-03 08:52:18.992826 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:52:18.992836 | orchestrator | Friday 03 April 2026 08:51:55 +0000 (0:00:01.280) 1:05:07.982 ********** 2026-04-03 08:52:18.992843 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:52:18.992852 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:52:18.992859 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:52:18.992866 | orchestrator | 2026-04-03 08:52:18.992923 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:52:18.992930 | orchestrator | Friday 03 April 2026 08:51:58 +0000 (0:00:02.901) 1:05:10.883 ********** 2026-04-03 08:52:18.992939 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:52:18.992947 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:52:18.992954 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:52:18.992962 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.992969 | orchestrator | 2026-04-03 08:52:18.992976 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:52:18.992984 | orchestrator | Friday 03 April 2026 08:51:59 +0000 (0:00:01.477) 1:05:12.361 ********** 2026-04-03 08:52:18.992993 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993003 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993011 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993018 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993026 | orchestrator | 2026-04-03 08:52:18.993033 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:52:18.993040 | orchestrator | Friday 03 April 2026 08:52:01 +0000 (0:00:02.071) 1:05:14.432 ********** 2026-04-03 08:52:18.993049 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993075 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993083 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:18.993091 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993118 | orchestrator | 2026-04-03 08:52:18.993126 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:52:18.993133 | orchestrator | Friday 03 April 2026 08:52:02 +0000 (0:00:01.163) 1:05:15.596 ********** 2026-04-03 08:52:18.993156 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:51:55.692193', 'end': '2026-04-03 08:51:55.749498', 'delta': '0:00:00.057305', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:52:18.993166 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:51:56.304186', 'end': '2026-04-03 08:51:56.345413', 'delta': '0:00:00.041227', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:52:18.993174 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:51:56.844567', 'end': '2026-04-03 08:51:56.897328', 'delta': '0:00:00.052761', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:52:18.993182 | orchestrator | 2026-04-03 08:52:18.993189 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:52:18.993197 | orchestrator | Friday 03 April 2026 08:52:03 +0000 (0:00:01.174) 1:05:16.770 ********** 2026-04-03 08:52:18.993204 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.993211 | orchestrator | 2026-04-03 08:52:18.993218 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:52:18.993226 | orchestrator | Friday 03 April 2026 08:52:05 +0000 (0:00:01.237) 1:05:18.007 ********** 2026-04-03 08:52:18.993233 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993240 | orchestrator | 2026-04-03 08:52:18.993247 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:52:18.993254 | orchestrator | Friday 03 April 2026 08:52:06 +0000 (0:00:01.236) 1:05:19.244 ********** 2026-04-03 08:52:18.993262 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.993270 | orchestrator | 2026-04-03 08:52:18.993279 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:52:18.993287 | orchestrator | Friday 03 April 2026 08:52:07 +0000 (0:00:01.223) 1:05:20.468 ********** 2026-04-03 08:52:18.993296 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:52:18.993304 | orchestrator | 2026-04-03 08:52:18.993312 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:52:18.993321 | orchestrator | Friday 03 April 2026 08:52:09 +0000 (0:00:02.050) 1:05:22.518 ********** 2026-04-03 08:52:18.993335 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.993344 | orchestrator | 2026-04-03 08:52:18.993356 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:52:18.993365 | orchestrator | Friday 03 April 2026 08:52:10 +0000 (0:00:01.238) 1:05:23.757 ********** 2026-04-03 08:52:18.993373 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993381 | orchestrator | 2026-04-03 08:52:18.993390 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:52:18.993399 | orchestrator | Friday 03 April 2026 08:52:12 +0000 (0:00:01.160) 1:05:24.917 ********** 2026-04-03 08:52:18.993407 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993416 | orchestrator | 2026-04-03 08:52:18.993424 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:52:18.993433 | orchestrator | Friday 03 April 2026 08:52:13 +0000 (0:00:01.208) 1:05:26.125 ********** 2026-04-03 08:52:18.993441 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993450 | orchestrator | 2026-04-03 08:52:18.993458 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:52:18.993467 | orchestrator | Friday 03 April 2026 08:52:14 +0000 (0:00:01.152) 1:05:27.278 ********** 2026-04-03 08:52:18.993475 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993484 | orchestrator | 2026-04-03 08:52:18.993492 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:52:18.993501 | orchestrator | Friday 03 April 2026 08:52:15 +0000 (0:00:01.151) 1:05:28.430 ********** 2026-04-03 08:52:18.993509 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.993518 | orchestrator | 2026-04-03 08:52:18.993526 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:52:18.993534 | orchestrator | Friday 03 April 2026 08:52:16 +0000 (0:00:01.150) 1:05:29.580 ********** 2026-04-03 08:52:18.993542 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:18.993551 | orchestrator | 2026-04-03 08:52:18.993560 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:52:18.993568 | orchestrator | Friday 03 April 2026 08:52:17 +0000 (0:00:01.122) 1:05:30.703 ********** 2026-04-03 08:52:18.993576 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:18.993585 | orchestrator | 2026-04-03 08:52:18.993593 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:52:18.993607 | orchestrator | Friday 03 April 2026 08:52:18 +0000 (0:00:01.142) 1:05:31.846 ********** 2026-04-03 08:52:21.538001 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:21.538197 | orchestrator | 2026-04-03 08:52:21.538218 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:52:21.538231 | orchestrator | Friday 03 April 2026 08:52:20 +0000 (0:00:01.147) 1:05:32.993 ********** 2026-04-03 08:52:21.538244 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:21.538255 | orchestrator | 2026-04-03 08:52:21.538267 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:52:21.538278 | orchestrator | Friday 03 April 2026 08:52:21 +0000 (0:00:01.178) 1:05:34.171 ********** 2026-04-03 08:52:21.538291 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538307 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}})  2026-04-03 08:52:21.538350 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:52:21.538377 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}})  2026-04-03 08:52:21.538390 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538402 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538440 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:52:21.538462 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538482 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538515 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538537 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}})  2026-04-03 08:52:21.538579 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}})  2026-04-03 08:52:21.538601 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:21.538632 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:52:22.931144 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:22.931251 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:52:22.931265 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:52:22.931274 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:22.931283 | orchestrator | 2026-04-03 08:52:22.931290 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:52:22.931298 | orchestrator | Friday 03 April 2026 08:52:22 +0000 (0:00:01.413) 1:05:35.585 ********** 2026-04-03 08:52:22.931305 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931313 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309', 'dm-uuid-LVM-mYCjmzZuu2hwjo5sLWPYTkDpfeou4cD6LG6MTri1x81C4YqbtegZDO0BsrauByb1'], 'uuids': ['85ba7fb8-5446-41e0-97a0-fc41ed20f921'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931339 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7', 'scsi-SQEMU_QEMU_HARDDISK_ee70ae4f-0a08-4543-aed0-4e9fbf59d0f7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ee70ae4f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931368 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Y4LDQ4-xKNJ-ydgP-h8RH-X3a2-GT6d-CFMNyM', 'scsi-0QEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506', 'scsi-SQEMU_QEMU_HARDDISK_9ac243a5-e044-41c7-a018-924969caf506'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931376 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931382 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931389 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-22-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931402 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:22.931414 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2', 'dm-uuid-CRYPT-LUKS2-ef5ebfb1d8c94839b753c90277d50937-fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.475628 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.475782 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--22674541--64cc--5df8--a9f8--30ff652f1dce-osd--block--22674541--64cc--5df8--a9f8--30ff652f1dce', 'dm-uuid-LVM-X8JbR1hRZpNWGLcfcW4k3AYuaXiUvjOlfPhwpmJJ6Jf2wHFSIRpBM3uRkd4uHPB2'], 'uuids': ['ef5ebfb1-d8c9-4839-b753-c90277d50937'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '9ac243a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['fPhwpm-JJ6J-f2wH-FSIR-pBM3-uRkd-4uHPB2']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.475816 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-OPZBih-4uzo-moKt-mpyK-QgOk-2ofo-NGFuEV', 'scsi-0QEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243', 'scsi-SQEMU_QEMU_HARDDISK_8670c2f2-ada3-4588-ba77-b0fabeb92243'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8670c2f2', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d44e23ea--2eda--5203--86ef--10b85847f309-osd--block--d44e23ea--2eda--5203--86ef--10b85847f309']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.475833 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.475999 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '37834d3d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1', 'scsi-SQEMU_QEMU_HARDDISK_37834d3d-70d4-489d-8bcd-3715e81551df-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.476031 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.476052 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.476085 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1', 'dm-uuid-CRYPT-LUKS2-85ba7fb8544641e097a0fc41ed20f921-LG6MTr-i1x8-1C4Y-qbte-gZDO-0Bsr-auByb1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:52:28.476107 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:52:28.476130 | orchestrator | 2026-04-03 08:52:28.476153 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:52:28.476170 | orchestrator | Friday 03 April 2026 08:52:24 +0000 (0:00:01.532) 1:05:37.118 ********** 2026-04-03 08:52:28.476181 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:28.476193 | orchestrator | 2026-04-03 08:52:28.476204 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:52:28.476215 | orchestrator | Friday 03 April 2026 08:52:25 +0000 (0:00:01.547) 1:05:38.666 ********** 2026-04-03 08:52:28.476225 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:28.476236 | orchestrator | 2026-04-03 08:52:28.476246 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:52:28.476257 | orchestrator | Friday 03 April 2026 08:52:26 +0000 (0:00:01.173) 1:05:39.839 ********** 2026-04-03 08:52:28.476268 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:52:28.476278 | orchestrator | 2026-04-03 08:52:28.476289 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:52:28.476309 | orchestrator | Friday 03 April 2026 08:52:28 +0000 (0:00:01.494) 1:05:41.334 ********** 2026-04-03 08:53:10.909073 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909190 | orchestrator | 2026-04-03 08:53:10.909208 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:53:10.909221 | orchestrator | Friday 03 April 2026 08:52:29 +0000 (0:00:01.127) 1:05:42.461 ********** 2026-04-03 08:53:10.909232 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909243 | orchestrator | 2026-04-03 08:53:10.909255 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:53:10.909266 | orchestrator | Friday 03 April 2026 08:52:30 +0000 (0:00:01.252) 1:05:43.713 ********** 2026-04-03 08:53:10.909277 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909287 | orchestrator | 2026-04-03 08:53:10.909298 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:53:10.909309 | orchestrator | Friday 03 April 2026 08:52:32 +0000 (0:00:01.161) 1:05:44.875 ********** 2026-04-03 08:53:10.909320 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-03 08:53:10.909348 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-03 08:53:10.909360 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-03 08:53:10.909370 | orchestrator | 2026-04-03 08:53:10.909382 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:53:10.909393 | orchestrator | Friday 03 April 2026 08:52:33 +0000 (0:00:01.950) 1:05:46.825 ********** 2026-04-03 08:53:10.909404 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-03 08:53:10.909415 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-03 08:53:10.909426 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-03 08:53:10.909437 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909448 | orchestrator | 2026-04-03 08:53:10.909459 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:53:10.909496 | orchestrator | Friday 03 April 2026 08:52:35 +0000 (0:00:01.168) 1:05:47.994 ********** 2026-04-03 08:53:10.909507 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-03 08:53:10.909519 | orchestrator | 2026-04-03 08:53:10.909531 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:53:10.909543 | orchestrator | Friday 03 April 2026 08:52:36 +0000 (0:00:01.193) 1:05:49.188 ********** 2026-04-03 08:53:10.909554 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909564 | orchestrator | 2026-04-03 08:53:10.909575 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:53:10.909586 | orchestrator | Friday 03 April 2026 08:52:37 +0000 (0:00:01.155) 1:05:50.344 ********** 2026-04-03 08:53:10.909599 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909611 | orchestrator | 2026-04-03 08:53:10.909624 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:53:10.909637 | orchestrator | Friday 03 April 2026 08:52:38 +0000 (0:00:01.146) 1:05:51.490 ********** 2026-04-03 08:53:10.909649 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909662 | orchestrator | 2026-04-03 08:53:10.909674 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:53:10.909686 | orchestrator | Friday 03 April 2026 08:52:39 +0000 (0:00:01.174) 1:05:52.665 ********** 2026-04-03 08:53:10.909699 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:10.909712 | orchestrator | 2026-04-03 08:53:10.909724 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:53:10.909737 | orchestrator | Friday 03 April 2026 08:52:41 +0000 (0:00:01.792) 1:05:54.457 ********** 2026-04-03 08:53:10.909749 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:53:10.909762 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:53:10.909775 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:53:10.909788 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909801 | orchestrator | 2026-04-03 08:53:10.909813 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:53:10.909825 | orchestrator | Friday 03 April 2026 08:52:43 +0000 (0:00:01.452) 1:05:55.909 ********** 2026-04-03 08:53:10.909838 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:53:10.909886 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:53:10.909900 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:53:10.909913 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.909925 | orchestrator | 2026-04-03 08:53:10.909938 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:53:10.909950 | orchestrator | Friday 03 April 2026 08:52:44 +0000 (0:00:01.455) 1:05:57.365 ********** 2026-04-03 08:53:10.909962 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:53:10.909973 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:53:10.909984 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:53:10.909995 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.910005 | orchestrator | 2026-04-03 08:53:10.910065 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:53:10.910080 | orchestrator | Friday 03 April 2026 08:52:45 +0000 (0:00:01.446) 1:05:58.812 ********** 2026-04-03 08:53:10.910100 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:10.910111 | orchestrator | 2026-04-03 08:53:10.910122 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:53:10.910133 | orchestrator | Friday 03 April 2026 08:52:47 +0000 (0:00:01.156) 1:05:59.969 ********** 2026-04-03 08:53:10.910144 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:53:10.910155 | orchestrator | 2026-04-03 08:53:10.910166 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:53:10.910186 | orchestrator | Friday 03 April 2026 08:52:48 +0000 (0:00:01.357) 1:06:01.327 ********** 2026-04-03 08:53:10.910216 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:53:10.910228 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:53:10.910239 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:53:10.910250 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:53:10.910261 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:53:10.910271 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:53:10.910282 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:53:10.910293 | orchestrator | 2026-04-03 08:53:10.910304 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:53:10.910315 | orchestrator | Friday 03 April 2026 08:52:50 +0000 (0:00:02.227) 1:06:03.555 ********** 2026-04-03 08:53:10.910331 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:53:10.910343 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:53:10.910353 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:53:10.910364 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:53:10.910375 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-03 08:53:10.910386 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-03 08:53:10.910396 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:53:10.910407 | orchestrator | 2026-04-03 08:53:10.910418 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-03 08:53:10.910429 | orchestrator | Friday 03 April 2026 08:52:52 +0000 (0:00:02.249) 1:06:05.805 ********** 2026-04-03 08:53:10.910440 | orchestrator | changed: [testbed-node-4] 2026-04-03 08:53:10.910451 | orchestrator | 2026-04-03 08:53:10.910461 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-03 08:53:10.910472 | orchestrator | Friday 03 April 2026 08:52:54 +0000 (0:00:01.913) 1:06:07.718 ********** 2026-04-03 08:53:10.910483 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:53:10.910494 | orchestrator | 2026-04-03 08:53:10.910505 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-03 08:53:10.910516 | orchestrator | Friday 03 April 2026 08:52:57 +0000 (0:00:02.525) 1:06:10.244 ********** 2026-04-03 08:53:10.910527 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:53:10.910538 | orchestrator | 2026-04-03 08:53:10.910549 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:53:10.910559 | orchestrator | Friday 03 April 2026 08:52:59 +0000 (0:00:01.895) 1:06:12.140 ********** 2026-04-03 08:53:10.910570 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-03 08:53:10.910581 | orchestrator | 2026-04-03 08:53:10.910592 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:53:10.910603 | orchestrator | Friday 03 April 2026 08:53:00 +0000 (0:00:01.307) 1:06:13.447 ********** 2026-04-03 08:53:10.910613 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-03 08:53:10.910624 | orchestrator | 2026-04-03 08:53:10.910635 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:53:10.910646 | orchestrator | Friday 03 April 2026 08:53:01 +0000 (0:00:01.116) 1:06:14.564 ********** 2026-04-03 08:53:10.910663 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.910673 | orchestrator | 2026-04-03 08:53:10.910684 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:53:10.910695 | orchestrator | Friday 03 April 2026 08:53:02 +0000 (0:00:01.147) 1:06:15.711 ********** 2026-04-03 08:53:10.910706 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:10.910716 | orchestrator | 2026-04-03 08:53:10.910727 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:53:10.910738 | orchestrator | Friday 03 April 2026 08:53:04 +0000 (0:00:01.561) 1:06:17.273 ********** 2026-04-03 08:53:10.910749 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:10.910759 | orchestrator | 2026-04-03 08:53:10.910770 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:53:10.910781 | orchestrator | Friday 03 April 2026 08:53:05 +0000 (0:00:01.538) 1:06:18.812 ********** 2026-04-03 08:53:10.910792 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:10.910802 | orchestrator | 2026-04-03 08:53:10.910813 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:53:10.910824 | orchestrator | Friday 03 April 2026 08:53:07 +0000 (0:00:01.539) 1:06:20.351 ********** 2026-04-03 08:53:10.910834 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.910870 | orchestrator | 2026-04-03 08:53:10.910891 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:53:10.910910 | orchestrator | Friday 03 April 2026 08:53:08 +0000 (0:00:01.116) 1:06:21.467 ********** 2026-04-03 08:53:10.910929 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.910943 | orchestrator | 2026-04-03 08:53:10.910954 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:53:10.910965 | orchestrator | Friday 03 April 2026 08:53:09 +0000 (0:00:01.144) 1:06:22.612 ********** 2026-04-03 08:53:10.910975 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:10.910986 | orchestrator | 2026-04-03 08:53:10.910997 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:53:10.911016 | orchestrator | Friday 03 April 2026 08:53:10 +0000 (0:00:01.152) 1:06:23.764 ********** 2026-04-03 08:53:50.538401 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.538512 | orchestrator | 2026-04-03 08:53:50.538529 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:53:50.538542 | orchestrator | Friday 03 April 2026 08:53:12 +0000 (0:00:01.606) 1:06:25.371 ********** 2026-04-03 08:53:50.538553 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.538564 | orchestrator | 2026-04-03 08:53:50.538575 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:53:50.538586 | orchestrator | Friday 03 April 2026 08:53:14 +0000 (0:00:01.573) 1:06:26.945 ********** 2026-04-03 08:53:50.538597 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.538609 | orchestrator | 2026-04-03 08:53:50.538620 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:53:50.538631 | orchestrator | Friday 03 April 2026 08:53:14 +0000 (0:00:00.816) 1:06:27.761 ********** 2026-04-03 08:53:50.538642 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.538652 | orchestrator | 2026-04-03 08:53:50.538679 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:53:50.538691 | orchestrator | Friday 03 April 2026 08:53:15 +0000 (0:00:00.965) 1:06:28.727 ********** 2026-04-03 08:53:50.538702 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.538713 | orchestrator | 2026-04-03 08:53:50.538723 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:53:50.538734 | orchestrator | Friday 03 April 2026 08:53:16 +0000 (0:00:00.794) 1:06:29.522 ********** 2026-04-03 08:53:50.538745 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.538756 | orchestrator | 2026-04-03 08:53:50.538766 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:53:50.538777 | orchestrator | Friday 03 April 2026 08:53:17 +0000 (0:00:00.803) 1:06:30.325 ********** 2026-04-03 08:53:50.538812 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.538854 | orchestrator | 2026-04-03 08:53:50.538867 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:53:50.538878 | orchestrator | Friday 03 April 2026 08:53:18 +0000 (0:00:00.827) 1:06:31.153 ********** 2026-04-03 08:53:50.538889 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.538900 | orchestrator | 2026-04-03 08:53:50.538910 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:53:50.538921 | orchestrator | Friday 03 April 2026 08:53:19 +0000 (0:00:00.774) 1:06:31.928 ********** 2026-04-03 08:53:50.538934 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.538947 | orchestrator | 2026-04-03 08:53:50.538960 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:53:50.538973 | orchestrator | Friday 03 April 2026 08:53:19 +0000 (0:00:00.792) 1:06:32.720 ********** 2026-04-03 08:53:50.538985 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.538997 | orchestrator | 2026-04-03 08:53:50.539009 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:53:50.539021 | orchestrator | Friday 03 April 2026 08:53:20 +0000 (0:00:00.787) 1:06:33.508 ********** 2026-04-03 08:53:50.539033 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.539046 | orchestrator | 2026-04-03 08:53:50.539059 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:53:50.539072 | orchestrator | Friday 03 April 2026 08:53:21 +0000 (0:00:00.799) 1:06:34.307 ********** 2026-04-03 08:53:50.539084 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.539097 | orchestrator | 2026-04-03 08:53:50.539109 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:53:50.539122 | orchestrator | Friday 03 April 2026 08:53:22 +0000 (0:00:00.792) 1:06:35.100 ********** 2026-04-03 08:53:50.539134 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539147 | orchestrator | 2026-04-03 08:53:50.539159 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:53:50.539173 | orchestrator | Friday 03 April 2026 08:53:23 +0000 (0:00:00.804) 1:06:35.904 ********** 2026-04-03 08:53:50.539184 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539195 | orchestrator | 2026-04-03 08:53:50.539206 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:53:50.539217 | orchestrator | Friday 03 April 2026 08:53:23 +0000 (0:00:00.848) 1:06:36.753 ********** 2026-04-03 08:53:50.539228 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539238 | orchestrator | 2026-04-03 08:53:50.539249 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:53:50.539260 | orchestrator | Friday 03 April 2026 08:53:24 +0000 (0:00:00.795) 1:06:37.549 ********** 2026-04-03 08:53:50.539271 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539281 | orchestrator | 2026-04-03 08:53:50.539292 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:53:50.539303 | orchestrator | Friday 03 April 2026 08:53:25 +0000 (0:00:00.920) 1:06:38.470 ********** 2026-04-03 08:53:50.539314 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539324 | orchestrator | 2026-04-03 08:53:50.539336 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:53:50.539347 | orchestrator | Friday 03 April 2026 08:53:26 +0000 (0:00:00.831) 1:06:39.302 ********** 2026-04-03 08:53:50.539357 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539368 | orchestrator | 2026-04-03 08:53:50.539379 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:53:50.539389 | orchestrator | Friday 03 April 2026 08:53:27 +0000 (0:00:00.768) 1:06:40.070 ********** 2026-04-03 08:53:50.539400 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539411 | orchestrator | 2026-04-03 08:53:50.539423 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:53:50.539435 | orchestrator | Friday 03 April 2026 08:53:27 +0000 (0:00:00.763) 1:06:40.834 ********** 2026-04-03 08:53:50.539454 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539465 | orchestrator | 2026-04-03 08:53:50.539476 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:53:50.539487 | orchestrator | Friday 03 April 2026 08:53:28 +0000 (0:00:00.765) 1:06:41.600 ********** 2026-04-03 08:53:50.539498 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539508 | orchestrator | 2026-04-03 08:53:50.539536 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:53:50.539548 | orchestrator | Friday 03 April 2026 08:53:29 +0000 (0:00:00.784) 1:06:42.385 ********** 2026-04-03 08:53:50.539559 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539570 | orchestrator | 2026-04-03 08:53:50.539581 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:53:50.539591 | orchestrator | Friday 03 April 2026 08:53:30 +0000 (0:00:00.760) 1:06:43.146 ********** 2026-04-03 08:53:50.539602 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539613 | orchestrator | 2026-04-03 08:53:50.539624 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:53:50.539635 | orchestrator | Friday 03 April 2026 08:53:31 +0000 (0:00:00.779) 1:06:43.925 ********** 2026-04-03 08:53:50.539645 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539656 | orchestrator | 2026-04-03 08:53:50.539667 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:53:50.539683 | orchestrator | Friday 03 April 2026 08:53:31 +0000 (0:00:00.772) 1:06:44.697 ********** 2026-04-03 08:53:50.539694 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.539705 | orchestrator | 2026-04-03 08:53:50.539716 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:53:50.539727 | orchestrator | Friday 03 April 2026 08:53:33 +0000 (0:00:01.606) 1:06:46.304 ********** 2026-04-03 08:53:50.539738 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.539749 | orchestrator | 2026-04-03 08:53:50.539760 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:53:50.539770 | orchestrator | Friday 03 April 2026 08:53:35 +0000 (0:00:01.855) 1:06:48.160 ********** 2026-04-03 08:53:50.539781 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-03 08:53:50.539793 | orchestrator | 2026-04-03 08:53:50.539804 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:53:50.539815 | orchestrator | Friday 03 April 2026 08:53:36 +0000 (0:00:01.294) 1:06:49.454 ********** 2026-04-03 08:53:50.539866 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539878 | orchestrator | 2026-04-03 08:53:50.539889 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:53:50.539899 | orchestrator | Friday 03 April 2026 08:53:37 +0000 (0:00:01.133) 1:06:50.588 ********** 2026-04-03 08:53:50.539910 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.539921 | orchestrator | 2026-04-03 08:53:50.539931 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:53:50.539942 | orchestrator | Friday 03 April 2026 08:53:38 +0000 (0:00:01.214) 1:06:51.803 ********** 2026-04-03 08:53:50.539953 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:53:50.539964 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:53:50.539974 | orchestrator | 2026-04-03 08:53:50.539985 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:53:50.539996 | orchestrator | Friday 03 April 2026 08:53:40 +0000 (0:00:01.873) 1:06:53.677 ********** 2026-04-03 08:53:50.540006 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.540017 | orchestrator | 2026-04-03 08:53:50.540028 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:53:50.540038 | orchestrator | Friday 03 April 2026 08:53:42 +0000 (0:00:01.496) 1:06:55.174 ********** 2026-04-03 08:53:50.540049 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540067 | orchestrator | 2026-04-03 08:53:50.540078 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:53:50.540089 | orchestrator | Friday 03 April 2026 08:53:43 +0000 (0:00:01.207) 1:06:56.381 ********** 2026-04-03 08:53:50.540100 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540110 | orchestrator | 2026-04-03 08:53:50.540121 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:53:50.540132 | orchestrator | Friday 03 April 2026 08:53:44 +0000 (0:00:00.838) 1:06:57.220 ********** 2026-04-03 08:53:50.540143 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540154 | orchestrator | 2026-04-03 08:53:50.540164 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:53:50.540175 | orchestrator | Friday 03 April 2026 08:53:45 +0000 (0:00:00.795) 1:06:58.016 ********** 2026-04-03 08:53:50.540186 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-03 08:53:50.540197 | orchestrator | 2026-04-03 08:53:50.540208 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:53:50.540218 | orchestrator | Friday 03 April 2026 08:53:46 +0000 (0:00:01.153) 1:06:59.169 ********** 2026-04-03 08:53:50.540229 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:53:50.540240 | orchestrator | 2026-04-03 08:53:50.540258 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:53:50.540277 | orchestrator | Friday 03 April 2026 08:53:48 +0000 (0:00:01.743) 1:07:00.912 ********** 2026-04-03 08:53:50.540294 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:53:50.540314 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:53:50.540332 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:53:50.540347 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540358 | orchestrator | 2026-04-03 08:53:50.540369 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:53:50.540380 | orchestrator | Friday 03 April 2026 08:53:49 +0000 (0:00:01.184) 1:07:02.097 ********** 2026-04-03 08:53:50.540391 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540401 | orchestrator | 2026-04-03 08:53:50.540412 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:53:50.540423 | orchestrator | Friday 03 April 2026 08:53:50 +0000 (0:00:01.119) 1:07:03.216 ********** 2026-04-03 08:53:50.540434 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:53:50.540444 | orchestrator | 2026-04-03 08:53:50.540463 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:54:33.764217 | orchestrator | Friday 03 April 2026 08:53:51 +0000 (0:00:01.169) 1:07:04.386 ********** 2026-04-03 08:54:33.764326 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764341 | orchestrator | 2026-04-03 08:54:33.764352 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:54:33.764362 | orchestrator | Friday 03 April 2026 08:53:52 +0000 (0:00:01.286) 1:07:05.673 ********** 2026-04-03 08:54:33.764372 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764382 | orchestrator | 2026-04-03 08:54:33.764392 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:54:33.764402 | orchestrator | Friday 03 April 2026 08:53:53 +0000 (0:00:01.143) 1:07:06.816 ********** 2026-04-03 08:54:33.764411 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764421 | orchestrator | 2026-04-03 08:54:33.764447 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:54:33.764457 | orchestrator | Friday 03 April 2026 08:53:54 +0000 (0:00:00.785) 1:07:07.602 ********** 2026-04-03 08:54:33.764467 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:54:33.764477 | orchestrator | 2026-04-03 08:54:33.764487 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:54:33.764497 | orchestrator | Friday 03 April 2026 08:53:56 +0000 (0:00:02.128) 1:07:09.731 ********** 2026-04-03 08:54:33.764530 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:54:33.764540 | orchestrator | 2026-04-03 08:54:33.764550 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:54:33.764559 | orchestrator | Friday 03 April 2026 08:53:57 +0000 (0:00:00.821) 1:07:10.552 ********** 2026-04-03 08:54:33.764569 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-03 08:54:33.764578 | orchestrator | 2026-04-03 08:54:33.764588 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:54:33.764597 | orchestrator | Friday 03 April 2026 08:53:58 +0000 (0:00:01.150) 1:07:11.703 ********** 2026-04-03 08:54:33.764606 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764615 | orchestrator | 2026-04-03 08:54:33.764625 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:54:33.764634 | orchestrator | Friday 03 April 2026 08:54:00 +0000 (0:00:01.182) 1:07:12.886 ********** 2026-04-03 08:54:33.764644 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764653 | orchestrator | 2026-04-03 08:54:33.764662 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:54:33.764672 | orchestrator | Friday 03 April 2026 08:54:01 +0000 (0:00:01.144) 1:07:14.031 ********** 2026-04-03 08:54:33.764681 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764690 | orchestrator | 2026-04-03 08:54:33.764700 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:54:33.764709 | orchestrator | Friday 03 April 2026 08:54:02 +0000 (0:00:01.181) 1:07:15.212 ********** 2026-04-03 08:54:33.764719 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764728 | orchestrator | 2026-04-03 08:54:33.764738 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:54:33.764749 | orchestrator | Friday 03 April 2026 08:54:03 +0000 (0:00:01.141) 1:07:16.354 ********** 2026-04-03 08:54:33.764761 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764771 | orchestrator | 2026-04-03 08:54:33.764783 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:54:33.764794 | orchestrator | Friday 03 April 2026 08:54:04 +0000 (0:00:01.148) 1:07:17.503 ********** 2026-04-03 08:54:33.764837 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764855 | orchestrator | 2026-04-03 08:54:33.764875 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:54:33.764893 | orchestrator | Friday 03 April 2026 08:54:05 +0000 (0:00:01.158) 1:07:18.661 ********** 2026-04-03 08:54:33.764912 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.764930 | orchestrator | 2026-04-03 08:54:33.764947 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:54:33.764966 | orchestrator | Friday 03 April 2026 08:54:07 +0000 (0:00:01.208) 1:07:19.871 ********** 2026-04-03 08:54:33.764984 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765002 | orchestrator | 2026-04-03 08:54:33.765022 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:54:33.765041 | orchestrator | Friday 03 April 2026 08:54:08 +0000 (0:00:01.186) 1:07:21.057 ********** 2026-04-03 08:54:33.765058 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:54:33.765069 | orchestrator | 2026-04-03 08:54:33.765080 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:54:33.765091 | orchestrator | Friday 03 April 2026 08:54:09 +0000 (0:00:00.809) 1:07:21.867 ********** 2026-04-03 08:54:33.765103 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-03 08:54:33.765115 | orchestrator | 2026-04-03 08:54:33.765124 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:54:33.765134 | orchestrator | Friday 03 April 2026 08:54:10 +0000 (0:00:01.133) 1:07:23.001 ********** 2026-04-03 08:54:33.765143 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-03 08:54:33.765153 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-03 08:54:33.765174 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-03 08:54:33.765183 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-03 08:54:33.765193 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-03 08:54:33.765202 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-03 08:54:33.765212 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-03 08:54:33.765221 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:54:33.765231 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:54:33.765240 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:54:33.765250 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:54:33.765278 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:54:33.765288 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:54:33.765297 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:54:33.765307 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-03 08:54:33.765316 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-03 08:54:33.765326 | orchestrator | 2026-04-03 08:54:33.765335 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:54:33.765345 | orchestrator | Friday 03 April 2026 08:54:16 +0000 (0:00:06.129) 1:07:29.130 ********** 2026-04-03 08:54:33.765355 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-03 08:54:33.765364 | orchestrator | 2026-04-03 08:54:33.765380 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:54:33.765390 | orchestrator | Friday 03 April 2026 08:54:17 +0000 (0:00:01.097) 1:07:30.228 ********** 2026-04-03 08:54:33.765400 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:54:33.765411 | orchestrator | 2026-04-03 08:54:33.765420 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:54:33.765429 | orchestrator | Friday 03 April 2026 08:54:18 +0000 (0:00:01.503) 1:07:31.732 ********** 2026-04-03 08:54:33.765439 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:54:33.765448 | orchestrator | 2026-04-03 08:54:33.765458 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:54:33.765467 | orchestrator | Friday 03 April 2026 08:54:20 +0000 (0:00:01.638) 1:07:33.370 ********** 2026-04-03 08:54:33.765477 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765486 | orchestrator | 2026-04-03 08:54:33.765495 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:54:33.765505 | orchestrator | Friday 03 April 2026 08:54:21 +0000 (0:00:00.765) 1:07:34.136 ********** 2026-04-03 08:54:33.765514 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765523 | orchestrator | 2026-04-03 08:54:33.765533 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:54:33.765542 | orchestrator | Friday 03 April 2026 08:54:22 +0000 (0:00:00.793) 1:07:34.929 ********** 2026-04-03 08:54:33.765552 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765561 | orchestrator | 2026-04-03 08:54:33.765571 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:54:33.765580 | orchestrator | Friday 03 April 2026 08:54:22 +0000 (0:00:00.827) 1:07:35.757 ********** 2026-04-03 08:54:33.765589 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765599 | orchestrator | 2026-04-03 08:54:33.765608 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:54:33.765618 | orchestrator | Friday 03 April 2026 08:54:23 +0000 (0:00:00.778) 1:07:36.535 ********** 2026-04-03 08:54:33.765633 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765643 | orchestrator | 2026-04-03 08:54:33.765652 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:54:33.765662 | orchestrator | Friday 03 April 2026 08:54:24 +0000 (0:00:00.828) 1:07:37.364 ********** 2026-04-03 08:54:33.765672 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765681 | orchestrator | 2026-04-03 08:54:33.765690 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:54:33.765700 | orchestrator | Friday 03 April 2026 08:54:25 +0000 (0:00:00.812) 1:07:38.176 ********** 2026-04-03 08:54:33.765709 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765719 | orchestrator | 2026-04-03 08:54:33.765728 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:54:33.765738 | orchestrator | Friday 03 April 2026 08:54:26 +0000 (0:00:00.832) 1:07:39.009 ********** 2026-04-03 08:54:33.765748 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765757 | orchestrator | 2026-04-03 08:54:33.765766 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:54:33.765776 | orchestrator | Friday 03 April 2026 08:54:26 +0000 (0:00:00.801) 1:07:39.810 ********** 2026-04-03 08:54:33.765785 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765795 | orchestrator | 2026-04-03 08:54:33.765850 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:54:33.765861 | orchestrator | Friday 03 April 2026 08:54:27 +0000 (0:00:00.815) 1:07:40.625 ********** 2026-04-03 08:54:33.765870 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765879 | orchestrator | 2026-04-03 08:54:33.765889 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:54:33.765899 | orchestrator | Friday 03 April 2026 08:54:28 +0000 (0:00:00.797) 1:07:41.423 ********** 2026-04-03 08:54:33.765908 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:54:33.765917 | orchestrator | 2026-04-03 08:54:33.765927 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:54:33.765936 | orchestrator | Friday 03 April 2026 08:54:29 +0000 (0:00:00.819) 1:07:42.243 ********** 2026-04-03 08:54:33.765946 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:54:33.765955 | orchestrator | 2026-04-03 08:54:33.765965 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:54:33.765974 | orchestrator | Friday 03 April 2026 08:54:33 +0000 (0:00:04.171) 1:07:46.415 ********** 2026-04-03 08:54:33.765983 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:54:33.765993 | orchestrator | 2026-04-03 08:54:33.766008 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:55:14.708577 | orchestrator | Friday 03 April 2026 08:54:34 +0000 (0:00:00.835) 1:07:47.251 ********** 2026-04-03 08:55:14.708698 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-03 08:55:14.708736 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-03 08:55:14.708750 | orchestrator | 2026-04-03 08:55:14.708763 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:55:14.708775 | orchestrator | Friday 03 April 2026 08:54:38 +0000 (0:00:04.579) 1:07:51.830 ********** 2026-04-03 08:55:14.708856 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.708896 | orchestrator | 2026-04-03 08:55:14.708908 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:55:14.708919 | orchestrator | Friday 03 April 2026 08:54:39 +0000 (0:00:00.855) 1:07:52.686 ********** 2026-04-03 08:55:14.708930 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.708941 | orchestrator | 2026-04-03 08:55:14.708952 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:55:14.708964 | orchestrator | Friday 03 April 2026 08:54:40 +0000 (0:00:00.877) 1:07:53.563 ********** 2026-04-03 08:55:14.708975 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.708986 | orchestrator | 2026-04-03 08:55:14.708997 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:55:14.709008 | orchestrator | Friday 03 April 2026 08:54:41 +0000 (0:00:00.817) 1:07:54.381 ********** 2026-04-03 08:55:14.709018 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709029 | orchestrator | 2026-04-03 08:55:14.709041 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:55:14.709052 | orchestrator | Friday 03 April 2026 08:54:42 +0000 (0:00:00.814) 1:07:55.195 ********** 2026-04-03 08:55:14.709062 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709073 | orchestrator | 2026-04-03 08:55:14.709084 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:55:14.709095 | orchestrator | Friday 03 April 2026 08:54:43 +0000 (0:00:00.823) 1:07:56.019 ********** 2026-04-03 08:55:14.709106 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:55:14.709120 | orchestrator | 2026-04-03 08:55:14.709133 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:55:14.709146 | orchestrator | Friday 03 April 2026 08:54:44 +0000 (0:00:00.876) 1:07:56.895 ********** 2026-04-03 08:55:14.709159 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:55:14.709172 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:55:14.709184 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:55:14.709198 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709210 | orchestrator | 2026-04-03 08:55:14.709223 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:55:14.709235 | orchestrator | Friday 03 April 2026 08:54:45 +0000 (0:00:01.116) 1:07:58.012 ********** 2026-04-03 08:55:14.709248 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:55:14.709261 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:55:14.709274 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:55:14.709287 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709299 | orchestrator | 2026-04-03 08:55:14.709311 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:55:14.709324 | orchestrator | Friday 03 April 2026 08:54:46 +0000 (0:00:01.100) 1:07:59.113 ********** 2026-04-03 08:55:14.709336 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-03 08:55:14.709349 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-03 08:55:14.709362 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-03 08:55:14.709375 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709387 | orchestrator | 2026-04-03 08:55:14.709400 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:55:14.709413 | orchestrator | Friday 03 April 2026 08:54:47 +0000 (0:00:01.160) 1:08:00.274 ********** 2026-04-03 08:55:14.709426 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:55:14.709438 | orchestrator | 2026-04-03 08:55:14.709451 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:55:14.709464 | orchestrator | Friday 03 April 2026 08:54:48 +0000 (0:00:00.805) 1:08:01.079 ********** 2026-04-03 08:55:14.709475 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-03 08:55:14.709494 | orchestrator | 2026-04-03 08:55:14.709505 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 08:55:14.709516 | orchestrator | Friday 03 April 2026 08:54:49 +0000 (0:00:01.078) 1:08:02.157 ********** 2026-04-03 08:55:14.709526 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:55:14.709537 | orchestrator | 2026-04-03 08:55:14.709548 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-03 08:55:14.709559 | orchestrator | Friday 03 April 2026 08:54:50 +0000 (0:00:01.413) 1:08:03.571 ********** 2026-04-03 08:55:14.709570 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-4 2026-04-03 08:55:14.709581 | orchestrator | 2026-04-03 08:55:14.709611 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 08:55:14.709623 | orchestrator | Friday 03 April 2026 08:54:52 +0000 (0:00:01.309) 1:08:04.881 ********** 2026-04-03 08:55:14.709634 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:55:14.709645 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:55:14.709655 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:55:14.709666 | orchestrator | 2026-04-03 08:55:14.709677 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:55:14.709688 | orchestrator | Friday 03 April 2026 08:54:55 +0000 (0:00:03.270) 1:08:08.151 ********** 2026-04-03 08:55:14.709699 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 08:55:14.709709 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-03 08:55:14.709728 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:55:14.709739 | orchestrator | 2026-04-03 08:55:14.709750 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-03 08:55:14.709760 | orchestrator | Friday 03 April 2026 08:54:57 +0000 (0:00:01.940) 1:08:10.091 ********** 2026-04-03 08:55:14.709771 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.709782 | orchestrator | 2026-04-03 08:55:14.709824 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-03 08:55:14.709844 | orchestrator | Friday 03 April 2026 08:54:58 +0000 (0:00:00.784) 1:08:10.876 ********** 2026-04-03 08:55:14.709864 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-4 2026-04-03 08:55:14.709883 | orchestrator | 2026-04-03 08:55:14.709897 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-03 08:55:14.709908 | orchestrator | Friday 03 April 2026 08:54:59 +0000 (0:00:01.110) 1:08:11.987 ********** 2026-04-03 08:55:14.709919 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:55:14.709931 | orchestrator | 2026-04-03 08:55:14.709942 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-03 08:55:14.709953 | orchestrator | Friday 03 April 2026 08:55:00 +0000 (0:00:01.683) 1:08:13.670 ********** 2026-04-03 08:55:14.709963 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:55:14.709975 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 08:55:14.709985 | orchestrator | 2026-04-03 08:55:14.709996 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 08:55:14.710007 | orchestrator | Friday 03 April 2026 08:55:06 +0000 (0:00:05.410) 1:08:19.081 ********** 2026-04-03 08:55:14.710066 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 08:55:14.710079 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 08:55:14.710090 | orchestrator | 2026-04-03 08:55:14.710101 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 08:55:14.710112 | orchestrator | Friday 03 April 2026 08:55:09 +0000 (0:00:03.228) 1:08:22.309 ********** 2026-04-03 08:55:14.710122 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 08:55:14.710151 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:55:14.710162 | orchestrator | 2026-04-03 08:55:14.710173 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-03 08:55:14.710183 | orchestrator | Friday 03 April 2026 08:55:11 +0000 (0:00:01.619) 1:08:23.929 ********** 2026-04-03 08:55:14.710194 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-4 2026-04-03 08:55:14.710205 | orchestrator | 2026-04-03 08:55:14.710216 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-03 08:55:14.710226 | orchestrator | Friday 03 April 2026 08:55:12 +0000 (0:00:01.146) 1:08:25.076 ********** 2026-04-03 08:55:14.710237 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710249 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710259 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710270 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710281 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710292 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:55:14.710303 | orchestrator | 2026-04-03 08:55:14.710314 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-03 08:55:14.710325 | orchestrator | Friday 03 April 2026 08:55:14 +0000 (0:00:02.034) 1:08:27.111 ********** 2026-04-03 08:55:14.710335 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710346 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710357 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:55:14.710377 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:56:23.107596 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 08:56:23.107704 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:56:23.107715 | orchestrator | 2026-04-03 08:56:23.107722 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-03 08:56:23.107729 | orchestrator | Friday 03 April 2026 08:55:15 +0000 (0:00:01.664) 1:08:28.775 ********** 2026-04-03 08:56:23.107748 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:56:23.107794 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:56:23.107801 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:56:23.107807 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:56:23.107815 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 08:56:23.107820 | orchestrator | 2026-04-03 08:56:23.107826 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-03 08:56:23.107851 | orchestrator | Friday 03 April 2026 08:55:48 +0000 (0:00:32.442) 1:09:01.218 ********** 2026-04-03 08:56:23.107856 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:56:23.107862 | orchestrator | 2026-04-03 08:56:23.107867 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-03 08:56:23.107873 | orchestrator | Friday 03 April 2026 08:55:49 +0000 (0:00:00.775) 1:09:01.993 ********** 2026-04-03 08:56:23.107878 | orchestrator | skipping: [testbed-node-4] 2026-04-03 08:56:23.107883 | orchestrator | 2026-04-03 08:56:23.107889 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-03 08:56:23.107894 | orchestrator | Friday 03 April 2026 08:55:49 +0000 (0:00:00.820) 1:09:02.814 ********** 2026-04-03 08:56:23.107900 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-4 2026-04-03 08:56:23.107906 | orchestrator | 2026-04-03 08:56:23.107911 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-03 08:56:23.107916 | orchestrator | Friday 03 April 2026 08:55:51 +0000 (0:00:01.165) 1:09:03.979 ********** 2026-04-03 08:56:23.107922 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-4 2026-04-03 08:56:23.107927 | orchestrator | 2026-04-03 08:56:23.107932 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-03 08:56:23.107938 | orchestrator | Friday 03 April 2026 08:55:52 +0000 (0:00:01.159) 1:09:05.139 ********** 2026-04-03 08:56:23.107943 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:56:23.107949 | orchestrator | 2026-04-03 08:56:23.107955 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-03 08:56:23.107960 | orchestrator | Friday 03 April 2026 08:55:54 +0000 (0:00:02.093) 1:09:07.232 ********** 2026-04-03 08:56:23.107966 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:56:23.107971 | orchestrator | 2026-04-03 08:56:23.107977 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-03 08:56:23.107982 | orchestrator | Friday 03 April 2026 08:55:56 +0000 (0:00:01.962) 1:09:09.195 ********** 2026-04-03 08:56:23.107987 | orchestrator | ok: [testbed-node-4] 2026-04-03 08:56:23.107992 | orchestrator | 2026-04-03 08:56:23.107998 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-03 08:56:23.108003 | orchestrator | Friday 03 April 2026 08:55:58 +0000 (0:00:02.236) 1:09:11.432 ********** 2026-04-03 08:56:23.108009 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-03 08:56:23.108014 | orchestrator | 2026-04-03 08:56:23.108019 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-03 08:56:23.108025 | orchestrator | 2026-04-03 08:56:23.108030 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 08:56:23.108035 | orchestrator | Friday 03 April 2026 08:56:01 +0000 (0:00:03.142) 1:09:14.575 ********** 2026-04-03 08:56:23.108041 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-03 08:56:23.108046 | orchestrator | 2026-04-03 08:56:23.108051 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-03 08:56:23.108057 | orchestrator | Friday 03 April 2026 08:56:02 +0000 (0:00:01.121) 1:09:15.696 ********** 2026-04-03 08:56:23.108062 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108067 | orchestrator | 2026-04-03 08:56:23.108073 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-03 08:56:23.108078 | orchestrator | Friday 03 April 2026 08:56:04 +0000 (0:00:01.521) 1:09:17.218 ********** 2026-04-03 08:56:23.108083 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108088 | orchestrator | 2026-04-03 08:56:23.108094 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 08:56:23.108099 | orchestrator | Friday 03 April 2026 08:56:05 +0000 (0:00:01.210) 1:09:18.428 ********** 2026-04-03 08:56:23.108104 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108110 | orchestrator | 2026-04-03 08:56:23.108115 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 08:56:23.108125 | orchestrator | Friday 03 April 2026 08:56:07 +0000 (0:00:01.463) 1:09:19.891 ********** 2026-04-03 08:56:23.108131 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108138 | orchestrator | 2026-04-03 08:56:23.108157 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-03 08:56:23.108164 | orchestrator | Friday 03 April 2026 08:56:08 +0000 (0:00:01.134) 1:09:21.026 ********** 2026-04-03 08:56:23.108170 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108176 | orchestrator | 2026-04-03 08:56:23.108182 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-03 08:56:23.108190 | orchestrator | Friday 03 April 2026 08:56:09 +0000 (0:00:01.195) 1:09:22.222 ********** 2026-04-03 08:56:23.108201 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108210 | orchestrator | 2026-04-03 08:56:23.108220 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-03 08:56:23.108235 | orchestrator | Friday 03 April 2026 08:56:10 +0000 (0:00:01.182) 1:09:23.404 ********** 2026-04-03 08:56:23.108245 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:23.108255 | orchestrator | 2026-04-03 08:56:23.108265 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-03 08:56:23.108276 | orchestrator | Friday 03 April 2026 08:56:11 +0000 (0:00:01.143) 1:09:24.548 ********** 2026-04-03 08:56:23.108287 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108295 | orchestrator | 2026-04-03 08:56:23.108302 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-03 08:56:23.108308 | orchestrator | Friday 03 April 2026 08:56:12 +0000 (0:00:01.225) 1:09:25.774 ********** 2026-04-03 08:56:23.108314 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:56:23.108321 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:56:23.108327 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:56:23.108333 | orchestrator | 2026-04-03 08:56:23.108340 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-03 08:56:23.108346 | orchestrator | Friday 03 April 2026 08:56:15 +0000 (0:00:02.109) 1:09:27.884 ********** 2026-04-03 08:56:23.108352 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:23.108359 | orchestrator | 2026-04-03 08:56:23.108365 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-03 08:56:23.108371 | orchestrator | Friday 03 April 2026 08:56:16 +0000 (0:00:01.651) 1:09:29.535 ********** 2026-04-03 08:56:23.108377 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:56:23.108384 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:56:23.108390 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:56:23.108396 | orchestrator | 2026-04-03 08:56:23.108402 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-03 08:56:23.108408 | orchestrator | Friday 03 April 2026 08:56:19 +0000 (0:00:03.271) 1:09:32.807 ********** 2026-04-03 08:56:23.108415 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:56:23.108422 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:56:23.108428 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:56:23.108434 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:23.108440 | orchestrator | 2026-04-03 08:56:23.108447 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-03 08:56:23.108453 | orchestrator | Friday 03 April 2026 08:56:21 +0000 (0:00:01.420) 1:09:34.228 ********** 2026-04-03 08:56:23.108460 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-03 08:56:23.108478 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-03 08:56:23.108485 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-03 08:56:23.108492 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:23.108498 | orchestrator | 2026-04-03 08:56:23.108503 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-03 08:56:23.108508 | orchestrator | Friday 03 April 2026 08:56:23 +0000 (0:00:01.660) 1:09:35.889 ********** 2026-04-03 08:56:23.108515 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:23.108528 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:43.228586 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:43.228701 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.228716 | orchestrator | 2026-04-03 08:56:43.228726 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-03 08:56:43.228735 | orchestrator | Friday 03 April 2026 08:56:24 +0000 (0:00:01.180) 1:09:37.070 ********** 2026-04-03 08:56:43.228745 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '48d75555448e', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-03 08:56:17.576833', 'end': '2026-04-03 08:56:17.630869', 'delta': '0:00:00.054036', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['48d75555448e'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-03 08:56:43.228796 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'bf7da6f68ee6', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-03 08:56:18.135041', 'end': '2026-04-03 08:56:18.197187', 'delta': '0:00:00.062146', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['bf7da6f68ee6'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-03 08:56:43.228824 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'e6d5268af19d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-03 08:56:18.693956', 'end': '2026-04-03 08:56:18.743720', 'delta': '0:00:00.049764', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e6d5268af19d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-03 08:56:43.228831 | orchestrator | 2026-04-03 08:56:43.228837 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-03 08:56:43.228844 | orchestrator | Friday 03 April 2026 08:56:25 +0000 (0:00:01.235) 1:09:38.306 ********** 2026-04-03 08:56:43.228850 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.228858 | orchestrator | 2026-04-03 08:56:43.228865 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-03 08:56:43.228872 | orchestrator | Friday 03 April 2026 08:56:26 +0000 (0:00:01.296) 1:09:39.602 ********** 2026-04-03 08:56:43.228879 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.228886 | orchestrator | 2026-04-03 08:56:43.228893 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-03 08:56:43.228900 | orchestrator | Friday 03 April 2026 08:56:27 +0000 (0:00:01.249) 1:09:40.852 ********** 2026-04-03 08:56:43.228907 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.228914 | orchestrator | 2026-04-03 08:56:43.228921 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-03 08:56:43.228928 | orchestrator | Friday 03 April 2026 08:56:29 +0000 (0:00:01.170) 1:09:42.023 ********** 2026-04-03 08:56:43.228935 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-03 08:56:43.228943 | orchestrator | 2026-04-03 08:56:43.228950 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:56:43.228957 | orchestrator | Friday 03 April 2026 08:56:31 +0000 (0:00:02.143) 1:09:44.166 ********** 2026-04-03 08:56:43.228964 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.228971 | orchestrator | 2026-04-03 08:56:43.228978 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-03 08:56:43.228985 | orchestrator | Friday 03 April 2026 08:56:32 +0000 (0:00:01.165) 1:09:45.331 ********** 2026-04-03 08:56:43.229007 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229014 | orchestrator | 2026-04-03 08:56:43.229020 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-03 08:56:43.229028 | orchestrator | Friday 03 April 2026 08:56:33 +0000 (0:00:01.114) 1:09:46.446 ********** 2026-04-03 08:56:43.229034 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229041 | orchestrator | 2026-04-03 08:56:43.229048 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-03 08:56:43.229055 | orchestrator | Friday 03 April 2026 08:56:34 +0000 (0:00:01.264) 1:09:47.711 ********** 2026-04-03 08:56:43.229062 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229069 | orchestrator | 2026-04-03 08:56:43.229082 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-03 08:56:43.229089 | orchestrator | Friday 03 April 2026 08:56:36 +0000 (0:00:01.165) 1:09:48.877 ********** 2026-04-03 08:56:43.229096 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229102 | orchestrator | 2026-04-03 08:56:43.229109 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-03 08:56:43.229116 | orchestrator | Friday 03 April 2026 08:56:37 +0000 (0:00:01.195) 1:09:50.073 ********** 2026-04-03 08:56:43.229123 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.229130 | orchestrator | 2026-04-03 08:56:43.229137 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-03 08:56:43.229151 | orchestrator | Friday 03 April 2026 08:56:38 +0000 (0:00:01.178) 1:09:51.252 ********** 2026-04-03 08:56:43.229158 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229166 | orchestrator | 2026-04-03 08:56:43.229173 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-03 08:56:43.229180 | orchestrator | Friday 03 April 2026 08:56:39 +0000 (0:00:01.162) 1:09:52.414 ********** 2026-04-03 08:56:43.229187 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.229193 | orchestrator | 2026-04-03 08:56:43.229201 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-03 08:56:43.229209 | orchestrator | Friday 03 April 2026 08:56:40 +0000 (0:00:01.210) 1:09:53.626 ********** 2026-04-03 08:56:43.229216 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:43.229225 | orchestrator | 2026-04-03 08:56:43.229232 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-03 08:56:43.229241 | orchestrator | Friday 03 April 2026 08:56:41 +0000 (0:00:01.102) 1:09:54.729 ********** 2026-04-03 08:56:43.229248 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:43.229255 | orchestrator | 2026-04-03 08:56:43.229262 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-03 08:56:43.229270 | orchestrator | Friday 03 April 2026 08:56:43 +0000 (0:00:01.220) 1:09:55.949 ********** 2026-04-03 08:56:43.229278 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.229288 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}})  2026-04-03 08:56:43.229297 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:56:43.229314 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}})  2026-04-03 08:56:43.351123 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351210 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351311 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-03 08:56:43.351326 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351334 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351342 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351349 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}})  2026-04-03 08:56:43.351377 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}})  2026-04-03 08:56:43.351400 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351410 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-03 08:56:43.351419 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351425 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-03 08:56:43.351441 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-03 08:56:44.747572 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:44.747672 | orchestrator | 2026-04-03 08:56:44.747689 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-03 08:56:44.747703 | orchestrator | Friday 03 April 2026 08:56:44 +0000 (0:00:01.408) 1:09:57.357 ********** 2026-04-03 08:56:44.747717 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747733 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29', 'dm-uuid-LVM-KkvhfAHYqay1EAN4am63Q5nAfQWGWCtG2ZWCT3JJ8LNbF9kePFp85Y6qTLdhcCnH'], 'uuids': ['80dbba78-7469-45ba-af0d-9c0fd50ecf63'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747775 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4', 'scsi-SQEMU_QEMU_HARDDISK_7cc69c6f-db35-4918-9d0a-70ecc89938b4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '7cc69c6f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747789 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-B25r07-SMai-VNNA-I5DO-dIeE-A5Ui-SobIys', 'scsi-0QEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7', 'scsi-SQEMU_QEMU_HARDDISK_26f49153-9bc1-41ad-be70-b72515b841e7'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747852 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747866 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747879 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-03-04-26-27-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747890 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747901 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX', 'dm-uuid-CRYPT-LUKS2-0cdec6bbe890417598fedcfd3c3c96e9-RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747913 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:44.747943 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--0168ecd7--dd70--56c3--8572--150117512a85-osd--block--0168ecd7--dd70--56c3--8572--150117512a85', 'dm-uuid-LVM-kx9EP0HReHYPQELvFPFLA7GiZ99x9dSaRF3LtxXpxfPdHL5XeQaoJOegCc8V54uX'], 'uuids': ['0cdec6bb-e890-4175-98fe-dcfd3c3c96e9'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '26f49153', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['RF3Ltx-Xpxf-PdHL-5XeQ-aoJO-egCc-8V54uX']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694444 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRpRJH-foSf-udSb-tD7t-A3qO-tW4P-EAQzWG', 'scsi-0QEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d', 'scsi-SQEMU_QEMU_HARDDISK_ed3cd219-4944-484e-a6c4-5c14d036f42d'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'ed3cd219', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29-osd--block--7e0184c0--0e73--56db--b9bd--1c5b3e3cac29']}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694565 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694603 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '14ae244f', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1', 'scsi-SQEMU_QEMU_HARDDISK_14ae244f-9908-4e60-9537-d5ef8d66f5e6-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694662 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694676 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694689 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH', 'dm-uuid-CRYPT-LUKS2-80dbba78746945baaf0d9c0fd50ecf63-2ZWCT3-JJ8L-NbF9-kePF-p85Y-6qTL-dhcCnH'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-03 08:56:56.694701 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:56.694714 | orchestrator | 2026-04-03 08:56:56.694727 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-03 08:56:56.694739 | orchestrator | Friday 03 April 2026 08:56:45 +0000 (0:00:01.500) 1:09:58.858 ********** 2026-04-03 08:56:56.694824 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:56.694836 | orchestrator | 2026-04-03 08:56:56.694847 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-03 08:56:56.694858 | orchestrator | Friday 03 April 2026 08:56:47 +0000 (0:00:01.486) 1:10:00.345 ********** 2026-04-03 08:56:56.694869 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:56.694879 | orchestrator | 2026-04-03 08:56:56.694915 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:56:56.694958 | orchestrator | Friday 03 April 2026 08:56:48 +0000 (0:00:01.105) 1:10:01.450 ********** 2026-04-03 08:56:56.694992 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:56:56.695012 | orchestrator | 2026-04-03 08:56:56.695031 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:56:56.695050 | orchestrator | Friday 03 April 2026 08:56:50 +0000 (0:00:01.456) 1:10:02.906 ********** 2026-04-03 08:56:56.695069 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:56.695087 | orchestrator | 2026-04-03 08:56:56.695107 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-03 08:56:56.695128 | orchestrator | Friday 03 April 2026 08:56:51 +0000 (0:00:01.115) 1:10:04.022 ********** 2026-04-03 08:56:56.695147 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:56.695163 | orchestrator | 2026-04-03 08:56:56.695173 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-03 08:56:56.695184 | orchestrator | Friday 03 April 2026 08:56:52 +0000 (0:00:01.215) 1:10:05.237 ********** 2026-04-03 08:56:56.695195 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:56.695205 | orchestrator | 2026-04-03 08:56:56.695216 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-03 08:56:56.695227 | orchestrator | Friday 03 April 2026 08:56:53 +0000 (0:00:01.217) 1:10:06.454 ********** 2026-04-03 08:56:56.695237 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-03 08:56:56.695249 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-03 08:56:56.695259 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-03 08:56:56.695270 | orchestrator | 2026-04-03 08:56:56.695281 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-03 08:56:56.695291 | orchestrator | Friday 03 April 2026 08:56:55 +0000 (0:00:01.752) 1:10:08.207 ********** 2026-04-03 08:56:56.695302 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-03 08:56:56.695313 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-03 08:56:56.695324 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-03 08:56:56.695335 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:56:56.695345 | orchestrator | 2026-04-03 08:56:56.695356 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-03 08:56:56.695375 | orchestrator | Friday 03 April 2026 08:56:56 +0000 (0:00:01.118) 1:10:09.326 ********** 2026-04-03 08:56:56.695386 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-03 08:56:56.695398 | orchestrator | 2026-04-03 08:56:56.695419 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:57:39.472514 | orchestrator | Friday 03 April 2026 08:56:57 +0000 (0:00:01.127) 1:10:10.454 ********** 2026-04-03 08:57:39.472633 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.472650 | orchestrator | 2026-04-03 08:57:39.472664 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:57:39.472675 | orchestrator | Friday 03 April 2026 08:56:58 +0000 (0:00:01.124) 1:10:11.579 ********** 2026-04-03 08:57:39.472686 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.472697 | orchestrator | 2026-04-03 08:57:39.472708 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 08:57:39.472719 | orchestrator | Friday 03 April 2026 08:56:59 +0000 (0:00:01.152) 1:10:12.731 ********** 2026-04-03 08:57:39.472795 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.472807 | orchestrator | 2026-04-03 08:57:39.472818 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 08:57:39.472829 | orchestrator | Friday 03 April 2026 08:57:01 +0000 (0:00:01.138) 1:10:13.869 ********** 2026-04-03 08:57:39.472840 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.472852 | orchestrator | 2026-04-03 08:57:39.472863 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 08:57:39.472874 | orchestrator | Friday 03 April 2026 08:57:02 +0000 (0:00:01.265) 1:10:15.135 ********** 2026-04-03 08:57:39.472912 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:57:39.472924 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:57:39.472935 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:57:39.472945 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.472956 | orchestrator | 2026-04-03 08:57:39.472967 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 08:57:39.472978 | orchestrator | Friday 03 April 2026 08:57:03 +0000 (0:00:01.434) 1:10:16.570 ********** 2026-04-03 08:57:39.472989 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:57:39.472999 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:57:39.473010 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:57:39.473020 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.473031 | orchestrator | 2026-04-03 08:57:39.473042 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 08:57:39.473053 | orchestrator | Friday 03 April 2026 08:57:05 +0000 (0:00:01.464) 1:10:18.034 ********** 2026-04-03 08:57:39.473063 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 08:57:39.473074 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 08:57:39.473084 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 08:57:39.473095 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.473105 | orchestrator | 2026-04-03 08:57:39.473116 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 08:57:39.473127 | orchestrator | Friday 03 April 2026 08:57:06 +0000 (0:00:01.812) 1:10:19.847 ********** 2026-04-03 08:57:39.473137 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.473148 | orchestrator | 2026-04-03 08:57:39.473159 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 08:57:39.473169 | orchestrator | Friday 03 April 2026 08:57:08 +0000 (0:00:01.142) 1:10:20.990 ********** 2026-04-03 08:57:39.473180 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 08:57:39.473190 | orchestrator | 2026-04-03 08:57:39.473201 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-03 08:57:39.473212 | orchestrator | Friday 03 April 2026 08:57:09 +0000 (0:00:01.780) 1:10:22.771 ********** 2026-04-03 08:57:39.473222 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:57:39.473234 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:57:39.473244 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:57:39.473255 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:57:39.473266 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:57:39.473276 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:57:39.473287 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:57:39.473298 | orchestrator | 2026-04-03 08:57:39.473309 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-03 08:57:39.473319 | orchestrator | Friday 03 April 2026 08:57:11 +0000 (0:00:01.984) 1:10:24.755 ********** 2026-04-03 08:57:39.473330 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-03 08:57:39.473340 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-03 08:57:39.473351 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-03 08:57:39.473361 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-03 08:57:39.473372 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-03 08:57:39.473390 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-03 08:57:39.473401 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-03 08:57:39.473411 | orchestrator | 2026-04-03 08:57:39.473436 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-03 08:57:39.473448 | orchestrator | Friday 03 April 2026 08:57:14 +0000 (0:00:02.361) 1:10:27.116 ********** 2026-04-03 08:57:39.473459 | orchestrator | changed: [testbed-node-5] 2026-04-03 08:57:39.473469 | orchestrator | 2026-04-03 08:57:39.473499 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-03 08:57:39.473510 | orchestrator | Friday 03 April 2026 08:57:16 +0000 (0:00:01.935) 1:10:29.052 ********** 2026-04-03 08:57:39.473521 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:57:39.473533 | orchestrator | 2026-04-03 08:57:39.473543 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-03 08:57:39.473554 | orchestrator | Friday 03 April 2026 08:57:18 +0000 (0:00:02.458) 1:10:31.511 ********** 2026-04-03 08:57:39.473565 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:57:39.473575 | orchestrator | 2026-04-03 08:57:39.473586 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 08:57:39.473597 | orchestrator | Friday 03 April 2026 08:57:20 +0000 (0:00:01.991) 1:10:33.502 ********** 2026-04-03 08:57:39.473607 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-03 08:57:39.473618 | orchestrator | 2026-04-03 08:57:39.473628 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 08:57:39.473639 | orchestrator | Friday 03 April 2026 08:57:21 +0000 (0:00:01.153) 1:10:34.656 ********** 2026-04-03 08:57:39.473650 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-03 08:57:39.473660 | orchestrator | 2026-04-03 08:57:39.473671 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 08:57:39.473682 | orchestrator | Friday 03 April 2026 08:57:22 +0000 (0:00:01.130) 1:10:35.786 ********** 2026-04-03 08:57:39.473692 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.473703 | orchestrator | 2026-04-03 08:57:39.473713 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 08:57:39.473744 | orchestrator | Friday 03 April 2026 08:57:24 +0000 (0:00:01.192) 1:10:36.979 ********** 2026-04-03 08:57:39.473764 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.473784 | orchestrator | 2026-04-03 08:57:39.473801 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 08:57:39.473819 | orchestrator | Friday 03 April 2026 08:57:25 +0000 (0:00:01.508) 1:10:38.488 ********** 2026-04-03 08:57:39.473830 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.473840 | orchestrator | 2026-04-03 08:57:39.473851 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 08:57:39.473862 | orchestrator | Friday 03 April 2026 08:57:27 +0000 (0:00:01.581) 1:10:40.070 ********** 2026-04-03 08:57:39.473873 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.473883 | orchestrator | 2026-04-03 08:57:39.473894 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 08:57:39.473905 | orchestrator | Friday 03 April 2026 08:57:28 +0000 (0:00:01.538) 1:10:41.608 ********** 2026-04-03 08:57:39.473916 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.473926 | orchestrator | 2026-04-03 08:57:39.473937 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 08:57:39.473948 | orchestrator | Friday 03 April 2026 08:57:29 +0000 (0:00:01.152) 1:10:42.761 ********** 2026-04-03 08:57:39.473958 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.473969 | orchestrator | 2026-04-03 08:57:39.473980 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 08:57:39.473999 | orchestrator | Friday 03 April 2026 08:57:31 +0000 (0:00:01.161) 1:10:43.923 ********** 2026-04-03 08:57:39.474010 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.474079 | orchestrator | 2026-04-03 08:57:39.474091 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 08:57:39.474102 | orchestrator | Friday 03 April 2026 08:57:32 +0000 (0:00:01.205) 1:10:45.129 ********** 2026-04-03 08:57:39.474113 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.474123 | orchestrator | 2026-04-03 08:57:39.474134 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 08:57:39.474145 | orchestrator | Friday 03 April 2026 08:57:33 +0000 (0:00:01.534) 1:10:46.663 ********** 2026-04-03 08:57:39.474155 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.474166 | orchestrator | 2026-04-03 08:57:39.474177 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 08:57:39.474187 | orchestrator | Friday 03 April 2026 08:57:35 +0000 (0:00:01.564) 1:10:48.228 ********** 2026-04-03 08:57:39.474198 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.474208 | orchestrator | 2026-04-03 08:57:39.474219 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 08:57:39.474230 | orchestrator | Friday 03 April 2026 08:57:36 +0000 (0:00:00.767) 1:10:48.995 ********** 2026-04-03 08:57:39.474240 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.474251 | orchestrator | 2026-04-03 08:57:39.474262 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 08:57:39.474273 | orchestrator | Friday 03 April 2026 08:57:36 +0000 (0:00:00.773) 1:10:49.769 ********** 2026-04-03 08:57:39.474283 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.474294 | orchestrator | 2026-04-03 08:57:39.474305 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 08:57:39.474315 | orchestrator | Friday 03 April 2026 08:57:37 +0000 (0:00:00.806) 1:10:50.576 ********** 2026-04-03 08:57:39.474326 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.474337 | orchestrator | 2026-04-03 08:57:39.474347 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 08:57:39.474358 | orchestrator | Friday 03 April 2026 08:57:38 +0000 (0:00:00.812) 1:10:51.388 ********** 2026-04-03 08:57:39.474369 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:57:39.474380 | orchestrator | 2026-04-03 08:57:39.474396 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 08:57:39.474408 | orchestrator | Friday 03 April 2026 08:57:39 +0000 (0:00:00.795) 1:10:52.183 ********** 2026-04-03 08:57:39.474418 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:57:39.474429 | orchestrator | 2026-04-03 08:57:39.474448 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 08:58:20.890508 | orchestrator | Friday 03 April 2026 08:57:40 +0000 (0:00:00.751) 1:10:52.935 ********** 2026-04-03 08:58:20.890609 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890623 | orchestrator | 2026-04-03 08:58:20.890633 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 08:58:20.890642 | orchestrator | Friday 03 April 2026 08:57:41 +0000 (0:00:00.935) 1:10:53.870 ********** 2026-04-03 08:58:20.890650 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890658 | orchestrator | 2026-04-03 08:58:20.890667 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 08:58:20.890676 | orchestrator | Friday 03 April 2026 08:57:41 +0000 (0:00:00.758) 1:10:54.629 ********** 2026-04-03 08:58:20.890684 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.890693 | orchestrator | 2026-04-03 08:58:20.890701 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 08:58:20.890811 | orchestrator | Friday 03 April 2026 08:57:42 +0000 (0:00:00.809) 1:10:55.438 ********** 2026-04-03 08:58:20.890821 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.890829 | orchestrator | 2026-04-03 08:58:20.890837 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-03 08:58:20.890866 | orchestrator | Friday 03 April 2026 08:57:43 +0000 (0:00:00.798) 1:10:56.237 ********** 2026-04-03 08:58:20.890874 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890882 | orchestrator | 2026-04-03 08:58:20.890890 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-03 08:58:20.890898 | orchestrator | Friday 03 April 2026 08:57:44 +0000 (0:00:00.791) 1:10:57.029 ********** 2026-04-03 08:58:20.890906 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890914 | orchestrator | 2026-04-03 08:58:20.890922 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-03 08:58:20.890929 | orchestrator | Friday 03 April 2026 08:57:44 +0000 (0:00:00.819) 1:10:57.849 ********** 2026-04-03 08:58:20.890937 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890945 | orchestrator | 2026-04-03 08:58:20.890953 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-03 08:58:20.890961 | orchestrator | Friday 03 April 2026 08:57:45 +0000 (0:00:00.775) 1:10:58.624 ********** 2026-04-03 08:58:20.890968 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.890976 | orchestrator | 2026-04-03 08:58:20.890984 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-03 08:58:20.890992 | orchestrator | Friday 03 April 2026 08:57:46 +0000 (0:00:00.799) 1:10:59.424 ********** 2026-04-03 08:58:20.891000 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891008 | orchestrator | 2026-04-03 08:58:20.891015 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-03 08:58:20.891023 | orchestrator | Friday 03 April 2026 08:57:47 +0000 (0:00:00.793) 1:11:00.217 ********** 2026-04-03 08:58:20.891031 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891039 | orchestrator | 2026-04-03 08:58:20.891046 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-03 08:58:20.891054 | orchestrator | Friday 03 April 2026 08:57:48 +0000 (0:00:00.784) 1:11:01.002 ********** 2026-04-03 08:58:20.891062 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891070 | orchestrator | 2026-04-03 08:58:20.891078 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-03 08:58:20.891087 | orchestrator | Friday 03 April 2026 08:57:48 +0000 (0:00:00.779) 1:11:01.782 ********** 2026-04-03 08:58:20.891095 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891103 | orchestrator | 2026-04-03 08:58:20.891111 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-03 08:58:20.891119 | orchestrator | Friday 03 April 2026 08:57:49 +0000 (0:00:00.817) 1:11:02.600 ********** 2026-04-03 08:58:20.891127 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891135 | orchestrator | 2026-04-03 08:58:20.891143 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-03 08:58:20.891151 | orchestrator | Friday 03 April 2026 08:57:50 +0000 (0:00:00.810) 1:11:03.410 ********** 2026-04-03 08:58:20.891159 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891167 | orchestrator | 2026-04-03 08:58:20.891175 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-03 08:58:20.891183 | orchestrator | Friday 03 April 2026 08:57:51 +0000 (0:00:00.922) 1:11:04.333 ********** 2026-04-03 08:58:20.891191 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891198 | orchestrator | 2026-04-03 08:58:20.891206 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-03 08:58:20.891214 | orchestrator | Friday 03 April 2026 08:57:52 +0000 (0:00:00.762) 1:11:05.096 ********** 2026-04-03 08:58:20.891222 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891230 | orchestrator | 2026-04-03 08:58:20.891238 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-03 08:58:20.891246 | orchestrator | Friday 03 April 2026 08:57:53 +0000 (0:00:00.771) 1:11:05.867 ********** 2026-04-03 08:58:20.891254 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891262 | orchestrator | 2026-04-03 08:58:20.891270 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-03 08:58:20.891286 | orchestrator | Friday 03 April 2026 08:57:54 +0000 (0:00:01.600) 1:11:07.467 ********** 2026-04-03 08:58:20.891294 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891302 | orchestrator | 2026-04-03 08:58:20.891310 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-03 08:58:20.891318 | orchestrator | Friday 03 April 2026 08:57:56 +0000 (0:00:01.834) 1:11:09.302 ********** 2026-04-03 08:58:20.891326 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-03 08:58:20.891335 | orchestrator | 2026-04-03 08:58:20.891355 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-03 08:58:20.891364 | orchestrator | Friday 03 April 2026 08:57:57 +0000 (0:00:01.145) 1:11:10.448 ********** 2026-04-03 08:58:20.891372 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891380 | orchestrator | 2026-04-03 08:58:20.891388 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-03 08:58:20.891411 | orchestrator | Friday 03 April 2026 08:57:58 +0000 (0:00:01.118) 1:11:11.566 ********** 2026-04-03 08:58:20.891420 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891428 | orchestrator | 2026-04-03 08:58:20.891436 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-03 08:58:20.891444 | orchestrator | Friday 03 April 2026 08:57:59 +0000 (0:00:01.138) 1:11:12.705 ********** 2026-04-03 08:58:20.891452 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-03 08:58:20.891460 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-03 08:58:20.891468 | orchestrator | 2026-04-03 08:58:20.891475 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-03 08:58:20.891483 | orchestrator | Friday 03 April 2026 08:58:01 +0000 (0:00:01.843) 1:11:14.549 ********** 2026-04-03 08:58:20.891491 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891499 | orchestrator | 2026-04-03 08:58:20.891507 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-03 08:58:20.891515 | orchestrator | Friday 03 April 2026 08:58:03 +0000 (0:00:01.442) 1:11:15.991 ********** 2026-04-03 08:58:20.891523 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891531 | orchestrator | 2026-04-03 08:58:20.891538 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-03 08:58:20.891546 | orchestrator | Friday 03 April 2026 08:58:04 +0000 (0:00:01.160) 1:11:17.152 ********** 2026-04-03 08:58:20.891554 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891562 | orchestrator | 2026-04-03 08:58:20.891570 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-03 08:58:20.891578 | orchestrator | Friday 03 April 2026 08:58:05 +0000 (0:00:00.863) 1:11:18.015 ********** 2026-04-03 08:58:20.891586 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891594 | orchestrator | 2026-04-03 08:58:20.891601 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-03 08:58:20.891609 | orchestrator | Friday 03 April 2026 08:58:05 +0000 (0:00:00.812) 1:11:18.827 ********** 2026-04-03 08:58:20.891617 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-03 08:58:20.891625 | orchestrator | 2026-04-03 08:58:20.891633 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-03 08:58:20.891641 | orchestrator | Friday 03 April 2026 08:58:07 +0000 (0:00:01.118) 1:11:19.946 ********** 2026-04-03 08:58:20.891649 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891657 | orchestrator | 2026-04-03 08:58:20.891665 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-03 08:58:20.891673 | orchestrator | Friday 03 April 2026 08:58:08 +0000 (0:00:01.721) 1:11:21.667 ********** 2026-04-03 08:58:20.891681 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-03 08:58:20.891689 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-03 08:58:20.891702 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-03 08:58:20.891724 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891732 | orchestrator | 2026-04-03 08:58:20.891740 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-03 08:58:20.891747 | orchestrator | Friday 03 April 2026 08:58:09 +0000 (0:00:01.137) 1:11:22.805 ********** 2026-04-03 08:58:20.891759 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891773 | orchestrator | 2026-04-03 08:58:20.891787 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-03 08:58:20.891802 | orchestrator | Friday 03 April 2026 08:58:11 +0000 (0:00:01.185) 1:11:23.990 ********** 2026-04-03 08:58:20.891816 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891831 | orchestrator | 2026-04-03 08:58:20.891844 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-03 08:58:20.891852 | orchestrator | Friday 03 April 2026 08:58:12 +0000 (0:00:01.200) 1:11:25.191 ********** 2026-04-03 08:58:20.891860 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891867 | orchestrator | 2026-04-03 08:58:20.891875 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-03 08:58:20.891883 | orchestrator | Friday 03 April 2026 08:58:13 +0000 (0:00:01.124) 1:11:26.316 ********** 2026-04-03 08:58:20.891891 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891898 | orchestrator | 2026-04-03 08:58:20.891906 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-03 08:58:20.891914 | orchestrator | Friday 03 April 2026 08:58:14 +0000 (0:00:01.198) 1:11:27.515 ********** 2026-04-03 08:58:20.891922 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.891929 | orchestrator | 2026-04-03 08:58:20.891937 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-03 08:58:20.891945 | orchestrator | Friday 03 April 2026 08:58:15 +0000 (0:00:00.897) 1:11:28.412 ********** 2026-04-03 08:58:20.891953 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891961 | orchestrator | 2026-04-03 08:58:20.891970 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-03 08:58:20.891979 | orchestrator | Friday 03 April 2026 08:58:17 +0000 (0:00:02.118) 1:11:30.531 ********** 2026-04-03 08:58:20.891987 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:58:20.891996 | orchestrator | 2026-04-03 08:58:20.892004 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-03 08:58:20.892013 | orchestrator | Friday 03 April 2026 08:58:18 +0000 (0:00:00.777) 1:11:31.309 ********** 2026-04-03 08:58:20.892021 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-03 08:58:20.892030 | orchestrator | 2026-04-03 08:58:20.892044 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-03 08:58:20.892052 | orchestrator | Friday 03 April 2026 08:58:19 +0000 (0:00:01.258) 1:11:32.567 ********** 2026-04-03 08:58:20.892061 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:58:20.892069 | orchestrator | 2026-04-03 08:58:20.892078 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-03 08:58:20.892093 | orchestrator | Friday 03 April 2026 08:58:20 +0000 (0:00:01.176) 1:11:33.744 ********** 2026-04-03 08:59:02.348979 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349097 | orchestrator | 2026-04-03 08:59:02.349116 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-03 08:59:02.349131 | orchestrator | Friday 03 April 2026 08:58:22 +0000 (0:00:01.136) 1:11:34.881 ********** 2026-04-03 08:59:02.349143 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349154 | orchestrator | 2026-04-03 08:59:02.349165 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-03 08:59:02.349176 | orchestrator | Friday 03 April 2026 08:58:23 +0000 (0:00:01.213) 1:11:36.095 ********** 2026-04-03 08:59:02.349187 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349224 | orchestrator | 2026-04-03 08:59:02.349235 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-03 08:59:02.349246 | orchestrator | Friday 03 April 2026 08:58:24 +0000 (0:00:01.163) 1:11:37.258 ********** 2026-04-03 08:59:02.349257 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349268 | orchestrator | 2026-04-03 08:59:02.349282 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-03 08:59:02.349302 | orchestrator | Friday 03 April 2026 08:58:25 +0000 (0:00:01.143) 1:11:38.401 ********** 2026-04-03 08:59:02.349322 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349343 | orchestrator | 2026-04-03 08:59:02.349363 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-03 08:59:02.349380 | orchestrator | Friday 03 April 2026 08:58:26 +0000 (0:00:01.150) 1:11:39.551 ********** 2026-04-03 08:59:02.349391 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349402 | orchestrator | 2026-04-03 08:59:02.349413 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-03 08:59:02.349423 | orchestrator | Friday 03 April 2026 08:58:27 +0000 (0:00:01.140) 1:11:40.692 ********** 2026-04-03 08:59:02.349434 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.349445 | orchestrator | 2026-04-03 08:59:02.349456 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-03 08:59:02.349466 | orchestrator | Friday 03 April 2026 08:58:28 +0000 (0:00:01.160) 1:11:41.853 ********** 2026-04-03 08:59:02.349477 | orchestrator | ok: [testbed-node-5] 2026-04-03 08:59:02.349489 | orchestrator | 2026-04-03 08:59:02.349500 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-03 08:59:02.349513 | orchestrator | Friday 03 April 2026 08:58:29 +0000 (0:00:00.822) 1:11:42.675 ********** 2026-04-03 08:59:02.349526 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-03 08:59:02.349541 | orchestrator | 2026-04-03 08:59:02.349554 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-03 08:59:02.349567 | orchestrator | Friday 03 April 2026 08:58:31 +0000 (0:00:01.279) 1:11:43.955 ********** 2026-04-03 08:59:02.349579 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-03 08:59:02.349593 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-03 08:59:02.349607 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-03 08:59:02.349620 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-03 08:59:02.349633 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-03 08:59:02.349645 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-03 08:59:02.349657 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-03 08:59:02.349670 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-03 08:59:02.349683 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-03 08:59:02.349726 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-03 08:59:02.349738 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-03 08:59:02.349751 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-03 08:59:02.349765 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-03 08:59:02.349778 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-03 08:59:02.349791 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-03 08:59:02.349804 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-03 08:59:02.349817 | orchestrator | 2026-04-03 08:59:02.349830 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-03 08:59:02.349843 | orchestrator | Friday 03 April 2026 08:58:37 +0000 (0:00:06.226) 1:11:50.181 ********** 2026-04-03 08:59:02.349856 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-03 08:59:02.349867 | orchestrator | 2026-04-03 08:59:02.349887 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-03 08:59:02.349898 | orchestrator | Friday 03 April 2026 08:58:38 +0000 (0:00:01.186) 1:11:51.368 ********** 2026-04-03 08:59:02.349910 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:59:02.349922 | orchestrator | 2026-04-03 08:59:02.349933 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-03 08:59:02.349944 | orchestrator | Friday 03 April 2026 08:58:40 +0000 (0:00:01.530) 1:11:52.899 ********** 2026-04-03 08:59:02.349955 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:59:02.349966 | orchestrator | 2026-04-03 08:59:02.349994 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-03 08:59:02.350006 | orchestrator | Friday 03 April 2026 08:58:41 +0000 (0:00:01.633) 1:11:54.533 ********** 2026-04-03 08:59:02.350073 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350086 | orchestrator | 2026-04-03 08:59:02.350097 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-03 08:59:02.350126 | orchestrator | Friday 03 April 2026 08:58:42 +0000 (0:00:00.800) 1:11:55.333 ********** 2026-04-03 08:59:02.350138 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350149 | orchestrator | 2026-04-03 08:59:02.350160 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-03 08:59:02.350170 | orchestrator | Friday 03 April 2026 08:58:43 +0000 (0:00:00.815) 1:11:56.149 ********** 2026-04-03 08:59:02.350181 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350191 | orchestrator | 2026-04-03 08:59:02.350202 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-03 08:59:02.350213 | orchestrator | Friday 03 April 2026 08:58:44 +0000 (0:00:00.791) 1:11:56.940 ********** 2026-04-03 08:59:02.350223 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350234 | orchestrator | 2026-04-03 08:59:02.350245 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-03 08:59:02.350256 | orchestrator | Friday 03 April 2026 08:58:44 +0000 (0:00:00.807) 1:11:57.748 ********** 2026-04-03 08:59:02.350266 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350277 | orchestrator | 2026-04-03 08:59:02.350288 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-03 08:59:02.350298 | orchestrator | Friday 03 April 2026 08:58:45 +0000 (0:00:00.839) 1:11:58.588 ********** 2026-04-03 08:59:02.350309 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350320 | orchestrator | 2026-04-03 08:59:02.350331 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-03 08:59:02.350342 | orchestrator | Friday 03 April 2026 08:58:46 +0000 (0:00:00.774) 1:11:59.363 ********** 2026-04-03 08:59:02.350353 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350363 | orchestrator | 2026-04-03 08:59:02.350374 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-03 08:59:02.350385 | orchestrator | Friday 03 April 2026 08:58:47 +0000 (0:00:00.812) 1:12:00.175 ********** 2026-04-03 08:59:02.350396 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350406 | orchestrator | 2026-04-03 08:59:02.350417 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-03 08:59:02.350428 | orchestrator | Friday 03 April 2026 08:58:48 +0000 (0:00:00.860) 1:12:01.036 ********** 2026-04-03 08:59:02.350438 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350449 | orchestrator | 2026-04-03 08:59:02.350460 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-03 08:59:02.350471 | orchestrator | Friday 03 April 2026 08:58:48 +0000 (0:00:00.796) 1:12:01.833 ********** 2026-04-03 08:59:02.350481 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350492 | orchestrator | 2026-04-03 08:59:02.350511 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-03 08:59:02.350522 | orchestrator | Friday 03 April 2026 08:58:49 +0000 (0:00:00.764) 1:12:02.597 ********** 2026-04-03 08:59:02.350532 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350543 | orchestrator | 2026-04-03 08:59:02.350554 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-03 08:59:02.350564 | orchestrator | Friday 03 April 2026 08:58:50 +0000 (0:00:00.810) 1:12:03.408 ********** 2026-04-03 08:59:02.350575 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-03 08:59:02.350586 | orchestrator | 2026-04-03 08:59:02.350597 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-03 08:59:02.350608 | orchestrator | Friday 03 April 2026 08:58:54 +0000 (0:00:04.079) 1:12:07.487 ********** 2026-04-03 08:59:02.350618 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 08:59:02.350629 | orchestrator | 2026-04-03 08:59:02.350640 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-03 08:59:02.350651 | orchestrator | Friday 03 April 2026 08:58:55 +0000 (0:00:00.864) 1:12:08.352 ********** 2026-04-03 08:59:02.350663 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-03 08:59:02.350677 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-03 08:59:02.350690 | orchestrator | 2026-04-03 08:59:02.350721 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-03 08:59:02.350732 | orchestrator | Friday 03 April 2026 08:58:59 +0000 (0:00:04.442) 1:12:12.795 ********** 2026-04-03 08:59:02.350743 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350754 | orchestrator | 2026-04-03 08:59:02.350765 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-03 08:59:02.350776 | orchestrator | Friday 03 April 2026 08:59:00 +0000 (0:00:00.817) 1:12:13.612 ********** 2026-04-03 08:59:02.350787 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350798 | orchestrator | 2026-04-03 08:59:02.350815 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-03 08:59:02.350827 | orchestrator | Friday 03 April 2026 08:59:01 +0000 (0:00:00.786) 1:12:14.399 ********** 2026-04-03 08:59:02.350838 | orchestrator | skipping: [testbed-node-5] 2026-04-03 08:59:02.350849 | orchestrator | 2026-04-03 08:59:02.350860 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-03 08:59:02.350878 | orchestrator | Friday 03 April 2026 08:59:02 +0000 (0:00:00.803) 1:12:15.202 ********** 2026-04-03 09:00:10.274244 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.274359 | orchestrator | 2026-04-03 09:00:10.274376 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-03 09:00:10.274390 | orchestrator | Friday 03 April 2026 08:59:03 +0000 (0:00:00.794) 1:12:15.997 ********** 2026-04-03 09:00:10.274402 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.274413 | orchestrator | 2026-04-03 09:00:10.274425 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-03 09:00:10.274454 | orchestrator | Friday 03 April 2026 08:59:03 +0000 (0:00:00.775) 1:12:16.772 ********** 2026-04-03 09:00:10.274477 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:00:10.274490 | orchestrator | 2026-04-03 09:00:10.274501 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-03 09:00:10.274539 | orchestrator | Friday 03 April 2026 08:59:04 +0000 (0:00:00.899) 1:12:17.672 ********** 2026-04-03 09:00:10.274551 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 09:00:10.274565 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 09:00:10.274583 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 09:00:10.274594 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.274605 | orchestrator | 2026-04-03 09:00:10.274616 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-03 09:00:10.274627 | orchestrator | Friday 03 April 2026 08:59:06 +0000 (0:00:01.530) 1:12:19.202 ********** 2026-04-03 09:00:10.274638 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 09:00:10.274648 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 09:00:10.274659 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 09:00:10.274696 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.274714 | orchestrator | 2026-04-03 09:00:10.274725 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-03 09:00:10.274736 | orchestrator | Friday 03 April 2026 08:59:07 +0000 (0:00:01.560) 1:12:20.763 ********** 2026-04-03 09:00:10.274747 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-03 09:00:10.274758 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-03 09:00:10.274773 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-03 09:00:10.274793 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.274812 | orchestrator | 2026-04-03 09:00:10.274829 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-03 09:00:10.274848 | orchestrator | Friday 03 April 2026 08:59:09 +0000 (0:00:01.116) 1:12:21.880 ********** 2026-04-03 09:00:10.274867 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:00:10.274885 | orchestrator | 2026-04-03 09:00:10.274907 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-03 09:00:10.274927 | orchestrator | Friday 03 April 2026 08:59:09 +0000 (0:00:00.836) 1:12:22.717 ********** 2026-04-03 09:00:10.274947 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-03 09:00:10.274960 | orchestrator | 2026-04-03 09:00:10.274973 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-03 09:00:10.274986 | orchestrator | Friday 03 April 2026 08:59:10 +0000 (0:00:01.044) 1:12:23.761 ********** 2026-04-03 09:00:10.274999 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:00:10.275012 | orchestrator | 2026-04-03 09:00:10.275029 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-03 09:00:10.275047 | orchestrator | Friday 03 April 2026 08:59:12 +0000 (0:00:01.454) 1:12:25.215 ********** 2026-04-03 09:00:10.275060 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-5 2026-04-03 09:00:10.275073 | orchestrator | 2026-04-03 09:00:10.275086 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 09:00:10.275099 | orchestrator | Friday 03 April 2026 08:59:13 +0000 (0:00:01.107) 1:12:26.323 ********** 2026-04-03 09:00:10.275111 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 09:00:10.275124 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 09:00:10.275138 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 09:00:10.275152 | orchestrator | 2026-04-03 09:00:10.275163 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 09:00:10.275174 | orchestrator | Friday 03 April 2026 08:59:16 +0000 (0:00:03.270) 1:12:29.594 ********** 2026-04-03 09:00:10.275185 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:00:10.275195 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-03 09:00:10.275206 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:00:10.275217 | orchestrator | 2026-04-03 09:00:10.275228 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-03 09:00:10.275249 | orchestrator | Friday 03 April 2026 08:59:18 +0000 (0:00:01.970) 1:12:31.564 ********** 2026-04-03 09:00:10.275268 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.275280 | orchestrator | 2026-04-03 09:00:10.275291 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-03 09:00:10.275301 | orchestrator | Friday 03 April 2026 08:59:19 +0000 (0:00:00.791) 1:12:32.355 ********** 2026-04-03 09:00:10.275312 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-5 2026-04-03 09:00:10.275324 | orchestrator | 2026-04-03 09:00:10.275335 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-03 09:00:10.275360 | orchestrator | Friday 03 April 2026 08:59:20 +0000 (0:00:01.262) 1:12:33.618 ********** 2026-04-03 09:00:10.275372 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 09:00:10.275384 | orchestrator | 2026-04-03 09:00:10.275395 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-03 09:00:10.275406 | orchestrator | Friday 03 April 2026 08:59:22 +0000 (0:00:01.661) 1:12:35.280 ********** 2026-04-03 09:00:10.275441 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 09:00:10.275454 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-03 09:00:10.275465 | orchestrator | 2026-04-03 09:00:10.275476 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-03 09:00:10.275487 | orchestrator | Friday 03 April 2026 08:59:27 +0000 (0:00:05.123) 1:12:40.403 ********** 2026-04-03 09:00:10.275497 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-03 09:00:10.275508 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-03 09:00:10.275519 | orchestrator | 2026-04-03 09:00:10.275530 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-03 09:00:10.275541 | orchestrator | Friday 03 April 2026 08:59:30 +0000 (0:00:03.173) 1:12:43.577 ********** 2026-04-03 09:00:10.275551 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:00:10.275562 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:00:10.275573 | orchestrator | 2026-04-03 09:00:10.275583 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-03 09:00:10.275594 | orchestrator | Friday 03 April 2026 08:59:32 +0000 (0:00:01.708) 1:12:45.286 ********** 2026-04-03 09:00:10.275605 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-5 2026-04-03 09:00:10.275616 | orchestrator | 2026-04-03 09:00:10.275627 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-03 09:00:10.275637 | orchestrator | Friday 03 April 2026 08:59:33 +0000 (0:00:01.162) 1:12:46.448 ********** 2026-04-03 09:00:10.275648 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275660 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275724 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275739 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275750 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275761 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.275772 | orchestrator | 2026-04-03 09:00:10.275801 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-03 09:00:10.275833 | orchestrator | Friday 03 April 2026 08:59:35 +0000 (0:00:01.607) 1:12:48.055 ********** 2026-04-03 09:00:10.275854 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275875 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275896 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275917 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275930 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-03 09:00:10.275949 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.275961 | orchestrator | 2026-04-03 09:00:10.275971 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-03 09:00:10.275982 | orchestrator | Friday 03 April 2026 08:59:36 +0000 (0:00:01.617) 1:12:49.673 ********** 2026-04-03 09:00:10.275993 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 09:00:10.276004 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 09:00:10.276015 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 09:00:10.276026 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 09:00:10.276044 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-03 09:00:10.276057 | orchestrator | 2026-04-03 09:00:10.276075 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-03 09:00:10.276095 | orchestrator | Friday 03 April 2026 09:00:09 +0000 (0:00:32.671) 1:13:22.345 ********** 2026-04-03 09:00:10.276114 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:00:10.276126 | orchestrator | 2026-04-03 09:00:10.276137 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-03 09:00:10.276157 | orchestrator | Friday 03 April 2026 09:00:10 +0000 (0:00:00.781) 1:13:23.126 ********** 2026-04-03 09:01:02.889406 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.889550 | orchestrator | 2026-04-03 09:01:02.889576 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-03 09:01:02.889599 | orchestrator | Friday 03 April 2026 09:00:11 +0000 (0:00:00.801) 1:13:23.928 ********** 2026-04-03 09:01:02.889618 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-5 2026-04-03 09:01:02.889639 | orchestrator | 2026-04-03 09:01:02.889732 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-03 09:01:02.889754 | orchestrator | Friday 03 April 2026 09:00:12 +0000 (0:00:01.306) 1:13:25.235 ********** 2026-04-03 09:01:02.889773 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-5 2026-04-03 09:01:02.889789 | orchestrator | 2026-04-03 09:01:02.889807 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-03 09:01:02.889825 | orchestrator | Friday 03 April 2026 09:00:13 +0000 (0:00:01.089) 1:13:26.324 ********** 2026-04-03 09:01:02.889842 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.889861 | orchestrator | 2026-04-03 09:01:02.889878 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-03 09:01:02.889896 | orchestrator | Friday 03 April 2026 09:00:15 +0000 (0:00:02.123) 1:13:28.448 ********** 2026-04-03 09:01:02.889951 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.889972 | orchestrator | 2026-04-03 09:01:02.889990 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-03 09:01:02.890010 | orchestrator | Friday 03 April 2026 09:00:17 +0000 (0:00:01.917) 1:13:30.365 ********** 2026-04-03 09:01:02.890124 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.890145 | orchestrator | 2026-04-03 09:01:02.890165 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-03 09:01:02.890185 | orchestrator | Friday 03 April 2026 09:00:19 +0000 (0:00:02.214) 1:13:32.580 ********** 2026-04-03 09:01:02.890207 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-03 09:01:02.890229 | orchestrator | 2026-04-03 09:01:02.890250 | orchestrator | PLAY [Upgrade ceph rbd mirror node] ******************************************** 2026-04-03 09:01:02.890270 | orchestrator | skipping: no hosts matched 2026-04-03 09:01:02.890290 | orchestrator | 2026-04-03 09:01:02.890310 | orchestrator | PLAY [Upgrade ceph nfs node] *************************************************** 2026-04-03 09:01:02.890331 | orchestrator | skipping: no hosts matched 2026-04-03 09:01:02.890350 | orchestrator | 2026-04-03 09:01:02.890370 | orchestrator | PLAY [Upgrade ceph client node] ************************************************ 2026-04-03 09:01:02.890391 | orchestrator | skipping: no hosts matched 2026-04-03 09:01:02.890411 | orchestrator | 2026-04-03 09:01:02.890431 | orchestrator | PLAY [Upgrade ceph-crash daemons] ********************************************** 2026-04-03 09:01:02.890444 | orchestrator | 2026-04-03 09:01:02.890455 | orchestrator | TASK [Stop the ceph-crash service] ********************************************* 2026-04-03 09:01:02.890466 | orchestrator | Friday 03 April 2026 09:00:23 +0000 (0:00:04.193) 1:13:36.774 ********** 2026-04-03 09:01:02.890477 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:01:02.890488 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:01:02.890499 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:01:02.890510 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:01:02.890521 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:01:02.890531 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:01:02.890542 | orchestrator | 2026-04-03 09:01:02.890553 | orchestrator | TASK [Mask and disable the ceph-crash service] ********************************* 2026-04-03 09:01:02.890564 | orchestrator | Friday 03 April 2026 09:00:26 +0000 (0:00:02.901) 1:13:39.676 ********** 2026-04-03 09:01:02.890580 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:01:02.890592 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:01:02.890603 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:01:02.890613 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:01:02.890624 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:01:02.890635 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:01:02.890646 | orchestrator | 2026-04-03 09:01:02.890686 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 09:01:02.890698 | orchestrator | Friday 03 April 2026 09:00:30 +0000 (0:00:03.225) 1:13:42.902 ********** 2026-04-03 09:01:02.890709 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.890720 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.890731 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.890741 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.890752 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.890763 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.890773 | orchestrator | 2026-04-03 09:01:02.890784 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 09:01:02.890795 | orchestrator | Friday 03 April 2026 09:00:32 +0000 (0:00:02.511) 1:13:45.414 ********** 2026-04-03 09:01:02.890806 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.890817 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.890828 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.890838 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.890849 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.890860 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.890887 | orchestrator | 2026-04-03 09:01:02.890898 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-03 09:01:02.890909 | orchestrator | Friday 03 April 2026 09:00:35 +0000 (0:00:02.449) 1:13:47.863 ********** 2026-04-03 09:01:02.890936 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:01:02.890949 | orchestrator | 2026-04-03 09:01:02.890960 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-03 09:01:02.890971 | orchestrator | Friday 03 April 2026 09:00:37 +0000 (0:00:02.343) 1:13:50.207 ********** 2026-04-03 09:01:02.890982 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:01:02.890993 | orchestrator | 2026-04-03 09:01:02.891029 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-03 09:01:02.891040 | orchestrator | Friday 03 April 2026 09:00:39 +0000 (0:00:02.412) 1:13:52.619 ********** 2026-04-03 09:01:02.891051 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.891062 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.891073 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.891084 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.891094 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.891105 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.891116 | orchestrator | 2026-04-03 09:01:02.891127 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-03 09:01:02.891138 | orchestrator | Friday 03 April 2026 09:00:42 +0000 (0:00:02.606) 1:13:55.225 ********** 2026-04-03 09:01:02.891149 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.891159 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.891170 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.891181 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.891192 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.891203 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.891213 | orchestrator | 2026-04-03 09:01:02.891224 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-03 09:01:02.891235 | orchestrator | Friday 03 April 2026 09:00:44 +0000 (0:00:02.422) 1:13:57.648 ********** 2026-04-03 09:01:02.891246 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.891256 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.891267 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.891278 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.891289 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.891299 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.891310 | orchestrator | 2026-04-03 09:01:02.891329 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-03 09:01:02.891348 | orchestrator | Friday 03 April 2026 09:00:47 +0000 (0:00:02.322) 1:13:59.971 ********** 2026-04-03 09:01:02.891367 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.891384 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.891402 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.891419 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.891437 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.891456 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.891475 | orchestrator | 2026-04-03 09:01:02.891493 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-03 09:01:02.891512 | orchestrator | Friday 03 April 2026 09:00:49 +0000 (0:00:02.112) 1:14:02.084 ********** 2026-04-03 09:01:02.891530 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.891550 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.891568 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.891584 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.891595 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.891606 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.891626 | orchestrator | 2026-04-03 09:01:02.891637 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-03 09:01:02.891648 | orchestrator | Friday 03 April 2026 09:00:51 +0000 (0:00:02.335) 1:14:04.419 ********** 2026-04-03 09:01:02.891687 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.891699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.891710 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.891721 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.891732 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.891743 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.891753 | orchestrator | 2026-04-03 09:01:02.891764 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-03 09:01:02.891775 | orchestrator | Friday 03 April 2026 09:00:53 +0000 (0:00:01.746) 1:14:06.166 ********** 2026-04-03 09:01:02.891786 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.891797 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.891808 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.891818 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.891829 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.891840 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.891851 | orchestrator | 2026-04-03 09:01:02.891861 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-03 09:01:02.891872 | orchestrator | Friday 03 April 2026 09:00:55 +0000 (0:00:02.084) 1:14:08.251 ********** 2026-04-03 09:01:02.891883 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.891894 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.891905 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.891916 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.891926 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.891937 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.891948 | orchestrator | 2026-04-03 09:01:02.891959 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-03 09:01:02.891969 | orchestrator | Friday 03 April 2026 09:00:57 +0000 (0:00:02.078) 1:14:10.330 ********** 2026-04-03 09:01:02.891980 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.891991 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.892002 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.892013 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:02.892023 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:02.892034 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:02.892045 | orchestrator | 2026-04-03 09:01:02.892056 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-03 09:01:02.892067 | orchestrator | Friday 03 April 2026 09:00:59 +0000 (0:00:02.514) 1:14:12.844 ********** 2026-04-03 09:01:02.892077 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:02.892088 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:02.892100 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:02.892116 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.892134 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.892175 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.892192 | orchestrator | 2026-04-03 09:01:02.892209 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-03 09:01:02.892226 | orchestrator | Friday 03 April 2026 09:01:01 +0000 (0:00:01.903) 1:14:14.748 ********** 2026-04-03 09:01:02.892243 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:02.892260 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:02.892277 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:02.892294 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:02.892311 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:02.892330 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:02.892349 | orchestrator | 2026-04-03 09:01:02.892383 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-03 09:01:59.822961 | orchestrator | Friday 03 April 2026 09:01:03 +0000 (0:00:02.042) 1:14:16.790 ********** 2026-04-03 09:01:59.823141 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.823172 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.823192 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.823212 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.823233 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.823251 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.823270 | orchestrator | 2026-04-03 09:01:59.823290 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-03 09:01:59.823308 | orchestrator | Friday 03 April 2026 09:01:05 +0000 (0:00:01.824) 1:14:18.615 ********** 2026-04-03 09:01:59.823325 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.823343 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.823360 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.823377 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.823393 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.823410 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.823427 | orchestrator | 2026-04-03 09:01:59.823446 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-03 09:01:59.823462 | orchestrator | Friday 03 April 2026 09:01:07 +0000 (0:00:02.128) 1:14:20.743 ********** 2026-04-03 09:01:59.823478 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.823495 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.823512 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.823530 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.823547 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.823564 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.823582 | orchestrator | 2026-04-03 09:01:59.823600 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-03 09:01:59.823618 | orchestrator | Friday 03 April 2026 09:01:09 +0000 (0:00:01.877) 1:14:22.620 ********** 2026-04-03 09:01:59.823705 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.823731 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.823751 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.823772 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.823791 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.823808 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.823819 | orchestrator | 2026-04-03 09:01:59.823830 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-03 09:01:59.823842 | orchestrator | Friday 03 April 2026 09:01:11 +0000 (0:00:01.815) 1:14:24.436 ********** 2026-04-03 09:01:59.823853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.823864 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.823874 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.823885 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.823895 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.823906 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.823916 | orchestrator | 2026-04-03 09:01:59.823927 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-03 09:01:59.823938 | orchestrator | Friday 03 April 2026 09:01:13 +0000 (0:00:02.112) 1:14:26.549 ********** 2026-04-03 09:01:59.823949 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.823960 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.823970 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.823981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.823992 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.824002 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.824012 | orchestrator | 2026-04-03 09:01:59.824023 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-03 09:01:59.824034 | orchestrator | Friday 03 April 2026 09:01:15 +0000 (0:00:02.084) 1:14:28.633 ********** 2026-04-03 09:01:59.824045 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824055 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.824066 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.824077 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.824087 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.824113 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.824124 | orchestrator | 2026-04-03 09:01:59.824135 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-03 09:01:59.824145 | orchestrator | Friday 03 April 2026 09:01:17 +0000 (0:00:02.160) 1:14:30.794 ********** 2026-04-03 09:01:59.824156 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824167 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.824177 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.824188 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.824199 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.824209 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.824235 | orchestrator | 2026-04-03 09:01:59.824257 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-03 09:01:59.824268 | orchestrator | Friday 03 April 2026 09:01:20 +0000 (0:00:02.205) 1:14:32.999 ********** 2026-04-03 09:01:59.824279 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824290 | orchestrator | 2026-04-03 09:01:59.824301 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-03 09:01:59.824312 | orchestrator | Friday 03 April 2026 09:01:23 +0000 (0:00:03.089) 1:14:36.089 ********** 2026-04-03 09:01:59.824323 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824334 | orchestrator | 2026-04-03 09:01:59.824344 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-03 09:01:59.824355 | orchestrator | Friday 03 April 2026 09:01:26 +0000 (0:00:03.081) 1:14:39.171 ********** 2026-04-03 09:01:59.824366 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824377 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.824388 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.824398 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.824409 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.824439 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.824450 | orchestrator | 2026-04-03 09:01:59.824461 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-03 09:01:59.824471 | orchestrator | Friday 03 April 2026 09:01:28 +0000 (0:00:02.575) 1:14:41.746 ********** 2026-04-03 09:01:59.824482 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824493 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.824504 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.824514 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.824525 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.824535 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.824546 | orchestrator | 2026-04-03 09:01:59.824557 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-03 09:01:59.824590 | orchestrator | Friday 03 April 2026 09:01:31 +0000 (0:00:02.571) 1:14:44.318 ********** 2026-04-03 09:01:59.824603 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:01:59.824616 | orchestrator | 2026-04-03 09:01:59.824627 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-03 09:01:59.824659 | orchestrator | Friday 03 April 2026 09:01:33 +0000 (0:00:02.521) 1:14:46.839 ********** 2026-04-03 09:01:59.824672 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.824682 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.824693 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.824703 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:01:59.824714 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:01:59.824724 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:01:59.824735 | orchestrator | 2026-04-03 09:01:59.824750 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-03 09:01:59.824770 | orchestrator | Friday 03 April 2026 09:01:36 +0000 (0:00:02.672) 1:14:49.512 ********** 2026-04-03 09:01:59.824788 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:01:59.824806 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:01:59.824824 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:01:59.824841 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:01:59.824871 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:01:59.824889 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:01:59.824908 | orchestrator | 2026-04-03 09:01:59.824927 | orchestrator | PLAY [Complete upgrade] ******************************************************** 2026-04-03 09:01:59.824945 | orchestrator | 2026-04-03 09:01:59.824964 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 09:01:59.824983 | orchestrator | Friday 03 April 2026 09:01:41 +0000 (0:00:04.536) 1:14:54.048 ********** 2026-04-03 09:01:59.825001 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.825020 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.825031 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.825042 | orchestrator | 2026-04-03 09:01:59.825052 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 09:01:59.825063 | orchestrator | Friday 03 April 2026 09:01:42 +0000 (0:00:01.691) 1:14:55.740 ********** 2026-04-03 09:01:59.825074 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.825084 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:01:59.825095 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:01:59.825105 | orchestrator | 2026-04-03 09:01:59.825116 | orchestrator | TASK [Container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-03 09:01:59.825127 | orchestrator | Friday 03 April 2026 09:01:44 +0000 (0:00:02.118) 1:14:57.858 ********** 2026-04-03 09:01:59.825138 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:01:59.825149 | orchestrator | 2026-04-03 09:01:59.825160 | orchestrator | TASK [Non container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-03 09:01:59.825170 | orchestrator | Friday 03 April 2026 09:01:47 +0000 (0:00:02.443) 1:15:00.302 ********** 2026-04-03 09:01:59.825181 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825191 | orchestrator | 2026-04-03 09:01:59.825202 | orchestrator | PLAY [Upgrade node-exporter] *************************************************** 2026-04-03 09:01:59.825213 | orchestrator | 2026-04-03 09:01:59.825223 | orchestrator | TASK [Stop node-exporter] ****************************************************** 2026-04-03 09:01:59.825234 | orchestrator | Friday 03 April 2026 09:01:49 +0000 (0:00:02.162) 1:15:02.464 ********** 2026-04-03 09:01:59.825245 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825255 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.825266 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.825276 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.825287 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.825297 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.825308 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:01:59.825319 | orchestrator | 2026-04-03 09:01:59.825330 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 09:01:59.825340 | orchestrator | Friday 03 April 2026 09:01:51 +0000 (0:00:01.986) 1:15:04.451 ********** 2026-04-03 09:01:59.825351 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825361 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.825372 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.825382 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.825392 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.825403 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.825413 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:01:59.825424 | orchestrator | 2026-04-03 09:01:59.825434 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-03 09:01:59.825445 | orchestrator | Friday 03 April 2026 09:01:54 +0000 (0:00:02.430) 1:15:06.882 ********** 2026-04-03 09:01:59.825456 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825466 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.825477 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.825487 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.825498 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.825508 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.825519 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:01:59.825538 | orchestrator | 2026-04-03 09:01:59.825549 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-03 09:01:59.825560 | orchestrator | Friday 03 April 2026 09:01:56 +0000 (0:00:02.534) 1:15:09.416 ********** 2026-04-03 09:01:59.825570 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825581 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.825598 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.825609 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:01:59.825619 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:01:59.825630 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:01:59.825689 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:01:59.825700 | orchestrator | 2026-04-03 09:01:59.825712 | orchestrator | TASK [ceph-node-exporter : Include setup_container.yml] ************************ 2026-04-03 09:01:59.825722 | orchestrator | Friday 03 April 2026 09:01:59 +0000 (0:00:02.747) 1:15:12.164 ********** 2026-04-03 09:01:59.825733 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:01:59.825744 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:01:59.825754 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:01:59.825776 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:02:47.528978 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:02:47.529094 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:02:47.529109 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529121 | orchestrator | 2026-04-03 09:02:47.529134 | orchestrator | PLAY [Upgrade monitoring node] ************************************************* 2026-04-03 09:02:47.529146 | orchestrator | 2026-04-03 09:02:47.529158 | orchestrator | TASK [Stop monitoring services] ************************************************ 2026-04-03 09:02:47.529170 | orchestrator | Friday 03 April 2026 09:02:02 +0000 (0:00:03.125) 1:15:15.289 ********** 2026-04-03 09:02:47.529181 | orchestrator | skipping: [testbed-manager] => (item=alertmanager)  2026-04-03 09:02:47.529193 | orchestrator | skipping: [testbed-manager] => (item=prometheus)  2026-04-03 09:02:47.529204 | orchestrator | skipping: [testbed-manager] => (item=grafana-server)  2026-04-03 09:02:47.529215 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529225 | orchestrator | 2026-04-03 09:02:47.529237 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-03 09:02:47.529247 | orchestrator | Friday 03 April 2026 09:02:03 +0000 (0:00:01.115) 1:15:16.405 ********** 2026-04-03 09:02:47.529259 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529270 | orchestrator | 2026-04-03 09:02:47.529281 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-03 09:02:47.529292 | orchestrator | Friday 03 April 2026 09:02:04 +0000 (0:00:01.130) 1:15:17.536 ********** 2026-04-03 09:02:47.529303 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529314 | orchestrator | 2026-04-03 09:02:47.529325 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-03 09:02:47.529336 | orchestrator | Friday 03 April 2026 09:02:05 +0000 (0:00:01.161) 1:15:18.697 ********** 2026-04-03 09:02:47.529347 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529357 | orchestrator | 2026-04-03 09:02:47.529368 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-03 09:02:47.529379 | orchestrator | Friday 03 April 2026 09:02:06 +0000 (0:00:01.152) 1:15:19.850 ********** 2026-04-03 09:02:47.529390 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529401 | orchestrator | 2026-04-03 09:02:47.529412 | orchestrator | TASK [ceph-prometheus : Create prometheus directories] ************************* 2026-04-03 09:02:47.529423 | orchestrator | Friday 03 April 2026 09:02:08 +0000 (0:00:01.130) 1:15:20.980 ********** 2026-04-03 09:02:47.529434 | orchestrator | skipping: [testbed-manager] => (item=/etc/prometheus)  2026-04-03 09:02:47.529445 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/prometheus)  2026-04-03 09:02:47.529456 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529467 | orchestrator | 2026-04-03 09:02:47.529478 | orchestrator | TASK [ceph-prometheus : Write prometheus config file] ************************** 2026-04-03 09:02:47.529514 | orchestrator | Friday 03 April 2026 09:02:09 +0000 (0:00:01.237) 1:15:22.218 ********** 2026-04-03 09:02:47.529528 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529541 | orchestrator | 2026-04-03 09:02:47.529555 | orchestrator | TASK [ceph-prometheus : Make sure the alerting rules directory exists] ********* 2026-04-03 09:02:47.529567 | orchestrator | Friday 03 April 2026 09:02:10 +0000 (0:00:01.216) 1:15:23.434 ********** 2026-04-03 09:02:47.529580 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529592 | orchestrator | 2026-04-03 09:02:47.529605 | orchestrator | TASK [ceph-prometheus : Copy alerting rules] *********************************** 2026-04-03 09:02:47.529618 | orchestrator | Friday 03 April 2026 09:02:11 +0000 (0:00:01.109) 1:15:24.544 ********** 2026-04-03 09:02:47.529668 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529683 | orchestrator | 2026-04-03 09:02:47.529697 | orchestrator | TASK [ceph-prometheus : Create alertmanager directories] *********************** 2026-04-03 09:02:47.529707 | orchestrator | Friday 03 April 2026 09:02:12 +0000 (0:00:01.101) 1:15:25.645 ********** 2026-04-03 09:02:47.529718 | orchestrator | skipping: [testbed-manager] => (item=/etc/alertmanager)  2026-04-03 09:02:47.529729 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/alertmanager)  2026-04-03 09:02:47.529740 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529750 | orchestrator | 2026-04-03 09:02:47.529761 | orchestrator | TASK [ceph-prometheus : Write alertmanager config file] ************************ 2026-04-03 09:02:47.529772 | orchestrator | Friday 03 April 2026 09:02:13 +0000 (0:00:01.137) 1:15:26.783 ********** 2026-04-03 09:02:47.529783 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529793 | orchestrator | 2026-04-03 09:02:47.529804 | orchestrator | TASK [ceph-prometheus : Include setup_container.yml] *************************** 2026-04-03 09:02:47.529815 | orchestrator | Friday 03 April 2026 09:02:15 +0000 (0:00:01.142) 1:15:27.925 ********** 2026-04-03 09:02:47.529825 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529836 | orchestrator | 2026-04-03 09:02:47.529847 | orchestrator | TASK [ceph-grafana : Include setup_container.yml] ****************************** 2026-04-03 09:02:47.529858 | orchestrator | Friday 03 April 2026 09:02:16 +0000 (0:00:01.220) 1:15:29.146 ********** 2026-04-03 09:02:47.529869 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529880 | orchestrator | 2026-04-03 09:02:47.529890 | orchestrator | TASK [ceph-grafana : Include configure_grafana.yml] **************************** 2026-04-03 09:02:47.529901 | orchestrator | Friday 03 April 2026 09:02:17 +0000 (0:00:01.187) 1:15:30.333 ********** 2026-04-03 09:02:47.529912 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:02:47.529922 | orchestrator | 2026-04-03 09:02:47.529933 | orchestrator | PLAY [Upgrade ceph dashboard] ************************************************** 2026-04-03 09:02:47.529944 | orchestrator | 2026-04-03 09:02:47.529969 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-03 09:02:47.529981 | orchestrator | Friday 03 April 2026 09:02:19 +0000 (0:00:01.908) 1:15:32.242 ********** 2026-04-03 09:02:47.529992 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530002 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530013 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530085 | orchestrator | 2026-04-03 09:02:47.530096 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-03 09:02:47.530107 | orchestrator | Friday 03 April 2026 09:02:20 +0000 (0:00:01.426) 1:15:33.669 ********** 2026-04-03 09:02:47.530119 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530130 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530160 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530172 | orchestrator | 2026-04-03 09:02:47.530183 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-03 09:02:47.530193 | orchestrator | Friday 03 April 2026 09:02:22 +0000 (0:00:01.408) 1:15:35.078 ********** 2026-04-03 09:02:47.530204 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530215 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530226 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530247 | orchestrator | 2026-04-03 09:02:47.530258 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-03 09:02:47.530269 | orchestrator | Friday 03 April 2026 09:02:23 +0000 (0:00:01.652) 1:15:36.731 ********** 2026-04-03 09:02:47.530280 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530290 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530301 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530312 | orchestrator | 2026-04-03 09:02:47.530322 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-03 09:02:47.530333 | orchestrator | Friday 03 April 2026 09:02:25 +0000 (0:00:01.387) 1:15:38.119 ********** 2026-04-03 09:02:47.530344 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530354 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530365 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530376 | orchestrator | 2026-04-03 09:02:47.530387 | orchestrator | TASK [ceph-dashboard : Include configure_dashboard.yml] ************************ 2026-04-03 09:02:47.530397 | orchestrator | Friday 03 April 2026 09:02:26 +0000 (0:00:01.324) 1:15:39.443 ********** 2026-04-03 09:02:47.530408 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530419 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:02:47.530429 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:02:47.530440 | orchestrator | 2026-04-03 09:02:47.530450 | orchestrator | TASK [ceph-dashboard : Print dashboard URL] ************************************ 2026-04-03 09:02:47.530461 | orchestrator | Friday 03 April 2026 09:02:28 +0000 (0:00:01.432) 1:15:40.875 ********** 2026-04-03 09:02:47.530472 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:02:47.530482 | orchestrator | 2026-04-03 09:02:47.530493 | orchestrator | PLAY [Switch any existing crush buckets to straw2] ***************************** 2026-04-03 09:02:47.530504 | orchestrator | 2026-04-03 09:02:47.530514 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-03 09:02:47.530527 | orchestrator | Friday 03 April 2026 09:02:29 +0000 (0:00:01.563) 1:15:42.438 ********** 2026-04-03 09:02:47.530545 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.530563 | orchestrator | 2026-04-03 09:02:47.530581 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-03 09:02:47.530597 | orchestrator | Friday 03 April 2026 09:02:31 +0000 (0:00:01.501) 1:15:43.940 ********** 2026-04-03 09:02:47.530615 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.530658 | orchestrator | 2026-04-03 09:02:47.530675 | orchestrator | TASK [Set_fact ceph_cmd] ******************************************************* 2026-04-03 09:02:47.530692 | orchestrator | Friday 03 April 2026 09:02:32 +0000 (0:00:01.159) 1:15:45.099 ********** 2026-04-03 09:02:47.530710 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.530729 | orchestrator | 2026-04-03 09:02:47.530746 | orchestrator | TASK [Backup the crushmap] ***************************************************** 2026-04-03 09:02:47.530764 | orchestrator | Friday 03 April 2026 09:02:33 +0000 (0:00:01.185) 1:15:46.285 ********** 2026-04-03 09:02:47.530782 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.530800 | orchestrator | 2026-04-03 09:02:47.530818 | orchestrator | TASK [Switch crush buckets to straw2] ****************************************** 2026-04-03 09:02:47.530837 | orchestrator | Friday 03 April 2026 09:02:36 +0000 (0:00:02.948) 1:15:49.233 ********** 2026-04-03 09:02:47.530857 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.530875 | orchestrator | 2026-04-03 09:02:47.530895 | orchestrator | TASK [Remove crushmap backup] ************************************************** 2026-04-03 09:02:47.530914 | orchestrator | Friday 03 April 2026 09:02:40 +0000 (0:00:03.941) 1:15:53.174 ********** 2026-04-03 09:02:47.530933 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:02:47.530945 | orchestrator | 2026-04-03 09:02:47.530956 | orchestrator | PLAY [Show ceph status] ******************************************************** 2026-04-03 09:02:47.530966 | orchestrator | 2026-04-03 09:02:47.530977 | orchestrator | TASK [Set_fact container_exec_cmd_status] ************************************** 2026-04-03 09:02:47.530988 | orchestrator | Friday 03 April 2026 09:02:42 +0000 (0:00:02.159) 1:15:55.333 ********** 2026-04-03 09:02:47.531010 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.531021 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:02:47.531032 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:02:47.531043 | orchestrator | 2026-04-03 09:02:47.531053 | orchestrator | TASK [Show ceph status] ******************************************************** 2026-04-03 09:02:47.531064 | orchestrator | Friday 03 April 2026 09:02:43 +0000 (0:00:01.423) 1:15:56.757 ********** 2026-04-03 09:02:47.531075 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.531086 | orchestrator | 2026-04-03 09:02:47.531097 | orchestrator | TASK [Show all daemons version] ************************************************ 2026-04-03 09:02:47.531107 | orchestrator | Friday 03 April 2026 09:02:46 +0000 (0:00:02.407) 1:15:59.164 ********** 2026-04-03 09:02:47.531118 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:02:47.531129 | orchestrator | 2026-04-03 09:02:47.531140 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:02:47.531152 | orchestrator | localhost : ok=0 changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 09:02:47.531172 | orchestrator | testbed-manager : ok=25  changed=1  unreachable=0 failed=0 skipped=76  rescued=0 ignored=0 2026-04-03 09:02:47.531185 | orchestrator | testbed-node-0 : ok=248  changed=19  unreachable=0 failed=0 skipped=369  rescued=0 ignored=0 2026-04-03 09:02:47.531196 | orchestrator | testbed-node-1 : ok=191  changed=14  unreachable=0 failed=0 skipped=343  rescued=0 ignored=0 2026-04-03 09:02:47.531218 | orchestrator | testbed-node-2 : ok=196  changed=14  unreachable=0 failed=0 skipped=344  rescued=0 ignored=0 2026-04-03 09:02:50.732365 | orchestrator | testbed-node-3 : ok=311  changed=21  unreachable=0 failed=0 skipped=341  rescued=0 ignored=0 2026-04-03 09:02:50.732498 | orchestrator | testbed-node-4 : ok=307  changed=17  unreachable=0 failed=0 skipped=352  rescued=0 ignored=0 2026-04-03 09:02:50.732524 | orchestrator | testbed-node-5 : ok=309  changed=16  unreachable=0 failed=0 skipped=351  rescued=0 ignored=0 2026-04-03 09:02:50.732547 | orchestrator | 2026-04-03 09:02:50.732572 | orchestrator | 2026-04-03 09:02:50.732593 | orchestrator | 2026-04-03 09:02:50.732617 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:02:50.732718 | orchestrator | Friday 03 April 2026 09:02:50 +0000 (0:00:03.736) 1:16:02.901 ********** 2026-04-03 09:02:50.732741 | orchestrator | =============================================================================== 2026-04-03 09:02:50.732763 | orchestrator | Re-enable pg autoscale on pools ---------------------------------------- 76.59s 2026-04-03 09:02:50.732783 | orchestrator | Disable pg autoscale on pools ------------------------------------------ 76.43s 2026-04-03 09:02:50.732799 | orchestrator | Gather and delegate facts ---------------------------------------------- 33.52s 2026-04-03 09:02:50.732818 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 32.67s 2026-04-03 09:02:50.732838 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 32.44s 2026-04-03 09:02:50.732861 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 32.09s 2026-04-03 09:02:50.732882 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 30.66s 2026-04-03 09:02:50.732905 | orchestrator | Stop ceph mgr ---------------------------------------------------------- 28.05s 2026-04-03 09:02:50.732928 | orchestrator | Waiting for clean pgs... ----------------------------------------------- 27.84s 2026-04-03 09:02:50.732951 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.93s 2026-04-03 09:02:50.732975 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.83s 2026-04-03 09:02:50.733037 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 22.28s 2026-04-03 09:02:50.733059 | orchestrator | ceph-infra : Update cache for Debian based OSs ------------------------- 16.43s 2026-04-03 09:02:50.733079 | orchestrator | Create potentially missing keys (rbd and rbd-mirror) ------------------- 16.29s 2026-04-03 09:02:50.733102 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 15.53s 2026-04-03 09:02:50.733124 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 13.81s 2026-04-03 09:02:50.733145 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 13.44s 2026-04-03 09:02:50.733167 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 12.68s 2026-04-03 09:02:50.733186 | orchestrator | Stop ceph osd ---------------------------------------------------------- 11.73s 2026-04-03 09:02:50.733209 | orchestrator | Restart active mds ----------------------------------------------------- 10.85s 2026-04-03 09:02:50.919912 | orchestrator | + osism apply cephclient 2026-04-03 09:02:52.318707 | orchestrator | 2026-04-03 09:02:52 | INFO  | Prepare task for execution of cephclient. 2026-04-03 09:02:52.388205 | orchestrator | 2026-04-03 09:02:52 | INFO  | Task 0195d231-6675-4276-b8d5-5c394aa6d9be (cephclient) was prepared for execution. 2026-04-03 09:02:52.388305 | orchestrator | 2026-04-03 09:02:52 | INFO  | It takes a moment until task 0195d231-6675-4276-b8d5-5c394aa6d9be (cephclient) has been started and output is visible here. 2026-04-03 09:03:20.626420 | orchestrator | 2026-04-03 09:03:20.626527 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-03 09:03:20.626541 | orchestrator | 2026-04-03 09:03:20.626553 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-03 09:03:20.626563 | orchestrator | Friday 03 April 2026 09:02:58 +0000 (0:00:01.961) 0:00:01.961 ********** 2026-04-03 09:03:20.626573 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-03 09:03:20.626584 | orchestrator | 2026-04-03 09:03:20.626594 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-03 09:03:20.626604 | orchestrator | Friday 03 April 2026 09:03:00 +0000 (0:00:01.837) 0:00:03.798 ********** 2026-04-03 09:03:20.626676 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-03 09:03:20.626688 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-03 09:03:20.626716 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-03 09:03:20.626726 | orchestrator | 2026-04-03 09:03:20.626736 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-03 09:03:20.626746 | orchestrator | Friday 03 April 2026 09:03:02 +0000 (0:00:02.547) 0:00:06.346 ********** 2026-04-03 09:03:20.626756 | orchestrator | ok: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-03 09:03:20.626766 | orchestrator | 2026-04-03 09:03:20.626776 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-03 09:03:20.626786 | orchestrator | Friday 03 April 2026 09:03:04 +0000 (0:00:02.012) 0:00:08.358 ********** 2026-04-03 09:03:20.626796 | orchestrator | ok: [testbed-manager] 2026-04-03 09:03:20.626806 | orchestrator | 2026-04-03 09:03:20.626816 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-03 09:03:20.626825 | orchestrator | Friday 03 April 2026 09:03:06 +0000 (0:00:01.886) 0:00:10.245 ********** 2026-04-03 09:03:20.626835 | orchestrator | ok: [testbed-manager] 2026-04-03 09:03:20.626845 | orchestrator | 2026-04-03 09:03:20.626855 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-03 09:03:20.626865 | orchestrator | Friday 03 April 2026 09:03:08 +0000 (0:00:01.949) 0:00:12.194 ********** 2026-04-03 09:03:20.626874 | orchestrator | ok: [testbed-manager] 2026-04-03 09:03:20.626884 | orchestrator | 2026-04-03 09:03:20.626894 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-03 09:03:20.626926 | orchestrator | Friday 03 April 2026 09:03:10 +0000 (0:00:02.283) 0:00:14.477 ********** 2026-04-03 09:03:20.626937 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-03 09:03:20.626947 | orchestrator | ok: [testbed-manager] => (item=ceph-authtool) 2026-04-03 09:03:20.626957 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-03 09:03:20.626968 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-03 09:03:20.626980 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-03 09:03:20.626992 | orchestrator | 2026-04-03 09:03:20.627003 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-03 09:03:20.627015 | orchestrator | Friday 03 April 2026 09:03:16 +0000 (0:00:05.146) 0:00:19.624 ********** 2026-04-03 09:03:20.627027 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-03 09:03:20.627038 | orchestrator | 2026-04-03 09:03:20.627050 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-03 09:03:20.627061 | orchestrator | Friday 03 April 2026 09:03:17 +0000 (0:00:01.481) 0:00:21.106 ********** 2026-04-03 09:03:20.627073 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:03:20.627084 | orchestrator | 2026-04-03 09:03:20.627095 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-03 09:03:20.627106 | orchestrator | Friday 03 April 2026 09:03:18 +0000 (0:00:01.136) 0:00:22.242 ********** 2026-04-03 09:03:20.627118 | orchestrator | skipping: [testbed-manager] 2026-04-03 09:03:20.627129 | orchestrator | 2026-04-03 09:03:20.627142 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:03:20.627154 | orchestrator | testbed-manager : ok=8  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 09:03:20.627166 | orchestrator | 2026-04-03 09:03:20.627177 | orchestrator | 2026-04-03 09:03:20.627189 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:03:20.627200 | orchestrator | Friday 03 April 2026 09:03:20 +0000 (0:00:01.519) 0:00:23.761 ********** 2026-04-03 09:03:20.627211 | orchestrator | =============================================================================== 2026-04-03 09:03:20.627222 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 5.15s 2026-04-03 09:03:20.627235 | orchestrator | osism.services.cephclient : Create required directories ----------------- 2.55s 2026-04-03 09:03:20.627247 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------- 2.28s 2026-04-03 09:03:20.627258 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 2.01s 2026-04-03 09:03:20.627269 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 1.95s 2026-04-03 09:03:20.627280 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 1.89s 2026-04-03 09:03:20.627291 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 1.84s 2026-04-03 09:03:20.627303 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 1.52s 2026-04-03 09:03:20.627315 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 1.48s 2026-04-03 09:03:20.627326 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 1.14s 2026-04-03 09:03:20.813081 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-03 09:03:20.813175 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/300-openstack.sh 2026-04-03 09:03:20.821283 | orchestrator | + set -e 2026-04-03 09:03:20.821365 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 09:03:20.821379 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 09:03:20.821389 | orchestrator | ++ INTERACTIVE=false 2026-04-03 09:03:20.821398 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 09:03:20.822431 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 09:03:20.822469 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 09:03:20.822484 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 09:03:20.822497 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 09:03:20.822509 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 09:03:20.822522 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 09:03:20.822535 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 09:03:20.822579 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 09:03:20.822593 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 09:03:20.822606 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 09:03:20.822642 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 09:03:20.822654 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 09:03:20.822668 | orchestrator | ++ export ARA=false 2026-04-03 09:03:20.822681 | orchestrator | ++ ARA=false 2026-04-03 09:03:20.822694 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 09:03:20.822708 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 09:03:20.822721 | orchestrator | ++ export TEMPEST=false 2026-04-03 09:03:20.822734 | orchestrator | ++ TEMPEST=false 2026-04-03 09:03:20.822747 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 09:03:20.822759 | orchestrator | ++ IS_ZUUL=true 2026-04-03 09:03:20.822773 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 09:03:20.822785 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 09:03:20.822798 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 09:03:20.822810 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 09:03:20.822841 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 09:03:20.822855 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 09:03:20.822868 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 09:03:20.822881 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 09:03:20.822893 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 09:03:20.822906 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 09:03:20.822919 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-03 09:03:20.822931 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-03 09:03:20.822945 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 09:03:20.823912 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 09:03:20.830530 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 09:03:20.830574 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 09:03:20.830587 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 09:03:20.830599 | orchestrator | + osism migrate rabbitmq3to4 prepare 2026-04-03 09:03:30.092232 | orchestrator | 2026-04-03 09:03:30 | ERROR  | Unable to get ansible vault password 2026-04-03 09:03:30.092326 | orchestrator | 2026-04-03 09:03:30 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 09:03:30.092341 | orchestrator | 2026-04-03 09:03:30 | ERROR  | Dropping encrypted entries 2026-04-03 09:03:30.133004 | orchestrator | 2026-04-03 09:03:30 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 09:03:30.133824 | orchestrator | 2026-04-03 09:03:30 | INFO  | Kolla configuration check passed 2026-04-03 09:03:30.367194 | orchestrator | 2026-04-03 09:03:30 | INFO  | Created vhost 'openstack' with default_queue_type=quorum 2026-04-03 09:03:30.388918 | orchestrator | 2026-04-03 09:03:30 | INFO  | Set permissions for user 'openstack' on vhost 'openstack' 2026-04-03 09:03:30.668140 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-03 09:03:36.950413 | orchestrator | 2026-04-03 09:03:36 | ERROR  | Unable to get ansible vault password 2026-04-03 09:03:36.950524 | orchestrator | 2026-04-03 09:03:36 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 09:03:36.950541 | orchestrator | 2026-04-03 09:03:36 | ERROR  | Dropping encrypted entries 2026-04-03 09:03:36.985047 | orchestrator | 2026-04-03 09:03:36 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 09:03:37.166843 | orchestrator | 2026-04-03 09:03:37 | INFO  | Found 208 classic queue(s) in vhost '/': 2026-04-03 09:03:37.166943 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - alarm.all.sample (vhost: /, messages: 0) 2026-04-03 09:03:37.166959 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - alarming.sample (vhost: /, messages: 0) 2026-04-03 09:03:37.168052 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican.workers (vhost: /, messages: 0) 2026-04-03 09:03:37.168117 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican.workers.barbican.queue (vhost: /, messages: 0) 2026-04-03 09:03:37.168131 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican.workers_fanout_634ddae349034d8cbc9d72bf8ae7e69a (vhost: /, messages: 0) 2026-04-03 09:03:37.168149 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican.workers_fanout_7bd1dc15a26740d5a9ca2b711fe054b6 (vhost: /, messages: 0) 2026-04-03 09:03:37.168168 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican.workers_fanout_ac237e574a204322bbee1a262170dfca (vhost: /, messages: 0) 2026-04-03 09:03:37.168186 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - barbican_notifications.info (vhost: /, messages: 0) 2026-04-03 09:03:37.168203 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central (vhost: /, messages: 0) 2026-04-03 09:03:37.168222 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.168240 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.168524 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.168643 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_1c07ade158134d129f71636a1f344413 (vhost: /, messages: 0) 2026-04-03 09:03:37.168771 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_416c6eb5969c444bb3c52f4f5d696784 (vhost: /, messages: 0) 2026-04-03 09:03:37.168789 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_6a162abff07442069054bf3124c430de (vhost: /, messages: 0) 2026-04-03 09:03:37.168799 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_a871dab2baa34ee6b569eca52c826319 (vhost: /, messages: 0) 2026-04-03 09:03:37.169327 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_b36eb7df16fd49529aa6669ea40ab022 (vhost: /, messages: 0) 2026-04-03 09:03:37.169429 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - central_fanout_cfd0e4b384cf4f73ba3dc5aefde57b86 (vhost: /, messages: 0) 2026-04-03 09:03:37.169449 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup (vhost: /, messages: 0) 2026-04-03 09:03:37.169460 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.169706 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.169727 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.169970 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup_fanout_083169b626a443f695100d5ba51005ed (vhost: /, messages: 0) 2026-04-03 09:03:37.170191 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup_fanout_a6c2dfa5820f4234800a9f082a2ecbb2 (vhost: /, messages: 0) 2026-04-03 09:03:37.170398 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-backup_fanout_de0431a2db9b4ba4bec93396826c419a (vhost: /, messages: 0) 2026-04-03 09:03:37.170416 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler (vhost: /, messages: 0) 2026-04-03 09:03:37.170603 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.171882 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.171905 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.171987 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler_fanout_49b34872b63a4012b9eea888de8ad73d (vhost: /, messages: 0) 2026-04-03 09:03:37.172022 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler_fanout_627a23f52e554f3bb10a3aa4e7792cac (vhost: /, messages: 0) 2026-04-03 09:03:37.172033 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-scheduler_fanout_f6d7e62117604c1ca5a7907058761c03 (vhost: /, messages: 0) 2026-04-03 09:03:37.172042 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume (vhost: /, messages: 0) 2026-04-03 09:03:37.172053 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: /, messages: 0) 2026-04-03 09:03:37.172062 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.172073 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_a4491138f3f74c23a98f25e3617d0219 (vhost: /, messages: 0) 2026-04-03 09:03:37.172084 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: /, messages: 0) 2026-04-03 09:03:37.172094 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.172103 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_b5dfa356601849e0a4226c0c0db60798 (vhost: /, messages: 0) 2026-04-03 09:03:37.172113 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: /, messages: 0) 2026-04-03 09:03:37.172123 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.172205 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_0e4f881af4d44b0ca7d830df9ebba6ff (vhost: /, messages: 0) 2026-04-03 09:03:37.172225 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume_fanout_6690419c715142f3af8fa5ac922a3231 (vhost: /, messages: 0) 2026-04-03 09:03:37.172235 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume_fanout_67d4423aa00f4c41aa8f7a2c44c73727 (vhost: /, messages: 0) 2026-04-03 09:03:37.172245 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - cinder-volume_fanout_71500d4b13ee442fac34b51ac5313db1 (vhost: /, messages: 0) 2026-04-03 09:03:37.172257 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute (vhost: /, messages: 0) 2026-04-03 09:03:37.172466 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute.testbed-node-3 (vhost: /, messages: 0) 2026-04-03 09:03:37.172486 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute.testbed-node-4 (vhost: /, messages: 0) 2026-04-03 09:03:37.172496 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute.testbed-node-5 (vhost: /, messages: 0) 2026-04-03 09:03:37.172736 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute_fanout_73860e5015ef4190bf4c7449e21cb718 (vhost: /, messages: 0) 2026-04-03 09:03:37.172758 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute_fanout_856838725882454395648d898fde8c99 (vhost: /, messages: 0) 2026-04-03 09:03:37.172773 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - compute_fanout_c0a92bd786354f2a9712ea6757128c92 (vhost: /, messages: 0) 2026-04-03 09:03:37.172783 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor (vhost: /, messages: 0) 2026-04-03 09:03:37.173005 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.173025 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.173035 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.173134 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_09a8d90392794455a55d31d9d6c997d7 (vhost: /, messages: 0) 2026-04-03 09:03:37.173148 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_31468dc4c1a24208a85193764ca8d8e1 (vhost: /, messages: 0) 2026-04-03 09:03:37.173264 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_5988dfa13bc84d75b6c465253c9c9d5a (vhost: /, messages: 0) 2026-04-03 09:03:37.173280 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_70508e27657e4d11b1777ad0d1c2776c (vhost: /, messages: 0) 2026-04-03 09:03:37.173408 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_9c7892abd4504a0da186db73db93f785 (vhost: /, messages: 0) 2026-04-03 09:03:37.173425 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - conductor_fanout_ae4e78b80364484fab145a391e29df38 (vhost: /, messages: 0) 2026-04-03 09:03:37.173756 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - event.sample (vhost: /, messages: 9) 2026-04-03 09:03:37.173795 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-03 09:03:37.173813 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor.cre24ozvki7j (vhost: /, messages: 0) 2026-04-03 09:03:37.173830 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor.kcisounizhqo (vhost: /, messages: 0) 2026-04-03 09:03:37.173844 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor.wmfrw7pq6kho (vhost: /, messages: 0) 2026-04-03 09:03:37.173984 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_054944816b704c8087606457a1635e4a (vhost: /, messages: 0) 2026-04-03 09:03:37.174002 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_3fab08c024ea4da78113b669810d6451 (vhost: /, messages: 0) 2026-04-03 09:03:37.174453 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_41ee208d5db647b7ad10fc67235d57d0 (vhost: /, messages: 0) 2026-04-03 09:03:37.174476 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_5431c7da8e3c45d68ff9f6ce25a68fb7 (vhost: /, messages: 0) 2026-04-03 09:03:37.174486 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_a3de3897f1f74451abd281b24fdbc335 (vhost: /, messages: 0) 2026-04-03 09:03:37.174496 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_b06d738881f14bf3acc8c20de5d52b21 (vhost: /, messages: 0) 2026-04-03 09:03:37.174506 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_c41351fa0a7341bd9852825bab17f6bc (vhost: /, messages: 0) 2026-04-03 09:03:37.174520 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_dedbda64b11a4a1b9424040cd87ad107 (vhost: /, messages: 0) 2026-04-03 09:03:37.174530 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - magnum-conductor_fanout_e9065fc22494427cbea06d64bb5548e0 (vhost: /, messages: 0) 2026-04-03 09:03:37.174685 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data (vhost: /, messages: 0) 2026-04-03 09:03:37.174703 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.174817 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.174832 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.174992 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data_fanout_71f6a3ab8b94475684007a3e31d827e8 (vhost: /, messages: 0) 2026-04-03 09:03:37.175018 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data_fanout_880be180475242989eb52d9bf7d8b47b (vhost: /, messages: 0) 2026-04-03 09:03:37.175240 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-data_fanout_9af5aa09e5ad4934b3caf17ad6e31140 (vhost: /, messages: 0) 2026-04-03 09:03:37.175257 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler (vhost: /, messages: 0) 2026-04-03 09:03:37.175372 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.175387 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.175468 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.175479 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler_fanout_0f6f01c47c7c4f2dadea1616e6a32bd7 (vhost: /, messages: 0) 2026-04-03 09:03:37.176606 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler_fanout_62a5ee4dac5e483fac03564aae78cdb0 (vhost: /, messages: 0) 2026-04-03 09:03:37.176907 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-scheduler_fanout_711ad96f7b6b44a19891c6064d628504 (vhost: /, messages: 0) 2026-04-03 09:03:37.176945 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share (vhost: /, messages: 0) 2026-04-03 09:03:37.177025 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: /, messages: 0) 2026-04-03 09:03:37.177180 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: /, messages: 0) 2026-04-03 09:03:37.177201 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: /, messages: 0) 2026-04-03 09:03:37.177218 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share_fanout_7c83306b89394aeab6ea25e3fcb26462 (vhost: /, messages: 0) 2026-04-03 09:03:37.177251 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share_fanout_b7715d9fed924473834717a4cb62339f (vhost: /, messages: 0) 2026-04-03 09:03:37.177268 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - manila-share_fanout_e25bd8d782a442eb966d6492bc699ea3 (vhost: /, messages: 0) 2026-04-03 09:03:37.177285 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.audit (vhost: /, messages: 0) 2026-04-03 09:03:37.177499 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.critical (vhost: /, messages: 0) 2026-04-03 09:03:37.177521 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.debug (vhost: /, messages: 0) 2026-04-03 09:03:37.177751 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.error (vhost: /, messages: 0) 2026-04-03 09:03:37.177770 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.info (vhost: /, messages: 0) 2026-04-03 09:03:37.177786 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.sample (vhost: /, messages: 0) 2026-04-03 09:03:37.177802 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - notifications.warn (vhost: /, messages: 0) 2026-04-03 09:03:37.177819 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2 (vhost: /, messages: 0) 2026-04-03 09:03:37.177836 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.177853 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.177869 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.177886 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2_fanout_04a27c3875584c96a875261ee1e53051 (vhost: /, messages: 0) 2026-04-03 09:03:37.177927 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2_fanout_16531f8443fd4d479d453bceb8e57cb0 (vhost: /, messages: 0) 2026-04-03 09:03:37.177957 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - octavia_provisioning_v2_fanout_afce68dd275045f4a2c8f16afb8a92f2 (vhost: /, messages: 0) 2026-04-03 09:03:37.177976 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer (vhost: /, messages: 0) 2026-04-03 09:03:37.177991 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.178009 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.178275 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.178450 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_0d63aa80b14f476f89e8e6e3bc2ae5db (vhost: /, messages: 0) 2026-04-03 09:03:37.178472 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_3c083d226f434571aea79c28f95dac9a (vhost: /, messages: 0) 2026-04-03 09:03:37.178485 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_7557334d7e404bd5ad1d3d60ead64a66 (vhost: /, messages: 0) 2026-04-03 09:03:37.178499 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_87c3606e01d8408088d5c950ab4a12ca (vhost: /, messages: 0) 2026-04-03 09:03:37.178524 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_d45c05123fd54567ba3861f7d7771e8a (vhost: /, messages: 0) 2026-04-03 09:03:37.178537 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - producer_fanout_f3874f5e8acc45769fa2f7438b7660be (vhost: /, messages: 0) 2026-04-03 09:03:37.178551 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin (vhost: /, messages: 0) 2026-04-03 09:03:37.178565 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.178580 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.178594 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.178607 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_0cc0ba3afd5a4f5483ae6c9ccae929b8 (vhost: /, messages: 0) 2026-04-03 09:03:37.178984 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_212008147965492a9eed68e5c646c8a0 (vhost: /, messages: 0) 2026-04-03 09:03:37.179005 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_4da4e7fd38c941c79a7bd5f6e6991126 (vhost: /, messages: 0) 2026-04-03 09:03:37.179019 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_6adf38a640544e74b407bab9ff0e84a0 (vhost: /, messages: 0) 2026-04-03 09:03:37.179032 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_90e881bf17754cd587eb4c1ed1aad8de (vhost: /, messages: 0) 2026-04-03 09:03:37.179046 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_971f3f048da74e0cb98715863ceb1fb9 (vhost: /, messages: 0) 2026-04-03 09:03:37.179220 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_d1593a4c36064315bce8421c79479812 (vhost: /, messages: 0) 2026-04-03 09:03:37.179244 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_e59cd237d78846c6958df59ecafc8c2d (vhost: /, messages: 0) 2026-04-03 09:03:37.179258 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-plugin_fanout_f1ef23167c4f4f66adb22c0a6f6a0b7f (vhost: /, messages: 0) 2026-04-03 09:03:37.179272 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin (vhost: /, messages: 0) 2026-04-03 09:03:37.179303 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.179528 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.179822 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.179843 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_156f6be1302d4aa38133d7aa459e462c (vhost: /, messages: 0) 2026-04-03 09:03:37.179856 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_33a197fbbfdf46b2a37aaacb30989089 (vhost: /, messages: 0) 2026-04-03 09:03:37.179870 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_3b3904e6ec63494a8748510eb3845de9 (vhost: /, messages: 0) 2026-04-03 09:03:37.179883 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_415a01d24fd14e328c01c6d502588968 (vhost: /, messages: 0) 2026-04-03 09:03:37.179897 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_53f2e65edf81424b80ba9e1656fd3cd1 (vhost: /, messages: 0) 2026-04-03 09:03:37.179910 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_594c48111e32431e80b37f1922001e69 (vhost: /, messages: 0) 2026-04-03 09:03:37.179933 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_5aac09ee04604aa192c24595fcb990fc (vhost: /, messages: 0) 2026-04-03 09:03:37.179947 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_5dddd9ade5014ed288688d2b88e7fb64 (vhost: /, messages: 0) 2026-04-03 09:03:37.179971 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_607e056aea8b4fb29914a47378f5e6ed (vhost: /, messages: 0) 2026-04-03 09:03:37.180139 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_7313ec939c5a4892912b6fd7b0d4dec1 (vhost: /, messages: 0) 2026-04-03 09:03:37.180158 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_7645f7f01d354a7c81e865bd44979fd8 (vhost: /, messages: 0) 2026-04-03 09:03:37.180171 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_7732d324ba8e48d8b589cbbdba5e6482 (vhost: /, messages: 0) 2026-04-03 09:03:37.180184 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_84aa1a498ca74d69946afc569d5bbfbd (vhost: /, messages: 0) 2026-04-03 09:03:37.180197 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_9bb4441275e447079d497eb0ff11ca4d (vhost: /, messages: 0) 2026-04-03 09:03:37.180209 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_b3063a6a831b427f8ab9dd39c1134218 (vhost: /, messages: 0) 2026-04-03 09:03:37.180264 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_b6128b75f64244b08b89723456e610d3 (vhost: /, messages: 0) 2026-04-03 09:03:37.180373 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_c4ceb6d8126f467d98c3342424517682 (vhost: /, messages: 0) 2026-04-03 09:03:37.180439 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-reports-plugin_fanout_dc2532595d0d406d8d4bfcec14cd91b8 (vhost: /, messages: 0) 2026-04-03 09:03:37.180553 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions (vhost: /, messages: 0) 2026-04-03 09:03:37.180606 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.180642 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.180750 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.180776 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_00cc38b1ade8478c93f5c2f6c81864a0 (vhost: /, messages: 0) 2026-04-03 09:03:37.180788 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_5a89d1d32368417d9c7189aafcc69a84 (vhost: /, messages: 0) 2026-04-03 09:03:37.180799 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_7ac0c3c9202b4c65a9147cc82d9ee2c5 (vhost: /, messages: 0) 2026-04-03 09:03:37.180819 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_8946a05ee0ec4cc5aa858d22c59ac89d (vhost: /, messages: 0) 2026-04-03 09:03:37.180831 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_8cd597201d9743e9b29f1266e3fb6b24 (vhost: /, messages: 0) 2026-04-03 09:03:37.180843 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_c7cdcea3536a4c619f42b9dfbd03dd3d (vhost: /, messages: 0) 2026-04-03 09:03:37.180903 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_dedb55e602ce492c977d4ff7357a34f0 (vhost: /, messages: 0) 2026-04-03 09:03:37.181114 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_e2d76c7a95e949d98d27f26ac8764ef2 (vhost: /, messages: 0) 2026-04-03 09:03:37.181130 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - q-server-resource-versions_fanout_e78d32fd7a5e4f90acbd994b31460441 (vhost: /, messages: 0) 2026-04-03 09:03:37.181276 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_055b1de3563a4788b4c5910cc6aeccc4 (vhost: /, messages: 0) 2026-04-03 09:03:37.181632 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_1cda3cb0737e46e194ee95d98cd31ca0 (vhost: /, messages: 0) 2026-04-03 09:03:37.181702 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_20ced56fb53946449e64a16495bfc380 (vhost: /, messages: 0) 2026-04-03 09:03:37.181957 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_42be2a4b14804fbba441844549537d40 (vhost: /, messages: 0) 2026-04-03 09:03:37.181978 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_50fedff8e241493e839d3e24ba79d375 (vhost: /, messages: 0) 2026-04-03 09:03:37.181990 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_5e4e301e0b9b49eea98063ad72695046 (vhost: /, messages: 0) 2026-04-03 09:03:37.182010 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_60111b7cc4b54fab8394c32365b339fc (vhost: /, messages: 0) 2026-04-03 09:03:37.182193 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_6b205ec5b97b46408c0879b2fcc0edec (vhost: /, messages: 0) 2026-04-03 09:03:37.182211 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_6c9d2c295cf54023987095b8d6413f67 (vhost: /, messages: 0) 2026-04-03 09:03:37.182224 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_a134d02641044f0c96369ac0ab44715f (vhost: /, messages: 0) 2026-04-03 09:03:37.182236 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_b3c7ed48cc5d46d4b84d853c5aacab86 (vhost: /, messages: 0) 2026-04-03 09:03:37.182256 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_bb4c79afa001435da18770c23c0ab41c (vhost: /, messages: 0) 2026-04-03 09:03:37.182270 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_bbf724cf4b0b4183acb68b4d96d4718f (vhost: /, messages: 0) 2026-04-03 09:03:37.182283 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_bf856eeeeb5b4db6bd63b9cc97f27ead (vhost: /, messages: 0) 2026-04-03 09:03:37.182295 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_c70859fdf69345259bb5bf91e9f43de2 (vhost: /, messages: 0) 2026-04-03 09:03:37.182308 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_ea11d3d73de64ac2865a53b1009eab4f (vhost: /, messages: 0) 2026-04-03 09:03:37.182334 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_ebf4541372dd4c3ca8ceaf735b18ef13 (vhost: /, messages: 0) 2026-04-03 09:03:37.182396 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_eede9de1a1234c7baa35c79982842254 (vhost: /, messages: 0) 2026-04-03 09:03:37.182796 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - reply_facddf1eded649a7b232a7cb83a2aa40 (vhost: /, messages: 0) 2026-04-03 09:03:37.182853 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler (vhost: /, messages: 0) 2026-04-03 09:03:37.182961 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.182975 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.182996 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.183008 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_35d1d10e4cc34432abb9f344c7c5c473 (vhost: /, messages: 0) 2026-04-03 09:03:37.183020 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_84ff2aecc5354b0d853f96fb77c9781d (vhost: /, messages: 0) 2026-04-03 09:03:37.183032 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_a7da395ddedc422896e7b69a0c28816d (vhost: /, messages: 0) 2026-04-03 09:03:37.183043 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_c7d81d44acbc46c49810ad50b40f14b3 (vhost: /, messages: 0) 2026-04-03 09:03:37.183100 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_e357c1c99e364ee58d29858cbabf6fd2 (vhost: /, messages: 0) 2026-04-03 09:03:37.183190 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - scheduler_fanout_f90ea08e0e054b00b0043fe5de03fab8 (vhost: /, messages: 0) 2026-04-03 09:03:37.183202 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker (vhost: /, messages: 0) 2026-04-03 09:03:37.183336 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker.testbed-node-0 (vhost: /, messages: 0) 2026-04-03 09:03:37.183347 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker.testbed-node-1 (vhost: /, messages: 0) 2026-04-03 09:03:37.183354 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker.testbed-node-2 (vhost: /, messages: 0) 2026-04-03 09:03:37.183361 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_06a570ebb88f4be1a8d5f4adc3095d6f (vhost: /, messages: 0) 2026-04-03 09:03:37.183368 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_5294b318ddeb46debe696111bfbfeb2b (vhost: /, messages: 0) 2026-04-03 09:03:37.183382 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_7d7f85b33b8e4e9f8ff995c18afaa8ae (vhost: /, messages: 0) 2026-04-03 09:03:37.183389 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_a18ee502dad84bebb691d28e37a81c37 (vhost: /, messages: 0) 2026-04-03 09:03:37.183395 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_d05e8d0a17a944c2883313c0a4420bae (vhost: /, messages: 0) 2026-04-03 09:03:37.183402 | orchestrator | 2026-04-03 09:03:37 | INFO  |  - worker_fanout_efb1accb575645dea1052036ac658161 (vhost: /, messages: 0) 2026-04-03 09:03:37.453760 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-03 09:03:43.839454 | orchestrator | 2026-04-03 09:03:43 | ERROR  | Unable to get ansible vault password 2026-04-03 09:03:43.839552 | orchestrator | 2026-04-03 09:03:43 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 09:03:43.839568 | orchestrator | 2026-04-03 09:03:43 | ERROR  | Dropping encrypted entries 2026-04-03 09:03:43.873805 | orchestrator | 2026-04-03 09:03:43 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 09:03:43.898148 | orchestrator | 2026-04-03 09:03:43 | INFO  | Found 46 exchange(s) in vhost '/': 2026-04-03 09:03:43.898233 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - aodh (type: topic, transient) 2026-04-03 09:03:43.898244 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - barbican.workers_fanout (type: fanout, transient) 2026-04-03 09:03:43.898256 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - ceilometer (type: topic, transient) 2026-04-03 09:03:43.898266 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - central_fanout (type: fanout, transient) 2026-04-03 09:03:43.898276 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder (type: topic, transient) 2026-04-03 09:03:43.898286 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-backup_fanout (type: fanout, transient) 2026-04-03 09:03:43.898296 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-scheduler_fanout (type: fanout, transient) 2026-04-03 09:03:43.898377 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout (type: fanout, transient) 2026-04-03 09:03:43.898390 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout (type: fanout, transient) 2026-04-03 09:03:43.898411 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout (type: fanout, transient) 2026-04-03 09:03:43.898421 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - cinder-volume_fanout (type: fanout, transient) 2026-04-03 09:03:43.898711 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - compute_fanout (type: fanout, transient) 2026-04-03 09:03:43.898732 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - conductor_fanout (type: fanout, transient) 2026-04-03 09:03:43.898806 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - designate (type: topic, transient) 2026-04-03 09:03:43.898820 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - dns (type: topic, transient) 2026-04-03 09:03:43.898830 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - glance (type: topic, transient) 2026-04-03 09:03:43.898844 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - heat (type: topic, transient) 2026-04-03 09:03:43.898854 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - ironic (type: topic, transient) 2026-04-03 09:03:43.899188 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - keystone (type: topic, transient) 2026-04-03 09:03:43.899270 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - l3_agent_fanout (type: fanout, transient) 2026-04-03 09:03:43.899285 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - magnum (type: topic, transient) 2026-04-03 09:03:43.899297 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - magnum-conductor_fanout (type: fanout, transient) 2026-04-03 09:03:43.899307 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - manila-data_fanout (type: fanout, transient) 2026-04-03 09:03:43.899736 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - manila-scheduler_fanout (type: fanout, transient) 2026-04-03 09:03:43.899754 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - manila-share_fanout (type: fanout, transient) 2026-04-03 09:03:43.899950 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron (type: topic, transient) 2026-04-03 09:03:43.900203 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron-vo-Network-1.1_fanout (type: fanout, transient) 2026-04-03 09:03:43.900222 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron-vo-Port-1.10_fanout (type: fanout, transient) 2026-04-03 09:03:43.900256 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron-vo-SecurityGroup-1.6_fanout (type: fanout, transient) 2026-04-03 09:03:43.900266 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron-vo-SecurityGroupRule-1.3_fanout (type: fanout, transient) 2026-04-03 09:03:43.900276 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - neutron-vo-Subnet-1.2_fanout (type: fanout, transient) 2026-04-03 09:03:43.900286 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - nova (type: topic, transient) 2026-04-03 09:03:43.900539 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - octavia (type: topic, transient) 2026-04-03 09:03:43.900559 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - octavia_provisioning_v2_fanout (type: fanout, transient) 2026-04-03 09:03:43.900677 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - openstack (type: topic, transient) 2026-04-03 09:03:43.900755 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - producer_fanout (type: fanout, transient) 2026-04-03 09:03:43.900771 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - q-agent-notifier-port-update_fanout (type: fanout, transient) 2026-04-03 09:03:43.900987 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - q-agent-notifier-security_group-update_fanout (type: fanout, transient) 2026-04-03 09:03:43.901127 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - q-plugin_fanout (type: fanout, transient) 2026-04-03 09:03:43.901240 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - q-reports-plugin_fanout (type: fanout, transient) 2026-04-03 09:03:43.901396 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - q-server-resource-versions_fanout (type: fanout, transient) 2026-04-03 09:03:43.901488 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - scheduler_fanout (type: fanout, transient) 2026-04-03 09:03:43.901502 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - swift (type: topic, transient) 2026-04-03 09:03:43.901810 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - trove (type: topic, transient) 2026-04-03 09:03:43.901830 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - worker_fanout (type: fanout, transient) 2026-04-03 09:03:43.901962 | orchestrator | 2026-04-03 09:03:43 | INFO  |  - zaqar (type: topic, transient) 2026-04-03 09:03:44.164397 | orchestrator | + osism apply -a upgrade keystone 2026-04-03 09:03:45.521816 | orchestrator | 2026-04-03 09:03:45 | INFO  | Prepare task for execution of keystone. 2026-04-03 09:03:45.591101 | orchestrator | 2026-04-03 09:03:45 | INFO  | Task 4a516547-500d-402c-9999-39d83d5086d9 (keystone) was prepared for execution. 2026-04-03 09:03:45.591192 | orchestrator | 2026-04-03 09:03:45 | INFO  | It takes a moment until task 4a516547-500d-402c-9999-39d83d5086d9 (keystone) has been started and output is visible here. 2026-04-03 09:03:55.298362 | orchestrator | 2026-04-03 09:03:55.298459 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:03:55.298472 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:03:55.298483 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:03:55.298500 | orchestrator | 2026-04-03 09:03:55.298508 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:03:55.298517 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:03:55.298525 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:03:55.298541 | orchestrator | Friday 03 April 2026 09:03:50 +0000 (0:00:01.166) 0:00:01.166 ********** 2026-04-03 09:03:55.298568 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:03:55.298578 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:03:55.298586 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:03:55.298594 | orchestrator | 2026-04-03 09:03:55.298602 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:03:55.298668 | orchestrator | Friday 03 April 2026 09:03:51 +0000 (0:00:00.959) 0:00:02.126 ********** 2026-04-03 09:03:55.298682 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-03 09:03:55.298695 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-03 09:03:55.298708 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-03 09:03:55.298720 | orchestrator | 2026-04-03 09:03:55.298733 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-03 09:03:55.298746 | orchestrator | 2026-04-03 09:03:55.298758 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 09:03:55.298771 | orchestrator | Friday 03 April 2026 09:03:52 +0000 (0:00:00.793) 0:00:02.920 ********** 2026-04-03 09:03:55.298784 | orchestrator | included: /ansible/roles/keystone/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:03:55.298800 | orchestrator | 2026-04-03 09:03:55.298814 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-03 09:03:55.298828 | orchestrator | Friday 03 April 2026 09:03:53 +0000 (0:00:01.076) 0:00:03.997 ********** 2026-04-03 09:03:55.298858 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:03:55.298871 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:03:55.298898 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:03:55.298918 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:03:55.298929 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:03:55.298943 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:03:55.298953 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:03:55.298964 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:03:55.298979 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:02.174738 | orchestrator | 2026-04-03 09:04:02.174842 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-03 09:04:02.174857 | orchestrator | Friday 03 April 2026 09:03:55 +0000 (0:00:02.132) 0:00:06.129 ********** 2026-04-03 09:04:02.174867 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:02.174877 | orchestrator | 2026-04-03 09:04:02.174887 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-03 09:04:02.174896 | orchestrator | Friday 03 April 2026 09:03:55 +0000 (0:00:00.147) 0:00:06.276 ********** 2026-04-03 09:04:02.174904 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:02.174913 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:02.174922 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:02.174931 | orchestrator | 2026-04-03 09:04:02.174940 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-03 09:04:02.174948 | orchestrator | Friday 03 April 2026 09:03:55 +0000 (0:00:00.315) 0:00:06.591 ********** 2026-04-03 09:04:02.174957 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:04:02.174966 | orchestrator | 2026-04-03 09:04:02.174975 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 09:04:02.174983 | orchestrator | Friday 03 April 2026 09:03:57 +0000 (0:00:01.208) 0:00:07.800 ********** 2026-04-03 09:04:02.174994 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:04:02.175003 | orchestrator | 2026-04-03 09:04:02.175011 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-03 09:04:02.175020 | orchestrator | Friday 03 April 2026 09:03:58 +0000 (0:00:01.136) 0:00:08.936 ********** 2026-04-03 09:04:02.175049 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:02.175063 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:02.175090 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175118 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:02.175129 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175143 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175153 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175168 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175179 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:02.175188 | orchestrator | 2026-04-03 09:04:02.175203 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-03 09:04:03.473289 | orchestrator | Friday 03 April 2026 09:04:02 +0000 (0:00:03.955) 0:00:12.892 ********** 2026-04-03 09:04:03.473401 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:03.473443 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:03.473457 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:03.473495 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:03.473510 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:03.473542 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:03.473554 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:03.473566 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:03.473599 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:03.473716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:03.473741 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:03.473752 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:03.473764 | orchestrator | 2026-04-03 09:04:03.473777 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-03 09:04:03.473788 | orchestrator | Friday 03 April 2026 09:04:03 +0000 (0:00:01.002) 0:00:13.894 ********** 2026-04-03 09:04:03.473811 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:05.427901 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:05.427980 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:05.428011 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:05.428029 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:05.428054 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:05.428063 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:05.428072 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:05.428093 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:05.428105 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:05.428114 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:05.428127 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:05.428133 | orchestrator | 2026-04-03 09:04:05.428141 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-03 09:04:05.428148 | orchestrator | Friday 03 April 2026 09:04:04 +0000 (0:00:00.846) 0:00:14.741 ********** 2026-04-03 09:04:05.428155 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:05.428169 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:11.052018 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052161 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052202 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:11.052217 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052230 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052269 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052288 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:11.052311 | orchestrator | 2026-04-03 09:04:11.052324 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-03 09:04:11.052336 | orchestrator | Friday 03 April 2026 09:04:08 +0000 (0:00:04.232) 0:00:18.974 ********** 2026-04-03 09:04:11.052353 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:11.052365 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:11.052377 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:11.052396 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:17.013420 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:17.013550 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:17.013569 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:17.013582 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:17.013594 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:17.013669 | orchestrator | 2026-04-03 09:04:17.013683 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-03 09:04:17.013696 | orchestrator | Friday 03 April 2026 09:04:13 +0000 (0:00:05.377) 0:00:24.351 ********** 2026-04-03 09:04:17.013708 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:04:17.013720 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:04:17.013731 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:04:17.013741 | orchestrator | 2026-04-03 09:04:17.013753 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-03 09:04:17.013772 | orchestrator | Friday 03 April 2026 09:04:15 +0000 (0:00:01.460) 0:00:25.812 ********** 2026-04-03 09:04:17.013783 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:17.013814 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:17.013826 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:17.013837 | orchestrator | 2026-04-03 09:04:17.013848 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-03 09:04:17.013859 | orchestrator | Friday 03 April 2026 09:04:15 +0000 (0:00:00.604) 0:00:26.416 ********** 2026-04-03 09:04:17.013870 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:17.013881 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:17.013893 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:17.013904 | orchestrator | 2026-04-03 09:04:17.013915 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-03 09:04:17.013926 | orchestrator | Friday 03 April 2026 09:04:16 +0000 (0:00:00.367) 0:00:26.784 ********** 2026-04-03 09:04:17.013947 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:17.013968 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:17.013986 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:17.014003 | orchestrator | 2026-04-03 09:04:17.014105 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-03 09:04:17.014138 | orchestrator | Friday 03 April 2026 09:04:16 +0000 (0:00:00.550) 0:00:27.334 ********** 2026-04-03 09:04:17.014191 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:17.014210 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:17.014224 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:17.014238 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:17.014265 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:34.549989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:34.550242 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:34.550262 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:34.550277 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:04:34.550290 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:04:34.550321 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:04:34.550332 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:34.550342 | orchestrator | 2026-04-03 09:04:34.550353 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-03 09:04:34.550364 | orchestrator | Friday 03 April 2026 09:04:17 +0000 (0:00:00.604) 0:00:27.938 ********** 2026-04-03 09:04:34.550374 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:34.550383 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:34.550393 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:34.550402 | orchestrator | 2026-04-03 09:04:34.550412 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-03 09:04:34.550440 | orchestrator | Friday 03 April 2026 09:04:17 +0000 (0:00:00.307) 0:00:28.246 ********** 2026-04-03 09:04:34.550451 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 09:04:34.550461 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 09:04:34.550471 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-03 09:04:34.550480 | orchestrator | 2026-04-03 09:04:34.550492 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-03 09:04:34.550503 | orchestrator | Friday 03 April 2026 09:04:19 +0000 (0:00:01.989) 0:00:30.235 ********** 2026-04-03 09:04:34.550522 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:04:34.550534 | orchestrator | 2026-04-03 09:04:34.550546 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-03 09:04:34.550557 | orchestrator | Friday 03 April 2026 09:04:20 +0000 (0:00:01.000) 0:00:31.236 ********** 2026-04-03 09:04:34.550568 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:04:34.550580 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:04:34.550592 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:04:34.550630 | orchestrator | 2026-04-03 09:04:34.550641 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-03 09:04:34.550653 | orchestrator | Friday 03 April 2026 09:04:21 +0000 (0:00:00.580) 0:00:31.816 ********** 2026-04-03 09:04:34.550664 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:04:34.550675 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:04:34.550686 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:04:34.550697 | orchestrator | 2026-04-03 09:04:34.550708 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-03 09:04:34.550721 | orchestrator | Friday 03 April 2026 09:04:22 +0000 (0:00:01.156) 0:00:32.973 ********** 2026-04-03 09:04:34.550732 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:04:34.550744 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:04:34.550755 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:04:34.550765 | orchestrator | 2026-04-03 09:04:34.550776 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-03 09:04:34.550787 | orchestrator | Friday 03 April 2026 09:04:22 +0000 (0:00:00.301) 0:00:33.275 ********** 2026-04-03 09:04:34.550798 | orchestrator | ok: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 09:04:34.550809 | orchestrator | ok: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 09:04:34.550829 | orchestrator | ok: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-03 09:04:34.550841 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 09:04:34.550853 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 09:04:34.550862 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-03 09:04:34.550872 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 09:04:34.550881 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 09:04:34.550891 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-03 09:04:34.550900 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 09:04:34.550910 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 09:04:34.550919 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-03 09:04:34.550928 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 09:04:34.550938 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 09:04:34.550947 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-03 09:04:34.550956 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:04:34.550966 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:04:34.550975 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:04:34.550985 | orchestrator | ok: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:04:34.550995 | orchestrator | ok: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:04:34.551004 | orchestrator | ok: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:04:34.551013 | orchestrator | 2026-04-03 09:04:34.551023 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-03 09:04:34.551033 | orchestrator | Friday 03 April 2026 09:04:32 +0000 (0:00:09.594) 0:00:42.869 ********** 2026-04-03 09:04:34.551042 | orchestrator | ok: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:04:34.551052 | orchestrator | ok: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:04:34.551061 | orchestrator | ok: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:04:34.551071 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:04:34.551087 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:04:39.068258 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:04:39.068351 | orchestrator | 2026-04-03 09:04:39.068365 | orchestrator | TASK [service-check-containers : keystone | Check containers] ****************** 2026-04-03 09:04:39.068377 | orchestrator | Friday 03 April 2026 09:04:35 +0000 (0:00:02.960) 0:00:45.830 ********** 2026-04-03 09:04:39.068408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:39.068443 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:39.068456 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-03 09:04:39.068482 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068499 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068517 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068528 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068538 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068547 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-03 09:04:39.068557 | orchestrator | 2026-04-03 09:04:39.068568 | orchestrator | TASK [service-check-containers : keystone | Notify handlers to restart containers] *** 2026-04-03 09:04:39.068578 | orchestrator | Friday 03 April 2026 09:04:38 +0000 (0:00:03.130) 0:00:48.960 ********** 2026-04-03 09:04:39.068588 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:04:39.068665 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:04:39.068676 | orchestrator | } 2026-04-03 09:04:39.068686 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:04:39.068696 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:04:39.068705 | orchestrator | } 2026-04-03 09:04:39.068715 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:04:39.068724 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:04:39.068734 | orchestrator | } 2026-04-03 09:04:39.068743 | orchestrator | 2026-04-03 09:04:39.068753 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:04:39.068763 | orchestrator | Friday 03 April 2026 09:04:38 +0000 (0:00:00.537) 0:00:49.497 ********** 2026-04-03 09:04:39.068787 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:06:40.704090 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:06:40.704207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:06:40.704225 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:06:40.704243 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:06:40.704258 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:06:40.704270 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:06:40.704325 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:06:40.704357 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-03 09:06:40.704371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-03 09:06:40.704382 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-03 09:06:40.704393 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:06:40.704404 | orchestrator | 2026-04-03 09:06:40.704417 | orchestrator | TASK [keystone : Enable log_bin_trust_function_creators function] ************** 2026-04-03 09:06:40.704430 | orchestrator | Friday 03 April 2026 09:04:39 +0000 (0:00:01.211) 0:00:50.708 ********** 2026-04-03 09:06:40.704441 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:06:40.704452 | orchestrator | 2026-04-03 09:06:40.704464 | orchestrator | TASK [keystone : Init keystone database upgrade] ******************************* 2026-04-03 09:06:40.704475 | orchestrator | Friday 03 April 2026 09:04:42 +0000 (0:00:02.286) 0:00:52.995 ********** 2026-04-03 09:06:40.704485 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:06:40.704497 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:06:40.704508 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:06:40.704519 | orchestrator | 2026-04-03 09:06:40.704530 | orchestrator | TASK [keystone : Finish keystone database upgrade] ***************************** 2026-04-03 09:06:40.704550 | orchestrator | Friday 03 April 2026 09:04:42 +0000 (0:00:00.460) 0:00:53.455 ********** 2026-04-03 09:06:40.704633 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:06:40.704649 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:06:40.704662 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:06:40.704676 | orchestrator | 2026-04-03 09:06:40.704690 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 09:06:40.704704 | orchestrator | Friday 03 April 2026 09:04:43 +0000 (0:00:00.849) 0:00:54.305 ********** 2026-04-03 09:06:40.704716 | orchestrator | 2026-04-03 09:06:40.704729 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 09:06:40.704741 | orchestrator | Friday 03 April 2026 09:04:43 +0000 (0:00:00.075) 0:00:54.380 ********** 2026-04-03 09:06:40.704754 | orchestrator | 2026-04-03 09:06:40.704767 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-03 09:06:40.704781 | orchestrator | Friday 03 April 2026 09:04:43 +0000 (0:00:00.073) 0:00:54.454 ********** 2026-04-03 09:06:40.704794 | orchestrator | 2026-04-03 09:06:40.704807 | orchestrator | RUNNING HANDLER [keystone : Init keystone database upgrade] ******************** 2026-04-03 09:06:40.704820 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:06:40.704835 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:06:40.704861 | orchestrator | Friday 03 April 2026 09:04:43 +0000 (0:00:00.073) 0:00:54.528 ********** 2026-04-03 09:06:40.704880 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:06:40.704893 | orchestrator | 2026-04-03 09:06:40.704906 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-03 09:06:40.704919 | orchestrator | Friday 03 April 2026 09:05:50 +0000 (0:01:06.498) 0:02:01.027 ********** 2026-04-03 09:06:40.704933 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:06:40.704946 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:06:40.704959 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:06:40.704971 | orchestrator | 2026-04-03 09:06:40.704985 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-03 09:06:40.705007 | orchestrator | Friday 03 April 2026 09:06:40 +0000 (0:00:50.389) 0:02:51.416 ********** 2026-04-03 09:07:20.635996 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:07:20.636094 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:07:20.636106 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:07:20.636115 | orchestrator | 2026-04-03 09:07:20.636124 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-03 09:07:20.636134 | orchestrator | Friday 03 April 2026 09:06:52 +0000 (0:00:11.876) 0:03:03.293 ********** 2026-04-03 09:07:20.636143 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:07:20.636151 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:07:20.636159 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:07:20.636167 | orchestrator | 2026-04-03 09:07:20.636176 | orchestrator | RUNNING HANDLER [keystone : Finish keystone database upgrade] ****************** 2026-04-03 09:07:20.636184 | orchestrator | Friday 03 April 2026 09:07:05 +0000 (0:00:12.747) 0:03:16.040 ********** 2026-04-03 09:07:20.636192 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:07:20.636200 | orchestrator | 2026-04-03 09:07:20.636208 | orchestrator | TASK [keystone : Disable log_bin_trust_function_creators function] ************* 2026-04-03 09:07:20.636216 | orchestrator | Friday 03 April 2026 09:07:17 +0000 (0:00:11.866) 0:03:27.907 ********** 2026-04-03 09:07:20.636223 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:07:20.636231 | orchestrator | 2026-04-03 09:07:20.636239 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:07:20.636248 | orchestrator | testbed-node-0 : ok=25  changed=11  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 09:07:20.636258 | orchestrator | testbed-node-1 : ok=19  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-03 09:07:20.636290 | orchestrator | testbed-node-2 : ok=21  changed=9  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-03 09:07:20.636299 | orchestrator | 2026-04-03 09:07:20.636307 | orchestrator | 2026-04-03 09:07:20.636315 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:07:20.636323 | orchestrator | Friday 03 April 2026 09:07:20 +0000 (0:00:02.993) 0:03:30.901 ********** 2026-04-03 09:07:20.636331 | orchestrator | =============================================================================== 2026-04-03 09:07:20.636339 | orchestrator | keystone : Init keystone database upgrade ------------------------------ 66.50s 2026-04-03 09:07:20.636347 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 50.39s 2026-04-03 09:07:20.636354 | orchestrator | keystone : Restart keystone container ---------------------------------- 12.75s 2026-04-03 09:07:20.636362 | orchestrator | keystone : Restart keystone-fernet container --------------------------- 11.88s 2026-04-03 09:07:20.636370 | orchestrator | keystone : Finish keystone database upgrade ---------------------------- 11.87s 2026-04-03 09:07:20.636378 | orchestrator | keystone : Copying files for keystone-fernet ---------------------------- 9.59s 2026-04-03 09:07:20.636386 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 5.38s 2026-04-03 09:07:20.636393 | orchestrator | keystone : Copying over config.json files for services ------------------ 4.23s 2026-04-03 09:07:20.636401 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.95s 2026-04-03 09:07:20.636409 | orchestrator | service-check-containers : keystone | Check containers ------------------ 3.13s 2026-04-03 09:07:20.636417 | orchestrator | keystone : Disable log_bin_trust_function_creators function ------------- 2.99s 2026-04-03 09:07:20.636425 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.96s 2026-04-03 09:07:20.636433 | orchestrator | keystone : Enable log_bin_trust_function_creators function -------------- 2.29s 2026-04-03 09:07:20.636441 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 2.13s 2026-04-03 09:07:20.636448 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 1.99s 2026-04-03 09:07:20.636456 | orchestrator | keystone : Copying keystone-startup script for keystone ----------------- 1.46s 2026-04-03 09:07:20.636464 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.21s 2026-04-03 09:07:20.636472 | orchestrator | keystone : Check if Keystone domain-specific config is supplied --------- 1.21s 2026-04-03 09:07:20.636480 | orchestrator | keystone : Generate the required cron jobs for the node ----------------- 1.16s 2026-04-03 09:07:20.636488 | orchestrator | keystone : include_tasks ------------------------------------------------ 1.14s 2026-04-03 09:07:20.835994 | orchestrator | + osism apply -a upgrade placement 2026-04-03 09:07:22.146662 | orchestrator | 2026-04-03 09:07:22 | INFO  | Prepare task for execution of placement. 2026-04-03 09:07:22.213749 | orchestrator | 2026-04-03 09:07:22 | INFO  | Task d9b2042c-1985-43f0-8821-cefb37a1f518 (placement) was prepared for execution. 2026-04-03 09:07:22.213843 | orchestrator | 2026-04-03 09:07:22 | INFO  | It takes a moment until task d9b2042c-1985-43f0-8821-cefb37a1f518 (placement) has been started and output is visible here. 2026-04-03 09:08:03.089462 | orchestrator | 2026-04-03 09:08:03.089615 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:08:03.089632 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:08:03.089645 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:08:03.089665 | orchestrator | 2026-04-03 09:08:03.089676 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:08:03.089686 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:08:03.089716 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:08:03.089736 | orchestrator | Friday 03 April 2026 09:07:26 +0000 (0:00:01.127) 0:00:01.127 ********** 2026-04-03 09:08:03.089746 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:08:03.089758 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:08:03.089767 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:08:03.089777 | orchestrator | 2026-04-03 09:08:03.089787 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:08:03.089797 | orchestrator | Friday 03 April 2026 09:07:27 +0000 (0:00:00.899) 0:00:02.027 ********** 2026-04-03 09:08:03.089806 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-03 09:08:03.089816 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-03 09:08:03.089826 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-03 09:08:03.089835 | orchestrator | 2026-04-03 09:08:03.089845 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-03 09:08:03.089855 | orchestrator | 2026-04-03 09:08:03.089864 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 09:08:03.089874 | orchestrator | Friday 03 April 2026 09:07:28 +0000 (0:00:00.746) 0:00:02.773 ********** 2026-04-03 09:08:03.089884 | orchestrator | included: /ansible/roles/placement/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:08:03.089893 | orchestrator | 2026-04-03 09:08:03.089903 | orchestrator | TASK [service-ks-register : placement | Creating/deleting services] ************ 2026-04-03 09:08:03.089913 | orchestrator | Friday 03 April 2026 09:07:29 +0000 (0:00:01.237) 0:00:04.011 ********** 2026-04-03 09:08:03.089922 | orchestrator | ok: [testbed-node-0] => (item=placement (placement)) 2026-04-03 09:08:03.089932 | orchestrator | 2026-04-03 09:08:03.089942 | orchestrator | TASK [service-ks-register : placement | Creating/deleting endpoints] *********** 2026-04-03 09:08:03.089952 | orchestrator | Friday 03 April 2026 09:07:34 +0000 (0:00:04.564) 0:00:08.575 ********** 2026-04-03 09:08:03.089962 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-03 09:08:03.089973 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-03 09:08:03.089982 | orchestrator | 2026-04-03 09:08:03.089995 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-03 09:08:03.090007 | orchestrator | Friday 03 April 2026 09:07:41 +0000 (0:00:07.454) 0:00:16.030 ********** 2026-04-03 09:08:03.090076 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 09:08:03.090089 | orchestrator | 2026-04-03 09:08:03.090102 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-03 09:08:03.090112 | orchestrator | Friday 03 April 2026 09:07:44 +0000 (0:00:03.325) 0:00:19.356 ********** 2026-04-03 09:08:03.090151 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-03 09:08:03.090161 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 09:08:03.090171 | orchestrator | 2026-04-03 09:08:03.090181 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-03 09:08:03.090191 | orchestrator | Friday 03 April 2026 09:07:50 +0000 (0:00:05.569) 0:00:24.926 ********** 2026-04-03 09:08:03.090200 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 09:08:03.090210 | orchestrator | 2026-04-03 09:08:03.090220 | orchestrator | TASK [service-ks-register : placement | Granting/revoking user roles] ********** 2026-04-03 09:08:03.090230 | orchestrator | Friday 03 April 2026 09:07:53 +0000 (0:00:03.404) 0:00:28.330 ********** 2026-04-03 09:08:03.090240 | orchestrator | ok: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-03 09:08:03.090250 | orchestrator | 2026-04-03 09:08:03.090260 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 09:08:03.090269 | orchestrator | Friday 03 April 2026 09:07:58 +0000 (0:00:04.420) 0:00:32.750 ********** 2026-04-03 09:08:03.090287 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:03.090297 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:03.090307 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:03.090317 | orchestrator | 2026-04-03 09:08:03.090327 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-03 09:08:03.090337 | orchestrator | Friday 03 April 2026 09:07:59 +0000 (0:00:00.707) 0:00:33.458 ********** 2026-04-03 09:08:03.090378 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:03.090394 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:03.090406 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:03.090417 | orchestrator | 2026-04-03 09:08:03.090427 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-03 09:08:03.090437 | orchestrator | Friday 03 April 2026 09:08:00 +0000 (0:00:01.301) 0:00:34.759 ********** 2026-04-03 09:08:03.090447 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:03.090463 | orchestrator | 2026-04-03 09:08:03.090473 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-03 09:08:03.090483 | orchestrator | Friday 03 April 2026 09:08:00 +0000 (0:00:00.184) 0:00:34.943 ********** 2026-04-03 09:08:03.090492 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:03.090502 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:03.090512 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:03.090521 | orchestrator | 2026-04-03 09:08:03.090531 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-03 09:08:03.090575 | orchestrator | Friday 03 April 2026 09:08:00 +0000 (0:00:00.303) 0:00:35.247 ********** 2026-04-03 09:08:03.090585 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:08:03.090595 | orchestrator | 2026-04-03 09:08:03.090605 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-03 09:08:03.090615 | orchestrator | Friday 03 April 2026 09:08:01 +0000 (0:00:01.153) 0:00:36.400 ********** 2026-04-03 09:08:03.090637 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:04.705747 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:04.705842 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:04.705884 | orchestrator | 2026-04-03 09:08:04.705900 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-03 09:08:04.705912 | orchestrator | Friday 03 April 2026 09:08:03 +0000 (0:00:01.406) 0:00:37.807 ********** 2026-04-03 09:08:04.705926 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:04.705938 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:04.705984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:04.705997 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:04.706009 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:04.706079 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:04.706091 | orchestrator | 2026-04-03 09:08:04.706103 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-03 09:08:04.706123 | orchestrator | Friday 03 April 2026 09:08:04 +0000 (0:00:00.915) 0:00:38.723 ********** 2026-04-03 09:08:04.706135 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:04.706183 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:04.706201 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:04.706213 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:04.706235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:14.204402 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:14.204523 | orchestrator | 2026-04-03 09:08:14.204618 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-03 09:08:14.204637 | orchestrator | Friday 03 April 2026 09:08:05 +0000 (0:00:00.743) 0:00:39.466 ********** 2026-04-03 09:08:14.204655 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204700 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204730 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204746 | orchestrator | 2026-04-03 09:08:14.204760 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-03 09:08:14.204774 | orchestrator | Friday 03 April 2026 09:08:06 +0000 (0:00:01.456) 0:00:40.923 ********** 2026-04-03 09:08:14.204809 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204831 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204847 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:14.204861 | orchestrator | 2026-04-03 09:08:14.204874 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-03 09:08:14.204887 | orchestrator | Friday 03 April 2026 09:08:09 +0000 (0:00:02.612) 0:00:43.535 ********** 2026-04-03 09:08:14.204906 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-03 09:08:14.204921 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:14.204934 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-03 09:08:14.204946 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:14.204959 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-03 09:08:14.204971 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:14.204984 | orchestrator | 2026-04-03 09:08:14.204997 | orchestrator | TASK [Configure uWSGI for Placement] ******************************************* 2026-04-03 09:08:14.205010 | orchestrator | Friday 03 April 2026 09:08:09 +0000 (0:00:00.516) 0:00:44.051 ********** 2026-04-03 09:08:14.205023 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:08:14.205037 | orchestrator | 2026-04-03 09:08:14.205050 | orchestrator | TASK [service-uwsgi-config : Copying over placement-api uWSGI config] ********** 2026-04-03 09:08:14.205063 | orchestrator | Friday 03 April 2026 09:08:10 +0000 (0:00:01.130) 0:00:45.182 ********** 2026-04-03 09:08:14.205075 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:08:14.205083 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:08:14.205098 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:08:14.205106 | orchestrator | 2026-04-03 09:08:14.205114 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-03 09:08:14.205146 | orchestrator | Friday 03 April 2026 09:08:12 +0000 (0:00:02.109) 0:00:47.292 ********** 2026-04-03 09:08:14.205154 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:08:14.205162 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:08:14.205168 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:08:14.205175 | orchestrator | 2026-04-03 09:08:14.205188 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-03 09:08:17.712096 | orchestrator | Friday 03 April 2026 09:08:14 +0000 (0:00:01.357) 0:00:48.649 ********** 2026-04-03 09:08:17.712204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:17.712226 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:08:17.712240 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:17.712252 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:08:17.712280 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:08:17.712312 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:08:17.712324 | orchestrator | 2026-04-03 09:08:17.712336 | orchestrator | TASK [service-check-containers : placement | Check containers] ***************** 2026-04-03 09:08:17.712347 | orchestrator | Friday 03 April 2026 09:08:15 +0000 (0:00:01.508) 0:00:50.158 ********** 2026-04-03 09:08:17.712377 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:17.712390 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:17.712404 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:08:17.712416 | orchestrator | 2026-04-03 09:08:17.712427 | orchestrator | TASK [service-check-containers : placement | Notify handlers to restart containers] *** 2026-04-03 09:08:17.712444 | orchestrator | Friday 03 April 2026 09:08:17 +0000 (0:00:01.374) 0:00:51.533 ********** 2026-04-03 09:08:17.712456 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:08:17.712467 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:08:17.712478 | orchestrator | } 2026-04-03 09:08:17.712495 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:08:17.712506 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:08:17.712517 | orchestrator | } 2026-04-03 09:08:17.712528 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:08:17.712597 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:08:17.712609 | orchestrator | } 2026-04-03 09:08:17.712619 | orchestrator | 2026-04-03 09:08:17.712633 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:08:17.712647 | orchestrator | Friday 03 April 2026 09:08:17 +0000 (0:00:00.394) 0:00:51.928 ********** 2026-04-03 09:08:17.712670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:09:03.785635 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:03.785789 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:09:03.785822 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:03.785845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:09:03.785868 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:03.785919 | orchestrator | 2026-04-03 09:09:03.785942 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-03 09:09:03.785962 | orchestrator | Friday 03 April 2026 09:08:18 +0000 (0:00:01.310) 0:00:53.238 ********** 2026-04-03 09:09:03.785981 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:03.786001 | orchestrator | 2026-04-03 09:09:03.786100 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-03 09:09:03.786143 | orchestrator | Friday 03 April 2026 09:08:20 +0000 (0:00:02.198) 0:00:55.437 ********** 2026-04-03 09:09:03.786165 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:03.786189 | orchestrator | 2026-04-03 09:09:03.786211 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-03 09:09:03.786231 | orchestrator | Friday 03 April 2026 09:08:23 +0000 (0:00:02.602) 0:00:58.039 ********** 2026-04-03 09:09:03.786252 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:09:03.786271 | orchestrator | 2026-04-03 09:09:03.786293 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 09:09:03.786313 | orchestrator | Friday 03 April 2026 09:08:39 +0000 (0:00:15.833) 0:01:13.873 ********** 2026-04-03 09:09:03.786334 | orchestrator | 2026-04-03 09:09:03.786357 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 09:09:03.786379 | orchestrator | Friday 03 April 2026 09:08:39 +0000 (0:00:00.075) 0:01:13.948 ********** 2026-04-03 09:09:03.786400 | orchestrator | 2026-04-03 09:09:03.786421 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-03 09:09:03.786444 | orchestrator | Friday 03 April 2026 09:08:39 +0000 (0:00:00.073) 0:01:14.022 ********** 2026-04-03 09:09:03.786468 | orchestrator | 2026-04-03 09:09:03.786490 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-03 09:09:03.786512 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:09:03.786568 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:09:03.786610 | orchestrator | Friday 03 April 2026 09:08:39 +0000 (0:00:00.074) 0:01:14.097 ********** 2026-04-03 09:09:03.786632 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:09:03.786654 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:09:03.786675 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:09:03.786696 | orchestrator | 2026-04-03 09:09:03.786716 | orchestrator | TASK [placement : Perform Placement online data migration] ********************* 2026-04-03 09:09:03.786737 | orchestrator | Friday 03 April 2026 09:08:51 +0000 (0:00:11.465) 0:01:25.563 ********** 2026-04-03 09:09:03.786758 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:09:03.786780 | orchestrator | 2026-04-03 09:09:03.786829 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:09:03.786854 | orchestrator | testbed-node-0 : ok=24  changed=9  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-03 09:09:03.786877 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 09:09:03.786898 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 09:09:03.786919 | orchestrator | 2026-04-03 09:09:03.786942 | orchestrator | 2026-04-03 09:09:03.786965 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:09:03.786984 | orchestrator | Friday 03 April 2026 09:09:03 +0000 (0:00:12.377) 0:01:37.940 ********** 2026-04-03 09:09:03.787005 | orchestrator | =============================================================================== 2026-04-03 09:09:03.787026 | orchestrator | placement : Running placement bootstrap container ---------------------- 15.83s 2026-04-03 09:09:03.787047 | orchestrator | placement : Perform Placement online data migration -------------------- 12.38s 2026-04-03 09:09:03.787084 | orchestrator | placement : Restart placement-api container ---------------------------- 11.47s 2026-04-03 09:09:03.787106 | orchestrator | service-ks-register : placement | Creating/deleting endpoints ----------- 7.45s 2026-04-03 09:09:03.787127 | orchestrator | service-ks-register : placement | Creating users ------------------------ 5.57s 2026-04-03 09:09:03.787148 | orchestrator | service-ks-register : placement | Creating/deleting services ------------ 4.56s 2026-04-03 09:09:03.787170 | orchestrator | service-ks-register : placement | Granting/revoking user roles ---------- 4.42s 2026-04-03 09:09:03.787188 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 3.40s 2026-04-03 09:09:03.787209 | orchestrator | service-ks-register : placement | Creating projects --------------------- 3.33s 2026-04-03 09:09:03.787230 | orchestrator | placement : Copying over placement.conf --------------------------------- 2.61s 2026-04-03 09:09:03.787253 | orchestrator | placement : Creating placement databases user and setting permissions --- 2.60s 2026-04-03 09:09:03.787274 | orchestrator | placement : Creating placement databases -------------------------------- 2.20s 2026-04-03 09:09:03.787295 | orchestrator | service-uwsgi-config : Copying over placement-api uWSGI config ---------- 2.11s 2026-04-03 09:09:03.787317 | orchestrator | placement : Copying over existing policy file --------------------------- 1.51s 2026-04-03 09:09:03.787339 | orchestrator | placement : Copying over config.json files for services ----------------- 1.46s 2026-04-03 09:09:03.787361 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 1.41s 2026-04-03 09:09:03.787381 | orchestrator | service-check-containers : placement | Check containers ----------------- 1.37s 2026-04-03 09:09:03.787402 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 1.36s 2026-04-03 09:09:03.787424 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.31s 2026-04-03 09:09:03.787447 | orchestrator | placement : Ensuring config directories exist --------------------------- 1.30s 2026-04-03 09:09:03.985870 | orchestrator | + osism apply -a upgrade neutron 2026-04-03 09:09:05.270462 | orchestrator | 2026-04-03 09:09:05 | INFO  | Prepare task for execution of neutron. 2026-04-03 09:09:05.336889 | orchestrator | 2026-04-03 09:09:05 | INFO  | Task ac89d8ba-b4ae-465c-9a48-9a4df9099317 (neutron) was prepared for execution. 2026-04-03 09:09:05.336983 | orchestrator | 2026-04-03 09:09:05 | INFO  | It takes a moment until task ac89d8ba-b4ae-465c-9a48-9a4df9099317 (neutron) has been started and output is visible here. 2026-04-03 09:09:42.833894 | orchestrator | 2026-04-03 09:09:42.834010 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:09:42.834217 | orchestrator | 2026-04-03 09:09:42.834233 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:09:42.834245 | orchestrator | Friday 03 April 2026 09:09:10 +0000 (0:00:01.505) 0:00:01.505 ********** 2026-04-03 09:09:42.834256 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:42.834268 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:09:42.834279 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:09:42.834290 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:09:42.834301 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:09:42.834312 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:09:42.834323 | orchestrator | 2026-04-03 09:09:42.834334 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:09:42.834345 | orchestrator | Friday 03 April 2026 09:09:12 +0000 (0:00:02.577) 0:00:04.083 ********** 2026-04-03 09:09:42.834356 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-03 09:09:42.834367 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-03 09:09:42.834378 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-03 09:09:42.834389 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-03 09:09:42.834400 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-03 09:09:42.834410 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-03 09:09:42.834445 | orchestrator | 2026-04-03 09:09:42.834460 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-03 09:09:42.834474 | orchestrator | 2026-04-03 09:09:42.834486 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 09:09:42.834500 | orchestrator | Friday 03 April 2026 09:09:14 +0000 (0:00:02.177) 0:00:06.260 ********** 2026-04-03 09:09:42.834548 | orchestrator | included: /ansible/roles/neutron/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:09:42.834577 | orchestrator | 2026-04-03 09:09:42.834598 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-03 09:09:42.834617 | orchestrator | Friday 03 April 2026 09:09:18 +0000 (0:00:03.186) 0:00:09.446 ********** 2026-04-03 09:09:42.834635 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:09:42.834653 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:09:42.834671 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:09:42.834690 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:42.834708 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:09:42.834727 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:09:42.834746 | orchestrator | 2026-04-03 09:09:42.834768 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-03 09:09:42.834788 | orchestrator | Friday 03 April 2026 09:09:21 +0000 (0:00:03.504) 0:00:12.950 ********** 2026-04-03 09:09:42.834807 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:42.834818 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:09:42.834829 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:09:42.834840 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:09:42.834851 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:09:42.834862 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:09:42.834872 | orchestrator | 2026-04-03 09:09:42.834883 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-03 09:09:42.834894 | orchestrator | Friday 03 April 2026 09:09:24 +0000 (0:00:02.680) 0:00:15.631 ********** 2026-04-03 09:09:42.834905 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 09:09:42.834917 | orchestrator |  "changed": false, 2026-04-03 09:09:42.834928 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.834939 | orchestrator | } 2026-04-03 09:09:42.834950 | orchestrator | ok: [testbed-node-1] => { 2026-04-03 09:09:42.834961 | orchestrator |  "changed": false, 2026-04-03 09:09:42.834971 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.834982 | orchestrator | } 2026-04-03 09:09:42.834993 | orchestrator | ok: [testbed-node-2] => { 2026-04-03 09:09:42.835003 | orchestrator |  "changed": false, 2026-04-03 09:09:42.835014 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.835024 | orchestrator | } 2026-04-03 09:09:42.835035 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 09:09:42.835046 | orchestrator |  "changed": false, 2026-04-03 09:09:42.835056 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.835067 | orchestrator | } 2026-04-03 09:09:42.835077 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 09:09:42.835088 | orchestrator |  "changed": false, 2026-04-03 09:09:42.835099 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.835109 | orchestrator | } 2026-04-03 09:09:42.835120 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 09:09:42.835130 | orchestrator |  "changed": false, 2026-04-03 09:09:42.835141 | orchestrator |  "msg": "All assertions passed" 2026-04-03 09:09:42.835152 | orchestrator | } 2026-04-03 09:09:42.835170 | orchestrator | 2026-04-03 09:09:42.835188 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-03 09:09:42.835207 | orchestrator | Friday 03 April 2026 09:09:26 +0000 (0:00:02.065) 0:00:17.696 ********** 2026-04-03 09:09:42.835225 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:42.835244 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:42.835262 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:42.835279 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:09:42.835315 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:09:42.835350 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:09:42.835370 | orchestrator | 2026-04-03 09:09:42.835383 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 09:09:42.835394 | orchestrator | Friday 03 April 2026 09:09:28 +0000 (0:00:02.298) 0:00:19.995 ********** 2026-04-03 09:09:42.835406 | orchestrator | included: /ansible/roles/neutron/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:09:42.835418 | orchestrator | 2026-04-03 09:09:42.835428 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-03 09:09:42.835455 | orchestrator | Friday 03 April 2026 09:09:31 +0000 (0:00:02.572) 0:00:22.567 ********** 2026-04-03 09:09:42.835466 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:42.835477 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:42.835488 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:42.835499 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:09:42.835568 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:09:42.835581 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:09:42.835592 | orchestrator | 2026-04-03 09:09:42.835603 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-03 09:09:42.835614 | orchestrator | Friday 03 April 2026 09:09:34 +0000 (0:00:03.511) 0:00:26.079 ********** 2026-04-03 09:09:42.835628 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:09:42.835648 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:09:42.835668 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:09:42.835687 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:09:42.835705 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:09:42.835722 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:09:42.835742 | orchestrator | 2026-04-03 09:09:42.835762 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-03 09:09:42.835784 | orchestrator | Friday 03 April 2026 09:09:37 +0000 (0:00:02.408) 0:00:28.487 ********** 2026-04-03 09:09:42.835806 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:42.835825 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:42.835836 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:09:42.835847 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:09:42.835858 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:42.835868 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:09:42.835879 | orchestrator | 2026-04-03 09:09:42.835890 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-03 09:09:42.835900 | orchestrator | Friday 03 April 2026 09:09:40 +0000 (0:00:03.695) 0:00:32.182 ********** 2026-04-03 09:09:42.835918 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:42.835935 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:42.835966 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:42.835990 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.616878 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.616993 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.617032 | orchestrator | 2026-04-03 09:09:54.617045 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-03 09:09:54.617057 | orchestrator | Friday 03 April 2026 09:09:44 +0000 (0:00:03.625) 0:00:35.808 ********** 2026-04-03 09:09:54.617068 | orchestrator | [WARNING]: Skipped 2026-04-03 09:09:54.617079 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-03 09:09:54.617091 | orchestrator | due to this access issue: 2026-04-03 09:09:54.617102 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-03 09:09:54.617112 | orchestrator | a directory 2026-04-03 09:09:54.617122 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:09:54.617132 | orchestrator | 2026-04-03 09:09:54.617142 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 09:09:54.617152 | orchestrator | Friday 03 April 2026 09:09:46 +0000 (0:00:02.311) 0:00:38.120 ********** 2026-04-03 09:09:54.617162 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:09:54.617173 | orchestrator | 2026-04-03 09:09:54.617183 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-03 09:09:54.617192 | orchestrator | Friday 03 April 2026 09:09:49 +0000 (0:00:02.788) 0:00:40.908 ********** 2026-04-03 09:09:54.617219 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:54.617253 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:54.617266 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:09:54.617286 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.617297 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.617312 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:09:54.617323 | orchestrator | 2026-04-03 09:09:54.617333 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-03 09:09:54.617343 | orchestrator | Friday 03 April 2026 09:09:53 +0000 (0:00:03.941) 0:00:44.850 ********** 2026-04-03 09:09:54.617362 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054504 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:59.054671 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:09:59.054689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:09:59.054702 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054714 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:59.054742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054754 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:59.054764 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:09:59.054795 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:09:59.054822 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:09:59.054833 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:09:59.054843 | orchestrator | 2026-04-03 09:09:59.054855 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-03 09:09:59.054866 | orchestrator | Friday 03 April 2026 09:09:57 +0000 (0:00:03.762) 0:00:48.613 ********** 2026-04-03 09:09:59.054876 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054887 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:09:59.054902 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054914 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:09:59.054932 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:09:59.054942 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:09:59.054959 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:09.102735 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:09.102834 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:09.102853 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:09.102865 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:09.102876 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:09.102887 | orchestrator | 2026-04-03 09:10:09.102913 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-03 09:10:09.102925 | orchestrator | Friday 03 April 2026 09:10:00 +0000 (0:00:03.464) 0:00:52.078 ********** 2026-04-03 09:10:09.102936 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:09.102947 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:09.102958 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:09.102969 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:09.102980 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:09.102990 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:09.103001 | orchestrator | 2026-04-03 09:10:09.103012 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-03 09:10:09.103023 | orchestrator | Friday 03 April 2026 09:10:04 +0000 (0:00:03.342) 0:00:55.420 ********** 2026-04-03 09:10:09.103034 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:09.103065 | orchestrator | 2026-04-03 09:10:09.103077 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-03 09:10:09.103088 | orchestrator | Friday 03 April 2026 09:10:05 +0000 (0:00:01.213) 0:00:56.634 ********** 2026-04-03 09:10:09.103098 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:09.103109 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:09.103120 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:09.103130 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:09.103141 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:09.103152 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:09.103162 | orchestrator | 2026-04-03 09:10:09.103173 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-03 09:10:09.103184 | orchestrator | Friday 03 April 2026 09:10:07 +0000 (0:00:01.768) 0:00:58.402 ********** 2026-04-03 09:10:09.103198 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:09.103213 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:09.103242 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:09.103254 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:09.103272 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:09.103291 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:09.103302 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:09.103314 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:09.103325 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:09.103336 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:09.103355 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:20.896695 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:20.896791 | orchestrator | 2026-04-03 09:10:20.896808 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-03 09:10:20.896822 | orchestrator | Friday 03 April 2026 09:10:10 +0000 (0:00:03.149) 0:01:01.551 ********** 2026-04-03 09:10:20.896838 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:20.896887 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:20.896902 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:20.896915 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:20.896944 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:20.896962 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:20.896981 | orchestrator | 2026-04-03 09:10:20.896992 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-03 09:10:20.897003 | orchestrator | Friday 03 April 2026 09:10:14 +0000 (0:00:04.097) 0:01:05.649 ********** 2026-04-03 09:10:20.897015 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:20.897027 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:20.897047 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:25.232092 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:25.232223 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:25.232290 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:10:25.232305 | orchestrator | 2026-04-03 09:10:25.232319 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-03 09:10:25.232332 | orchestrator | Friday 03 April 2026 09:10:22 +0000 (0:00:08.399) 0:01:14.049 ********** 2026-04-03 09:10:25.232345 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:25.232358 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:25.232390 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:25.232410 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:25.232428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:10:25.232439 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:25.232451 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:25.232462 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:25.232473 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:25.232485 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:25.232560 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:54.240787 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.240904 | orchestrator | 2026-04-03 09:10:54.240922 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-03 09:10:54.240936 | orchestrator | Friday 03 April 2026 09:10:26 +0000 (0:00:03.731) 0:01:17.781 ********** 2026-04-03 09:10:54.240947 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.240958 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:10:54.240970 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:10:54.240981 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.240992 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241003 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:10:54.241014 | orchestrator | 2026-04-03 09:10:54.241025 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-03 09:10:54.241036 | orchestrator | Friday 03 April 2026 09:10:30 +0000 (0:00:04.439) 0:01:22.220 ********** 2026-04-03 09:10:54.241065 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:54.241080 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241092 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:54.241104 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241115 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:10:54.241127 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241141 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:54.241199 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:54.241215 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:10:54.241228 | orchestrator | 2026-04-03 09:10:54.241239 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-03 09:10:54.241250 | orchestrator | Friday 03 April 2026 09:10:36 +0000 (0:00:05.598) 0:01:27.819 ********** 2026-04-03 09:10:54.241261 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:54.241272 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:54.241282 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:54.241293 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241304 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241316 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241329 | orchestrator | 2026-04-03 09:10:54.241342 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-03 09:10:54.241354 | orchestrator | Friday 03 April 2026 09:10:40 +0000 (0:00:04.202) 0:01:32.021 ********** 2026-04-03 09:10:54.241368 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:54.241380 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:54.241393 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241406 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:54.241419 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241431 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241453 | orchestrator | 2026-04-03 09:10:54.241466 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-03 09:10:54.241480 | orchestrator | Friday 03 April 2026 09:10:44 +0000 (0:00:03.676) 0:01:35.697 ********** 2026-04-03 09:10:54.241492 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:54.241538 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:54.241551 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:54.241564 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241577 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241589 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241602 | orchestrator | 2026-04-03 09:10:54.241615 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-03 09:10:54.241627 | orchestrator | Friday 03 April 2026 09:10:47 +0000 (0:00:03.205) 0:01:38.903 ********** 2026-04-03 09:10:54.241640 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:54.241653 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:54.241665 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:54.241676 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241687 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241698 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241708 | orchestrator | 2026-04-03 09:10:54.241719 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-03 09:10:54.241730 | orchestrator | Friday 03 April 2026 09:10:50 +0000 (0:00:03.239) 0:01:42.143 ********** 2026-04-03 09:10:54.241740 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:10:54.241751 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:10:54.241762 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:10:54.241772 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:10:54.241783 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:10:54.241794 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:10:54.241804 | orchestrator | 2026-04-03 09:10:54.241815 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-03 09:10:54.241834 | orchestrator | Friday 03 April 2026 09:10:54 +0000 (0:00:03.461) 0:01:45.604 ********** 2026-04-03 09:11:03.303880 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.303992 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:03.304011 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.304023 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:03.304034 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.304046 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:03.304057 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.304067 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:03.304078 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.304089 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:03.304100 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-03 09:11:03.304111 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:03.304122 | orchestrator | 2026-04-03 09:11:03.304134 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-03 09:11:03.304162 | orchestrator | Friday 03 April 2026 09:10:57 +0000 (0:00:03.604) 0:01:49.209 ********** 2026-04-03 09:11:03.304180 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:03.304220 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:03.304233 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:03.304245 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:03.304274 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:03.304287 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:03.304300 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:03.304312 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:03.304329 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:03.304350 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:03.304361 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:03.304372 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:03.304383 | orchestrator | 2026-04-03 09:11:03.304394 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-03 09:11:03.304405 | orchestrator | Friday 03 April 2026 09:11:01 +0000 (0:00:03.602) 0:01:52.811 ********** 2026-04-03 09:11:03.304420 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:03.304434 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:03.304457 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:40.902140 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:40.902231 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902239 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902245 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:40.902250 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902254 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:40.902258 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902262 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:40.902266 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902270 | orchestrator | 2026-04-03 09:11:40.902275 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-03 09:11:40.902280 | orchestrator | Friday 03 April 2026 09:11:04 +0000 (0:00:03.476) 0:01:56.287 ********** 2026-04-03 09:11:40.902284 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902288 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902291 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902295 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902302 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902306 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902310 | orchestrator | 2026-04-03 09:11:40.902314 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-03 09:11:40.902328 | orchestrator | Friday 03 April 2026 09:11:08 +0000 (0:00:03.310) 0:01:59.598 ********** 2026-04-03 09:11:40.902332 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902336 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902339 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902343 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:11:40.902347 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:11:40.902354 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:11:40.902358 | orchestrator | 2026-04-03 09:11:40.902362 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-03 09:11:40.902366 | orchestrator | Friday 03 April 2026 09:11:13 +0000 (0:00:05.471) 0:02:05.070 ********** 2026-04-03 09:11:40.902369 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902373 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902377 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902381 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902385 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902389 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902392 | orchestrator | 2026-04-03 09:11:40.902396 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-03 09:11:40.902400 | orchestrator | Friday 03 April 2026 09:11:17 +0000 (0:00:03.552) 0:02:08.623 ********** 2026-04-03 09:11:40.902404 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902408 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902412 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902415 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902419 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902423 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902427 | orchestrator | 2026-04-03 09:11:40.902430 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-03 09:11:40.902434 | orchestrator | Friday 03 April 2026 09:11:20 +0000 (0:00:03.542) 0:02:12.165 ********** 2026-04-03 09:11:40.902438 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902442 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902445 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902449 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902453 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902457 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902460 | orchestrator | 2026-04-03 09:11:40.902464 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-03 09:11:40.902468 | orchestrator | Friday 03 April 2026 09:11:24 +0000 (0:00:03.294) 0:02:15.460 ********** 2026-04-03 09:11:40.902472 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902476 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902479 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902533 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902539 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902543 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902547 | orchestrator | 2026-04-03 09:11:40.902551 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-03 09:11:40.902555 | orchestrator | Friday 03 April 2026 09:11:27 +0000 (0:00:03.600) 0:02:19.061 ********** 2026-04-03 09:11:40.902558 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902562 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902566 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902569 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902573 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902577 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902587 | orchestrator | 2026-04-03 09:11:40.902591 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-03 09:11:40.902605 | orchestrator | Friday 03 April 2026 09:11:31 +0000 (0:00:03.667) 0:02:22.728 ********** 2026-04-03 09:11:40.902609 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902613 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902617 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902621 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902624 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902628 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902632 | orchestrator | 2026-04-03 09:11:40.902636 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-03 09:11:40.902639 | orchestrator | Friday 03 April 2026 09:11:34 +0000 (0:00:03.469) 0:02:26.198 ********** 2026-04-03 09:11:40.902643 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902647 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902651 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902656 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902660 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902665 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902669 | orchestrator | 2026-04-03 09:11:40.902674 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-03 09:11:40.902678 | orchestrator | Friday 03 April 2026 09:11:38 +0000 (0:00:03.541) 0:02:29.740 ********** 2026-04-03 09:11:40.902683 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902687 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:40.902692 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902696 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:40.902701 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902705 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:40.902709 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902714 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:40.902718 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902723 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:40.902727 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-03 09:11:40.902732 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:40.902736 | orchestrator | 2026-04-03 09:11:40.902744 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-03 09:11:48.271706 | orchestrator | Friday 03 April 2026 09:11:41 +0000 (0:00:03.522) 0:02:33.263 ********** 2026-04-03 09:11:48.271835 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:48.271859 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:48.271873 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:48.271908 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:48.271921 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:48.271933 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:48.271945 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:48.271958 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:11:48.271994 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:48.272007 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:48.272019 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:48.272038 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:11:48.272050 | orchestrator | 2026-04-03 09:11:48.272062 | orchestrator | TASK [service-check-containers : neutron | Check containers] ******************* 2026-04-03 09:11:48.272073 | orchestrator | Friday 03 April 2026 09:11:45 +0000 (0:00:03.790) 0:02:37.053 ********** 2026-04-03 09:11:48.272084 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:11:48.272096 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:11:48.272122 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:11:53.517100 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:11:53.517348 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:11:53.517373 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-03 09:11:53.517386 | orchestrator | 2026-04-03 09:11:53.517399 | orchestrator | TASK [service-check-containers : neutron | Notify handlers to restart containers] *** 2026-04-03 09:11:53.517411 | orchestrator | Friday 03 April 2026 09:11:49 +0000 (0:00:04.134) 0:02:41.188 ********** 2026-04-03 09:11:53.517423 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:11:53.517434 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517445 | orchestrator | } 2026-04-03 09:11:53.517456 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:11:53.517467 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517477 | orchestrator | } 2026-04-03 09:11:53.517545 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:11:53.517557 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517568 | orchestrator | } 2026-04-03 09:11:53.517578 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 09:11:53.517589 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517600 | orchestrator | } 2026-04-03 09:11:53.517610 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 09:11:53.517621 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517631 | orchestrator | } 2026-04-03 09:11:53.517642 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 09:11:53.517653 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:11:53.517663 | orchestrator | } 2026-04-03 09:11:53.517674 | orchestrator | 2026-04-03 09:11:53.517685 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:11:53.517696 | orchestrator | Friday 03 April 2026 09:11:51 +0000 (0:00:01.771) 0:02:42.960 ********** 2026-04-03 09:11:53.517753 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:53.517769 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:11:53.517781 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:53.517792 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:11:53.517804 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:11:53.517815 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:11:53.517826 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:11:53.517844 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:11:53.517868 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:14:58.825210 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:14:58.825300 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-03 09:14:58.825312 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:14:58.825319 | orchestrator | 2026-04-03 09:14:58.825326 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 09:14:58.825333 | orchestrator | Friday 03 April 2026 09:11:55 +0000 (0:00:04.013) 0:02:46.973 ********** 2026-04-03 09:14:58.825339 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:14:58.825345 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:14:58.825351 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:14:58.825357 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:14:58.825363 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:14:58.825368 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:14:58.825374 | orchestrator | 2026-04-03 09:14:58.825381 | orchestrator | TASK [neutron : Running Neutron database expand container] ********************* 2026-04-03 09:14:58.825386 | orchestrator | Friday 03 April 2026 09:11:57 +0000 (0:00:01.809) 0:02:48.783 ********** 2026-04-03 09:14:58.825392 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:14:58.825398 | orchestrator | 2026-04-03 09:14:58.825404 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825410 | orchestrator | Friday 03 April 2026 09:12:35 +0000 (0:00:38.194) 0:03:26.977 ********** 2026-04-03 09:14:58.825416 | orchestrator | 2026-04-03 09:14:58.825422 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825428 | orchestrator | Friday 03 April 2026 09:12:36 +0000 (0:00:00.473) 0:03:27.451 ********** 2026-04-03 09:14:58.825433 | orchestrator | 2026-04-03 09:14:58.825439 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825445 | orchestrator | Friday 03 April 2026 09:12:36 +0000 (0:00:00.475) 0:03:27.927 ********** 2026-04-03 09:14:58.825451 | orchestrator | 2026-04-03 09:14:58.825457 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825463 | orchestrator | Friday 03 April 2026 09:12:37 +0000 (0:00:00.636) 0:03:28.563 ********** 2026-04-03 09:14:58.825468 | orchestrator | 2026-04-03 09:14:58.825474 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825480 | orchestrator | Friday 03 April 2026 09:12:37 +0000 (0:00:00.448) 0:03:29.012 ********** 2026-04-03 09:14:58.825502 | orchestrator | 2026-04-03 09:14:58.825508 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825514 | orchestrator | Friday 03 April 2026 09:12:38 +0000 (0:00:00.439) 0:03:29.452 ********** 2026-04-03 09:14:58.825520 | orchestrator | 2026-04-03 09:14:58.825526 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-03 09:14:58.825531 | orchestrator | Friday 03 April 2026 09:12:38 +0000 (0:00:00.789) 0:03:30.241 ********** 2026-04-03 09:14:58.825537 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:14:58.825543 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:14:58.825562 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:14:58.825568 | orchestrator | 2026-04-03 09:14:58.825582 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-03 09:14:58.825621 | orchestrator | Friday 03 April 2026 09:13:21 +0000 (0:00:42.561) 0:04:12.803 ********** 2026-04-03 09:14:58.825628 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:14:58.825633 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:14:58.825639 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:14:58.825645 | orchestrator | 2026-04-03 09:14:58.825651 | orchestrator | TASK [neutron : Checking neutron pending contract scripts] ********************* 2026-04-03 09:14:58.825656 | orchestrator | Friday 03 April 2026 09:14:28 +0000 (0:01:06.935) 0:05:19.738 ********** 2026-04-03 09:14:58.825662 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:14:58.825668 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:14:58.825674 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:14:58.825679 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:14:58.825685 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:14:58.825691 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:14:58.825696 | orchestrator | 2026-04-03 09:14:58.825702 | orchestrator | TASK [neutron : Stopping all neutron-server for contract db] ******************* 2026-04-03 09:14:58.825708 | orchestrator | Friday 03 April 2026 09:14:30 +0000 (0:00:02.103) 0:05:21.842 ********** 2026-04-03 09:14:58.825714 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:14:58.825719 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:14:58.825725 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:14:58.825731 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:14:58.825737 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:14:58.825754 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:14:58.825760 | orchestrator | 2026-04-03 09:14:58.825766 | orchestrator | TASK [neutron : Running Neutron database contract container] ******************* 2026-04-03 09:14:58.825772 | orchestrator | Friday 03 April 2026 09:14:35 +0000 (0:00:05.443) 0:05:27.285 ********** 2026-04-03 09:14:58.825779 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:14:58.825786 | orchestrator | 2026-04-03 09:14:58.825793 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825812 | orchestrator | Friday 03 April 2026 09:14:52 +0000 (0:00:16.987) 0:05:44.273 ********** 2026-04-03 09:14:58.825820 | orchestrator | 2026-04-03 09:14:58.825826 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825833 | orchestrator | Friday 03 April 2026 09:14:53 +0000 (0:00:00.462) 0:05:44.735 ********** 2026-04-03 09:14:58.825840 | orchestrator | 2026-04-03 09:14:58.825847 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825853 | orchestrator | Friday 03 April 2026 09:14:53 +0000 (0:00:00.427) 0:05:45.163 ********** 2026-04-03 09:14:58.825860 | orchestrator | 2026-04-03 09:14:58.825867 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825873 | orchestrator | Friday 03 April 2026 09:14:54 +0000 (0:00:00.468) 0:05:45.631 ********** 2026-04-03 09:14:58.825880 | orchestrator | 2026-04-03 09:14:58.825886 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825893 | orchestrator | Friday 03 April 2026 09:14:54 +0000 (0:00:00.465) 0:05:46.097 ********** 2026-04-03 09:14:58.825899 | orchestrator | 2026-04-03 09:14:58.825906 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-03 09:14:58.825919 | orchestrator | Friday 03 April 2026 09:14:55 +0000 (0:00:00.451) 0:05:46.548 ********** 2026-04-03 09:14:58.825925 | orchestrator | 2026-04-03 09:14:58.825932 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-03 09:14:58.825938 | orchestrator | Friday 03 April 2026 09:14:56 +0000 (0:00:00.832) 0:05:47.381 ********** 2026-04-03 09:14:58.825946 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:14:58.825952 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:14:58.825959 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:14:58.825966 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:14:58.825972 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:14:58.825979 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:14:58.825985 | orchestrator | 2026-04-03 09:14:58.825992 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:14:58.825999 | orchestrator | testbed-node-0 : ok=21  changed=8  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-03 09:14:58.826007 | orchestrator | testbed-node-1 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-03 09:14:58.826013 | orchestrator | testbed-node-2 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-03 09:14:58.826062 | orchestrator | testbed-node-3 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-03 09:14:58.826069 | orchestrator | testbed-node-4 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-03 09:14:58.826076 | orchestrator | testbed-node-5 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-03 09:14:58.826082 | orchestrator | 2026-04-03 09:14:58.826089 | orchestrator | 2026-04-03 09:14:58.826096 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:14:58.826103 | orchestrator | Friday 03 April 2026 09:14:58 +0000 (0:00:02.794) 0:05:50.175 ********** 2026-04-03 09:14:58.826110 | orchestrator | =============================================================================== 2026-04-03 09:14:58.826117 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 66.94s 2026-04-03 09:14:58.826124 | orchestrator | neutron : Restart neutron-server container ----------------------------- 42.56s 2026-04-03 09:14:58.826131 | orchestrator | neutron : Running Neutron database expand container -------------------- 38.19s 2026-04-03 09:14:58.826137 | orchestrator | neutron : Running Neutron database contract container ------------------ 16.99s 2026-04-03 09:14:58.826143 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 8.40s 2026-04-03 09:14:58.826148 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 5.60s 2026-04-03 09:14:58.826154 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 5.47s 2026-04-03 09:14:58.826159 | orchestrator | neutron : Stopping all neutron-server for contract db ------------------- 5.44s 2026-04-03 09:14:58.826165 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 4.44s 2026-04-03 09:14:58.826171 | orchestrator | neutron : Copying over openvswitch_agent.ini ---------------------------- 4.20s 2026-04-03 09:14:58.826176 | orchestrator | service-check-containers : neutron | Check containers ------------------- 4.14s 2026-04-03 09:14:58.826182 | orchestrator | neutron : Copying over config.json files for services ------------------- 4.10s 2026-04-03 09:14:58.826188 | orchestrator | service-check-containers : Include tasks -------------------------------- 4.01s 2026-04-03 09:14:58.826193 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 3.94s 2026-04-03 09:14:58.826202 | orchestrator | neutron : Copying over neutron_taas.conf -------------------------------- 3.79s 2026-04-03 09:14:58.826212 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS certificate --- 3.76s 2026-04-03 09:14:58.826219 | orchestrator | neutron : Copying over neutron_vpnaas.conf ------------------------------ 3.73s 2026-04-03 09:14:58.826225 | orchestrator | Setting sysctl values --------------------------------------------------- 3.70s 2026-04-03 09:14:58.826230 | orchestrator | neutron : Copying over sriov_agent.ini ---------------------------------- 3.68s 2026-04-03 09:14:58.826240 | orchestrator | neutron : Copying over nsx.ini ------------------------------------------ 3.67s 2026-04-03 09:14:59.454946 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 09:14:59.455022 | orchestrator | + osism apply -a reconfigure nova 2026-04-03 09:15:00.773922 | orchestrator | 2026-04-03 09:15:00 | INFO  | Prepare task for execution of nova. 2026-04-03 09:15:00.841357 | orchestrator | 2026-04-03 09:15:00 | INFO  | Task 9eb670fa-7ccb-4909-9be0-21dcb0513ed4 (nova) was prepared for execution. 2026-04-03 09:15:00.841451 | orchestrator | 2026-04-03 09:15:00 | INFO  | It takes a moment until task 9eb670fa-7ccb-4909-9be0-21dcb0513ed4 (nova) has been started and output is visible here. 2026-04-03 09:17:30.834466 | orchestrator | 2026-04-03 09:17:30.834544 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:17:30.834551 | orchestrator | 2026-04-03 09:17:30.834555 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-03 09:17:30.834559 | orchestrator | Friday 03 April 2026 09:15:06 +0000 (0:00:01.842) 0:00:01.842 ********** 2026-04-03 09:17:30.834564 | orchestrator | changed: [testbed-manager] 2026-04-03 09:17:30.834569 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:17:30.834573 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:17:30.834577 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:17:30.834581 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:17:30.834585 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:17:30.834589 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:17:30.834593 | orchestrator | 2026-04-03 09:17:30.834597 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:17:30.834600 | orchestrator | Friday 03 April 2026 09:15:09 +0000 (0:00:03.451) 0:00:05.294 ********** 2026-04-03 09:17:30.834604 | orchestrator | changed: [testbed-manager] 2026-04-03 09:17:30.834608 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:17:30.834612 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:17:30.834615 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:17:30.834619 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:17:30.834623 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:17:30.834627 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:17:30.834630 | orchestrator | 2026-04-03 09:17:30.834634 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:17:30.834638 | orchestrator | Friday 03 April 2026 09:15:11 +0000 (0:00:01.981) 0:00:07.276 ********** 2026-04-03 09:17:30.834642 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-03 09:17:30.834647 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-03 09:17:30.834650 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-03 09:17:30.834654 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-03 09:17:30.834658 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-03 09:17:30.834662 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-03 09:17:30.834666 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-03 09:17:30.834669 | orchestrator | 2026-04-03 09:17:30.834673 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-03 09:17:30.834677 | orchestrator | 2026-04-03 09:17:30.834681 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 09:17:30.834684 | orchestrator | Friday 03 April 2026 09:15:14 +0000 (0:00:02.911) 0:00:10.187 ********** 2026-04-03 09:17:30.834703 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:17:30.834707 | orchestrator | 2026-04-03 09:17:30.834711 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-03 09:17:30.834714 | orchestrator | Friday 03 April 2026 09:15:17 +0000 (0:00:02.995) 0:00:13.183 ********** 2026-04-03 09:17:30.834719 | orchestrator | ok: [testbed-node-0] => (item=nova_cell0) 2026-04-03 09:17:30.834723 | orchestrator | ok: [testbed-node-0] => (item=nova_api) 2026-04-03 09:17:30.834727 | orchestrator | 2026-04-03 09:17:30.834731 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-03 09:17:30.834735 | orchestrator | Friday 03 April 2026 09:15:23 +0000 (0:00:05.518) 0:00:18.701 ********** 2026-04-03 09:17:30.834739 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 09:17:30.834742 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 09:17:30.834746 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834750 | orchestrator | 2026-04-03 09:17:30.834754 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 09:17:30.834758 | orchestrator | Friday 03 April 2026 09:15:28 +0000 (0:00:05.548) 0:00:24.250 ********** 2026-04-03 09:17:30.834761 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834765 | orchestrator | 2026-04-03 09:17:30.834769 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-03 09:17:30.834772 | orchestrator | Friday 03 April 2026 09:15:30 +0000 (0:00:01.676) 0:00:25.926 ********** 2026-04-03 09:17:30.834776 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834780 | orchestrator | 2026-04-03 09:17:30.834783 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-03 09:17:30.834787 | orchestrator | Friday 03 April 2026 09:15:32 +0000 (0:00:02.142) 0:00:28.068 ********** 2026-04-03 09:17:30.834791 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:17:30.834794 | orchestrator | 2026-04-03 09:17:30.834798 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:17:30.834802 | orchestrator | Friday 03 April 2026 09:15:36 +0000 (0:00:03.920) 0:00:31.989 ********** 2026-04-03 09:17:30.834805 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.834819 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.834823 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.834827 | orchestrator | 2026-04-03 09:17:30.834830 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-03 09:17:30.834834 | orchestrator | Friday 03 April 2026 09:15:38 +0000 (0:00:01.721) 0:00:33.710 ********** 2026-04-03 09:17:30.834838 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834841 | orchestrator | 2026-04-03 09:17:30.834845 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-03 09:17:30.834849 | orchestrator | Friday 03 April 2026 09:16:16 +0000 (0:00:38.139) 0:01:11.850 ********** 2026-04-03 09:17:30.834853 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834857 | orchestrator | 2026-04-03 09:17:30.834899 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 09:17:30.834905 | orchestrator | Friday 03 April 2026 09:16:32 +0000 (0:00:16.223) 0:01:28.073 ********** 2026-04-03 09:17:30.834908 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834912 | orchestrator | 2026-04-03 09:17:30.834916 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 09:17:30.834920 | orchestrator | Friday 03 April 2026 09:16:48 +0000 (0:00:16.106) 0:01:44.179 ********** 2026-04-03 09:17:30.834924 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.834927 | orchestrator | 2026-04-03 09:17:30.834940 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-03 09:17:30.834944 | orchestrator | Friday 03 April 2026 09:16:50 +0000 (0:00:02.083) 0:01:46.263 ********** 2026-04-03 09:17:30.834948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.834952 | orchestrator | 2026-04-03 09:17:30.834955 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:17:30.834959 | orchestrator | Friday 03 April 2026 09:16:52 +0000 (0:00:01.698) 0:01:47.962 ********** 2026-04-03 09:17:30.834967 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.834971 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.834975 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.834978 | orchestrator | 2026-04-03 09:17:30.834982 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 09:17:30.834986 | orchestrator | Friday 03 April 2026 09:16:53 +0000 (0:00:01.432) 0:01:49.394 ********** 2026-04-03 09:17:30.834989 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.834993 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.834997 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835001 | orchestrator | 2026-04-03 09:17:30.835004 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-03 09:17:30.835008 | orchestrator | 2026-04-03 09:17:30.835012 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 09:17:30.835016 | orchestrator | Friday 03 April 2026 09:16:55 +0000 (0:00:01.725) 0:01:51.119 ********** 2026-04-03 09:17:30.835019 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:17:30.835023 | orchestrator | 2026-04-03 09:17:30.835027 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-03 09:17:30.835030 | orchestrator | Friday 03 April 2026 09:16:57 +0000 (0:00:01.823) 0:01:52.942 ********** 2026-04-03 09:17:30.835035 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835040 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835044 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.835048 | orchestrator | 2026-04-03 09:17:30.835053 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-03 09:17:30.835057 | orchestrator | Friday 03 April 2026 09:17:00 +0000 (0:00:03.172) 0:01:56.115 ********** 2026-04-03 09:17:30.835062 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835066 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835070 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.835075 | orchestrator | 2026-04-03 09:17:30.835079 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-03 09:17:30.835084 | orchestrator | Friday 03 April 2026 09:17:04 +0000 (0:00:03.647) 0:01:59.762 ********** 2026-04-03 09:17:30.835088 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-03 09:17:30.835092 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835097 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-03 09:17:30.835101 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835106 | orchestrator | ok: [testbed-node-0] => (item=openstack) 2026-04-03 09:17:30.835110 | orchestrator | 2026-04-03 09:17:30.835114 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-03 09:17:30.835119 | orchestrator | Friday 03 April 2026 09:17:09 +0000 (0:00:05.295) 0:02:05.057 ********** 2026-04-03 09:17:30.835123 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 09:17:30.835127 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835132 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 09:17:30.835136 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835140 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-03 09:17:30.835144 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-03 09:17:30.835149 | orchestrator | 2026-04-03 09:17:30.835153 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-03 09:17:30.835158 | orchestrator | Friday 03 April 2026 09:17:23 +0000 (0:00:14.214) 0:02:19.272 ********** 2026-04-03 09:17:30.835162 | orchestrator | skipping: [testbed-node-0] => (item=openstack)  2026-04-03 09:17:30.835166 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.835171 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-03 09:17:30.835175 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835179 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-03 09:17:30.835190 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835194 | orchestrator | 2026-04-03 09:17:30.835198 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-03 09:17:30.835203 | orchestrator | Friday 03 April 2026 09:17:25 +0000 (0:00:01.604) 0:02:20.877 ********** 2026-04-03 09:17:30.835207 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-03 09:17:30.835212 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:17:30.835219 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-03 09:17:30.835224 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835228 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-03 09:17:30.835232 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835236 | orchestrator | 2026-04-03 09:17:30.835241 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 09:17:30.835245 | orchestrator | Friday 03 April 2026 09:17:27 +0000 (0:00:01.824) 0:02:22.701 ********** 2026-04-03 09:17:30.835250 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835254 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.835258 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835263 | orchestrator | 2026-04-03 09:17:30.835267 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-03 09:17:30.835272 | orchestrator | Friday 03 April 2026 09:17:28 +0000 (0:00:01.606) 0:02:24.308 ********** 2026-04-03 09:17:30.835276 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:17:30.835281 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:17:30.835285 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:17:30.835290 | orchestrator | 2026-04-03 09:17:30.835294 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-03 09:17:30.835298 | orchestrator | Friday 03 April 2026 09:17:30 +0000 (0:00:01.989) 0:02:26.297 ********** 2026-04-03 09:17:30.835307 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020178 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020293 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:19:02.020309 | orchestrator | 2026-04-03 09:19:02.020322 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-03 09:19:02.020334 | orchestrator | Friday 03 April 2026 09:17:34 +0000 (0:00:03.682) 0:02:29.980 ********** 2026-04-03 09:19:02.020346 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020357 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020367 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:19:02.020379 | orchestrator | 2026-04-03 09:19:02.020390 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 09:19:02.020402 | orchestrator | Friday 03 April 2026 09:17:47 +0000 (0:00:13.646) 0:02:43.627 ********** 2026-04-03 09:19:02.020413 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020423 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020434 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:19:02.020445 | orchestrator | 2026-04-03 09:19:02.020456 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 09:19:02.020467 | orchestrator | Friday 03 April 2026 09:18:01 +0000 (0:00:13.911) 0:02:57.538 ********** 2026-04-03 09:19:02.020478 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:19:02.020489 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020501 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020511 | orchestrator | 2026-04-03 09:19:02.020522 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-03 09:19:02.020533 | orchestrator | Friday 03 April 2026 09:18:04 +0000 (0:00:02.303) 0:02:59.842 ********** 2026-04-03 09:19:02.020544 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:02.020555 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020566 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020577 | orchestrator | 2026-04-03 09:19:02.020588 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-03 09:19:02.020599 | orchestrator | Friday 03 April 2026 09:18:06 +0000 (0:00:02.037) 0:03:01.880 ********** 2026-04-03 09:19:02.020634 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020646 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020657 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:19:02.020668 | orchestrator | 2026-04-03 09:19:02.020679 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 09:19:02.020690 | orchestrator | Friday 03 April 2026 09:18:20 +0000 (0:00:14.321) 0:03:16.201 ********** 2026-04-03 09:19:02.020701 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:02.020714 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:02.020726 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:02.020740 | orchestrator | 2026-04-03 09:19:02.020754 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-03 09:19:02.020768 | orchestrator | 2026-04-03 09:19:02.020781 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:19:02.020795 | orchestrator | Friday 03 April 2026 09:18:22 +0000 (0:00:01.997) 0:03:18.199 ********** 2026-04-03 09:19:02.020808 | orchestrator | included: /ansible/roles/nova/tasks/reconfigure.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:19:02.020821 | orchestrator | 2026-04-03 09:19:02.020834 | orchestrator | TASK [service-ks-register : nova | Creating/deleting services] ***************** 2026-04-03 09:19:02.020848 | orchestrator | Friday 03 April 2026 09:18:24 +0000 (0:00:01.952) 0:03:20.151 ********** 2026-04-03 09:19:02.020860 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-03 09:19:02.020873 | orchestrator | ok: [testbed-node-0] => (item=nova (compute)) 2026-04-03 09:19:02.020886 | orchestrator | 2026-04-03 09:19:02.020899 | orchestrator | TASK [service-ks-register : nova | Creating/deleting endpoints] **************** 2026-04-03 09:19:02.020912 | orchestrator | Friday 03 April 2026 09:18:29 +0000 (0:00:04.551) 0:03:24.703 ********** 2026-04-03 09:19:02.020924 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-03 09:19:02.020938 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-03 09:19:02.020952 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-03 09:19:02.020966 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-03 09:19:02.020979 | orchestrator | 2026-04-03 09:19:02.021024 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-03 09:19:02.021039 | orchestrator | Friday 03 April 2026 09:18:36 +0000 (0:00:07.767) 0:03:32.470 ********** 2026-04-03 09:19:02.021068 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-03 09:19:02.021079 | orchestrator | 2026-04-03 09:19:02.021090 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-03 09:19:02.021101 | orchestrator | Friday 03 April 2026 09:18:41 +0000 (0:00:04.424) 0:03:36.895 ********** 2026-04-03 09:19:02.021112 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-03 09:19:02.021123 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-03 09:19:02.021134 | orchestrator | 2026-04-03 09:19:02.021145 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-03 09:19:02.021156 | orchestrator | Friday 03 April 2026 09:18:47 +0000 (0:00:05.908) 0:03:42.804 ********** 2026-04-03 09:19:02.021166 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-03 09:19:02.021177 | orchestrator | 2026-04-03 09:19:02.021188 | orchestrator | TASK [service-ks-register : nova | Granting/revoking user roles] *************** 2026-04-03 09:19:02.021199 | orchestrator | Friday 03 April 2026 09:18:51 +0000 (0:00:04.533) 0:03:47.337 ********** 2026-04-03 09:19:02.021210 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-03 09:19:02.021221 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> service) 2026-04-03 09:19:02.021232 | orchestrator | 2026-04-03 09:19:02.021267 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 09:19:02.021279 | orchestrator | Friday 03 April 2026 09:19:00 +0000 (0:00:08.685) 0:03:56.023 ********** 2026-04-03 09:19:02.021295 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:02.021311 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:02.021330 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:02.021352 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:13.382782 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:13.382904 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:13.382922 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:13.382953 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:13.382966 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:13.383001 | orchestrator | 2026-04-03 09:19:13.383079 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-03 09:19:13.383093 | orchestrator | Friday 03 April 2026 09:19:03 +0000 (0:00:03.504) 0:03:59.528 ********** 2026-04-03 09:19:13.383121 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:13.383135 | orchestrator | 2026-04-03 09:19:13.383147 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-03 09:19:13.383158 | orchestrator | Friday 03 April 2026 09:19:04 +0000 (0:00:01.133) 0:04:00.662 ********** 2026-04-03 09:19:13.383169 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:13.383179 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:13.383190 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:13.383201 | orchestrator | 2026-04-03 09:19:13.383212 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-03 09:19:13.383223 | orchestrator | Friday 03 April 2026 09:19:06 +0000 (0:00:01.448) 0:04:02.110 ********** 2026-04-03 09:19:13.383233 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:19:13.383244 | orchestrator | 2026-04-03 09:19:13.383255 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-03 09:19:13.383266 | orchestrator | Friday 03 April 2026 09:19:08 +0000 (0:00:02.174) 0:04:04.284 ********** 2026-04-03 09:19:13.383276 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:13.383290 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:13.383302 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:13.383315 | orchestrator | 2026-04-03 09:19:13.383328 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:19:13.383354 | orchestrator | Friday 03 April 2026 09:19:09 +0000 (0:00:01.388) 0:04:05.673 ********** 2026-04-03 09:19:13.383378 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:19:13.383392 | orchestrator | 2026-04-03 09:19:13.383405 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 09:19:13.383418 | orchestrator | Friday 03 April 2026 09:19:11 +0000 (0:00:01.952) 0:04:07.626 ********** 2026-04-03 09:19:13.383434 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:13.383456 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:13.383491 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:17.102658 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:17.102792 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:17.102879 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:17.102910 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:17.102955 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:17.102975 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:17.102995 | orchestrator | 2026-04-03 09:19:17.103047 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 09:19:17.103068 | orchestrator | Friday 03 April 2026 09:19:16 +0000 (0:00:04.329) 0:04:11.955 ********** 2026-04-03 09:19:17.103091 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:17.103127 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:17.103141 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:17.103154 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:17.103182 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.114766 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.114887 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:19.114923 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:19.114941 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.114955 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.114988 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:19.115002 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:19.115085 | orchestrator | 2026-04-03 09:19:19.115101 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 09:19:19.115115 | orchestrator | Friday 03 April 2026 09:19:18 +0000 (0:00:02.133) 0:04:14.088 ********** 2026-04-03 09:19:19.115138 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.115160 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:19.115176 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:19.115189 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:19.115211 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:22.597942 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:22.598251 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:22.598280 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:22.598296 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:22.598310 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:22.598345 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:22.598373 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:22.598384 | orchestrator | 2026-04-03 09:19:22.598397 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-03 09:19:22.598409 | orchestrator | Friday 03 April 2026 09:19:20 +0000 (0:00:01.828) 0:04:15.917 ********** 2026-04-03 09:19:22.598426 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:22.598443 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:22.598457 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:22.598488 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977225 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977415 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977454 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:30.977497 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:30.977549 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:30.977562 | orchestrator | 2026-04-03 09:19:30.977594 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-03 09:19:30.977655 | orchestrator | Friday 03 April 2026 09:19:24 +0000 (0:00:04.700) 0:04:20.617 ********** 2026-04-03 09:19:30.977688 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977730 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977754 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:30.977840 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:35.514143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:35.514256 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:35.514274 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:35.514312 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:35.514325 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:35.514336 | orchestrator | 2026-04-03 09:19:35.514349 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-03 09:19:35.514380 | orchestrator | Friday 03 April 2026 09:19:34 +0000 (0:00:09.954) 0:04:30.572 ********** 2026-04-03 09:19:35.514400 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:35.514413 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:35.514435 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:35.514447 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:35.514459 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:35.514486 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:53.674770 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:53.674878 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:53.674897 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:53.674933 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:53.674946 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:19:53.674956 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:53.674966 | orchestrator | 2026-04-03 09:19:53.674991 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-03 09:19:53.675003 | orchestrator | Friday 03 April 2026 09:19:36 +0000 (0:00:01.916) 0:04:32.489 ********** 2026-04-03 09:19:53.675012 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:53.675022 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:53.675032 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:53.675041 | orchestrator | 2026-04-03 09:19:53.675051 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-03 09:19:53.675109 | orchestrator | Friday 03 April 2026 09:19:38 +0000 (0:00:01.713) 0:04:34.202 ********** 2026-04-03 09:19:53.675119 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:53.675128 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:53.675138 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:53.675147 | orchestrator | 2026-04-03 09:19:53.675157 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-03 09:19:53.675182 | orchestrator | Friday 03 April 2026 09:19:40 +0000 (0:00:02.196) 0:04:36.399 ********** 2026-04-03 09:19:53.675193 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-03 09:19:53.675203 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-03 09:19:53.675213 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:19:53.675222 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-03 09:19:53.675232 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-03 09:19:53.675250 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:19:53.675259 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-03 09:19:53.675269 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-03 09:19:53.675278 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:19:53.675287 | orchestrator | 2026-04-03 09:19:53.675299 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-03 09:19:53.675311 | orchestrator | Friday 03 April 2026 09:19:42 +0000 (0:00:01.661) 0:04:38.061 ********** 2026-04-03 09:19:53.675322 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-03 09:19:53.675336 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-03 09:19:53.675348 | orchestrator | 2026-04-03 09:19:53.675360 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-03 09:19:53.675371 | orchestrator | Friday 03 April 2026 09:19:44 +0000 (0:00:02.579) 0:04:40.641 ********** 2026-04-03 09:19:53.675383 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:19:53.675393 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:19:53.675405 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:19:53.675416 | orchestrator | 2026-04-03 09:19:53.675427 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-03 09:19:53.675438 | orchestrator | Friday 03 April 2026 09:19:48 +0000 (0:00:03.522) 0:04:44.163 ********** 2026-04-03 09:19:53.675449 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:19:53.675460 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:19:53.675471 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:19:53.675482 | orchestrator | 2026-04-03 09:19:53.675493 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-03 09:19:53.675504 | orchestrator | Friday 03 April 2026 09:19:51 +0000 (0:00:03.488) 0:04:47.652 ********** 2026-04-03 09:19:53.675517 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:53.675536 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:53.675564 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:58.237335 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:58.237429 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:58.237457 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:19:58.237486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:58.237510 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:58.237517 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:19:58.237523 | orchestrator | 2026-04-03 09:19:58.237532 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-03 09:19:58.237540 | orchestrator | Friday 03 April 2026 09:19:56 +0000 (0:00:04.339) 0:04:51.991 ********** 2026-04-03 09:19:58.237547 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:19:58.237555 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:19:58.237561 | orchestrator | } 2026-04-03 09:19:58.237568 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:19:58.237574 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:19:58.237580 | orchestrator | } 2026-04-03 09:19:58.237586 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:19:58.237592 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:19:58.237598 | orchestrator | } 2026-04-03 09:19:58.237604 | orchestrator | 2026-04-03 09:19:58.237610 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:19:58.237615 | orchestrator | Friday 03 April 2026 09:19:57 +0000 (0:00:01.446) 0:04:53.438 ********** 2026-04-03 09:19:58.237628 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:58.237643 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:19:58.237659 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:21:41.251641 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:21:41.251738 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:21:41.251748 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:21:41.251777 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:21:41.251783 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:21:41.251787 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:21:41.251803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:21:41.251807 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:21:41.251812 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:21:41.251816 | orchestrator | 2026-04-03 09:21:41.251821 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:21:41.251831 | orchestrator | Friday 03 April 2026 09:19:59 +0000 (0:00:02.137) 0:04:55.576 ********** 2026-04-03 09:21:41.251834 | orchestrator | 2026-04-03 09:21:41.251839 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:21:41.251842 | orchestrator | Friday 03 April 2026 09:20:00 +0000 (0:00:00.711) 0:04:56.288 ********** 2026-04-03 09:21:41.251846 | orchestrator | 2026-04-03 09:21:41.251850 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:21:41.251853 | orchestrator | Friday 03 April 2026 09:20:01 +0000 (0:00:00.497) 0:04:56.785 ********** 2026-04-03 09:21:41.251857 | orchestrator | 2026-04-03 09:21:41.251861 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-03 09:21:41.251865 | orchestrator | Friday 03 April 2026 09:20:01 +0000 (0:00:00.837) 0:04:57.623 ********** 2026-04-03 09:21:41.251869 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:21:41.251872 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:21:41.251876 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:21:41.251880 | orchestrator | 2026-04-03 09:21:41.251884 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-03 09:21:41.251890 | orchestrator | Friday 03 April 2026 09:20:34 +0000 (0:00:32.384) 0:05:30.008 ********** 2026-04-03 09:21:41.251894 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:21:41.251898 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:21:41.251901 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:21:41.251905 | orchestrator | 2026-04-03 09:21:41.251909 | orchestrator | RUNNING HANDLER [nova : Restart nova-metadata container] *********************** 2026-04-03 09:21:41.251913 | orchestrator | Friday 03 April 2026 09:20:48 +0000 (0:00:14.007) 0:05:44.015 ********** 2026-04-03 09:21:41.251917 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:21:41.251920 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:21:41.251924 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:21:41.251928 | orchestrator | 2026-04-03 09:21:41.251931 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-03 09:21:41.251935 | orchestrator | 2026-04-03 09:21:41.251939 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:21:41.251943 | orchestrator | Friday 03 April 2026 09:20:59 +0000 (0:00:11.203) 0:05:55.218 ********** 2026-04-03 09:21:41.251947 | orchestrator | included: /ansible/roles/nova-cell/tasks/reconfigure.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:21:41.251951 | orchestrator | 2026-04-03 09:21:41.251955 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:21:41.251959 | orchestrator | Friday 03 April 2026 09:21:02 +0000 (0:00:02.558) 0:05:57.777 ********** 2026-04-03 09:21:41.251963 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:21:41.251967 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:21:41.251970 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:21:41.251974 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:21:41.251978 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:21:41.251981 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:21:41.251985 | orchestrator | 2026-04-03 09:21:41.251989 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-03 09:21:41.251992 | orchestrator | Friday 03 April 2026 09:21:04 +0000 (0:00:02.363) 0:06:00.140 ********** 2026-04-03 09:21:41.251996 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:21:41.252000 | orchestrator | 2026-04-03 09:21:41.252004 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-03 09:21:41.252007 | orchestrator | Friday 03 April 2026 09:21:39 +0000 (0:00:35.243) 0:06:35.384 ********** 2026-04-03 09:21:41.252011 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:21:41.252016 | orchestrator | 2026-04-03 09:21:41.252022 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-03 09:22:33.480139 | orchestrator | Friday 03 April 2026 09:21:42 +0000 (0:00:02.531) 0:06:37.916 ********** 2026-04-03 09:22:33.480470 | orchestrator | included: service-image-info for testbed-node-3 2026-04-03 09:22:33.480503 | orchestrator | 2026-04-03 09:22:33.480518 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-03 09:22:33.480530 | orchestrator | Friday 03 April 2026 09:21:44 +0000 (0:00:02.031) 0:06:39.947 ********** 2026-04-03 09:22:33.480541 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.480552 | orchestrator | 2026-04-03 09:22:33.480564 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-03 09:22:33.480575 | orchestrator | Friday 03 April 2026 09:21:48 +0000 (0:00:04.338) 0:06:44.286 ********** 2026-04-03 09:22:33.480586 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.480597 | orchestrator | 2026-04-03 09:22:33.480607 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-03 09:22:33.480618 | orchestrator | Friday 03 April 2026 09:21:51 +0000 (0:00:03.034) 0:06:47.320 ********** 2026-04-03 09:22:33.480629 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:22:33.480642 | orchestrator | 2026-04-03 09:22:33.480655 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-03 09:22:33.480668 | orchestrator | Friday 03 April 2026 09:21:54 +0000 (0:00:03.128) 0:06:50.449 ********** 2026-04-03 09:22:33.480680 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:22:33.480693 | orchestrator | 2026-04-03 09:22:33.480705 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-03 09:22:33.480719 | orchestrator | Friday 03 April 2026 09:21:58 +0000 (0:00:03.313) 0:06:53.762 ********** 2026-04-03 09:22:33.480732 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.480745 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.480757 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.480770 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.480783 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:22:33.480796 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:22:33.480809 | orchestrator | 2026-04-03 09:22:33.480822 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-03 09:22:33.480834 | orchestrator | Friday 03 April 2026 09:22:03 +0000 (0:00:05.519) 0:06:59.282 ********** 2026-04-03 09:22:33.480846 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.480859 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.480872 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.480884 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:22:33.480897 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.480909 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:22:33.480921 | orchestrator | 2026-04-03 09:22:33.480934 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-03 09:22:33.480945 | orchestrator | Friday 03 April 2026 09:22:09 +0000 (0:00:05.909) 0:07:05.191 ********** 2026-04-03 09:22:33.480956 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.480967 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.480977 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.480988 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 09:22:33.480999 | orchestrator |  "changed": false, 2026-04-03 09:22:33.481010 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-03 09:22:33.481022 | orchestrator | } 2026-04-03 09:22:33.481033 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 09:22:33.481044 | orchestrator |  "changed": false, 2026-04-03 09:22:33.481055 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-03 09:22:33.481065 | orchestrator | } 2026-04-03 09:22:33.481076 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 09:22:33.481104 | orchestrator |  "changed": false, 2026-04-03 09:22:33.481116 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-03 09:22:33.481126 | orchestrator | } 2026-04-03 09:22:33.481137 | orchestrator | 2026-04-03 09:22:33.481149 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-03 09:22:33.481168 | orchestrator | Friday 03 April 2026 09:22:17 +0000 (0:00:07.606) 0:07:12.798 ********** 2026-04-03 09:22:33.481179 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.481190 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.481200 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.481211 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:22:33.481251 | orchestrator | 2026-04-03 09:22:33.481263 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 09:22:33.481273 | orchestrator | Friday 03 April 2026 09:22:19 +0000 (0:00:02.387) 0:07:15.186 ********** 2026-04-03 09:22:33.481284 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-03 09:22:33.481295 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-03 09:22:33.481305 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-03 09:22:33.481316 | orchestrator | 2026-04-03 09:22:33.481327 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 09:22:33.481337 | orchestrator | Friday 03 April 2026 09:22:21 +0000 (0:00:01.666) 0:07:16.852 ********** 2026-04-03 09:22:33.481348 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-03 09:22:33.481359 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-03 09:22:33.481370 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-03 09:22:33.481380 | orchestrator | 2026-04-03 09:22:33.481391 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 09:22:33.481402 | orchestrator | Friday 03 April 2026 09:22:23 +0000 (0:00:02.429) 0:07:19.282 ********** 2026-04-03 09:22:33.481412 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-03 09:22:33.481423 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:22:33.481434 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-03 09:22:33.481444 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:22:33.481455 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-03 09:22:33.481465 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:22:33.481476 | orchestrator | 2026-04-03 09:22:33.481487 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-03 09:22:33.481521 | orchestrator | Friday 03 April 2026 09:22:24 +0000 (0:00:01.375) 0:07:20.657 ********** 2026-04-03 09:22:33.481532 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:22:33.481543 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:22:33.481554 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:22:33.481565 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:22:33.481575 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:22:33.481586 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.481597 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:22:33.481607 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:22:33.481618 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.481629 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:22:33.481639 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:22:33.481650 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:22:33.481661 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:22:33.481671 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.481682 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:22:33.481693 | orchestrator | 2026-04-03 09:22:33.481704 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-03 09:22:33.481722 | orchestrator | Friday 03 April 2026 09:22:27 +0000 (0:00:02.375) 0:07:23.033 ********** 2026-04-03 09:22:33.481732 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.481743 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.481753 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.481764 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.481775 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:22:33.481785 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:22:33.481796 | orchestrator | 2026-04-03 09:22:33.481807 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-03 09:22:33.481817 | orchestrator | Friday 03 April 2026 09:22:29 +0000 (0:00:02.133) 0:07:25.166 ********** 2026-04-03 09:22:33.481828 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:33.481839 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:33.481849 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:33.481860 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:22:33.481870 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:22:33.481881 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:22:33.481892 | orchestrator | 2026-04-03 09:22:33.481902 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 09:22:33.481913 | orchestrator | Friday 03 April 2026 09:22:32 +0000 (0:00:02.668) 0:07:27.834 ********** 2026-04-03 09:22:33.481933 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:33.481950 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:33.481972 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104758 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104839 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104863 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104881 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104888 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104896 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104917 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104940 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104951 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104957 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104964 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104970 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:37.104982 | orchestrator | 2026-04-03 09:22:37.104990 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:22:37.104998 | orchestrator | Friday 03 April 2026 09:22:35 +0000 (0:00:03.591) 0:07:31.425 ********** 2026-04-03 09:22:37.105010 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:22:41.139044 | orchestrator | 2026-04-03 09:22:41.139132 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 09:22:41.139143 | orchestrator | Friday 03 April 2026 09:22:37 +0000 (0:00:02.211) 0:07:33.637 ********** 2026-04-03 09:22:41.139154 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139178 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139186 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139195 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139302 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139312 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139319 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139331 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139338 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139345 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139352 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:41.139371 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:44.514371 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:44.514537 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:44.514566 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:22:44.514597 | orchestrator | 2026-04-03 09:22:44.514620 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 09:22:44.514640 | orchestrator | Friday 03 April 2026 09:22:42 +0000 (0:00:04.646) 0:07:38.284 ********** 2026-04-03 09:22:44.514659 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:44.514715 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:44.514727 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:44.514745 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:44.514755 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:22:44.514767 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:44.514777 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:44.514794 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:22:44.514804 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:44.514822 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:47.313682 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:47.313768 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:47.313794 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:47.313802 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:47.313811 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:47.313837 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:47.313845 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:47.313852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:47.313870 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:47.313879 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:47.313886 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:22:47.313893 | orchestrator | 2026-04-03 09:22:47.313900 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 09:22:47.313908 | orchestrator | Friday 03 April 2026 09:22:46 +0000 (0:00:03.557) 0:07:41.842 ********** 2026-04-03 09:22:47.313919 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:47.313932 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:47.313939 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:47.313946 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:47.313958 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.838756 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:22:55.838876 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.838915 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:22:55.838928 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:55.838940 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:22:55.838951 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.838962 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:55.838973 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:22:55.839001 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.839012 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:22:55.839027 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:55.839044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.839054 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:55.839064 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:22:55.839074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:22:55.839084 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:55.839094 | orchestrator | 2026-04-03 09:22:55.839106 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:22:55.839117 | orchestrator | Friday 03 April 2026 09:22:49 +0000 (0:00:03.748) 0:07:45.590 ********** 2026-04-03 09:22:55.839127 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:22:55.839137 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:22:55.839147 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:22:55.839157 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:22:55.839167 | orchestrator | 2026-04-03 09:22:55.839177 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-03 09:22:55.839186 | orchestrator | Friday 03 April 2026 09:22:52 +0000 (0:00:02.274) 0:07:47.864 ********** 2026-04-03 09:22:55.839196 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:22:55.839206 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:22:55.839216 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:22:55.839225 | orchestrator | 2026-04-03 09:22:55.839235 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-03 09:22:55.839273 | orchestrator | Friday 03 April 2026 09:22:54 +0000 (0:00:02.351) 0:07:50.216 ********** 2026-04-03 09:22:55.839283 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:22:55.839296 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:22:55.839315 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:22:55.839327 | orchestrator | 2026-04-03 09:22:55.839345 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-03 09:23:39.454391 | orchestrator | Friday 03 April 2026 09:22:56 +0000 (0:00:02.305) 0:07:52.521 ********** 2026-04-03 09:23:39.454508 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:23:39.454525 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:23:39.454537 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:23:39.454548 | orchestrator | 2026-04-03 09:23:39.454561 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-03 09:23:39.454573 | orchestrator | Friday 03 April 2026 09:22:58 +0000 (0:00:01.497) 0:07:54.019 ********** 2026-04-03 09:23:39.454584 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:23:39.454594 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:23:39.454605 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:23:39.454615 | orchestrator | 2026-04-03 09:23:39.454642 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-03 09:23:39.454653 | orchestrator | Friday 03 April 2026 09:23:00 +0000 (0:00:01.810) 0:07:55.829 ********** 2026-04-03 09:23:39.454665 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:23:39.454675 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:23:39.454686 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:23:39.454697 | orchestrator | 2026-04-03 09:23:39.454707 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-03 09:23:39.454718 | orchestrator | Friday 03 April 2026 09:23:02 +0000 (0:00:02.259) 0:07:58.089 ********** 2026-04-03 09:23:39.454729 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:23:39.454740 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:23:39.454750 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:23:39.454761 | orchestrator | 2026-04-03 09:23:39.454772 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-03 09:23:39.454782 | orchestrator | Friday 03 April 2026 09:23:04 +0000 (0:00:02.176) 0:08:00.265 ********** 2026-04-03 09:23:39.454793 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:23:39.454804 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:23:39.454815 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:23:39.454826 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-03 09:23:39.454837 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-03 09:23:39.454847 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-03 09:23:39.454858 | orchestrator | 2026-04-03 09:23:39.454869 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-03 09:23:39.454882 | orchestrator | Friday 03 April 2026 09:23:09 +0000 (0:00:05.046) 0:08:05.311 ********** 2026-04-03 09:23:39.454896 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.454911 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:23:39.454924 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:23:39.454936 | orchestrator | 2026-04-03 09:23:39.454949 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-03 09:23:39.454961 | orchestrator | Friday 03 April 2026 09:23:11 +0000 (0:00:01.633) 0:08:06.945 ********** 2026-04-03 09:23:39.454975 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.454987 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:23:39.455000 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:23:39.455012 | orchestrator | 2026-04-03 09:23:39.455026 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-03 09:23:39.455038 | orchestrator | Friday 03 April 2026 09:23:12 +0000 (0:00:01.372) 0:08:08.318 ********** 2026-04-03 09:23:39.455051 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:23:39.455063 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:23:39.455076 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:23:39.455090 | orchestrator | 2026-04-03 09:23:39.455103 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-03 09:23:39.455134 | orchestrator | Friday 03 April 2026 09:23:14 +0000 (0:00:02.241) 0:08:10.560 ********** 2026-04-03 09:23:39.455146 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:23:39.455160 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:23:39.455171 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:23:39.455182 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:23:39.455194 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:23:39.455205 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:23:39.455216 | orchestrator | 2026-04-03 09:23:39.455227 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-03 09:23:39.455238 | orchestrator | Friday 03 April 2026 09:23:19 +0000 (0:00:04.588) 0:08:15.148 ********** 2026-04-03 09:23:39.455249 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 09:23:39.455260 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 09:23:39.455306 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:23:39.455318 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 09:23:39.455329 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:23:39.455340 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 09:23:39.455350 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:23:39.455361 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:23:39.455372 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:23:39.455382 | orchestrator | 2026-04-03 09:23:39.455393 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-03 09:23:39.455404 | orchestrator | Friday 03 April 2026 09:23:23 +0000 (0:00:04.135) 0:08:19.284 ********** 2026-04-03 09:23:39.455414 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:23:39.455425 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:23:39.455441 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:23:39.455453 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:23:39.455464 | orchestrator | 2026-04-03 09:23:39.455475 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-03 09:23:39.455486 | orchestrator | Friday 03 April 2026 09:23:27 +0000 (0:00:03.488) 0:08:22.772 ********** 2026-04-03 09:23:39.455497 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:23:39.455508 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:23:39.455518 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:23:39.455529 | orchestrator | 2026-04-03 09:23:39.455539 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-03 09:23:39.455550 | orchestrator | Friday 03 April 2026 09:23:29 +0000 (0:00:02.025) 0:08:24.797 ********** 2026-04-03 09:23:39.455561 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.455571 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:23:39.455582 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:23:39.455593 | orchestrator | 2026-04-03 09:23:39.455603 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-03 09:23:39.455624 | orchestrator | Friday 03 April 2026 09:23:30 +0000 (0:00:01.485) 0:08:26.283 ********** 2026-04-03 09:23:39.455635 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.455646 | orchestrator | 2026-04-03 09:23:39.455656 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-03 09:23:39.455667 | orchestrator | Friday 03 April 2026 09:23:31 +0000 (0:00:01.152) 0:08:27.436 ********** 2026-04-03 09:23:39.455678 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.455688 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:23:39.455699 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:23:39.455710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:23:39.455720 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:23:39.455731 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:23:39.455742 | orchestrator | 2026-04-03 09:23:39.455752 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-03 09:23:39.455763 | orchestrator | Friday 03 April 2026 09:23:33 +0000 (0:00:01.993) 0:08:29.429 ********** 2026-04-03 09:23:39.455774 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:23:39.455785 | orchestrator | 2026-04-03 09:23:39.455796 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-03 09:23:39.455806 | orchestrator | Friday 03 April 2026 09:23:35 +0000 (0:00:01.801) 0:08:31.231 ********** 2026-04-03 09:23:39.455817 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:23:39.455828 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:23:39.455838 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:23:39.455849 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:23:39.455859 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:23:39.455870 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:23:39.455881 | orchestrator | 2026-04-03 09:23:39.455891 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-03 09:23:39.455902 | orchestrator | Friday 03 April 2026 09:23:37 +0000 (0:00:01.785) 0:08:33.017 ********** 2026-04-03 09:23:39.455916 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:23:39.455939 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961672 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961833 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961865 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961894 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961916 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961936 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:23:41.961988 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962087 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962101 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962113 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962125 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962139 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:41.962174 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:48.048986 | orchestrator | 2026-04-03 09:23:48.049082 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-03 09:23:48.049095 | orchestrator | Friday 03 April 2026 09:23:43 +0000 (0:00:05.711) 0:08:38.728 ********** 2026-04-03 09:23:48.049107 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:23:48.049133 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:23:48.049143 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:23:48.049153 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:23:48.049199 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:23:48.049225 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:23:48.049235 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:48.049245 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:48.049253 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:23:48.049268 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:23:48.049301 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:24:11.745394 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:24:11.745508 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:11.745524 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:11.745536 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:11.745549 | orchestrator | 2026-04-03 09:24:11.745586 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-03 09:24:11.745600 | orchestrator | Friday 03 April 2026 09:23:51 +0000 (0:00:08.650) 0:08:47.379 ********** 2026-04-03 09:24:11.745611 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:11.745623 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:11.745634 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:11.745645 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:11.745655 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:11.745666 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:11.745677 | orchestrator | 2026-04-03 09:24:11.745688 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-03 09:24:11.745699 | orchestrator | Friday 03 April 2026 09:23:54 +0000 (0:00:02.657) 0:08:50.037 ********** 2026-04-03 09:24:11.745710 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:24:11.745722 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:24:11.745733 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:24:11.745743 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:24:11.745754 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:24:11.745779 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:24:11.745791 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:11.745802 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:24:11.745812 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:24:11.745823 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:11.745834 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:24:11.745845 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:11.745873 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:24:11.745885 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:24:11.745896 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:24:11.745906 | orchestrator | 2026-04-03 09:24:11.745917 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-03 09:24:11.745928 | orchestrator | Friday 03 April 2026 09:24:00 +0000 (0:00:06.040) 0:08:56.078 ********** 2026-04-03 09:24:11.745939 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:11.745950 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:11.745960 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:11.745971 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:11.745982 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:11.745993 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:11.746003 | orchestrator | 2026-04-03 09:24:11.746113 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-03 09:24:11.746129 | orchestrator | Friday 03 April 2026 09:24:02 +0000 (0:00:01.829) 0:08:57.908 ********** 2026-04-03 09:24:11.746140 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:24:11.746152 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:24:11.746163 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:24:11.746173 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:24:11.746184 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:24:11.746205 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746217 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:24:11.746228 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746239 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746250 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746260 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:11.746271 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746282 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:11.746292 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746322 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:24:11.746333 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:11.746344 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746355 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746365 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746376 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746387 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:24:11.746398 | orchestrator | 2026-04-03 09:24:11.746409 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-03 09:24:11.746420 | orchestrator | Friday 03 April 2026 09:24:08 +0000 (0:00:06.194) 0:09:04.102 ********** 2026-04-03 09:24:11.746431 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:24:11.746442 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:24:11.746453 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:24:11.746470 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:24:11.746481 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:24:11.746492 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:24:11.746503 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:24:11.746514 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:24:11.746525 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:24:11.746535 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:24:11.746555 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:24:28.180140 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:24:28.180275 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:24:28.180292 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:28.180362 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:24:28.180376 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:28.180387 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:24:28.180399 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:24:28.180418 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:28.180446 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:24:28.180467 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:24:28.180485 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:24:28.180503 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:24:28.180521 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:24:28.180538 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:24:28.180556 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:24:28.180574 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:24:28.180593 | orchestrator | 2026-04-03 09:24:28.180614 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-03 09:24:28.180633 | orchestrator | Friday 03 April 2026 09:24:16 +0000 (0:00:08.213) 0:09:12.315 ********** 2026-04-03 09:24:28.180652 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:28.180672 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:28.180690 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:28.180709 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:28.180729 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:28.180748 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:28.180768 | orchestrator | 2026-04-03 09:24:28.180787 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-03 09:24:28.180806 | orchestrator | Friday 03 April 2026 09:24:18 +0000 (0:00:02.022) 0:09:14.337 ********** 2026-04-03 09:24:28.180825 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:28.180843 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:28.180863 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:28.180881 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:28.180900 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:28.180920 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:28.180936 | orchestrator | 2026-04-03 09:24:28.180948 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-03 09:24:28.180962 | orchestrator | Friday 03 April 2026 09:24:20 +0000 (0:00:01.872) 0:09:16.210 ********** 2026-04-03 09:24:28.180975 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:28.180988 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:28.180999 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:28.181010 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:24:28.181021 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:24:28.181032 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:24:28.181042 | orchestrator | 2026-04-03 09:24:28.181053 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-03 09:24:28.181064 | orchestrator | Friday 03 April 2026 09:24:23 +0000 (0:00:03.355) 0:09:19.565 ********** 2026-04-03 09:24:28.181075 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:28.181086 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:28.181097 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:24:28.181107 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:24:28.181118 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:28.181128 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:24:28.181139 | orchestrator | 2026-04-03 09:24:28.181150 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-03 09:24:28.181172 | orchestrator | Friday 03 April 2026 09:24:26 +0000 (0:00:02.955) 0:09:22.521 ********** 2026-04-03 09:24:28.181201 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:28.181239 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:28.181253 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:28.181264 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:28.181276 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:24:28.181288 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:28.181333 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:24:28.181345 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:28.181364 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:33.150944 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:33.151036 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:24:33.151050 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:33.151062 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:24:33.151072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:24:33.151119 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:24:33.151131 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:33.151140 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:24:33.151150 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:33.151175 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:24:33.151185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:24:33.151194 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:33.151202 | orchestrator | 2026-04-03 09:24:33.151213 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-03 09:24:33.151223 | orchestrator | Friday 03 April 2026 09:24:29 +0000 (0:00:02.966) 0:09:25.487 ********** 2026-04-03 09:24:33.151233 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-03 09:24:33.151242 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151251 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:33.151259 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-03 09:24:33.151268 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151286 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:24:33.151296 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-03 09:24:33.151304 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151313 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:33.151388 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 09:24:33.151400 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151410 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:24:33.151419 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 09:24:33.151428 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151437 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:24:33.151447 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 09:24:33.151457 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 09:24:33.151466 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:24:33.151475 | orchestrator | 2026-04-03 09:24:33.151485 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-03 09:24:33.151495 | orchestrator | Friday 03 April 2026 09:24:31 +0000 (0:00:01.861) 0:09:27.349 ********** 2026-04-03 09:24:33.151512 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:24:33.151533 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586566 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586737 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586772 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586794 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586833 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586854 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586899 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586919 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586952 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586976 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:34.586995 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:34.587023 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:39.083812 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:24:39.083931 | orchestrator | 2026-04-03 09:24:39.083945 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-03 09:24:39.083957 | orchestrator | Friday 03 April 2026 09:24:35 +0000 (0:00:04.285) 0:09:31.634 ********** 2026-04-03 09:24:39.083967 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 09:24:39.083977 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.083986 | orchestrator | } 2026-04-03 09:24:39.083995 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 09:24:39.084004 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.084013 | orchestrator | } 2026-04-03 09:24:39.084022 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 09:24:39.084031 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.084040 | orchestrator | } 2026-04-03 09:24:39.084049 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:24:39.084058 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.084067 | orchestrator | } 2026-04-03 09:24:39.084075 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:24:39.084084 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.084093 | orchestrator | } 2026-04-03 09:24:39.084102 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:24:39.084111 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:24:39.084120 | orchestrator | } 2026-04-03 09:24:39.084129 | orchestrator | 2026-04-03 09:24:39.084137 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:24:39.084146 | orchestrator | Friday 03 April 2026 09:24:37 +0000 (0:00:01.993) 0:09:33.628 ********** 2026-04-03 09:24:39.084158 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:39.084183 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:39.084193 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:39.084225 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:39.084235 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:24:39.084245 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:24:39.084255 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:24:39.084264 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:24:39.084277 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:24:39.084286 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:24:39.084307 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:27:42.924681 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:27:42.924775 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:27:42.924792 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:27:42.924804 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:27:42.924815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:27:42.924839 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:27:42.924850 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:27:42.924876 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:27:42.924887 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:27:42.924897 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:27:42.924907 | orchestrator | 2026-04-03 09:27:42.924918 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:27:42.924941 | orchestrator | Friday 03 April 2026 09:24:41 +0000 (0:00:03.074) 0:09:36.702 ********** 2026-04-03 09:27:42.924952 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:27:42.924962 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:27:42.924972 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:27:42.924982 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:27:42.924991 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:27:42.925001 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:27:42.925011 | orchestrator | 2026-04-03 09:27:42.925021 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925031 | orchestrator | Friday 03 April 2026 09:24:42 +0000 (0:00:01.773) 0:09:38.476 ********** 2026-04-03 09:27:42.925040 | orchestrator | 2026-04-03 09:27:42.925050 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925060 | orchestrator | Friday 03 April 2026 09:24:43 +0000 (0:00:00.522) 0:09:38.998 ********** 2026-04-03 09:27:42.925070 | orchestrator | 2026-04-03 09:27:42.925079 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925089 | orchestrator | Friday 03 April 2026 09:24:44 +0000 (0:00:00.725) 0:09:39.724 ********** 2026-04-03 09:27:42.925098 | orchestrator | 2026-04-03 09:27:42.925108 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925118 | orchestrator | Friday 03 April 2026 09:24:44 +0000 (0:00:00.512) 0:09:40.237 ********** 2026-04-03 09:27:42.925128 | orchestrator | 2026-04-03 09:27:42.925138 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925147 | orchestrator | Friday 03 April 2026 09:24:45 +0000 (0:00:00.537) 0:09:40.774 ********** 2026-04-03 09:27:42.925157 | orchestrator | 2026-04-03 09:27:42.925167 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:27:42.925176 | orchestrator | Friday 03 April 2026 09:24:45 +0000 (0:00:00.550) 0:09:41.324 ********** 2026-04-03 09:27:42.925186 | orchestrator | 2026-04-03 09:27:42.925196 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-03 09:27:42.925206 | orchestrator | Friday 03 April 2026 09:24:46 +0000 (0:00:00.914) 0:09:42.239 ********** 2026-04-03 09:27:42.925216 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:27:42.925226 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:27:42.925236 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:27:42.925247 | orchestrator | 2026-04-03 09:27:42.925259 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-03 09:27:42.925270 | orchestrator | Friday 03 April 2026 09:25:01 +0000 (0:00:15.146) 0:09:57.386 ********** 2026-04-03 09:27:42.925281 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:27:42.925292 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:27:42.925303 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:27:42.925321 | orchestrator | 2026-04-03 09:27:42.925333 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-03 09:27:42.925344 | orchestrator | Friday 03 April 2026 09:25:24 +0000 (0:00:23.136) 0:10:20.522 ********** 2026-04-03 09:27:42.925356 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:27:42.925367 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:27:42.925378 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:27:42.925389 | orchestrator | 2026-04-03 09:27:42.925400 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-03 09:27:42.925412 | orchestrator | Friday 03 April 2026 09:25:52 +0000 (0:00:27.297) 0:10:47.820 ********** 2026-04-03 09:27:42.925423 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:27:42.925458 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:27:42.925469 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:27:42.925479 | orchestrator | 2026-04-03 09:27:42.925488 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-03 09:27:42.925503 | orchestrator | Friday 03 April 2026 09:26:36 +0000 (0:00:44.146) 0:11:31.966 ********** 2026-04-03 09:27:42.925513 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:27:42.925523 | orchestrator | FAILED - RETRYING: [testbed-node-4]: Checking libvirt container is ready (10 retries left). 2026-04-03 09:27:42.925533 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:27:42.925543 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:27:42.925553 | orchestrator | 2026-04-03 09:27:42.925562 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-03 09:27:42.925572 | orchestrator | Friday 03 April 2026 09:26:43 +0000 (0:00:07.388) 0:11:39.355 ********** 2026-04-03 09:27:42.925581 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:27:42.925591 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:27:42.925601 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:27:42.925611 | orchestrator | 2026-04-03 09:27:42.925620 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-03 09:27:42.925630 | orchestrator | Friday 03 April 2026 09:26:45 +0000 (0:00:01.936) 0:11:41.292 ********** 2026-04-03 09:27:42.925640 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:27:42.925649 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:27:42.925659 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:27:42.925668 | orchestrator | 2026-04-03 09:27:42.925678 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-03 09:27:42.925689 | orchestrator | Friday 03 April 2026 09:27:22 +0000 (0:00:36.796) 0:12:18.088 ********** 2026-04-03 09:27:42.925698 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:27:42.925708 | orchestrator | 2026-04-03 09:27:42.925717 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-03 09:27:42.925727 | orchestrator | Friday 03 April 2026 09:27:23 +0000 (0:00:01.444) 0:12:19.533 ********** 2026-04-03 09:27:42.925736 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:27:42.925746 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:27:42.925756 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:27:42.925765 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:27:42.925775 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:27:42.925784 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 09:27:42.925794 | orchestrator | 2026-04-03 09:27:42.925804 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-03 09:27:42.925813 | orchestrator | Friday 03 April 2026 09:27:34 +0000 (0:00:10.352) 0:12:29.885 ********** 2026-04-03 09:27:42.925823 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:27:42.925839 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.952915 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.953028 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:28:37.953044 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:28:37.953056 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.953068 | orchestrator | 2026-04-03 09:28:37.953081 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-03 09:28:37.953117 | orchestrator | Friday 03 April 2026 09:27:44 +0000 (0:00:10.650) 0:12:40.536 ********** 2026-04-03 09:28:37.953129 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:28:37.953140 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.953151 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.953161 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.953172 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:28:37.953183 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-4 2026-04-03 09:28:37.953195 | orchestrator | 2026-04-03 09:28:37.953206 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-03 09:28:37.953217 | orchestrator | Friday 03 April 2026 09:27:50 +0000 (0:00:05.675) 0:12:46.212 ********** 2026-04-03 09:28:37.953228 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 09:28:37.953238 | orchestrator | 2026-04-03 09:28:37.953249 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-03 09:28:37.953260 | orchestrator | Friday 03 April 2026 09:28:05 +0000 (0:00:14.686) 0:13:00.898 ********** 2026-04-03 09:28:37.953271 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 09:28:37.953281 | orchestrator | 2026-04-03 09:28:37.953292 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-03 09:28:37.953303 | orchestrator | Friday 03 April 2026 09:28:08 +0000 (0:00:03.026) 0:13:03.925 ********** 2026-04-03 09:28:37.953314 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:28:37.953325 | orchestrator | 2026-04-03 09:28:37.953335 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-03 09:28:37.953347 | orchestrator | Friday 03 April 2026 09:28:10 +0000 (0:00:02.664) 0:13:06.590 ********** 2026-04-03 09:28:37.953358 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-03 09:28:37.953369 | orchestrator | 2026-04-03 09:28:37.953380 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-03 09:28:37.953390 | orchestrator | 2026-04-03 09:28:37.953401 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-03 09:28:37.953412 | orchestrator | Friday 03 April 2026 09:28:24 +0000 (0:00:13.863) 0:13:20.453 ********** 2026-04-03 09:28:37.953422 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:28:37.953435 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:28:37.953448 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:28:37.953499 | orchestrator | 2026-04-03 09:28:37.953513 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-03 09:28:37.953526 | orchestrator | 2026-04-03 09:28:37.953539 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-03 09:28:37.953551 | orchestrator | Friday 03 April 2026 09:28:27 +0000 (0:00:02.445) 0:13:22.898 ********** 2026-04-03 09:28:37.953564 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.953576 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.953588 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.953601 | orchestrator | 2026-04-03 09:28:37.953613 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-03 09:28:37.953626 | orchestrator | 2026-04-03 09:28:37.953638 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-03 09:28:37.953651 | orchestrator | Friday 03 April 2026 09:28:28 +0000 (0:00:01.680) 0:13:24.579 ********** 2026-04-03 09:28:37.953677 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-03 09:28:37.953690 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-03 09:28:37.953703 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 09:28:37.953716 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-03 09:28:37.953729 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-03 09:28:37.953743 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.953764 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:28:37.953776 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-03 09:28:37.953789 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-03 09:28:37.953802 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 09:28:37.953814 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-03 09:28:37.953824 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-03 09:28:37.953835 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.953846 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:28:37.953857 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-03 09:28:37.953867 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-03 09:28:37.953878 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 09:28:37.953889 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-03 09:28:37.953900 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-03 09:28:37.953910 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.953921 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:28:37.953932 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-03 09:28:37.953942 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 09:28:37.953953 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 09:28:37.953964 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-03 09:28:37.953975 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-03 09:28:37.954003 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.954015 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.954083 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-03 09:28:37.954094 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 09:28:37.954105 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 09:28:37.954116 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-03 09:28:37.954126 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-03 09:28:37.954137 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.954148 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.954158 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-03 09:28:37.954169 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 09:28:37.954179 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 09:28:37.954190 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-03 09:28:37.954201 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-03 09:28:37.954211 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-03 09:28:37.954222 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.954233 | orchestrator | 2026-04-03 09:28:37.954244 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-03 09:28:37.954255 | orchestrator | 2026-04-03 09:28:37.954265 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-03 09:28:37.954276 | orchestrator | Friday 03 April 2026 09:28:31 +0000 (0:00:02.795) 0:13:27.374 ********** 2026-04-03 09:28:37.954287 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-03 09:28:37.954298 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-03 09:28:37.954308 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.954319 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-03 09:28:37.954330 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-03 09:28:37.954348 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.954359 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-03 09:28:37.954369 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-03 09:28:37.954380 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.954391 | orchestrator | 2026-04-03 09:28:37.954402 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-03 09:28:37.954412 | orchestrator | 2026-04-03 09:28:37.954423 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-03 09:28:37.954434 | orchestrator | Friday 03 April 2026 09:28:33 +0000 (0:00:01.909) 0:13:29.284 ********** 2026-04-03 09:28:37.954445 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.954456 | orchestrator | 2026-04-03 09:28:37.954487 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-03 09:28:37.954498 | orchestrator | 2026-04-03 09:28:37.954509 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-03 09:28:37.954520 | orchestrator | Friday 03 April 2026 09:28:35 +0000 (0:00:02.129) 0:13:31.414 ********** 2026-04-03 09:28:37.954530 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:28:37.954541 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:28:37.954552 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:28:37.954562 | orchestrator | 2026-04-03 09:28:37.954573 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:28:37.954590 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 09:28:37.954604 | orchestrator | testbed-node-0 : ok=58  changed=25  unreachable=0 failed=0 skipped=53  rescued=0 ignored=0 2026-04-03 09:28:37.954615 | orchestrator | testbed-node-1 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-03 09:28:37.954625 | orchestrator | testbed-node-2 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-03 09:28:37.954636 | orchestrator | testbed-node-3 : ok=49  changed=15  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-03 09:28:37.954647 | orchestrator | testbed-node-4 : ok=48  changed=14  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-03 09:28:37.954657 | orchestrator | testbed-node-5 : ok=43  changed=14  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-03 09:28:37.954668 | orchestrator | 2026-04-03 09:28:37.954679 | orchestrator | 2026-04-03 09:28:37.954689 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:28:37.954700 | orchestrator | Friday 03 April 2026 09:28:37 +0000 (0:00:02.205) 0:13:33.619 ********** 2026-04-03 09:28:37.954711 | orchestrator | =============================================================================== 2026-04-03 09:28:37.954721 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 44.15s 2026-04-03 09:28:37.954732 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 38.14s 2026-04-03 09:28:37.954743 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 36.80s 2026-04-03 09:28:37.954754 | orchestrator | nova-cell : Get new Libvirt version ------------------------------------ 35.24s 2026-04-03 09:28:37.954772 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 32.39s 2026-04-03 09:28:38.287367 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 27.30s 2026-04-03 09:28:38.287529 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 23.14s 2026-04-03 09:28:38.287548 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 16.22s 2026-04-03 09:28:38.287588 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 16.11s 2026-04-03 09:28:38.287600 | orchestrator | nova-cell : Restart nova-conductor container --------------------------- 15.15s 2026-04-03 09:28:38.287612 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 14.69s 2026-04-03 09:28:38.287630 | orchestrator | nova-cell : Update cell ------------------------------------------------ 14.32s 2026-04-03 09:28:38.287650 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------ 14.21s 2026-04-03 09:28:38.287668 | orchestrator | nova : Restart nova-api container -------------------------------------- 14.01s 2026-04-03 09:28:38.287690 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.91s 2026-04-03 09:28:38.287712 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 13.86s 2026-04-03 09:28:38.287733 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 13.65s 2026-04-03 09:28:38.287751 | orchestrator | nova : Restart nova-metadata container --------------------------------- 11.20s 2026-04-03 09:28:38.287763 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------ 10.65s 2026-04-03 09:28:38.287774 | orchestrator | nova-cell : Waiting for nova-compute services to register themselves --- 10.35s 2026-04-03 09:28:38.488807 | orchestrator | + osism apply nova-update-cell-mappings 2026-04-03 09:28:49.840590 | orchestrator | 2026-04-03 09:28:49 | INFO  | Prepare task for execution of nova-update-cell-mappings. 2026-04-03 09:28:49.913659 | orchestrator | 2026-04-03 09:28:49 | INFO  | Task 785d5f39-8a21-4ffa-bf9a-746722f10d9d (nova-update-cell-mappings) was prepared for execution. 2026-04-03 09:28:49.913838 | orchestrator | 2026-04-03 09:28:49 | INFO  | It takes a moment until task 785d5f39-8a21-4ffa-bf9a-746722f10d9d (nova-update-cell-mappings) has been started and output is visible here. 2026-04-03 09:29:21.795073 | orchestrator | 2026-04-03 09:29:21.795215 | orchestrator | PLAY [Update Nova cell mappings] *********************************************** 2026-04-03 09:29:21.795242 | orchestrator | 2026-04-03 09:29:21.795263 | orchestrator | TASK [Get list of Nova cells] ************************************************** 2026-04-03 09:29:21.795282 | orchestrator | Friday 03 April 2026 09:28:54 +0000 (0:00:01.412) 0:00:01.412 ********** 2026-04-03 09:29:21.795302 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:29:21.795323 | orchestrator | 2026-04-03 09:29:21.795341 | orchestrator | TASK [Parse cell information] ************************************************** 2026-04-03 09:29:21.795360 | orchestrator | Friday 03 April 2026 09:29:09 +0000 (0:00:14.515) 0:00:15.927 ********** 2026-04-03 09:29:21.795379 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:29:21.795397 | orchestrator | 2026-04-03 09:29:21.795416 | orchestrator | TASK [Display cells to update] ************************************************* 2026-04-03 09:29:21.795435 | orchestrator | Friday 03 April 2026 09:29:10 +0000 (0:00:01.195) 0:00:17.123 ********** 2026-04-03 09:29:21.795477 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 09:29:21.795550 | orchestrator |  "msg": "Cells to update: [{'name': '', 'uuid': '825c4965-8f3c-4979-aee4-5bfc0fab5224'}]" 2026-04-03 09:29:21.795571 | orchestrator | } 2026-04-03 09:29:21.795594 | orchestrator | 2026-04-03 09:29:21.795617 | orchestrator | TASK [Use specified cell UUID if provided] ************************************* 2026-04-03 09:29:21.795639 | orchestrator | Friday 03 April 2026 09:29:11 +0000 (0:00:01.113) 0:00:18.236 ********** 2026-04-03 09:29:21.795661 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:29:21.795683 | orchestrator | 2026-04-03 09:29:21.795705 | orchestrator | TASK [Abort if multiple cells found without specific UUID and abort_on_multiple is enabled] *** 2026-04-03 09:29:21.795728 | orchestrator | Friday 03 April 2026 09:29:12 +0000 (0:00:01.107) 0:00:19.343 ********** 2026-04-03 09:29:21.795750 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:29:21.795772 | orchestrator | 2026-04-03 09:29:21.795794 | orchestrator | TASK [Update Nova cell mappings] *********************************************** 2026-04-03 09:29:21.795816 | orchestrator | Friday 03 April 2026 09:29:14 +0000 (0:00:01.110) 0:00:20.453 ********** 2026-04-03 09:29:21.795871 | orchestrator | changed: [testbed-node-0] => (item=825c4965-8f3c-4979-aee4-5bfc0fab5224) 2026-04-03 09:29:21.795894 | orchestrator | 2026-04-03 09:29:21.795913 | orchestrator | TASK [Display update results] ************************************************** 2026-04-03 09:29:21.795933 | orchestrator | Friday 03 April 2026 09:29:19 +0000 (0:00:05.835) 0:00:26.289 ********** 2026-04-03 09:29:21.795952 | orchestrator | ok: [testbed-node-0] => (item=825c4965-8f3c-4979-aee4-5bfc0fab5224) => { 2026-04-03 09:29:21.795971 | orchestrator |  "msg": "Cell 825c4965-8f3c-4979-aee4-5bfc0fab5224 updated successfully" 2026-04-03 09:29:21.795989 | orchestrator | } 2026-04-03 09:29:21.796007 | orchestrator | 2026-04-03 09:29:21.796025 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:29:21.796044 | orchestrator | testbed-node-0 : ok=5  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 09:29:21.796065 | orchestrator | 2026-04-03 09:29:21.796084 | orchestrator | 2026-04-03 09:29:21.796102 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:29:21.796119 | orchestrator | Friday 03 April 2026 09:29:21 +0000 (0:00:01.650) 0:00:27.939 ********** 2026-04-03 09:29:21.796137 | orchestrator | =============================================================================== 2026-04-03 09:29:21.796155 | orchestrator | Get list of Nova cells ------------------------------------------------- 14.52s 2026-04-03 09:29:21.796174 | orchestrator | Update Nova cell mappings ----------------------------------------------- 5.84s 2026-04-03 09:29:21.796193 | orchestrator | Display update results -------------------------------------------------- 1.65s 2026-04-03 09:29:21.796212 | orchestrator | Parse cell information -------------------------------------------------- 1.20s 2026-04-03 09:29:21.796229 | orchestrator | Display cells to update ------------------------------------------------- 1.11s 2026-04-03 09:29:21.796245 | orchestrator | Abort if multiple cells found without specific UUID and abort_on_multiple is enabled --- 1.11s 2026-04-03 09:29:21.796261 | orchestrator | Use specified cell UUID if provided ------------------------------------- 1.11s 2026-04-03 09:29:21.981567 | orchestrator | + osism apply -a upgrade nova 2026-04-03 09:29:23.285662 | orchestrator | 2026-04-03 09:29:23 | INFO  | Prepare task for execution of nova. 2026-04-03 09:29:23.355391 | orchestrator | 2026-04-03 09:29:23 | INFO  | Task 7924a116-ed5c-43f2-ac7a-7da777c08101 (nova) was prepared for execution. 2026-04-03 09:29:23.355569 | orchestrator | 2026-04-03 09:29:23 | INFO  | It takes a moment until task 7924a116-ed5c-43f2-ac7a-7da777c08101 (nova) has been started and output is visible here. 2026-04-03 09:30:38.020677 | orchestrator | 2026-04-03 09:30:38.020793 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:30:38.020810 | orchestrator | 2026-04-03 09:30:38.020823 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-03 09:30:38.020834 | orchestrator | Friday 03 April 2026 09:29:28 +0000 (0:00:01.840) 0:00:01.840 ********** 2026-04-03 09:30:38.020845 | orchestrator | changed: [testbed-manager] 2026-04-03 09:30:38.020858 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:30:38.020869 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:30:38.020880 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:30:38.020890 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:30:38.020901 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:30:38.020911 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:30:38.020922 | orchestrator | 2026-04-03 09:30:38.020933 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:30:38.020944 | orchestrator | Friday 03 April 2026 09:29:32 +0000 (0:00:03.572) 0:00:05.412 ********** 2026-04-03 09:30:38.020955 | orchestrator | changed: [testbed-manager] 2026-04-03 09:30:38.020966 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:30:38.020978 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:30:38.020988 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:30:38.020999 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:30:38.021032 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:30:38.021044 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:30:38.021054 | orchestrator | 2026-04-03 09:30:38.021065 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:30:38.021076 | orchestrator | Friday 03 April 2026 09:29:34 +0000 (0:00:02.022) 0:00:07.434 ********** 2026-04-03 09:30:38.021087 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-03 09:30:38.021098 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-03 09:30:38.021108 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-03 09:30:38.021119 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-03 09:30:38.021129 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-03 09:30:38.021154 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-03 09:30:38.021168 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-03 09:30:38.021180 | orchestrator | 2026-04-03 09:30:38.021193 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-03 09:30:38.021206 | orchestrator | 2026-04-03 09:30:38.021219 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 09:30:38.021233 | orchestrator | Friday 03 April 2026 09:29:36 +0000 (0:00:02.469) 0:00:09.904 ********** 2026-04-03 09:30:38.021246 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:38.021260 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021272 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021286 | orchestrator | 2026-04-03 09:30:38.021299 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 09:30:38.021311 | orchestrator | Friday 03 April 2026 09:29:38 +0000 (0:00:01.479) 0:00:11.383 ********** 2026-04-03 09:30:38.021324 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:30:38.021337 | orchestrator | 2026-04-03 09:30:38.021350 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 09:30:38.021363 | orchestrator | Friday 03 April 2026 09:29:41 +0000 (0:00:03.167) 0:00:14.550 ********** 2026-04-03 09:30:38.021375 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021389 | orchestrator | 2026-04-03 09:30:38.021401 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-03 09:30:38.021414 | orchestrator | Friday 03 April 2026 09:29:43 +0000 (0:00:02.174) 0:00:16.725 ********** 2026-04-03 09:30:38.021428 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021440 | orchestrator | 2026-04-03 09:30:38.021452 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-03 09:30:38.021465 | orchestrator | Friday 03 April 2026 09:29:45 +0000 (0:00:02.178) 0:00:18.904 ********** 2026-04-03 09:30:38.021478 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021491 | orchestrator | 2026-04-03 09:30:38.021504 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-03 09:30:38.021539 | orchestrator | Friday 03 April 2026 09:29:49 +0000 (0:00:04.073) 0:00:22.978 ********** 2026-04-03 09:30:38.021551 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021561 | orchestrator | 2026-04-03 09:30:38.021572 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-03 09:30:38.021583 | orchestrator | 2026-04-03 09:30:38.021594 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-03 09:30:38.021605 | orchestrator | Friday 03 April 2026 09:30:09 +0000 (0:00:20.131) 0:00:43.109 ********** 2026-04-03 09:30:38.021615 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:38.021626 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021637 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021648 | orchestrator | 2026-04-03 09:30:38.021659 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-03 09:30:38.021670 | orchestrator | Friday 03 April 2026 09:30:11 +0000 (0:00:01.546) 0:00:44.656 ********** 2026-04-03 09:30:38.021690 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:30:38.021701 | orchestrator | 2026-04-03 09:30:38.021712 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 09:30:38.021723 | orchestrator | Friday 03 April 2026 09:30:13 +0000 (0:00:01.892) 0:00:46.549 ********** 2026-04-03 09:30:38.021733 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021744 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021756 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021766 | orchestrator | 2026-04-03 09:30:38.021777 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-03 09:30:38.021788 | orchestrator | Friday 03 April 2026 09:30:15 +0000 (0:00:01.675) 0:00:48.224 ********** 2026-04-03 09:30:38.021799 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021810 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021821 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021831 | orchestrator | 2026-04-03 09:30:38.021859 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-03 09:30:38.021871 | orchestrator | Friday 03 April 2026 09:30:17 +0000 (0:00:01.936) 0:00:50.160 ********** 2026-04-03 09:30:38.021882 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021893 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021903 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021914 | orchestrator | 2026-04-03 09:30:38.021925 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-03 09:30:38.021935 | orchestrator | Friday 03 April 2026 09:30:20 +0000 (0:00:03.741) 0:00:53.902 ********** 2026-04-03 09:30:38.021946 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:38.021957 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:38.021967 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:30:38.021978 | orchestrator | 2026-04-03 09:30:38.021989 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-03 09:30:38.021999 | orchestrator | 2026-04-03 09:30:38.022010 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:30:38.022077 | orchestrator | Friday 03 April 2026 09:30:34 +0000 (0:00:13.945) 0:01:07.848 ********** 2026-04-03 09:30:38.022089 | orchestrator | included: /ansible/roles/nova/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:30:38.022100 | orchestrator | 2026-04-03 09:30:38.022111 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-03 09:30:38.022122 | orchestrator | Friday 03 April 2026 09:30:36 +0000 (0:00:02.033) 0:01:09.881 ********** 2026-04-03 09:30:38.022146 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:38.022163 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:38.022192 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:49.787130 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:49.787280 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:49.787302 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:49.787336 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:49.787365 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:49.787377 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:49.787389 | orchestrator | 2026-04-03 09:30:49.787401 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-03 09:30:49.787412 | orchestrator | Friday 03 April 2026 09:30:39 +0000 (0:00:03.218) 0:01:13.100 ********** 2026-04-03 09:30:49.787422 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:49.787434 | orchestrator | 2026-04-03 09:30:49.787444 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-03 09:30:49.787454 | orchestrator | Friday 03 April 2026 09:30:41 +0000 (0:00:01.163) 0:01:14.264 ********** 2026-04-03 09:30:49.787469 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:49.787479 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:49.787489 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:49.787499 | orchestrator | 2026-04-03 09:30:49.787509 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-03 09:30:49.787555 | orchestrator | Friday 03 April 2026 09:30:42 +0000 (0:00:01.711) 0:01:15.975 ********** 2026-04-03 09:30:49.787566 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:30:49.787576 | orchestrator | 2026-04-03 09:30:49.787586 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-03 09:30:49.787603 | orchestrator | Friday 03 April 2026 09:30:45 +0000 (0:00:02.217) 0:01:18.193 ********** 2026-04-03 09:30:49.787614 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:49.787624 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:49.787634 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:49.787643 | orchestrator | 2026-04-03 09:30:49.787653 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-03 09:30:49.787663 | orchestrator | Friday 03 April 2026 09:30:46 +0000 (0:00:01.349) 0:01:19.543 ********** 2026-04-03 09:30:49.787674 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:30:49.787684 | orchestrator | 2026-04-03 09:30:49.787694 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 09:30:49.787704 | orchestrator | Friday 03 April 2026 09:30:48 +0000 (0:00:01.921) 0:01:21.464 ********** 2026-04-03 09:30:49.787715 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:49.787736 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:53.209247 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:53.209372 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:53.209390 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:53.209422 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:53.209436 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:53.209462 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:53.209474 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:30:53.209486 | orchestrator | 2026-04-03 09:30:53.209499 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 09:30:53.209511 | orchestrator | Friday 03 April 2026 09:30:52 +0000 (0:00:04.410) 0:01:25.875 ********** 2026-04-03 09:30:53.209572 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:53.209594 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230011 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:55.230186 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:55.230218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230244 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:55.230255 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:55.230283 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230319 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:55.230329 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:55.230339 | orchestrator | 2026-04-03 09:30:55.230350 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 09:30:55.230361 | orchestrator | Friday 03 April 2026 09:30:54 +0000 (0:00:01.851) 0:01:27.727 ********** 2026-04-03 09:30:55.230371 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:55.230389 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:58.207945 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:58.208029 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:30:58.208079 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:58.208090 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:58.208098 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:58.208105 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:30:58.208148 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:58.208157 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:30:58.208164 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:30:58.208170 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:30:58.208177 | orchestrator | 2026-04-03 09:30:58.208184 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-03 09:30:58.208191 | orchestrator | Friday 03 April 2026 09:30:56 +0000 (0:00:02.230) 0:01:29.957 ********** 2026-04-03 09:30:58.208198 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:30:58.208220 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.504797 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.504905 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.504923 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.504977 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.504992 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:04.505006 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:04.505017 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:04.505030 | orchestrator | 2026-04-03 09:31:04.505043 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-03 09:31:04.505056 | orchestrator | Friday 03 April 2026 09:31:01 +0000 (0:00:04.413) 0:01:34.371 ********** 2026-04-03 09:31:04.505068 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:04.505096 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:11.440289 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:11.440380 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:11.440390 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:11.440428 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:11.440436 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:11.440444 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:11.440450 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:11.440457 | orchestrator | 2026-04-03 09:31:11.440464 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-03 09:31:11.440478 | orchestrator | Friday 03 April 2026 09:31:10 +0000 (0:00:09.697) 0:01:44.069 ********** 2026-04-03 09:31:11.440485 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:11.440496 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:23.546227 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:23.546310 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:23.546319 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:23.546343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:23.546348 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:23.546353 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:23.546369 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:23.546374 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:23.546383 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:23.546387 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:23.546392 | orchestrator | 2026-04-03 09:31:23.546397 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-03 09:31:23.546403 | orchestrator | Friday 03 April 2026 09:31:12 +0000 (0:00:02.039) 0:01:46.108 ********** 2026-04-03 09:31:23.546407 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:23.546411 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:23.546415 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:23.546419 | orchestrator | 2026-04-03 09:31:23.546423 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-03 09:31:23.546427 | orchestrator | Friday 03 April 2026 09:31:15 +0000 (0:00:02.033) 0:01:48.142 ********** 2026-04-03 09:31:23.546431 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:23.546435 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:23.546440 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:23.546444 | orchestrator | 2026-04-03 09:31:23.546448 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-03 09:31:23.546452 | orchestrator | Friday 03 April 2026 09:31:16 +0000 (0:00:01.790) 0:01:49.932 ********** 2026-04-03 09:31:23.546457 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-03 09:31:23.546462 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-03 09:31:23.546466 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:23.546470 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-03 09:31:23.546474 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-03 09:31:23.546478 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:23.546482 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-03 09:31:23.546486 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-03 09:31:23.546490 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:23.546494 | orchestrator | 2026-04-03 09:31:23.546498 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-03 09:31:23.546502 | orchestrator | Friday 03 April 2026 09:31:18 +0000 (0:00:01.423) 0:01:51.356 ********** 2026-04-03 09:31:23.546507 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-03 09:31:23.546513 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-03 09:31:23.546517 | orchestrator | 2026-04-03 09:31:23.546521 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-03 09:31:23.546525 | orchestrator | Friday 03 April 2026 09:31:21 +0000 (0:00:03.107) 0:01:54.463 ********** 2026-04-03 09:31:23.546572 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:31:23.546579 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:31:23.546583 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:31:23.546587 | orchestrator | 2026-04-03 09:31:49.617618 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-03 09:31:49.617748 | orchestrator | Friday 03 April 2026 09:31:24 +0000 (0:00:02.968) 0:01:57.431 ********** 2026-04-03 09:31:49.617765 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:31:49.617776 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:31:49.617786 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:31:49.617818 | orchestrator | 2026-04-03 09:31:49.617829 | orchestrator | TASK [nova : Run Nova upgrade checks] ****************************************** 2026-04-03 09:31:49.617839 | orchestrator | Friday 03 April 2026 09:31:27 +0000 (0:00:03.644) 0:02:01.076 ********** 2026-04-03 09:31:49.617849 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:31:49.617860 | orchestrator | 2026-04-03 09:31:49.617870 | orchestrator | TASK [nova : Upgrade status check result] ************************************** 2026-04-03 09:31:49.617879 | orchestrator | Friday 03 April 2026 09:31:47 +0000 (0:00:19.154) 0:02:20.231 ********** 2026-04-03 09:31:49.617889 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:49.617899 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:49.617909 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:49.617918 | orchestrator | 2026-04-03 09:31:49.617928 | orchestrator | TASK [nova : Stopping top level nova services] ********************************* 2026-04-03 09:31:49.617937 | orchestrator | Friday 03 April 2026 09:31:48 +0000 (0:00:01.506) 0:02:21.738 ********** 2026-04-03 09:31:49.617952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:49.617967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:49.617979 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:49.617991 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:49.618076 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:49.618099 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:49.618112 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:49.618124 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:49.618135 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:49.618159 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:54.901903 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:54.901980 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:31:54.901988 | orchestrator | 2026-04-03 09:31:54.901993 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-03 09:31:54.901999 | orchestrator | Friday 03 April 2026 09:31:51 +0000 (0:00:02.497) 0:02:24.235 ********** 2026-04-03 09:31:54.902004 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902011 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902065 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902084 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902089 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902094 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:31:54.902103 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:54.902113 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:58.576677 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:31:58.576770 | orchestrator | 2026-04-03 09:31:58.576786 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-03 09:31:58.576797 | orchestrator | Friday 03 April 2026 09:31:56 +0000 (0:00:05.150) 0:02:29.386 ********** 2026-04-03 09:31:58.576808 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 09:31:58.576820 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:31:58.576830 | orchestrator | } 2026-04-03 09:31:58.576840 | orchestrator | ok: [testbed-node-1] => { 2026-04-03 09:31:58.576850 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:31:58.576859 | orchestrator | } 2026-04-03 09:31:58.576869 | orchestrator | ok: [testbed-node-2] => { 2026-04-03 09:31:58.576878 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:31:58.576888 | orchestrator | } 2026-04-03 09:31:58.576897 | orchestrator | 2026-04-03 09:31:58.576907 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:31:58.576917 | orchestrator | Friday 03 April 2026 09:31:57 +0000 (0:00:01.424) 0:02:30.810 ********** 2026-04-03 09:31:58.576929 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:58.576967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:58.576979 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:58.576991 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:31:58.577018 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:58.577030 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:58.577049 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:31:58.577084 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:31:58.577095 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:31:58.577115 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:32:41.841076 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:32:41.841191 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:41.841208 | orchestrator | 2026-04-03 09:32:41.841222 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:32:41.841234 | orchestrator | Friday 03 April 2026 09:31:59 +0000 (0:00:02.117) 0:02:32.927 ********** 2026-04-03 09:32:41.841245 | orchestrator | 2026-04-03 09:32:41.841256 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:32:41.841290 | orchestrator | Friday 03 April 2026 09:32:00 +0000 (0:00:00.576) 0:02:33.504 ********** 2026-04-03 09:32:41.841301 | orchestrator | 2026-04-03 09:32:41.841312 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-03 09:32:41.841323 | orchestrator | Friday 03 April 2026 09:32:00 +0000 (0:00:00.509) 0:02:34.014 ********** 2026-04-03 09:32:41.841333 | orchestrator | 2026-04-03 09:32:41.841344 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-03 09:32:41.841355 | orchestrator | 2026-04-03 09:32:41.841366 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:32:41.841377 | orchestrator | Friday 03 April 2026 09:32:02 +0000 (0:00:01.620) 0:02:35.634 ********** 2026-04-03 09:32:41.841388 | orchestrator | included: /ansible/roles/nova-cell/tasks/upgrade.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:32:41.841400 | orchestrator | 2026-04-03 09:32:41.841411 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-03 09:32:41.841422 | orchestrator | Friday 03 April 2026 09:32:05 +0000 (0:00:02.547) 0:02:38.181 ********** 2026-04-03 09:32:41.841433 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:32:41.841444 | orchestrator | 2026-04-03 09:32:41.841455 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-03 09:32:41.841466 | orchestrator | Friday 03 April 2026 09:32:09 +0000 (0:00:04.494) 0:02:42.676 ********** 2026-04-03 09:32:41.841477 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:32:41.841489 | orchestrator | 2026-04-03 09:32:41.841499 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-03 09:32:41.841510 | orchestrator | Friday 03 April 2026 09:32:11 +0000 (0:00:02.361) 0:02:45.037 ********** 2026-04-03 09:32:41.841521 | orchestrator | included: service-image-info for testbed-node-3 2026-04-03 09:32:41.841532 | orchestrator | 2026-04-03 09:32:41.841543 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-03 09:32:41.841579 | orchestrator | Friday 03 April 2026 09:32:13 +0000 (0:00:02.060) 0:02:47.098 ********** 2026-04-03 09:32:41.841591 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:32:41.841602 | orchestrator | 2026-04-03 09:32:41.841615 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-03 09:32:41.841627 | orchestrator | Friday 03 April 2026 09:32:18 +0000 (0:00:04.423) 0:02:51.522 ********** 2026-04-03 09:32:41.841639 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:32:41.841652 | orchestrator | 2026-04-03 09:32:41.841665 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-03 09:32:41.841677 | orchestrator | Friday 03 April 2026 09:32:21 +0000 (0:00:03.160) 0:02:54.683 ********** 2026-04-03 09:32:41.841689 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:41.841703 | orchestrator | 2026-04-03 09:32:41.841716 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-03 09:32:41.841728 | orchestrator | Friday 03 April 2026 09:32:24 +0000 (0:00:03.045) 0:02:57.728 ********** 2026-04-03 09:32:41.841741 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:41.841753 | orchestrator | 2026-04-03 09:32:41.841765 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-03 09:32:41.841779 | orchestrator | Friday 03 April 2026 09:32:27 +0000 (0:00:03.066) 0:03:00.795 ********** 2026-04-03 09:32:41.841791 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:32:41.841804 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:41.841818 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:41.841830 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:32:41.841843 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:32:41.841856 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:32:41.841867 | orchestrator | 2026-04-03 09:32:41.841877 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-03 09:32:41.841888 | orchestrator | Friday 03 April 2026 09:32:32 +0000 (0:00:05.301) 0:03:06.097 ********** 2026-04-03 09:32:41.841907 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:41.841918 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:41.841928 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:32:41.841939 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:32:41.841950 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:41.841960 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:32:41.841971 | orchestrator | 2026-04-03 09:32:41.841982 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-03 09:32:41.841993 | orchestrator | Friday 03 April 2026 09:32:37 +0000 (0:00:04.868) 0:03:10.965 ********** 2026-04-03 09:32:41.842003 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:41.842014 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:32:41.842094 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:32:41.842105 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:41.842115 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:32:41.842144 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:41.842156 | orchestrator | 2026-04-03 09:32:41.842177 | orchestrator | TASK [nova-cell : Stopping nova cell services] ********************************* 2026-04-03 09:32:41.842188 | orchestrator | Friday 03 April 2026 09:32:40 +0000 (0:00:02.988) 0:03:13.954 ********** 2026-04-03 09:32:41.842201 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:32:41.842215 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:32:41.842227 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:32:41.842240 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:32:41.842259 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:32:41.842279 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:32:52.883752 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:52.883868 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:32:52.883888 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:32:52.883906 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:32:52.883919 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:32:52.883955 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:32:52.883969 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:32:52.883981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:32:52.883993 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:52.884021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:32:52.884034 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:32:52.884045 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:32:52.884055 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:32:52.884067 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:32:52.884086 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:52.884097 | orchestrator | 2026-04-03 09:32:52.884110 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-03 09:32:52.884123 | orchestrator | Friday 03 April 2026 09:32:44 +0000 (0:00:03.388) 0:03:17.342 ********** 2026-04-03 09:32:52.884133 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:52.884144 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:32:52.884155 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:32:52.884165 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:32:52.884177 | orchestrator | 2026-04-03 09:32:52.884188 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-03 09:32:52.884199 | orchestrator | Friday 03 April 2026 09:32:46 +0000 (0:00:02.367) 0:03:19.710 ********** 2026-04-03 09:32:52.884210 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-03 09:32:52.884220 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-03 09:32:52.884231 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-03 09:32:52.884241 | orchestrator | 2026-04-03 09:32:52.884252 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-03 09:32:52.884263 | orchestrator | Friday 03 April 2026 09:32:48 +0000 (0:00:01.981) 0:03:21.692 ********** 2026-04-03 09:32:52.884273 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-03 09:32:52.884284 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-03 09:32:52.884295 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-03 09:32:52.884306 | orchestrator | 2026-04-03 09:32:52.884316 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-03 09:32:52.884327 | orchestrator | Friday 03 April 2026 09:32:50 +0000 (0:00:02.184) 0:03:23.877 ********** 2026-04-03 09:32:52.884338 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-03 09:32:52.884349 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:32:52.884359 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-03 09:32:52.884370 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:32:52.884380 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-03 09:32:52.884391 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:32:52.884401 | orchestrator | 2026-04-03 09:32:52.884412 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-03 09:32:52.884423 | orchestrator | Friday 03 April 2026 09:32:52 +0000 (0:00:01.583) 0:03:25.460 ********** 2026-04-03 09:32:52.884434 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:32:52.884444 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:32:52.884455 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:32:52.884473 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:33:01.462711 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:33:01.462793 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:33:01.462802 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:33:01.462808 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:01.462815 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-03 09:33:01.462821 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-03 09:33:01.462843 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-03 09:33:01.462849 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:01.462855 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:33:01.462860 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:33:01.462875 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-03 09:33:01.462880 | orchestrator | 2026-04-03 09:33:01.462887 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-03 09:33:01.462893 | orchestrator | Friday 03 April 2026 09:32:54 +0000 (0:00:02.178) 0:03:27.639 ********** 2026-04-03 09:33:01.462905 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:33:01.462911 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:01.462917 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:01.462922 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:01.462929 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:01.462935 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:01.462940 | orchestrator | 2026-04-03 09:33:01.462946 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-03 09:33:01.462952 | orchestrator | Friday 03 April 2026 09:32:56 +0000 (0:00:02.309) 0:03:29.948 ********** 2026-04-03 09:33:01.462957 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:33:01.462963 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:01.462968 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:01.462974 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:01.462980 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:01.462985 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:01.462991 | orchestrator | 2026-04-03 09:33:01.462996 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-03 09:33:01.463002 | orchestrator | Friday 03 April 2026 09:32:59 +0000 (0:00:02.448) 0:03:32.397 ********** 2026-04-03 09:33:01.463010 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463019 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463046 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463071 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463080 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463090 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463099 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463107 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463116 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:01.463137 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.682921 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683054 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683081 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683102 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683149 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683169 | orchestrator | 2026-04-03 09:33:07.683188 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:33:07.683207 | orchestrator | Friday 03 April 2026 09:33:02 +0000 (0:00:03.706) 0:03:36.103 ********** 2026-04-03 09:33:07.683226 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:33:07.683244 | orchestrator | 2026-04-03 09:33:07.683260 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-03 09:33:07.683277 | orchestrator | Friday 03 April 2026 09:33:05 +0000 (0:00:02.230) 0:03:38.334 ********** 2026-04-03 09:33:07.683318 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683339 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683356 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683387 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683404 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:07.683430 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229783 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229884 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229900 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229912 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229952 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229966 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.229997 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.230010 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.230091 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:33:11.230114 | orchestrator | 2026-04-03 09:33:11.230128 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-03 09:33:11.230150 | orchestrator | Friday 03 April 2026 09:33:09 +0000 (0:00:04.719) 0:03:43.053 ********** 2026-04-03 09:33:11.230165 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:11.230178 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:11.230198 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:12.059643 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:12.059744 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:12.059772 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:33:12.059840 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:12.059850 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:33:12.059857 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:12.059866 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:12.059894 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:12.059902 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:12.059916 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:33:12.059923 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:12.059931 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:12.059938 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:33:12.059945 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:12.059952 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:12.059959 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:12.059975 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:15.247430 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:15.247523 | orchestrator | 2026-04-03 09:33:15.247534 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-03 09:33:15.247542 | orchestrator | Friday 03 April 2026 09:33:13 +0000 (0:00:03.249) 0:03:46.303 ********** 2026-04-03 09:33:15.247550 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:15.247617 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:15.247626 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:15.247634 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:33:15.247651 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:15.247674 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:33:15.247688 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:15.247695 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:33:15.247702 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:15.247708 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:33:15.247714 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:33:15.247721 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:33:15.247728 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:15.247743 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:51.809777 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:51.809900 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:51.809921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:51.809934 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:33:51.809946 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:33:51.809959 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:33:51.809973 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:51.809992 | orchestrator | 2026-04-03 09:33:51.810013 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-03 09:33:51.810103 | orchestrator | Friday 03 April 2026 09:33:17 +0000 (0:00:03.988) 0:03:50.291 ********** 2026-04-03 09:33:51.810124 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:33:51.810142 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:33:51.810163 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:33:51.810183 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:33:51.810205 | orchestrator | 2026-04-03 09:33:51.810226 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-03 09:33:51.810246 | orchestrator | Friday 03 April 2026 09:33:19 +0000 (0:00:02.288) 0:03:52.580 ********** 2026-04-03 09:33:51.810300 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:33:51.810323 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:33:51.810337 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:33:51.810350 | orchestrator | 2026-04-03 09:33:51.810363 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-03 09:33:51.810392 | orchestrator | Friday 03 April 2026 09:33:21 +0000 (0:00:02.112) 0:03:54.692 ********** 2026-04-03 09:33:51.810425 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:33:51.810447 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:33:51.810466 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:33:51.810484 | orchestrator | 2026-04-03 09:33:51.810526 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-03 09:33:51.810552 | orchestrator | Friday 03 April 2026 09:33:23 +0000 (0:00:02.013) 0:03:56.705 ********** 2026-04-03 09:33:51.810570 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:51.810620 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:51.810638 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:51.810654 | orchestrator | 2026-04-03 09:33:51.810669 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-03 09:33:51.810686 | orchestrator | Friday 03 April 2026 09:33:25 +0000 (0:00:01.903) 0:03:58.609 ********** 2026-04-03 09:33:51.810704 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:51.810747 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:51.810766 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:51.810782 | orchestrator | 2026-04-03 09:33:51.810800 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-03 09:33:51.810818 | orchestrator | Friday 03 April 2026 09:33:27 +0000 (0:00:01.571) 0:04:00.181 ********** 2026-04-03 09:33:51.810836 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:33:51.810855 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:33:51.810875 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:33:51.810892 | orchestrator | 2026-04-03 09:33:51.810910 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-03 09:33:51.810928 | orchestrator | Friday 03 April 2026 09:33:29 +0000 (0:00:02.184) 0:04:02.366 ********** 2026-04-03 09:33:51.810947 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:33:51.810967 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:33:51.810986 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:33:51.810998 | orchestrator | 2026-04-03 09:33:51.811009 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-03 09:33:51.811019 | orchestrator | Friday 03 April 2026 09:33:31 +0000 (0:00:02.297) 0:04:04.663 ********** 2026-04-03 09:33:51.811030 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:33:51.811040 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:33:51.811051 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:33:51.811061 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-03 09:33:51.811072 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-03 09:33:51.811082 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-03 09:33:51.811092 | orchestrator | 2026-04-03 09:33:51.811103 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-03 09:33:51.811114 | orchestrator | Friday 03 April 2026 09:33:36 +0000 (0:00:04.840) 0:04:09.503 ********** 2026-04-03 09:33:51.811124 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:33:51.811135 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:33:51.811145 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:33:51.811156 | orchestrator | 2026-04-03 09:33:51.811166 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-03 09:33:51.811177 | orchestrator | Friday 03 April 2026 09:33:37 +0000 (0:00:01.416) 0:04:10.920 ********** 2026-04-03 09:33:51.811187 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:33:51.811198 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:33:51.811222 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:33:51.811233 | orchestrator | 2026-04-03 09:33:51.811243 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-03 09:33:51.811254 | orchestrator | Friday 03 April 2026 09:33:39 +0000 (0:00:01.376) 0:04:12.296 ********** 2026-04-03 09:33:51.811264 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:51.811275 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:51.811286 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:51.811297 | orchestrator | 2026-04-03 09:33:51.811314 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-03 09:33:51.811333 | orchestrator | Friday 03 April 2026 09:33:41 +0000 (0:00:02.585) 0:04:14.882 ********** 2026-04-03 09:33:51.811352 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:33:51.811364 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:33:51.811375 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-03 09:33:51.811386 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:33:51.811396 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:33:51.811407 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-03 09:33:51.811417 | orchestrator | 2026-04-03 09:33:51.811428 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-03 09:33:51.811438 | orchestrator | Friday 03 April 2026 09:33:45 +0000 (0:00:04.167) 0:04:19.049 ********** 2026-04-03 09:33:51.811449 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 09:33:51.811460 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 09:33:51.811470 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:33:51.811489 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-03 09:33:51.811501 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:33:51.811516 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-03 09:33:51.811535 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:33:51.811551 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-03 09:33:51.811562 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:33:51.811573 | orchestrator | 2026-04-03 09:33:51.811641 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-03 09:33:51.811653 | orchestrator | Friday 03 April 2026 09:33:50 +0000 (0:00:04.249) 0:04:23.299 ********** 2026-04-03 09:33:51.811674 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:06.522933 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:06.523084 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:06.523116 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:34:06.523137 | orchestrator | 2026-04-03 09:34:06.523158 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-03 09:34:06.523177 | orchestrator | Friday 03 April 2026 09:33:53 +0000 (0:00:03.560) 0:04:26.860 ********** 2026-04-03 09:34:06.523197 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:34:06.523215 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:34:06.523234 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:34:06.523285 | orchestrator | 2026-04-03 09:34:06.523305 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-03 09:34:06.523324 | orchestrator | Friday 03 April 2026 09:33:55 +0000 (0:00:02.039) 0:04:28.899 ********** 2026-04-03 09:34:06.523343 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:06.523361 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:06.523379 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:06.523398 | orchestrator | 2026-04-03 09:34:06.523417 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-03 09:34:06.523435 | orchestrator | Friday 03 April 2026 09:33:57 +0000 (0:00:01.354) 0:04:30.253 ********** 2026-04-03 09:34:06.523454 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:06.523472 | orchestrator | 2026-04-03 09:34:06.523489 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-03 09:34:06.523505 | orchestrator | Friday 03 April 2026 09:33:58 +0000 (0:00:01.132) 0:04:31.386 ********** 2026-04-03 09:34:06.523521 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:06.523539 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:06.523556 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:06.523573 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:06.523623 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:06.523641 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:06.523657 | orchestrator | 2026-04-03 09:34:06.523676 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-03 09:34:06.523695 | orchestrator | Friday 03 April 2026 09:34:00 +0000 (0:00:01.795) 0:04:33.182 ********** 2026-04-03 09:34:06.523713 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:34:06.523730 | orchestrator | 2026-04-03 09:34:06.523748 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-03 09:34:06.523767 | orchestrator | Friday 03 April 2026 09:34:01 +0000 (0:00:01.812) 0:04:34.995 ********** 2026-04-03 09:34:06.523785 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:06.523803 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:06.523823 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:06.523841 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:06.523858 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:06.523877 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:06.523895 | orchestrator | 2026-04-03 09:34:06.523913 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-03 09:34:06.523933 | orchestrator | Friday 03 April 2026 09:34:03 +0000 (0:00:01.971) 0:04:36.966 ********** 2026-04-03 09:34:06.523957 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524002 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524078 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524103 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524124 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524144 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524164 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524193 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:06.524239 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638543 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638688 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638704 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638716 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638744 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638797 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:09.638811 | orchestrator | 2026-04-03 09:34:09.638825 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-03 09:34:09.638838 | orchestrator | Friday 03 April 2026 09:34:08 +0000 (0:00:04.614) 0:04:41.581 ********** 2026-04-03 09:34:09.638850 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:09.638863 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:09.638875 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:09.638894 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:09.638918 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:22.015230 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:22.015322 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015332 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015339 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015373 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015392 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015400 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015407 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015414 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015421 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:34:22.015433 | orchestrator | 2026-04-03 09:34:22.015441 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-03 09:34:22.015449 | orchestrator | Friday 03 April 2026 09:34:16 +0000 (0:00:07.653) 0:04:49.235 ********** 2026-04-03 09:34:22.015456 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:22.015463 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:22.015469 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:22.015475 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:22.015481 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:22.015487 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:22.015493 | orchestrator | 2026-04-03 09:34:22.015500 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-03 09:34:22.015506 | orchestrator | Friday 03 April 2026 09:34:19 +0000 (0:00:02.969) 0:04:52.204 ********** 2026-04-03 09:34:22.015512 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:34:22.015523 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:34:22.015529 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:34:22.015535 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-03 09:34:22.015542 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:34:22.015548 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:34:22.015554 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:22.015560 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-03 09:34:22.015567 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:34:22.015573 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:22.015583 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-03 09:34:52.078708 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.078823 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:34:52.078840 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:34:52.078852 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-03 09:34:52.078864 | orchestrator | 2026-04-03 09:34:52.078877 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-03 09:34:52.078894 | orchestrator | Friday 03 April 2026 09:34:24 +0000 (0:00:05.016) 0:04:57.221 ********** 2026-04-03 09:34:52.078915 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:52.078931 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:52.078950 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:52.078970 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.078992 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.079012 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.079025 | orchestrator | 2026-04-03 09:34:52.079036 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-03 09:34:52.079047 | orchestrator | Friday 03 April 2026 09:34:26 +0000 (0:00:02.033) 0:04:59.255 ********** 2026-04-03 09:34:52.079059 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:34:52.079070 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:34:52.079108 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-03 09:34:52.079127 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:34:52.079144 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:34:52.079164 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079176 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-03 09:34:52.079186 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079197 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079216 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079235 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.079251 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079264 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.079277 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079291 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-03 09:34:52.079304 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.079317 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079329 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079342 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079355 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079368 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-03 09:34:52.079380 | orchestrator | 2026-04-03 09:34:52.079393 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-03 09:34:52.079406 | orchestrator | Friday 03 April 2026 09:34:32 +0000 (0:00:06.496) 0:05:05.751 ********** 2026-04-03 09:34:52.079434 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:34:52.079447 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:34:52.079460 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-03 09:34:52.079473 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:34:52.079486 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:34:52.079502 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:34:52.079521 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:34:52.079538 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-03 09:34:52.079553 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-03 09:34:52.079584 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:34:52.079631 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:34:52.079643 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:34:52.079654 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.079665 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-03 09:34:52.079676 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:34:52.079687 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:34:52.079698 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:34:52.079708 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.079719 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-03 09:34:52.079730 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.079741 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-03 09:34:52.079752 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:34:52.079762 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:34:52.079773 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-03 09:34:52.079784 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:34:52.079794 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:34:52.079805 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-03 09:34:52.079816 | orchestrator | 2026-04-03 09:34:52.079826 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-03 09:34:52.079837 | orchestrator | Friday 03 April 2026 09:34:41 +0000 (0:00:08.435) 0:05:14.187 ********** 2026-04-03 09:34:52.079848 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:52.079859 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:52.079870 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:52.079880 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.079891 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.079901 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.079912 | orchestrator | 2026-04-03 09:34:52.079923 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-03 09:34:52.079934 | orchestrator | Friday 03 April 2026 09:34:42 +0000 (0:00:01.801) 0:05:15.988 ********** 2026-04-03 09:34:52.079945 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:52.079955 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:52.079966 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:52.079977 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.079987 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.079998 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.080008 | orchestrator | 2026-04-03 09:34:52.080019 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-03 09:34:52.080030 | orchestrator | Friday 03 April 2026 09:34:44 +0000 (0:00:01.971) 0:05:17.960 ********** 2026-04-03 09:34:52.080041 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.080051 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.080062 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.080098 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:34:52.080123 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:34:52.080145 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:34:52.080170 | orchestrator | 2026-04-03 09:34:52.080182 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-03 09:34:52.080193 | orchestrator | Friday 03 April 2026 09:34:47 +0000 (0:00:03.150) 0:05:21.110 ********** 2026-04-03 09:34:52.080203 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:52.080221 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:52.080232 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:52.080243 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:34:52.080254 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:34:52.080265 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:34:52.080276 | orchestrator | 2026-04-03 09:34:52.080287 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-03 09:34:52.080298 | orchestrator | Friday 03 April 2026 09:34:51 +0000 (0:00:03.179) 0:05:24.289 ********** 2026-04-03 09:34:52.080318 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:52.080343 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:53.213780 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:34:53.213920 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:53.213952 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:53.213973 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:34:53.214103 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:53.214123 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:34:53.214167 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:34:53.214179 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:53.214191 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:34:53.214202 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:53.214214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:34:53.214234 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:34:53.214247 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:53.214267 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:34:53.214280 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:34:53.214294 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:53.214315 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:34:59.267741 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:34:59.267885 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:59.267905 | orchestrator | 2026-04-03 09:34:59.267919 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-03 09:34:59.267932 | orchestrator | Friday 03 April 2026 09:34:54 +0000 (0:00:03.139) 0:05:27.429 ********** 2026-04-03 09:34:59.267972 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-03 09:34:59.267985 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 09:34:59.267996 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:34:59.268007 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-03 09:34:59.268019 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 09:34:59.268029 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:34:59.268040 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-03 09:34:59.268051 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 09:34:59.268062 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:34:59.268073 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 09:34:59.268084 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 09:34:59.268095 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:34:59.268106 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 09:34:59.268117 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 09:34:59.268128 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:34:59.268139 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 09:34:59.268150 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 09:34:59.268161 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:34:59.268172 | orchestrator | 2026-04-03 09:34:59.268183 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-03 09:34:59.268195 | orchestrator | Friday 03 April 2026 09:34:56 +0000 (0:00:02.217) 0:05:29.646 ********** 2026-04-03 09:34:59.268223 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268237 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268269 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268290 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268304 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268321 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268333 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268345 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:34:59.268364 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430701 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430844 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430880 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430894 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430907 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.430952 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 09:35:04.431035 | orchestrator | 2026-04-03 09:35:04.431055 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-03 09:35:04.431076 | orchestrator | Friday 03 April 2026 09:35:01 +0000 (0:00:04.907) 0:05:34.554 ********** 2026-04-03 09:35:04.431098 | orchestrator | ok: [testbed-node-3] => { 2026-04-03 09:35:04.431118 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431130 | orchestrator | } 2026-04-03 09:35:04.431146 | orchestrator | ok: [testbed-node-4] => { 2026-04-03 09:35:04.431165 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431186 | orchestrator | } 2026-04-03 09:35:04.431208 | orchestrator | ok: [testbed-node-5] => { 2026-04-03 09:35:04.431222 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431238 | orchestrator | } 2026-04-03 09:35:04.431257 | orchestrator | ok: [testbed-node-0] => { 2026-04-03 09:35:04.431278 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431298 | orchestrator | } 2026-04-03 09:35:04.431312 | orchestrator | ok: [testbed-node-1] => { 2026-04-03 09:35:04.431325 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431338 | orchestrator | } 2026-04-03 09:35:04.431356 | orchestrator | ok: [testbed-node-2] => { 2026-04-03 09:35:04.431376 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:35:04.431395 | orchestrator | } 2026-04-03 09:35:04.431413 | orchestrator | 2026-04-03 09:35:04.431427 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:35:04.431447 | orchestrator | Friday 03 April 2026 09:35:03 +0000 (0:00:02.042) 0:05:36.597 ********** 2026-04-03 09:35:04.431470 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:35:04.431501 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:35:04.431523 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:35:04.431555 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:35:04.431587 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:35:08.615283 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:35:08.615379 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:35:08.615396 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:35:08.615423 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:35:08.615436 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:35:08.615469 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-03 09:35:08.615480 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:35:08.615511 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-03 09:35:08.615533 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-03 09:35:08.615551 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:35:08.615569 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:35:08.615655 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:35:08.615682 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:35:08.615705 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-03 09:35:08.615716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-03 09:35:08.615728 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:35:08.615739 | orchestrator | 2026-04-03 09:35:08.615752 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:35:08.615764 | orchestrator | Friday 03 April 2026 09:35:07 +0000 (0:00:03.781) 0:05:40.379 ********** 2026-04-03 09:35:08.615775 | orchestrator | 2026-04-03 09:35:08.615786 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:35:08.615796 | orchestrator | Friday 03 April 2026 09:35:07 +0000 (0:00:00.507) 0:05:40.887 ********** 2026-04-03 09:35:08.615807 | orchestrator | 2026-04-03 09:35:08.615818 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:35:08.615830 | orchestrator | Friday 03 April 2026 09:35:08 +0000 (0:00:00.527) 0:05:41.415 ********** 2026-04-03 09:35:08.615843 | orchestrator | 2026-04-03 09:35:08.615865 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:36:41.899894 | orchestrator | Friday 03 April 2026 09:35:08 +0000 (0:00:00.648) 0:05:42.063 ********** 2026-04-03 09:36:41.900011 | orchestrator | 2026-04-03 09:36:41.900030 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:36:41.900043 | orchestrator | Friday 03 April 2026 09:35:09 +0000 (0:00:00.522) 0:05:42.586 ********** 2026-04-03 09:36:41.900054 | orchestrator | 2026-04-03 09:36:41.900066 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-03 09:36:41.900078 | orchestrator | Friday 03 April 2026 09:35:09 +0000 (0:00:00.503) 0:05:43.090 ********** 2026-04-03 09:36:41.900088 | orchestrator | 2026-04-03 09:36:41.900099 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-03 09:36:41.900110 | orchestrator | 2026-04-03 09:36:41.900121 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-03 09:36:41.900132 | orchestrator | Friday 03 April 2026 09:35:11 +0000 (0:00:01.915) 0:05:45.006 ********** 2026-04-03 09:36:41.900143 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:36:41.900156 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:36:41.900166 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:36:41.900177 | orchestrator | 2026-04-03 09:36:41.900188 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-03 09:36:41.900199 | orchestrator | 2026-04-03 09:36:41.900210 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-03 09:36:41.900221 | orchestrator | Friday 03 April 2026 09:35:13 +0000 (0:00:01.701) 0:05:46.708 ********** 2026-04-03 09:36:41.900232 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:36:41.900243 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:36:41.900254 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:36:41.900288 | orchestrator | 2026-04-03 09:36:41.900300 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-03 09:36:41.900311 | orchestrator | 2026-04-03 09:36:41.900322 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-03 09:36:41.900332 | orchestrator | Friday 03 April 2026 09:35:16 +0000 (0:00:02.846) 0:05:49.554 ********** 2026-04-03 09:36:41.900343 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-03 09:36:41.900354 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-03 09:36:41.900367 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-03 09:36:41.900388 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-03 09:36:41.900407 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-03 09:36:41.900425 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-03 09:36:41.900461 | orchestrator | changed: [testbed-node-1] => (item=nova-conductor) 2026-04-03 09:36:41.900480 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900501 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900519 | orchestrator | changed: [testbed-node-0] => (item=nova-conductor) 2026-04-03 09:36:41.900537 | orchestrator | changed: [testbed-node-2] => (item=nova-conductor) 2026-04-03 09:36:41.900558 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-03 09:36:41.900576 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900596 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-03 09:36:41.900617 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-03 09:36:41.900670 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-03 09:36:41.900686 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-03 09:36:41.900699 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-03 09:36:41.900711 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-03 09:36:41.900724 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900741 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900760 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-03 09:36:41.900778 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-03 09:36:41.900804 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-03 09:36:41.900825 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.900843 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.900861 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.900879 | orchestrator | changed: [testbed-node-0] => (item=nova-novncproxy) 2026-04-03 09:36:41.900898 | orchestrator | changed: [testbed-node-1] => (item=nova-novncproxy) 2026-04-03 09:36:41.900916 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-03 09:36:41.900934 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-03 09:36:41.900952 | orchestrator | changed: [testbed-node-2] => (item=nova-novncproxy) 2026-04-03 09:36:41.900971 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.900990 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.901009 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-03 09:36:41.901027 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-03 09:36:41.901046 | orchestrator | 2026-04-03 09:36:41.901064 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-03 09:36:41.901082 | orchestrator | 2026-04-03 09:36:41.901100 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-03 09:36:41.901116 | orchestrator | Friday 03 April 2026 09:35:49 +0000 (0:00:33.105) 0:06:22.659 ********** 2026-04-03 09:36:41.901148 | orchestrator | changed: [testbed-node-0] => (item=nova-scheduler) 2026-04-03 09:36:41.901191 | orchestrator | changed: [testbed-node-1] => (item=nova-scheduler) 2026-04-03 09:36:41.901209 | orchestrator | changed: [testbed-node-2] => (item=nova-scheduler) 2026-04-03 09:36:41.901225 | orchestrator | changed: [testbed-node-1] => (item=nova-api) 2026-04-03 09:36:41.901242 | orchestrator | changed: [testbed-node-0] => (item=nova-api) 2026-04-03 09:36:41.901259 | orchestrator | changed: [testbed-node-2] => (item=nova-api) 2026-04-03 09:36:41.901275 | orchestrator | 2026-04-03 09:36:41.901293 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-03 09:36:41.901311 | orchestrator | 2026-04-03 09:36:41.901328 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-03 09:36:41.901345 | orchestrator | Friday 03 April 2026 09:36:09 +0000 (0:00:20.162) 0:06:42.822 ********** 2026-04-03 09:36:41.901361 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:36:41.901380 | orchestrator | 2026-04-03 09:36:41.901399 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-03 09:36:41.901417 | orchestrator | 2026-04-03 09:36:41.901436 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-03 09:36:41.901454 | orchestrator | Friday 03 April 2026 09:36:26 +0000 (0:00:17.125) 0:06:59.948 ********** 2026-04-03 09:36:41.901472 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:36:41.901492 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:36:41.901512 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:36:41.901530 | orchestrator | 2026-04-03 09:36:41.901550 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:36:41.901569 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 09:36:41.901587 | orchestrator | testbed-node-0 : ok=39  changed=8  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-03 09:36:41.901598 | orchestrator | testbed-node-1 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-03 09:36:41.901609 | orchestrator | testbed-node-2 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-03 09:36:41.901646 | orchestrator | testbed-node-3 : ok=43  changed=5  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-03 09:36:41.901670 | orchestrator | testbed-node-4 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-03 09:36:41.901681 | orchestrator | testbed-node-5 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-03 09:36:41.901692 | orchestrator | 2026-04-03 09:36:41.901705 | orchestrator | 2026-04-03 09:36:41.901724 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:36:41.901740 | orchestrator | Friday 03 April 2026 09:36:41 +0000 (0:00:14.589) 0:07:14.538 ********** 2026-04-03 09:36:41.901758 | orchestrator | =============================================================================== 2026-04-03 09:36:41.901776 | orchestrator | nova-cell : Reload nova cell services to remove RPC version cap -------- 33.11s 2026-04-03 09:36:41.901793 | orchestrator | nova : Reload nova API services to remove RPC version pin -------------- 20.16s 2026-04-03 09:36:41.901813 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 20.13s 2026-04-03 09:36:41.901832 | orchestrator | nova : Run Nova upgrade checks ----------------------------------------- 19.16s 2026-04-03 09:36:41.901851 | orchestrator | nova : Run Nova API online database migrations ------------------------- 17.13s 2026-04-03 09:36:41.901862 | orchestrator | nova-cell : Run Nova cell online database migrations ------------------- 14.59s 2026-04-03 09:36:41.901885 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 13.95s 2026-04-03 09:36:41.901896 | orchestrator | nova : Copying over nova.conf ------------------------------------------- 9.70s 2026-04-03 09:36:41.901907 | orchestrator | nova-cell : Copying files for nova-ssh ---------------------------------- 8.44s 2026-04-03 09:36:41.901918 | orchestrator | nova-cell : Copying over nova.conf -------------------------------------- 7.65s 2026-04-03 09:36:41.901928 | orchestrator | nova-cell : Copying over libvirt SASL configuration --------------------- 6.50s 2026-04-03 09:36:41.901939 | orchestrator | nova-cell : Get container facts ----------------------------------------- 5.30s 2026-04-03 09:36:41.901950 | orchestrator | service-check-containers : nova | Check containers ---------------------- 5.15s 2026-04-03 09:36:41.901960 | orchestrator | nova-cell : Copying over libvirt configuration -------------------------- 5.02s 2026-04-03 09:36:41.901971 | orchestrator | service-check-containers : nova_cell | Check containers ----------------- 4.91s 2026-04-03 09:36:41.901982 | orchestrator | nova-cell : Get current Libvirt version --------------------------------- 4.87s 2026-04-03 09:36:41.901992 | orchestrator | nova-cell : Copy over ceph.conf ----------------------------------------- 4.84s 2026-04-03 09:36:41.902003 | orchestrator | service-cert-copy : nova | Copying over extra CA certificates ----------- 4.72s 2026-04-03 09:36:41.902014 | orchestrator | nova-cell : Flush handlers ---------------------------------------------- 4.63s 2026-04-03 09:36:41.902107 | orchestrator | nova-cell : Copying over config.json files for services ----------------- 4.62s 2026-04-03 09:36:42.093180 | orchestrator | + osism apply -a upgrade horizon 2026-04-03 09:36:43.377524 | orchestrator | 2026-04-03 09:36:43 | INFO  | Prepare task for execution of horizon. 2026-04-03 09:36:43.443015 | orchestrator | 2026-04-03 09:36:43 | INFO  | Task 82fcbc99-5d46-4e32-b6e9-2f453ba0ad9f (horizon) was prepared for execution. 2026-04-03 09:36:43.443101 | orchestrator | 2026-04-03 09:36:43 | INFO  | It takes a moment until task 82fcbc99-5d46-4e32-b6e9-2f453ba0ad9f (horizon) has been started and output is visible here. 2026-04-03 09:36:58.479596 | orchestrator | 2026-04-03 09:36:58.479767 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:36:58.479785 | orchestrator | 2026-04-03 09:36:58.479797 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:36:58.479809 | orchestrator | Friday 03 April 2026 09:36:48 +0000 (0:00:01.500) 0:00:01.500 ********** 2026-04-03 09:36:58.479820 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:36:58.479832 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:36:58.479843 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:36:58.479854 | orchestrator | 2026-04-03 09:36:58.479865 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:36:58.479876 | orchestrator | Friday 03 April 2026 09:36:50 +0000 (0:00:01.833) 0:00:03.334 ********** 2026-04-03 09:36:58.479887 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-03 09:36:58.479898 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-03 09:36:58.479909 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-03 09:36:58.479920 | orchestrator | 2026-04-03 09:36:58.479931 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-03 09:36:58.479942 | orchestrator | 2026-04-03 09:36:58.479953 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 09:36:58.479964 | orchestrator | Friday 03 April 2026 09:36:51 +0000 (0:00:01.717) 0:00:05.051 ********** 2026-04-03 09:36:58.479975 | orchestrator | included: /ansible/roles/horizon/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:36:58.479987 | orchestrator | 2026-04-03 09:36:58.479998 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-03 09:36:58.480009 | orchestrator | Friday 03 April 2026 09:36:55 +0000 (0:00:03.423) 0:00:08.475 ********** 2026-04-03 09:36:58.480044 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:36:58.480112 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:36:58.480138 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:36:58.480153 | orchestrator | 2026-04-03 09:36:58.480166 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-03 09:36:58.480178 | orchestrator | Friday 03 April 2026 09:36:58 +0000 (0:00:02.873) 0:00:11.348 ********** 2026-04-03 09:36:58.480191 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:36:58.480203 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:36:58.480216 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:36:58.480228 | orchestrator | 2026-04-03 09:36:58.480247 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 09:37:25.410746 | orchestrator | Friday 03 April 2026 09:36:59 +0000 (0:00:01.501) 0:00:12.850 ********** 2026-04-03 09:37:25.410869 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 09:37:25.410887 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 09:37:25.410899 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 09:37:25.410911 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 09:37:25.410921 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 09:37:25.410933 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 09:37:25.410944 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-03 09:37:25.410979 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 09:37:25.410990 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 09:37:25.411001 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 09:37:25.411012 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 09:37:25.411024 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 09:37:25.411035 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 09:37:25.411046 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 09:37:25.411056 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-03 09:37:25.411067 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 09:37:25.411093 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-03 09:37:25.411104 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-03 09:37:25.411115 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-03 09:37:25.411126 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-03 09:37:25.411137 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-03 09:37:25.411147 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-03 09:37:25.411158 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-03 09:37:25.411169 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-03 09:37:25.411180 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-03 09:37:25.411193 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-03 09:37:25.411207 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-03 09:37:25.411220 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-03 09:37:25.411234 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-03 09:37:25.411247 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-03 09:37:25.411260 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-03 09:37:25.411273 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-03 09:37:25.411286 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-03 09:37:25.411299 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-03 09:37:25.411312 | orchestrator | 2026-04-03 09:37:25.411326 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.411339 | orchestrator | Friday 03 April 2026 09:37:01 +0000 (0:00:02.190) 0:00:15.040 ********** 2026-04-03 09:37:25.411360 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.411374 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.411386 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.411399 | orchestrator | 2026-04-03 09:37:25.411430 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.411442 | orchestrator | Friday 03 April 2026 09:37:03 +0000 (0:00:01.579) 0:00:16.620 ********** 2026-04-03 09:37:25.411454 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411466 | orchestrator | 2026-04-03 09:37:25.411477 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.411488 | orchestrator | Friday 03 April 2026 09:37:04 +0000 (0:00:01.179) 0:00:17.799 ********** 2026-04-03 09:37:25.411499 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411510 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.411521 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:25.411532 | orchestrator | 2026-04-03 09:37:25.411543 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.411554 | orchestrator | Friday 03 April 2026 09:37:06 +0000 (0:00:01.444) 0:00:19.244 ********** 2026-04-03 09:37:25.411564 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.411575 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.411586 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.411597 | orchestrator | 2026-04-03 09:37:25.411608 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.411618 | orchestrator | Friday 03 April 2026 09:37:07 +0000 (0:00:01.515) 0:00:20.760 ********** 2026-04-03 09:37:25.411648 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411660 | orchestrator | 2026-04-03 09:37:25.411671 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.411681 | orchestrator | Friday 03 April 2026 09:37:08 +0000 (0:00:01.137) 0:00:21.897 ********** 2026-04-03 09:37:25.411692 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411703 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.411714 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:25.411725 | orchestrator | 2026-04-03 09:37:25.411736 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.411747 | orchestrator | Friday 03 April 2026 09:37:10 +0000 (0:00:01.398) 0:00:23.295 ********** 2026-04-03 09:37:25.411758 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.411769 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.411779 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.411790 | orchestrator | 2026-04-03 09:37:25.411806 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.411818 | orchestrator | Friday 03 April 2026 09:37:11 +0000 (0:00:01.413) 0:00:24.709 ********** 2026-04-03 09:37:25.411828 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411839 | orchestrator | 2026-04-03 09:37:25.411850 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.411861 | orchestrator | Friday 03 April 2026 09:37:12 +0000 (0:00:01.132) 0:00:25.842 ********** 2026-04-03 09:37:25.411872 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.411883 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.411894 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:25.411905 | orchestrator | 2026-04-03 09:37:25.411916 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.411926 | orchestrator | Friday 03 April 2026 09:37:14 +0000 (0:00:01.576) 0:00:27.418 ********** 2026-04-03 09:37:25.411937 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.411948 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.411959 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.411970 | orchestrator | 2026-04-03 09:37:25.411981 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.411991 | orchestrator | Friday 03 April 2026 09:37:15 +0000 (0:00:01.467) 0:00:28.886 ********** 2026-04-03 09:37:25.412009 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412020 | orchestrator | 2026-04-03 09:37:25.412031 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.412041 | orchestrator | Friday 03 April 2026 09:37:16 +0000 (0:00:01.132) 0:00:30.018 ********** 2026-04-03 09:37:25.412052 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412063 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.412074 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:25.412085 | orchestrator | 2026-04-03 09:37:25.412096 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.412106 | orchestrator | Friday 03 April 2026 09:37:18 +0000 (0:00:01.355) 0:00:31.374 ********** 2026-04-03 09:37:25.412117 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.412128 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.412139 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.412150 | orchestrator | 2026-04-03 09:37:25.412160 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.412171 | orchestrator | Friday 03 April 2026 09:37:19 +0000 (0:00:01.593) 0:00:32.968 ********** 2026-04-03 09:37:25.412182 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412193 | orchestrator | 2026-04-03 09:37:25.412204 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.412215 | orchestrator | Friday 03 April 2026 09:37:20 +0000 (0:00:01.145) 0:00:34.114 ********** 2026-04-03 09:37:25.412226 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412237 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.412247 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:25.412258 | orchestrator | 2026-04-03 09:37:25.412269 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:25.412280 | orchestrator | Friday 03 April 2026 09:37:22 +0000 (0:00:01.401) 0:00:35.516 ********** 2026-04-03 09:37:25.412291 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:25.412302 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:25.412312 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:25.412323 | orchestrator | 2026-04-03 09:37:25.412334 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:25.412345 | orchestrator | Friday 03 April 2026 09:37:23 +0000 (0:00:01.399) 0:00:36.915 ********** 2026-04-03 09:37:25.412355 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412366 | orchestrator | 2026-04-03 09:37:25.412378 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:25.412397 | orchestrator | Friday 03 April 2026 09:37:24 +0000 (0:00:01.184) 0:00:38.100 ********** 2026-04-03 09:37:25.412417 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:25.412436 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:25.412466 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.753760 | orchestrator | 2026-04-03 09:37:59.753878 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:59.753894 | orchestrator | Friday 03 April 2026 09:37:26 +0000 (0:00:01.581) 0:00:39.681 ********** 2026-04-03 09:37:59.753906 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:59.753919 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:59.753930 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:59.753941 | orchestrator | 2026-04-03 09:37:59.753952 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:59.753963 | orchestrator | Friday 03 April 2026 09:37:27 +0000 (0:00:01.367) 0:00:41.049 ********** 2026-04-03 09:37:59.753975 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.753987 | orchestrator | 2026-04-03 09:37:59.753998 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:59.754009 | orchestrator | Friday 03 April 2026 09:37:28 +0000 (0:00:01.108) 0:00:42.158 ********** 2026-04-03 09:37:59.754078 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754090 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.754101 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.754139 | orchestrator | 2026-04-03 09:37:59.754150 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:59.754162 | orchestrator | Friday 03 April 2026 09:37:30 +0000 (0:00:01.430) 0:00:43.588 ********** 2026-04-03 09:37:59.754172 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:59.754183 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:59.754194 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:59.754204 | orchestrator | 2026-04-03 09:37:59.754215 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:59.754227 | orchestrator | Friday 03 April 2026 09:37:31 +0000 (0:00:01.335) 0:00:44.924 ********** 2026-04-03 09:37:59.754238 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754248 | orchestrator | 2026-04-03 09:37:59.754259 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:59.754270 | orchestrator | Friday 03 April 2026 09:37:32 +0000 (0:00:01.127) 0:00:46.051 ********** 2026-04-03 09:37:59.754281 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754292 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.754317 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.754328 | orchestrator | 2026-04-03 09:37:59.754339 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:59.754350 | orchestrator | Friday 03 April 2026 09:37:34 +0000 (0:00:01.579) 0:00:47.630 ********** 2026-04-03 09:37:59.754361 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:59.754372 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:59.754382 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:59.754393 | orchestrator | 2026-04-03 09:37:59.754404 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:59.754415 | orchestrator | Friday 03 April 2026 09:37:35 +0000 (0:00:01.369) 0:00:49.000 ********** 2026-04-03 09:37:59.754426 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754437 | orchestrator | 2026-04-03 09:37:59.754448 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:59.754459 | orchestrator | Friday 03 April 2026 09:37:36 +0000 (0:00:01.122) 0:00:50.123 ********** 2026-04-03 09:37:59.754470 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754481 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.754492 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.754503 | orchestrator | 2026-04-03 09:37:59.754514 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-03 09:37:59.754525 | orchestrator | Friday 03 April 2026 09:37:38 +0000 (0:00:01.317) 0:00:51.441 ********** 2026-04-03 09:37:59.754536 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:37:59.754547 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:37:59.754558 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:37:59.754568 | orchestrator | 2026-04-03 09:37:59.754579 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-03 09:37:59.754590 | orchestrator | Friday 03 April 2026 09:37:39 +0000 (0:00:01.364) 0:00:52.806 ********** 2026-04-03 09:37:59.754601 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754612 | orchestrator | 2026-04-03 09:37:59.754623 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-03 09:37:59.754658 | orchestrator | Friday 03 April 2026 09:37:40 +0000 (0:00:01.118) 0:00:53.924 ********** 2026-04-03 09:37:59.754671 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.754682 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.754692 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.754703 | orchestrator | 2026-04-03 09:37:59.754714 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-03 09:37:59.754725 | orchestrator | Friday 03 April 2026 09:37:42 +0000 (0:00:01.348) 0:00:55.272 ********** 2026-04-03 09:37:59.754736 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:37:59.754746 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:37:59.754757 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:37:59.754776 | orchestrator | 2026-04-03 09:37:59.754787 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-03 09:37:59.754797 | orchestrator | Friday 03 April 2026 09:37:44 +0000 (0:00:02.794) 0:00:58.067 ********** 2026-04-03 09:37:59.754808 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 09:37:59.754819 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 09:37:59.754830 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-03 09:37:59.754841 | orchestrator | 2026-04-03 09:37:59.754852 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-03 09:37:59.754863 | orchestrator | Friday 03 April 2026 09:37:47 +0000 (0:00:03.078) 0:01:01.145 ********** 2026-04-03 09:37:59.754874 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 09:37:59.754886 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 09:37:59.754915 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-03 09:37:59.754927 | orchestrator | 2026-04-03 09:37:59.754938 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-03 09:37:59.754950 | orchestrator | Friday 03 April 2026 09:37:50 +0000 (0:00:03.024) 0:01:04.170 ********** 2026-04-03 09:37:59.754961 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 09:37:59.754972 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 09:37:59.754982 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-03 09:37:59.754993 | orchestrator | 2026-04-03 09:37:59.755004 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-03 09:37:59.755015 | orchestrator | Friday 03 April 2026 09:37:53 +0000 (0:00:02.648) 0:01:06.818 ********** 2026-04-03 09:37:59.755026 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.755037 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.755047 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.755058 | orchestrator | 2026-04-03 09:37:59.755069 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-03 09:37:59.755079 | orchestrator | Friday 03 April 2026 09:37:54 +0000 (0:00:01.336) 0:01:08.155 ********** 2026-04-03 09:37:59.755090 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:37:59.755101 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:37:59.755111 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:37:59.755122 | orchestrator | 2026-04-03 09:37:59.755133 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 09:37:59.755143 | orchestrator | Friday 03 April 2026 09:37:56 +0000 (0:00:01.592) 0:01:09.748 ********** 2026-04-03 09:37:59.755154 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:37:59.755165 | orchestrator | 2026-04-03 09:37:59.755176 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-03 09:37:59.755192 | orchestrator | Friday 03 April 2026 09:37:58 +0000 (0:00:01.722) 0:01:11.470 ********** 2026-04-03 09:37:59.755210 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:37:59.755250 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:38:01.496440 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:38:01.496566 | orchestrator | 2026-04-03 09:38:01.496584 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-03 09:38:01.496597 | orchestrator | Friday 03 April 2026 09:38:00 +0000 (0:00:02.637) 0:01:14.108 ********** 2026-04-03 09:38:01.496697 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:01.496725 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:38:01.496739 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:01.496751 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:38:01.496779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:06.327178 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:38:06.327271 | orchestrator | 2026-04-03 09:38:06.327286 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-03 09:38:06.327297 | orchestrator | Friday 03 April 2026 09:38:02 +0000 (0:00:01.709) 0:01:15.818 ********** 2026-04-03 09:38:06.327310 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:06.327323 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:38:06.327364 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:06.327394 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:38:06.327409 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:06.327425 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:38:06.327434 | orchestrator | 2026-04-03 09:38:06.327443 | orchestrator | TASK [service-check-containers : horizon | Check containers] ******************* 2026-04-03 09:38:06.327451 | orchestrator | Friday 03 April 2026 09:38:04 +0000 (0:00:02.022) 0:01:17.841 ********** 2026-04-03 09:38:06.327468 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:38:09.323843 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:38:09.323993 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-03 09:38:09.324017 | orchestrator | 2026-04-03 09:38:09.324040 | orchestrator | TASK [service-check-containers : horizon | Notify handlers to restart containers] *** 2026-04-03 09:38:09.324063 | orchestrator | Friday 03 April 2026 09:38:07 +0000 (0:00:02.822) 0:01:20.664 ********** 2026-04-03 09:38:09.324084 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:38:09.324105 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:38:09.324125 | orchestrator | } 2026-04-03 09:38:09.324145 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:38:09.324165 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:38:09.324185 | orchestrator | } 2026-04-03 09:38:09.324205 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:38:09.324225 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:38:09.324246 | orchestrator | } 2026-04-03 09:38:09.324266 | orchestrator | 2026-04-03 09:38:09.324280 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:38:09.324294 | orchestrator | Friday 03 April 2026 09:38:08 +0000 (0:00:01.362) 0:01:22.027 ********** 2026-04-03 09:38:09.324331 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:38:09.324347 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:38:09.324381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:39:24.281371 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:39:24.281485 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-03 09:39:24.281504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:39:24.281516 | orchestrator | 2026-04-03 09:39:24.281528 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 09:39:24.281539 | orchestrator | Friday 03 April 2026 09:38:11 +0000 (0:00:02.231) 0:01:24.258 ********** 2026-04-03 09:39:24.281549 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:39:24.281559 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:39:24.281569 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:39:24.281579 | orchestrator | 2026-04-03 09:39:24.281588 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-03 09:39:24.281598 | orchestrator | Friday 03 April 2026 09:38:12 +0000 (0:00:01.355) 0:01:25.614 ********** 2026-04-03 09:39:24.281608 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:39:24.281618 | orchestrator | 2026-04-03 09:39:24.281628 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-03 09:39:24.281638 | orchestrator | Friday 03 April 2026 09:38:14 +0000 (0:00:01.690) 0:01:27.305 ********** 2026-04-03 09:39:24.281731 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:39:24.281743 | orchestrator | 2026-04-03 09:39:24.281752 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 09:39:24.281762 | orchestrator | Friday 03 April 2026 09:38:51 +0000 (0:00:37.601) 0:02:04.906 ********** 2026-04-03 09:39:24.281772 | orchestrator | 2026-04-03 09:39:24.281782 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 09:39:24.281792 | orchestrator | Friday 03 April 2026 09:38:52 +0000 (0:00:00.638) 0:02:05.545 ********** 2026-04-03 09:39:24.281801 | orchestrator | 2026-04-03 09:39:24.281811 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-03 09:39:24.281821 | orchestrator | Friday 03 April 2026 09:38:52 +0000 (0:00:00.442) 0:02:05.988 ********** 2026-04-03 09:39:24.281831 | orchestrator | 2026-04-03 09:39:24.281840 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-03 09:39:24.281850 | orchestrator | Friday 03 April 2026 09:38:53 +0000 (0:00:00.822) 0:02:06.810 ********** 2026-04-03 09:39:24.281860 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:39:24.281870 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:39:24.281880 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:39:24.281889 | orchestrator | 2026-04-03 09:39:24.281899 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:39:24.281910 | orchestrator | testbed-node-0 : ok=36  changed=6  unreachable=0 failed=0 skipped=26  rescued=0 ignored=0 2026-04-03 09:39:24.281950 | orchestrator | testbed-node-1 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 09:39:24.281962 | orchestrator | testbed-node-2 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 09:39:24.281971 | orchestrator | 2026-04-03 09:39:24.281981 | orchestrator | 2026-04-03 09:39:24.281991 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:39:24.282000 | orchestrator | Friday 03 April 2026 09:39:23 +0000 (0:00:30.192) 0:02:37.003 ********** 2026-04-03 09:39:24.282010 | orchestrator | =============================================================================== 2026-04-03 09:39:24.282076 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 37.60s 2026-04-03 09:39:24.282087 | orchestrator | horizon : Restart horizon container ------------------------------------ 30.19s 2026-04-03 09:39:24.282097 | orchestrator | horizon : include_tasks ------------------------------------------------- 3.42s 2026-04-03 09:39:24.282106 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 3.08s 2026-04-03 09:39:24.282115 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 3.02s 2026-04-03 09:39:24.282125 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 2.87s 2026-04-03 09:39:24.282134 | orchestrator | service-check-containers : horizon | Check containers ------------------- 2.82s 2026-04-03 09:39:24.282144 | orchestrator | horizon : Copying over config.json files for services ------------------- 2.79s 2026-04-03 09:39:24.282153 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 2.65s 2026-04-03 09:39:24.282163 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 2.64s 2026-04-03 09:39:24.282172 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.23s 2026-04-03 09:39:24.282182 | orchestrator | horizon : include_tasks ------------------------------------------------- 2.19s 2026-04-03 09:39:24.282191 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 2.02s 2026-04-03 09:39:24.282201 | orchestrator | horizon : Flush handlers ------------------------------------------------ 1.90s 2026-04-03 09:39:24.282210 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.83s 2026-04-03 09:39:24.282220 | orchestrator | horizon : include_tasks ------------------------------------------------- 1.72s 2026-04-03 09:39:24.282238 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.72s 2026-04-03 09:39:24.282248 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 1.71s 2026-04-03 09:39:24.282257 | orchestrator | horizon : include_tasks ------------------------------------------------- 1.69s 2026-04-03 09:39:24.282267 | orchestrator | horizon : Copying over custom themes ------------------------------------ 1.59s 2026-04-03 09:39:24.477078 | orchestrator | + osism apply -a upgrade skyline 2026-04-03 09:39:25.818252 | orchestrator | 2026-04-03 09:39:25 | INFO  | Prepare task for execution of skyline. 2026-04-03 09:39:25.882647 | orchestrator | 2026-04-03 09:39:25 | INFO  | Task 826c711a-642f-4bb9-8fcd-ff6708a58f36 (skyline) was prepared for execution. 2026-04-03 09:39:25.882794 | orchestrator | 2026-04-03 09:39:25 | INFO  | It takes a moment until task 826c711a-642f-4bb9-8fcd-ff6708a58f36 (skyline) has been started and output is visible here. 2026-04-03 09:39:35.832158 | orchestrator | 2026-04-03 09:39:35.832277 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:39:35.832295 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:39:35.832310 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:39:35.832332 | orchestrator | 2026-04-03 09:39:35.832343 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:39:35.832354 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:39:35.832365 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:39:35.832386 | orchestrator | Friday 03 April 2026 09:39:30 +0000 (0:00:01.239) 0:00:01.239 ********** 2026-04-03 09:39:35.832397 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:39:35.832408 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:39:35.832419 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:39:35.832429 | orchestrator | 2026-04-03 09:39:35.832440 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:39:35.832451 | orchestrator | Friday 03 April 2026 09:39:31 +0000 (0:00:00.917) 0:00:02.157 ********** 2026-04-03 09:39:35.832462 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-03 09:39:35.832473 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-03 09:39:35.832484 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-03 09:39:35.832494 | orchestrator | 2026-04-03 09:39:35.832505 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-03 09:39:35.832516 | orchestrator | 2026-04-03 09:39:35.832526 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-03 09:39:35.832537 | orchestrator | Friday 03 April 2026 09:39:32 +0000 (0:00:00.724) 0:00:02.881 ********** 2026-04-03 09:39:35.832564 | orchestrator | included: /ansible/roles/skyline/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:39:35.832575 | orchestrator | 2026-04-03 09:39:35.832586 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-03 09:39:35.832597 | orchestrator | Friday 03 April 2026 09:39:33 +0000 (0:00:01.244) 0:00:04.126 ********** 2026-04-03 09:39:35.832613 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:35.832693 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:35.832732 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:35.832755 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:35.832769 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:35.832791 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:35.832805 | orchestrator | 2026-04-03 09:39:35.832818 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-03 09:39:35.832831 | orchestrator | Friday 03 April 2026 09:39:35 +0000 (0:00:01.967) 0:00:06.093 ********** 2026-04-03 09:39:35.832851 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:39:39.329858 | orchestrator | 2026-04-03 09:39:39.329944 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-03 09:39:39.329955 | orchestrator | Friday 03 April 2026 09:39:36 +0000 (0:00:01.333) 0:00:07.427 ********** 2026-04-03 09:39:39.329967 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:39.329991 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:39.330059 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:39.330085 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:39.330095 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:39.330108 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:39.330122 | orchestrator | 2026-04-03 09:39:39.330131 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-03 09:39:39.330139 | orchestrator | Friday 03 April 2026 09:39:38 +0000 (0:00:02.366) 0:00:09.793 ********** 2026-04-03 09:39:39.330147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:39.330162 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:40.041407 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:39:40.041537 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:40.041580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:40.041593 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:39:40.041606 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:40.041639 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:40.041709 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:39:40.041732 | orchestrator | 2026-04-03 09:39:40.041753 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-03 09:39:40.041775 | orchestrator | Friday 03 April 2026 09:39:39 +0000 (0:00:00.636) 0:00:10.430 ********** 2026-04-03 09:39:40.041803 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:40.041838 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:40.041860 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:39:40.041880 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:40.041913 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:43.213915 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:39:43.214154 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:43.214219 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:43.214243 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:39:43.214265 | orchestrator | 2026-04-03 09:39:43.214287 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-03 09:39:43.214309 | orchestrator | Friday 03 April 2026 09:39:40 +0000 (0:00:01.123) 0:00:11.554 ********** 2026-04-03 09:39:43.214330 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:43.214380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:43.214423 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:43.214439 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:43.214453 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:43.214477 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:51.678272 | orchestrator | 2026-04-03 09:39:51.678429 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-03 09:39:51.678454 | orchestrator | Friday 03 April 2026 09:39:43 +0000 (0:00:02.595) 0:00:14.149 ********** 2026-04-03 09:39:51.678467 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 09:39:51.678479 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 09:39:51.678490 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-03 09:39:51.678501 | orchestrator | 2026-04-03 09:39:51.678513 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-03 09:39:51.678524 | orchestrator | Friday 03 April 2026 09:39:44 +0000 (0:00:01.607) 0:00:15.757 ********** 2026-04-03 09:39:51.678535 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 09:39:51.678546 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 09:39:51.678557 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-03 09:39:51.678568 | orchestrator | 2026-04-03 09:39:51.678579 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-03 09:39:51.678590 | orchestrator | Friday 03 April 2026 09:39:46 +0000 (0:00:01.992) 0:00:17.749 ********** 2026-04-03 09:39:51.678605 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:51.678622 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:51.678713 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:51.678731 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:51.678743 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:51.678756 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:51.678775 | orchestrator | 2026-04-03 09:39:51.678787 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-03 09:39:51.678800 | orchestrator | Friday 03 April 2026 09:39:49 +0000 (0:00:02.759) 0:00:20.509 ********** 2026-04-03 09:39:51.678814 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:39:51.678829 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:39:51.678841 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:39:51.678853 | orchestrator | 2026-04-03 09:39:51.678866 | orchestrator | TASK [service-check-containers : skyline | Check containers] ******************* 2026-04-03 09:39:51.678879 | orchestrator | Friday 03 April 2026 09:39:50 +0000 (0:00:00.685) 0:00:21.195 ********** 2026-04-03 09:39:51.678905 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:53.786204 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:53.786313 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-03 09:39:53.786355 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:53.786402 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:53.786416 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-03 09:39:53.786429 | orchestrator | 2026-04-03 09:39:53.786442 | orchestrator | TASK [service-check-containers : skyline | Notify handlers to restart containers] *** 2026-04-03 09:39:53.786455 | orchestrator | Friday 03 April 2026 09:39:52 +0000 (0:00:02.408) 0:00:23.603 ********** 2026-04-03 09:39:53.786467 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:39:53.786480 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:39:53.786491 | orchestrator | } 2026-04-03 09:39:53.786502 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:39:53.786513 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:39:53.786523 | orchestrator | } 2026-04-03 09:39:53.786542 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:39:53.786553 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:39:53.786563 | orchestrator | } 2026-04-03 09:39:53.786574 | orchestrator | 2026-04-03 09:39:53.786585 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:39:53.786596 | orchestrator | Friday 03 April 2026 09:39:53 +0000 (0:00:00.569) 0:00:24.173 ********** 2026-04-03 09:39:53.786608 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:39:53.786626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:39:53.786638 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:39:53.786686 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:40:25.674992 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:40:25.675135 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:40:25.675156 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-03 09:40:25.675185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-03 09:40:25.675198 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:40:25.675210 | orchestrator | 2026-04-03 09:40:25.675222 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 09:40:25.675235 | orchestrator | Friday 03 April 2026 09:39:54 +0000 (0:00:01.291) 0:00:25.464 ********** 2026-04-03 09:40:25.675246 | orchestrator | 2026-04-03 09:40:25.675257 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 09:40:25.675268 | orchestrator | Friday 03 April 2026 09:39:54 +0000 (0:00:00.084) 0:00:25.549 ********** 2026-04-03 09:40:25.675279 | orchestrator | 2026-04-03 09:40:25.675289 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-03 09:40:25.675300 | orchestrator | Friday 03 April 2026 09:39:54 +0000 (0:00:00.073) 0:00:25.622 ********** 2026-04-03 09:40:25.675311 | orchestrator | 2026-04-03 09:40:25.675322 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-03 09:40:25.675333 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:40:25.675345 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:40:25.675393 | orchestrator | Friday 03 April 2026 09:39:54 +0000 (0:00:00.072) 0:00:25.695 ********** 2026-04-03 09:40:25.675405 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:40:25.675416 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:40:25.675426 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:40:25.675437 | orchestrator | 2026-04-03 09:40:25.675448 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-03 09:40:25.675459 | orchestrator | Friday 03 April 2026 09:40:08 +0000 (0:00:13.676) 0:00:39.371 ********** 2026-04-03 09:40:25.675469 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:40:25.675480 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:40:25.675491 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:40:25.675504 | orchestrator | 2026-04-03 09:40:25.675517 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:40:25.675531 | orchestrator | testbed-node-0 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 09:40:25.675546 | orchestrator | testbed-node-1 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 09:40:25.675559 | orchestrator | testbed-node-2 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 09:40:25.675571 | orchestrator | 2026-04-03 09:40:25.675584 | orchestrator | 2026-04-03 09:40:25.675597 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:40:25.675609 | orchestrator | Friday 03 April 2026 09:40:25 +0000 (0:00:16.743) 0:00:56.115 ********** 2026-04-03 09:40:25.675622 | orchestrator | =============================================================================== 2026-04-03 09:40:25.675634 | orchestrator | skyline : Restart skyline-console container ---------------------------- 16.74s 2026-04-03 09:40:25.675647 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 13.68s 2026-04-03 09:40:25.675687 | orchestrator | skyline : Copying over config.json files for services ------------------- 2.76s 2026-04-03 09:40:25.675702 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 2.60s 2026-04-03 09:40:25.675715 | orchestrator | service-check-containers : skyline | Check containers ------------------- 2.41s 2026-04-03 09:40:25.675727 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 2.37s 2026-04-03 09:40:25.675739 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 1.99s 2026-04-03 09:40:25.675751 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 1.97s 2026-04-03 09:40:25.675764 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 1.61s 2026-04-03 09:40:25.675776 | orchestrator | skyline : include_tasks ------------------------------------------------- 1.33s 2026-04-03 09:40:25.675790 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.29s 2026-04-03 09:40:25.675802 | orchestrator | skyline : include_tasks ------------------------------------------------- 1.25s 2026-04-03 09:40:25.675814 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 1.12s 2026-04-03 09:40:25.675827 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.92s 2026-04-03 09:40:25.675839 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.72s 2026-04-03 09:40:25.675852 | orchestrator | skyline : Copying over custom logos ------------------------------------- 0.69s 2026-04-03 09:40:25.675862 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS certificate --- 0.64s 2026-04-03 09:40:25.675873 | orchestrator | service-check-containers : skyline | Notify handlers to restart containers --- 0.57s 2026-04-03 09:40:25.675890 | orchestrator | skyline : Flush handlers ------------------------------------------------ 0.23s 2026-04-03 09:40:25.868047 | orchestrator | + osism apply -a upgrade glance 2026-04-03 09:40:27.162160 | orchestrator | 2026-04-03 09:40:27 | INFO  | Prepare task for execution of glance. 2026-04-03 09:40:27.234774 | orchestrator | 2026-04-03 09:40:27 | INFO  | Task b6413535-8922-405c-9c1b-4f936c6f0284 (glance) was prepared for execution. 2026-04-03 09:40:27.234867 | orchestrator | 2026-04-03 09:40:27 | INFO  | It takes a moment until task b6413535-8922-405c-9c1b-4f936c6f0284 (glance) has been started and output is visible here. 2026-04-03 09:40:55.542475 | orchestrator | 2026-04-03 09:40:55.542585 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:40:55.542603 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:40:55.542616 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:40:55.542636 | orchestrator | 2026-04-03 09:40:55.542646 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:40:55.542655 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:40:55.542711 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:40:55.542731 | orchestrator | Friday 03 April 2026 09:40:31 +0000 (0:00:01.252) 0:00:01.252 ********** 2026-04-03 09:40:55.542741 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:40:55.542752 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:40:55.542762 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:40:55.542771 | orchestrator | 2026-04-03 09:40:55.542781 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:40:55.542790 | orchestrator | Friday 03 April 2026 09:40:32 +0000 (0:00:01.177) 0:00:02.430 ********** 2026-04-03 09:40:55.542800 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-03 09:40:55.542810 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-03 09:40:55.542820 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-03 09:40:55.542830 | orchestrator | 2026-04-03 09:40:55.542839 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-03 09:40:55.542849 | orchestrator | 2026-04-03 09:40:55.542859 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:40:55.542868 | orchestrator | Friday 03 April 2026 09:40:33 +0000 (0:00:00.820) 0:00:03.250 ********** 2026-04-03 09:40:55.542878 | orchestrator | included: /ansible/roles/glance/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:40:55.542888 | orchestrator | 2026-04-03 09:40:55.542898 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:40:55.542908 | orchestrator | Friday 03 April 2026 09:40:35 +0000 (0:00:01.980) 0:00:05.231 ********** 2026-04-03 09:40:55.542917 | orchestrator | included: /ansible/roles/glance/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:40:55.542927 | orchestrator | 2026-04-03 09:40:55.542937 | orchestrator | TASK [glance : Start Glance upgrade] ******************************************* 2026-04-03 09:40:55.542946 | orchestrator | Friday 03 April 2026 09:40:37 +0000 (0:00:01.847) 0:00:07.079 ********** 2026-04-03 09:40:55.542956 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:40:55.542965 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:40:55.542975 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:40:55.542984 | orchestrator | 2026-04-03 09:40:55.542994 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:40:55.543004 | orchestrator | Friday 03 April 2026 09:40:38 +0000 (0:00:00.593) 0:00:07.672 ********** 2026-04-03 09:40:55.543013 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:40:55.543026 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:40:55.543037 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-0 2026-04-03 09:40:55.543070 | orchestrator | 2026-04-03 09:40:55.543082 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-03 09:40:55.543093 | orchestrator | Friday 03 April 2026 09:40:39 +0000 (0:00:01.127) 0:00:08.799 ********** 2026-04-03 09:40:55.543140 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:40:55.543156 | orchestrator | 2026-04-03 09:40:55.543167 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:40:55.543177 | orchestrator | Friday 03 April 2026 09:40:43 +0000 (0:00:03.833) 0:00:12.633 ********** 2026-04-03 09:40:55.543189 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0 2026-04-03 09:40:55.543200 | orchestrator | 2026-04-03 09:40:55.543211 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-03 09:40:55.543221 | orchestrator | Friday 03 April 2026 09:40:43 +0000 (0:00:00.627) 0:00:13.260 ********** 2026-04-03 09:40:55.543233 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:40:55.543245 | orchestrator | 2026-04-03 09:40:55.543256 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-03 09:40:55.543267 | orchestrator | Friday 03 April 2026 09:40:47 +0000 (0:00:03.695) 0:00:16.956 ********** 2026-04-03 09:40:55.543279 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:40:55.543291 | orchestrator | 2026-04-03 09:40:55.543302 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-03 09:40:55.543313 | orchestrator | Friday 03 April 2026 09:40:49 +0000 (0:00:01.559) 0:00:18.516 ********** 2026-04-03 09:40:55.543322 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:40:55.543332 | orchestrator | 2026-04-03 09:40:55.543341 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-03 09:40:55.543351 | orchestrator | Friday 03 April 2026 09:40:50 +0000 (0:00:01.021) 0:00:19.537 ********** 2026-04-03 09:40:55.543360 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:40:55.543369 | orchestrator | 2026-04-03 09:40:55.543379 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-03 09:40:55.543388 | orchestrator | Friday 03 April 2026 09:40:50 +0000 (0:00:00.686) 0:00:20.223 ********** 2026-04-03 09:40:55.543405 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:40:55.543415 | orchestrator | 2026-04-03 09:40:55.543424 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-03 09:40:55.543433 | orchestrator | Friday 03 April 2026 09:40:50 +0000 (0:00:00.136) 0:00:20.359 ********** 2026-04-03 09:40:55.543443 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:40:55.543452 | orchestrator | 2026-04-03 09:40:55.543462 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:40:55.543471 | orchestrator | Friday 03 April 2026 09:40:51 +0000 (0:00:00.138) 0:00:20.498 ********** 2026-04-03 09:40:55.543480 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0 2026-04-03 09:40:55.543489 | orchestrator | 2026-04-03 09:40:55.543499 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-03 09:40:55.543508 | orchestrator | Friday 03 April 2026 09:40:51 +0000 (0:00:00.646) 0:00:21.145 ********** 2026-04-03 09:40:55.543523 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:40:55.543534 | orchestrator | 2026-04-03 09:40:55.543544 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-03 09:40:55.543560 | orchestrator | Friday 03 April 2026 09:40:55 +0000 (0:00:03.824) 0:00:24.970 ********** 2026-04-03 09:41:47.721971 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:41:47.722214 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722233 | orchestrator | 2026-04-03 09:41:47.722247 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-03 09:41:47.722260 | orchestrator | Friday 03 April 2026 09:40:58 +0000 (0:00:02.979) 0:00:27.949 ********** 2026-04-03 09:41:47.722291 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:41:47.722304 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722315 | orchestrator | 2026-04-03 09:41:47.722326 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-03 09:41:47.722337 | orchestrator | Friday 03 April 2026 09:41:01 +0000 (0:00:03.119) 0:00:31.069 ********** 2026-04-03 09:41:47.722347 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722358 | orchestrator | 2026-04-03 09:41:47.722369 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-03 09:41:47.722400 | orchestrator | Friday 03 April 2026 09:41:05 +0000 (0:00:03.389) 0:00:34.459 ********** 2026-04-03 09:41:47.722413 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:41:47.722433 | orchestrator | 2026-04-03 09:41:47.722444 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-03 09:41:47.722455 | orchestrator | Friday 03 April 2026 09:41:09 +0000 (0:00:04.103) 0:00:38.562 ********** 2026-04-03 09:41:47.722469 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:41:47.722481 | orchestrator | 2026-04-03 09:41:47.722493 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-03 09:41:47.722506 | orchestrator | Friday 03 April 2026 09:41:15 +0000 (0:00:05.924) 0:00:44.487 ********** 2026-04-03 09:41:47.722518 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722530 | orchestrator | 2026-04-03 09:41:47.722543 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-03 09:41:47.722555 | orchestrator | Friday 03 April 2026 09:41:18 +0000 (0:00:03.251) 0:00:47.738 ********** 2026-04-03 09:41:47.722568 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722581 | orchestrator | 2026-04-03 09:41:47.722593 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-03 09:41:47.722605 | orchestrator | Friday 03 April 2026 09:41:21 +0000 (0:00:03.201) 0:00:50.940 ********** 2026-04-03 09:41:47.722617 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722629 | orchestrator | 2026-04-03 09:41:47.722641 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-03 09:41:47.722654 | orchestrator | Friday 03 April 2026 09:41:24 +0000 (0:00:03.240) 0:00:54.180 ********** 2026-04-03 09:41:47.722667 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722703 | orchestrator | 2026-04-03 09:41:47.722716 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-03 09:41:47.722728 | orchestrator | Friday 03 April 2026 09:41:24 +0000 (0:00:00.153) 0:00:54.334 ********** 2026-04-03 09:41:47.722741 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 09:41:47.722755 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722767 | orchestrator | 2026-04-03 09:41:47.722780 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-03 09:41:47.722793 | orchestrator | Friday 03 April 2026 09:41:28 +0000 (0:00:03.261) 0:00:57.596 ********** 2026-04-03 09:41:47.722806 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722818 | orchestrator | 2026-04-03 09:41:47.722832 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-03 09:41:47.722843 | orchestrator | Friday 03 April 2026 09:41:31 +0000 (0:00:03.288) 0:01:00.885 ********** 2026-04-03 09:41:47.722854 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:41:47.722865 | orchestrator | 2026-04-03 09:41:47.722881 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:41:47.722892 | orchestrator | Friday 03 April 2026 09:41:34 +0000 (0:00:03.273) 0:01:04.158 ********** 2026-04-03 09:41:47.722909 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:41:47.722921 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:41:47.722932 | orchestrator | included: /ansible/roles/glance/tasks/stop_service.yml for testbed-node-0 2026-04-03 09:41:47.722944 | orchestrator | 2026-04-03 09:41:47.722954 | orchestrator | TASK [glance : Stop glance service] ******************************************** 2026-04-03 09:41:47.722965 | orchestrator | Friday 03 April 2026 09:41:35 +0000 (0:00:00.974) 0:01:05.133 ********** 2026-04-03 09:41:47.722976 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:41:47.722987 | orchestrator | 2026-04-03 09:41:47.722998 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-03 09:41:47.723015 | orchestrator | Friday 03 April 2026 09:41:47 +0000 (0:00:12.017) 0:01:17.151 ********** 2026-04-03 09:42:49.476310 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:42:49.476393 | orchestrator | 2026-04-03 09:42:49.476400 | orchestrator | TASK [glance : Running Glance database expand container] *********************** 2026-04-03 09:42:49.476406 | orchestrator | Friday 03 April 2026 09:41:50 +0000 (0:00:02.332) 0:01:19.484 ********** 2026-04-03 09:42:49.476410 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:42:49.476414 | orchestrator | 2026-04-03 09:42:49.476419 | orchestrator | TASK [glance : Running Glance database migrate container] ********************** 2026-04-03 09:42:49.476423 | orchestrator | Friday 03 April 2026 09:42:16 +0000 (0:00:26.629) 0:01:46.113 ********** 2026-04-03 09:42:49.476427 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:42:49.476430 | orchestrator | 2026-04-03 09:42:49.476434 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:42:49.476438 | orchestrator | Friday 03 April 2026 09:42:32 +0000 (0:00:16.113) 0:02:02.227 ********** 2026-04-03 09:42:49.476442 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:42:49.476446 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-1, testbed-node-2 2026-04-03 09:42:49.476451 | orchestrator | 2026-04-03 09:42:49.476454 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-03 09:42:49.476458 | orchestrator | Friday 03 April 2026 09:42:33 +0000 (0:00:00.507) 0:02:02.734 ********** 2026-04-03 09:42:49.476467 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:42:49.476494 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:42:49.476512 | orchestrator | 2026-04-03 09:42:49.476516 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:42:49.476520 | orchestrator | Friday 03 April 2026 09:42:37 +0000 (0:00:04.076) 0:02:06.811 ********** 2026-04-03 09:42:49.476524 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-1, testbed-node-2 2026-04-03 09:42:49.476529 | orchestrator | 2026-04-03 09:42:49.476533 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-03 09:42:49.476537 | orchestrator | Friday 03 April 2026 09:42:37 +0000 (0:00:00.423) 0:02:07.234 ********** 2026-04-03 09:42:49.476541 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:42:49.476545 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:42:49.476549 | orchestrator | 2026-04-03 09:42:49.476553 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-03 09:42:49.476557 | orchestrator | Friday 03 April 2026 09:42:41 +0000 (0:00:03.809) 0:02:11.044 ********** 2026-04-03 09:42:49.476561 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:42:49.476566 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:42:49.476570 | orchestrator | 2026-04-03 09:42:49.476574 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-03 09:42:49.476578 | orchestrator | Friday 03 April 2026 09:42:42 +0000 (0:00:01.283) 0:02:12.327 ********** 2026-04-03 09:42:49.476582 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:42:49.476585 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-03 09:42:49.476589 | orchestrator | 2026-04-03 09:42:49.476593 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-03 09:42:49.476597 | orchestrator | Friday 03 April 2026 09:42:43 +0000 (0:00:01.091) 0:02:13.419 ********** 2026-04-03 09:42:49.476601 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:42:49.476605 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:42:49.476608 | orchestrator | 2026-04-03 09:42:49.476612 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-03 09:42:49.476620 | orchestrator | Friday 03 April 2026 09:42:44 +0000 (0:00:00.861) 0:02:14.280 ********** 2026-04-03 09:42:49.476624 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:42:49.476628 | orchestrator | 2026-04-03 09:42:49.476632 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-03 09:42:49.476635 | orchestrator | Friday 03 April 2026 09:42:44 +0000 (0:00:00.139) 0:02:14.420 ********** 2026-04-03 09:42:49.476639 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:42:49.476643 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:42:49.476647 | orchestrator | 2026-04-03 09:42:49.476651 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:42:49.476654 | orchestrator | Friday 03 April 2026 09:42:45 +0000 (0:00:00.241) 0:02:14.661 ********** 2026-04-03 09:42:49.476658 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-1, testbed-node-2 2026-04-03 09:42:49.476662 | orchestrator | 2026-04-03 09:42:49.476666 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-03 09:42:49.476670 | orchestrator | Friday 03 April 2026 09:42:45 +0000 (0:00:00.418) 0:02:15.080 ********** 2026-04-03 09:42:49.476732 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:42:56.242282 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:42:56.242408 | orchestrator | 2026-04-03 09:42:56.242420 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-03 09:42:56.242428 | orchestrator | Friday 03 April 2026 09:42:49 +0000 (0:00:04.109) 0:02:19.190 ********** 2026-04-03 09:42:56.242449 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:42:56.242457 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:42:56.242481 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:42:56.242494 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:42:56.242501 | orchestrator | 2026-04-03 09:42:56.242507 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-03 09:42:56.242514 | orchestrator | Friday 03 April 2026 09:42:53 +0000 (0:00:03.459) 0:02:22.650 ********** 2026-04-03 09:42:56.242524 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:42:56.242531 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:42:56.242545 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:43:35.692492 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.692608 | orchestrator | 2026-04-03 09:43:35.692625 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-03 09:43:35.692638 | orchestrator | Friday 03 April 2026 09:42:56 +0000 (0:00:03.282) 0:02:25.933 ********** 2026-04-03 09:43:35.692650 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.692661 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.692672 | orchestrator | 2026-04-03 09:43:35.692734 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-03 09:43:35.692748 | orchestrator | Friday 03 April 2026 09:42:59 +0000 (0:00:03.476) 0:02:29.409 ********** 2026-04-03 09:43:35.692779 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:43:35.692796 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:43:35.692829 | orchestrator | 2026-04-03 09:43:35.692841 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-03 09:43:35.692869 | orchestrator | Friday 03 April 2026 09:43:04 +0000 (0:00:04.184) 0:02:33.593 ********** 2026-04-03 09:43:35.692897 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:43:35.692909 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:43:35.692920 | orchestrator | 2026-04-03 09:43:35.692931 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-03 09:43:35.692942 | orchestrator | Friday 03 April 2026 09:43:10 +0000 (0:00:05.879) 0:02:39.473 ********** 2026-04-03 09:43:35.692952 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.692963 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.692974 | orchestrator | 2026-04-03 09:43:35.692985 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-03 09:43:35.692996 | orchestrator | Friday 03 April 2026 09:43:13 +0000 (0:00:03.593) 0:02:43.067 ********** 2026-04-03 09:43:35.693007 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693018 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693031 | orchestrator | 2026-04-03 09:43:35.693043 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-03 09:43:35.693056 | orchestrator | Friday 03 April 2026 09:43:17 +0000 (0:00:03.390) 0:02:46.457 ********** 2026-04-03 09:43:35.693069 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693082 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693095 | orchestrator | 2026-04-03 09:43:35.693107 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-03 09:43:35.693121 | orchestrator | Friday 03 April 2026 09:43:20 +0000 (0:00:03.442) 0:02:49.900 ********** 2026-04-03 09:43:35.693134 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693146 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693159 | orchestrator | 2026-04-03 09:43:35.693172 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-03 09:43:35.693185 | orchestrator | Friday 03 April 2026 09:43:20 +0000 (0:00:00.235) 0:02:50.136 ********** 2026-04-03 09:43:35.693197 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 09:43:35.693211 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693224 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-03 09:43:35.693237 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693249 | orchestrator | 2026-04-03 09:43:35.693262 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-03 09:43:35.693275 | orchestrator | Friday 03 April 2026 09:43:24 +0000 (0:00:03.717) 0:02:53.853 ********** 2026-04-03 09:43:35.693288 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693301 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693313 | orchestrator | 2026-04-03 09:43:35.693326 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-03 09:43:35.693339 | orchestrator | Friday 03 April 2026 09:43:28 +0000 (0:00:03.699) 0:02:57.553 ********** 2026-04-03 09:43:35.693351 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:35.693364 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:35.693378 | orchestrator | 2026-04-03 09:43:35.693395 | orchestrator | TASK [service-check-containers : glance | Check containers] ******************** 2026-04-03 09:43:35.693406 | orchestrator | Friday 03 April 2026 09:43:31 +0000 (0:00:03.753) 0:03:01.306 ********** 2026-04-03 09:43:35.693427 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:43:35.693450 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:43:40.318430 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-03 09:43:40.318547 | orchestrator | 2026-04-03 09:43:40.318561 | orchestrator | TASK [service-check-containers : glance | Notify handlers to restart containers] *** 2026-04-03 09:43:40.318572 | orchestrator | Friday 03 April 2026 09:43:35 +0000 (0:00:04.114) 0:03:05.421 ********** 2026-04-03 09:43:40.318581 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:43:40.318589 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:43:40.318596 | orchestrator | } 2026-04-03 09:43:40.318604 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:43:40.318611 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:43:40.318618 | orchestrator | } 2026-04-03 09:43:40.318627 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:43:40.318636 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:43:40.318644 | orchestrator | } 2026-04-03 09:43:40.318652 | orchestrator | 2026-04-03 09:43:40.318662 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:43:40.318670 | orchestrator | Friday 03 April 2026 09:43:36 +0000 (0:00:00.378) 0:03:05.799 ********** 2026-04-03 09:43:40.318740 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:43:40.318760 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:43:40.318776 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:43:40.318787 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:43:40.318795 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-03 09:43:40.318803 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:43:40.318810 | orchestrator | 2026-04-03 09:43:40.318818 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 09:43:40.318825 | orchestrator | Friday 03 April 2026 09:43:40 +0000 (0:00:03.782) 0:03:09.582 ********** 2026-04-03 09:43:40.318832 | orchestrator | 2026-04-03 09:43:40.318839 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 09:43:40.318852 | orchestrator | Friday 03 April 2026 09:43:40 +0000 (0:00:00.073) 0:03:09.655 ********** 2026-04-03 09:43:40.318859 | orchestrator | 2026-04-03 09:43:40.318866 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-03 09:43:40.318879 | orchestrator | Friday 03 April 2026 09:43:40 +0000 (0:00:00.094) 0:03:09.749 ********** 2026-04-03 09:44:40.301853 | orchestrator | 2026-04-03 09:44:40.301950 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-03 09:44:40.301962 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:44:40.301970 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:44:40.301999 | orchestrator | Friday 03 April 2026 09:43:40 +0000 (0:00:00.087) 0:03:09.837 ********** 2026-04-03 09:44:40.302006 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:44:40.302057 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:44:40.302065 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:44:40.302071 | orchestrator | 2026-04-03 09:44:40.302078 | orchestrator | TASK [glance : Running Glance database contract container] ********************* 2026-04-03 09:44:40.302085 | orchestrator | Friday 03 April 2026 09:44:19 +0000 (0:00:39.260) 0:03:49.098 ********** 2026-04-03 09:44:40.302096 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:44:40.302103 | orchestrator | 2026-04-03 09:44:40.302109 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-03 09:44:40.302116 | orchestrator | Friday 03 April 2026 09:44:35 +0000 (0:00:15.966) 0:04:05.064 ********** 2026-04-03 09:44:40.302122 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:44:40.302129 | orchestrator | 2026-04-03 09:44:40.302135 | orchestrator | TASK [glance : Finish Glance upgrade] ****************************************** 2026-04-03 09:44:40.302141 | orchestrator | Friday 03 April 2026 09:44:38 +0000 (0:00:02.656) 0:04:07.721 ********** 2026-04-03 09:44:40.302147 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:44:40.302154 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:44:40.302160 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:44:40.302167 | orchestrator | 2026-04-03 09:44:40.302174 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-03 09:44:40.302180 | orchestrator | Friday 03 April 2026 09:44:38 +0000 (0:00:00.323) 0:04:08.044 ********** 2026-04-03 09:44:40.302187 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:44:40.302193 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:44:40.302200 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:44:40.302207 | orchestrator | 2026-04-03 09:44:40.302213 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:44:40.302221 | orchestrator | testbed-node-0 : ok=27  changed=11  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-03 09:44:40.302229 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 09:44:40.302235 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-03 09:44:40.302242 | orchestrator | 2026-04-03 09:44:40.302248 | orchestrator | 2026-04-03 09:44:40.302254 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:44:40.302261 | orchestrator | Friday 03 April 2026 09:44:39 +0000 (0:00:01.295) 0:04:09.339 ********** 2026-04-03 09:44:40.302267 | orchestrator | =============================================================================== 2026-04-03 09:44:40.302273 | orchestrator | glance : Restart glance-api container ---------------------------------- 39.26s 2026-04-03 09:44:40.302280 | orchestrator | glance : Running Glance database expand container ---------------------- 26.63s 2026-04-03 09:44:40.302286 | orchestrator | glance : Running Glance database migrate container --------------------- 16.11s 2026-04-03 09:44:40.302311 | orchestrator | glance : Running Glance database contract container -------------------- 15.97s 2026-04-03 09:44:40.302319 | orchestrator | glance : Stop glance service ------------------------------------------- 12.02s 2026-04-03 09:44:40.302325 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 5.92s 2026-04-03 09:44:40.302331 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 5.88s 2026-04-03 09:44:40.302337 | orchestrator | glance : Copying over config.json files for services -------------------- 4.18s 2026-04-03 09:44:40.302343 | orchestrator | service-check-containers : glance | Check containers -------------------- 4.11s 2026-04-03 09:44:40.302349 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 4.11s 2026-04-03 09:44:40.302355 | orchestrator | glance : Copying over config.json files for services -------------------- 4.10s 2026-04-03 09:44:40.302362 | orchestrator | glance : Ensuring config directories exist ------------------------------ 4.08s 2026-04-03 09:44:40.302368 | orchestrator | glance : Ensuring config directories exist ------------------------------ 3.83s 2026-04-03 09:44:40.302375 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 3.82s 2026-04-03 09:44:40.302381 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 3.81s 2026-04-03 09:44:40.302387 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.78s 2026-04-03 09:44:40.302394 | orchestrator | glance : Generating 'hostid' file for glance_api ------------------------ 3.75s 2026-04-03 09:44:40.302400 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 3.72s 2026-04-03 09:44:40.302406 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 3.70s 2026-04-03 09:44:40.302413 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 3.69s 2026-04-03 09:44:40.516586 | orchestrator | + osism apply -a upgrade cinder 2026-04-03 09:44:41.880851 | orchestrator | 2026-04-03 09:44:41 | INFO  | Prepare task for execution of cinder. 2026-04-03 09:44:41.945628 | orchestrator | 2026-04-03 09:44:41 | INFO  | Task 653f014c-f12b-43c2-8014-c848c86bdd1e (cinder) was prepared for execution. 2026-04-03 09:44:41.945755 | orchestrator | 2026-04-03 09:44:41 | INFO  | It takes a moment until task 653f014c-f12b-43c2-8014-c848c86bdd1e (cinder) has been started and output is visible here. 2026-04-03 09:44:55.821292 | orchestrator | 2026-04-03 09:44:55.821387 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:44:55.821411 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:44:55.821421 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:44:55.821435 | orchestrator | 2026-04-03 09:44:55.821442 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:44:55.821449 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:44:55.821455 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:44:55.821469 | orchestrator | Friday 03 April 2026 09:44:46 +0000 (0:00:01.079) 0:00:01.079 ********** 2026-04-03 09:44:55.821476 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:44:55.821484 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:44:55.821490 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:44:55.821497 | orchestrator | 2026-04-03 09:44:55.821504 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:44:55.821510 | orchestrator | Friday 03 April 2026 09:44:47 +0000 (0:00:00.753) 0:00:01.832 ********** 2026-04-03 09:44:55.821517 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-03 09:44:55.821524 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-03 09:44:55.821558 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-03 09:44:55.821569 | orchestrator | 2026-04-03 09:44:55.821580 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-03 09:44:55.821591 | orchestrator | 2026-04-03 09:44:55.821602 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:44:55.821614 | orchestrator | Friday 03 April 2026 09:44:48 +0000 (0:00:00.931) 0:00:02.763 ********** 2026-04-03 09:44:55.821625 | orchestrator | included: /ansible/roles/cinder/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:44:55.821638 | orchestrator | 2026-04-03 09:44:55.821650 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:44:55.821661 | orchestrator | Friday 03 April 2026 09:44:49 +0000 (0:00:01.424) 0:00:04.188 ********** 2026-04-03 09:44:55.821673 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:44:55.821684 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:44:55.821738 | orchestrator | included: /ansible/roles/cinder/tasks/config.yml for testbed-node-0 2026-04-03 09:44:55.821749 | orchestrator | 2026-04-03 09:44:55.821760 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-03 09:44:55.821770 | orchestrator | Friday 03 April 2026 09:44:50 +0000 (0:00:00.898) 0:00:05.087 ********** 2026-04-03 09:44:55.821787 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:44:55.821804 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:44:55.821843 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:44:55.821857 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:44:55.821881 | orchestrator | 2026-04-03 09:44:55.821893 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:44:55.821906 | orchestrator | Friday 03 April 2026 09:44:52 +0000 (0:00:02.422) 0:00:07.509 ********** 2026-04-03 09:44:55.821918 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:44:55.821931 | orchestrator | 2026-04-03 09:44:55.821944 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:44:55.821957 | orchestrator | Friday 03 April 2026 09:44:53 +0000 (0:00:00.119) 0:00:07.628 ********** 2026-04-03 09:44:55.821969 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0 2026-04-03 09:44:55.821981 | orchestrator | 2026-04-03 09:44:55.821994 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-03 09:44:55.822007 | orchestrator | Friday 03 April 2026 09:44:53 +0000 (0:00:00.594) 0:00:08.223 ********** 2026-04-03 09:44:55.822081 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-03 09:44:55.822095 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-03 09:44:55.822107 | orchestrator | 2026-04-03 09:44:55.822121 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-03 09:44:55.822136 | orchestrator | Friday 03 April 2026 09:44:55 +0000 (0:00:01.805) 0:00:10.028 ********** 2026-04-03 09:44:55.822152 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:44:55.822181 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:45:08.335591 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:45:08.335714 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:45:08.335734 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:45:08.335749 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:45:08.335761 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:45:08.335815 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:45:08.335830 | orchestrator | 2026-04-03 09:45:08.335843 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-03 09:45:08.335855 | orchestrator | Friday 03 April 2026 09:45:00 +0000 (0:00:05.293) 0:00:15.322 ********** 2026-04-03 09:45:08.335867 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:45:08.335878 | orchestrator | 2026-04-03 09:45:08.335890 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-03 09:45:08.335901 | orchestrator | Friday 03 April 2026 09:45:02 +0000 (0:00:01.355) 0:00:16.678 ********** 2026-04-03 09:45:08.335912 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:45:08.335924 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-03 09:45:08.335936 | orchestrator | 2026-04-03 09:45:08.335947 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-03 09:45:08.335958 | orchestrator | Friday 03 April 2026 09:45:04 +0000 (0:00:02.461) 0:00:19.140 ********** 2026-04-03 09:45:08.335969 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-03 09:45:08.335980 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-03 09:45:08.335991 | orchestrator | 2026-04-03 09:45:08.336002 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-03 09:45:08.336013 | orchestrator | Friday 03 April 2026 09:45:05 +0000 (0:00:00.910) 0:00:20.051 ********** 2026-04-03 09:45:08.336024 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:45:08.336036 | orchestrator | 2026-04-03 09:45:08.336047 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-03 09:45:08.336058 | orchestrator | Friday 03 April 2026 09:45:05 +0000 (0:00:00.125) 0:00:20.177 ********** 2026-04-03 09:45:08.336069 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:45:08.336080 | orchestrator | 2026-04-03 09:45:08.336091 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:45:08.336102 | orchestrator | Friday 03 April 2026 09:45:05 +0000 (0:00:00.112) 0:00:20.289 ********** 2026-04-03 09:45:08.336113 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0 2026-04-03 09:45:08.336124 | orchestrator | 2026-04-03 09:45:08.336136 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-03 09:45:08.336150 | orchestrator | Friday 03 April 2026 09:45:06 +0000 (0:00:00.569) 0:00:20.859 ********** 2026-04-03 09:45:08.336166 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:45:08.336201 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:11.461946 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:11.462092 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:11.462111 | orchestrator | 2026-04-03 09:45:11.462125 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-03 09:45:11.462137 | orchestrator | Friday 03 April 2026 09:45:10 +0000 (0:00:03.853) 0:00:24.713 ********** 2026-04-03 09:45:11.462151 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:45:11.462186 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462211 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462253 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:45:11.462264 | orchestrator | 2026-04-03 09:45:11.462276 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-03 09:45:11.462287 | orchestrator | Friday 03 April 2026 09:45:10 +0000 (0:00:00.594) 0:00:25.307 ********** 2026-04-03 09:45:11.462299 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:45:11.462311 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462330 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462346 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:45:11.462358 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:45:11.462368 | orchestrator | 2026-04-03 09:45:11.462386 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-03 09:45:33.669821 | orchestrator | Friday 03 April 2026 09:45:11 +0000 (0:00:00.773) 0:00:26.081 ********** 2026-04-03 09:45:33.669974 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:45:33.670005 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670080 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670121 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670134 | orchestrator | 2026-04-03 09:45:33.670146 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-03 09:45:33.670157 | orchestrator | Friday 03 April 2026 09:45:15 +0000 (0:00:04.432) 0:00:30.513 ********** 2026-04-03 09:45:33.670168 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-03 09:45:33.670180 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:45:33.670193 | orchestrator | 2026-04-03 09:45:33.670205 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-03 09:45:33.670215 | orchestrator | Friday 03 April 2026 09:45:16 +0000 (0:00:00.479) 0:00:30.993 ********** 2026-04-03 09:45:33.670227 | orchestrator | included: service-uwsgi-config for testbed-node-0 2026-04-03 09:45:33.670237 | orchestrator | 2026-04-03 09:45:33.670248 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-03 09:45:33.670273 | orchestrator | Friday 03 April 2026 09:45:17 +0000 (0:00:00.991) 0:00:31.984 ********** 2026-04-03 09:45:33.670285 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:45:33.670298 | orchestrator | 2026-04-03 09:45:33.670311 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-03 09:45:33.670344 | orchestrator | Friday 03 April 2026 09:45:18 +0000 (0:00:01.592) 0:00:33.576 ********** 2026-04-03 09:45:33.670359 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:45:33.670376 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670398 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670411 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:45:33.670424 | orchestrator | 2026-04-03 09:45:33.670437 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-03 09:45:33.670450 | orchestrator | Friday 03 April 2026 09:45:30 +0000 (0:00:11.223) 0:00:44.800 ********** 2026-04-03 09:45:33.670463 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:45:33.670476 | orchestrator | 2026-04-03 09:45:33.670489 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-03 09:45:33.670501 | orchestrator | Friday 03 April 2026 09:45:31 +0000 (0:00:01.325) 0:00:46.125 ********** 2026-04-03 09:45:33.670513 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:45:33.670525 | orchestrator | 2026-04-03 09:45:33.670538 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-03 09:45:33.670551 | orchestrator | Friday 03 April 2026 09:45:33 +0000 (0:00:01.567) 0:00:47.693 ********** 2026-04-03 09:45:33.670579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:14.290319 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:14.290479 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:14.290498 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:14.290511 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:14.290525 | orchestrator | 2026-04-03 09:46:14.290538 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-03 09:46:14.290550 | orchestrator | Friday 03 April 2026 09:45:33 +0000 (0:00:00.864) 0:00:48.557 ********** 2026-04-03 09:46:14.290561 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:14.290572 | orchestrator | 2026-04-03 09:46:14.290583 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-03 09:46:14.290594 | orchestrator | Friday 03 April 2026 09:45:34 +0000 (0:00:00.527) 0:00:49.085 ********** 2026-04-03 09:46:14.290605 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:46:14.290615 | orchestrator | 2026-04-03 09:46:14.290626 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-03 09:46:14.290637 | orchestrator | Friday 03 April 2026 09:46:12 +0000 (0:00:38.154) 0:01:27.239 ********** 2026-04-03 09:46:14.290665 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:14.290739 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:14.290764 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:14.290777 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:14.290790 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:14.290808 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:14.290830 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335576 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335680 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335738 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335752 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335781 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:18.335815 | orchestrator | 2026-04-03 09:46:18.335829 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:46:18.335842 | orchestrator | Friday 03 April 2026 09:46:15 +0000 (0:00:02.496) 0:01:29.736 ********** 2026-04-03 09:46:18.335853 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:18.335866 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:46:18.335877 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:46:18.335887 | orchestrator | 2026-04-03 09:46:18.335899 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:46:18.335910 | orchestrator | Friday 03 April 2026 09:46:15 +0000 (0:00:00.332) 0:01:30.069 ********** 2026-04-03 09:46:18.335938 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:46:18.335950 | orchestrator | 2026-04-03 09:46:18.335961 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-03 09:46:18.335971 | orchestrator | Friday 03 April 2026 09:46:16 +0000 (0:00:00.773) 0:01:30.843 ********** 2026-04-03 09:46:18.335982 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-03 09:46:18.335993 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-03 09:46:18.336004 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-03 09:46:18.336015 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-03 09:46:18.336025 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-03 09:46:18.336036 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-03 09:46:18.336047 | orchestrator | 2026-04-03 09:46:18.336058 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-03 09:46:18.336068 | orchestrator | Friday 03 April 2026 09:46:17 +0000 (0:00:01.648) 0:01:32.491 ********** 2026-04-03 09:46:18.336083 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:18.336104 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:18.336128 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:18.336152 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:19.600909 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:19.601001 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:19.601048 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:19.601060 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:19.601083 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:19.601092 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:19.601111 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-03 09:46:19.601120 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-03 09:46:19.601134 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.092957 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.093074 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.093146 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:23.093170 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:23.093214 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:23.093235 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.093256 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.093297 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-03 09:46:23.093319 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:23.093346 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:32.083452 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-03 09:46:32.083575 | orchestrator | 2026-04-03 09:46:32.083616 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-03 09:46:32.083630 | orchestrator | Friday 03 April 2026 09:46:23 +0000 (0:00:05.335) 0:01:37.827 ********** 2026-04-03 09:46:32.083642 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083654 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083665 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083676 | orchestrator | 2026-04-03 09:46:32.083688 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-03 09:46:32.083761 | orchestrator | Friday 03 April 2026 09:46:24 +0000 (0:00:01.775) 0:01:39.603 ********** 2026-04-03 09:46:32.083774 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083801 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083812 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-03 09:46:32.083824 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-03 09:46:32.083836 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-03 09:46:32.083847 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-03 09:46:32.083857 | orchestrator | 2026-04-03 09:46:32.083868 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-03 09:46:32.083879 | orchestrator | Friday 03 April 2026 09:46:27 +0000 (0:00:02.623) 0:01:42.227 ********** 2026-04-03 09:46:32.083891 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-03 09:46:32.083902 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-03 09:46:32.083912 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-03 09:46:32.083923 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-03 09:46:32.083934 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-03 09:46:32.083945 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-03 09:46:32.083956 | orchestrator | 2026-04-03 09:46:32.083967 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-03 09:46:32.083980 | orchestrator | Friday 03 April 2026 09:46:28 +0000 (0:00:01.074) 0:01:43.301 ********** 2026-04-03 09:46:32.083994 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:32.084008 | orchestrator | 2026-04-03 09:46:32.084022 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-03 09:46:32.084035 | orchestrator | Friday 03 April 2026 09:46:28 +0000 (0:00:00.124) 0:01:43.426 ********** 2026-04-03 09:46:32.084048 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:32.084061 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:46:32.084075 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:46:32.084088 | orchestrator | 2026-04-03 09:46:32.084100 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-03 09:46:32.084111 | orchestrator | Friday 03 April 2026 09:46:29 +0000 (0:00:00.568) 0:01:43.994 ********** 2026-04-03 09:46:32.084122 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:46:32.084142 | orchestrator | 2026-04-03 09:46:32.084153 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-03 09:46:32.084164 | orchestrator | Friday 03 April 2026 09:46:29 +0000 (0:00:00.603) 0:01:44.597 ********** 2026-04-03 09:46:32.084198 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:32.084220 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:32.084234 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:32.084247 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:32.084274 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489573 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489679 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489775 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489791 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489804 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489858 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489871 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:34.489883 | orchestrator | 2026-04-03 09:46:34.489897 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-03 09:46:34.489909 | orchestrator | Friday 03 April 2026 09:46:33 +0000 (0:00:03.942) 0:01:48.540 ********** 2026-04-03 09:46:34.489930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:34.489946 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:34.489958 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:34.489986 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295323 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:35.295423 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:35.295453 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295461 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295469 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295495 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:46:35.295515 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:35.295522 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295532 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295539 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:35.295545 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:46:35.295552 | orchestrator | 2026-04-03 09:46:35.295560 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-03 09:46:35.295567 | orchestrator | Friday 03 April 2026 09:46:34 +0000 (0:00:00.966) 0:01:49.507 ********** 2026-04-03 09:46:35.295574 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:35.295590 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031662 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031783 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031815 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:37.031832 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:37.031869 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031880 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031908 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031919 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:46:37.031934 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:46:37.031945 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031963 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031973 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:46:37.031983 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:46:37.031992 | orchestrator | 2026-04-03 09:46:37.032004 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-03 09:46:37.032015 | orchestrator | Friday 03 April 2026 09:46:35 +0000 (0:00:00.990) 0:01:50.497 ********** 2026-04-03 09:46:37.032032 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:40.162886 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:40.163002 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:40.163017 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163029 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163038 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163067 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163079 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163100 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163110 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163120 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:40.163136 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.215910 | orchestrator | 2026-04-03 09:46:54.216021 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-03 09:46:54.216038 | orchestrator | Friday 03 April 2026 09:46:40 +0000 (0:00:04.610) 0:01:55.107 ********** 2026-04-03 09:46:54.216048 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-03 09:46:54.216059 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:46:54.216071 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-03 09:46:54.216081 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:46:54.216127 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-03 09:46:54.216138 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:46:54.216148 | orchestrator | 2026-04-03 09:46:54.216158 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-03 09:46:54.216168 | orchestrator | Friday 03 April 2026 09:46:41 +0000 (0:00:00.654) 0:01:55.762 ********** 2026-04-03 09:46:54.216178 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:46:54.216188 | orchestrator | 2026-04-03 09:46:54.216198 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-03 09:46:54.216208 | orchestrator | Friday 03 April 2026 09:46:42 +0000 (0:00:00.947) 0:01:56.709 ********** 2026-04-03 09:46:54.216217 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:46:54.216228 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:46:54.216238 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:46:54.216247 | orchestrator | 2026-04-03 09:46:54.216257 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-03 09:46:54.216267 | orchestrator | Friday 03 April 2026 09:46:44 +0000 (0:00:02.260) 0:01:58.970 ********** 2026-04-03 09:46:54.216283 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:54.216298 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:54.216327 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:46:54.216352 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.216364 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.216374 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.216385 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.216395 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:46:54.216413 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:01.184736 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:01.184845 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:01.184862 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:01.184876 | orchestrator | 2026-04-03 09:47:01.184890 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-03 09:47:01.184902 | orchestrator | Friday 03 April 2026 09:46:57 +0000 (0:00:12.782) 0:02:11.752 ********** 2026-04-03 09:47:01.184914 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:47:01.184926 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:47:01.184937 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:47:01.184948 | orchestrator | 2026-04-03 09:47:01.184960 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-03 09:47:01.184971 | orchestrator | Friday 03 April 2026 09:46:58 +0000 (0:00:01.758) 0:02:13.511 ********** 2026-04-03 09:47:01.184982 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:47:01.184993 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:47:01.185006 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:47:01.185017 | orchestrator | 2026-04-03 09:47:01.185028 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-03 09:47:01.185039 | orchestrator | Friday 03 April 2026 09:47:00 +0000 (0:00:01.817) 0:02:15.328 ********** 2026-04-03 09:47:01.185054 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:47:01.185115 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:47:01.185131 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:47:01.185143 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:47:01.185154 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:47:01.185166 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:47:01.185186 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:47:01.185211 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:47:04.320412 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:47:04.320555 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:47:04.320592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:47:04.320617 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:47:04.320672 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:47:04.320686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:47:04.320741 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:47:04.320755 | orchestrator | 2026-04-03 09:47:04.320768 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-03 09:47:04.320796 | orchestrator | Friday 03 April 2026 09:47:01 +0000 (0:00:00.673) 0:02:16.002 ********** 2026-04-03 09:47:04.320828 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:47:04.320840 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:47:04.320851 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:47:04.320862 | orchestrator | 2026-04-03 09:47:04.320873 | orchestrator | TASK [service-check-containers : cinder | Check containers] ******************** 2026-04-03 09:47:04.320884 | orchestrator | Friday 03 April 2026 09:47:02 +0000 (0:00:00.740) 0:02:16.743 ********** 2026-04-03 09:47:04.320896 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:47:04.320912 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:47:04.320936 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:47:04.320956 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:04.320980 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261569 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261673 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261769 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261797 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261828 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261841 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:47:07.261853 | orchestrator | 2026-04-03 09:47:07.261866 | orchestrator | TASK [service-check-containers : cinder | Notify handlers to restart containers] *** 2026-04-03 09:47:07.261879 | orchestrator | Friday 03 April 2026 09:47:06 +0000 (0:00:04.385) 0:02:21.128 ********** 2026-04-03 09:47:07.261899 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:47:07.261912 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:47:07.261954 | orchestrator | } 2026-04-03 09:47:07.261965 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:47:07.261976 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:47:07.261987 | orchestrator | } 2026-04-03 09:47:07.261998 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:47:07.262008 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:47:07.262077 | orchestrator | } 2026-04-03 09:47:07.262091 | orchestrator | 2026-04-03 09:47:07.262105 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:47:07.262118 | orchestrator | Friday 03 April 2026 09:47:06 +0000 (0:00:00.382) 0:02:21.511 ********** 2026-04-03 09:47:07.262135 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:47:07.262152 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:47:07.262173 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:47:07.262198 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084408 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:48:44.084548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:48:44.084581 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084605 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084648 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084671 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:48:44.084716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:48:44.084753 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084766 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084777 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-03 09:48:44.084789 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:48:44.084800 | orchestrator | 2026-04-03 09:48:44.084875 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 09:48:44.084890 | orchestrator | Friday 03 April 2026 09:47:07 +0000 (0:00:00.905) 0:02:22.416 ********** 2026-04-03 09:48:44.084901 | orchestrator | 2026-04-03 09:48:44.084913 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 09:48:44.084926 | orchestrator | Friday 03 April 2026 09:47:07 +0000 (0:00:00.072) 0:02:22.489 ********** 2026-04-03 09:48:44.084939 | orchestrator | 2026-04-03 09:48:44.084952 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-03 09:48:44.084966 | orchestrator | Friday 03 April 2026 09:47:08 +0000 (0:00:00.264) 0:02:22.753 ********** 2026-04-03 09:48:44.084979 | orchestrator | 2026-04-03 09:48:44.084999 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-03 09:48:44.085013 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:48:44.085026 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:48:44.085063 | orchestrator | Friday 03 April 2026 09:47:08 +0000 (0:00:00.076) 0:02:22.830 ********** 2026-04-03 09:48:44.085084 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:48:44.085107 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:48:44.085141 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:48:44.085164 | orchestrator | 2026-04-03 09:48:44.085186 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-03 09:48:44.085208 | orchestrator | Friday 03 April 2026 09:47:40 +0000 (0:00:31.900) 0:02:54.731 ********** 2026-04-03 09:48:44.085230 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:48:44.085252 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:48:44.085275 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:48:44.085296 | orchestrator | 2026-04-03 09:48:44.085318 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-03 09:48:44.085340 | orchestrator | Friday 03 April 2026 09:47:52 +0000 (0:00:11.948) 0:03:06.679 ********** 2026-04-03 09:48:44.085362 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:48:44.085384 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:48:44.085405 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:48:44.085427 | orchestrator | 2026-04-03 09:48:44.085448 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-03 09:48:44.085470 | orchestrator | Friday 03 April 2026 09:48:26 +0000 (0:00:34.104) 0:03:40.784 ********** 2026-04-03 09:48:44.085507 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:48:44.085527 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:48:44.085559 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:49:37.778789 | orchestrator | 2026-04-03 09:49:37.778907 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-03 09:49:37.778924 | orchestrator | Friday 03 April 2026 09:48:44 +0000 (0:00:18.004) 0:03:58.789 ********** 2026-04-03 09:49:37.778937 | orchestrator | Pausing for 30 seconds 2026-04-03 09:49:37.779041 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:49:37.779054 | orchestrator | 2026-04-03 09:49:37.779066 | orchestrator | TASK [cinder : Reload cinder services to remove RPC version pin] *************** 2026-04-03 09:49:37.779077 | orchestrator | Friday 03 April 2026 09:49:14 +0000 (0:00:30.510) 0:04:29.300 ********** 2026-04-03 09:49:37.779095 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:49:37.779113 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:49:37.779164 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:49:37.779199 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779213 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779224 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779237 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779249 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779273 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:37.779294 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:59.031322 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:59.031434 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-03 09:49:59.031451 | orchestrator | 2026-04-03 09:49:59.031465 | orchestrator | TASK [cinder : Running Cinder online schema migration] ************************* 2026-04-03 09:49:59.031478 | orchestrator | Friday 03 April 2026 09:49:43 +0000 (0:00:28.568) 0:04:57.868 ********** 2026-04-03 09:49:59.031489 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:49:59.031502 | orchestrator | 2026-04-03 09:49:59.031514 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:49:59.031526 | orchestrator | testbed-node-0 : ok=44  changed=13  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 09:49:59.031564 | orchestrator | testbed-node-1 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 09:49:59.031575 | orchestrator | testbed-node-2 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 09:49:59.031586 | orchestrator | 2026-04-03 09:49:59.031597 | orchestrator | 2026-04-03 09:49:59.031608 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:49:59.031618 | orchestrator | Friday 03 April 2026 09:49:58 +0000 (0:00:15.353) 0:05:13.222 ********** 2026-04-03 09:49:59.031629 | orchestrator | =============================================================================== 2026-04-03 09:49:59.031640 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 38.15s 2026-04-03 09:49:59.031650 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 34.11s 2026-04-03 09:49:59.031676 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 31.90s 2026-04-03 09:49:59.031687 | orchestrator | cinder : Wait for cinder services to update service versions ----------- 30.51s 2026-04-03 09:49:59.031698 | orchestrator | cinder : Reload cinder services to remove RPC version pin -------------- 28.57s 2026-04-03 09:49:59.031709 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 18.00s 2026-04-03 09:49:59.031719 | orchestrator | cinder : Running Cinder online schema migration ------------------------ 15.35s 2026-04-03 09:49:59.031730 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 12.78s 2026-04-03 09:49:59.031741 | orchestrator | cinder : Restart cinder-scheduler container ---------------------------- 11.95s 2026-04-03 09:49:59.031752 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 11.22s 2026-04-03 09:49:59.031762 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 5.34s 2026-04-03 09:49:59.031773 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 5.29s 2026-04-03 09:49:59.031783 | orchestrator | cinder : Copying over config.json files for services -------------------- 4.61s 2026-04-03 09:49:59.031794 | orchestrator | cinder : Copying over config.json files for services -------------------- 4.43s 2026-04-03 09:49:59.031805 | orchestrator | service-check-containers : cinder | Check containers -------------------- 4.39s 2026-04-03 09:49:59.031815 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 3.94s 2026-04-03 09:49:59.031826 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 3.85s 2026-04-03 09:49:59.031836 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 2.62s 2026-04-03 09:49:59.031847 | orchestrator | cinder : Ensuring config directories exist ------------------------------ 2.50s 2026-04-03 09:49:59.031859 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 2.46s 2026-04-03 09:49:59.233536 | orchestrator | + osism apply -a upgrade barbican 2026-04-03 09:50:00.648789 | orchestrator | 2026-04-03 09:50:00 | INFO  | Prepare task for execution of barbican. 2026-04-03 09:50:00.713550 | orchestrator | 2026-04-03 09:50:00 | INFO  | Task 486dd3f6-a098-4161-8a04-a3681dff7bbc (barbican) was prepared for execution. 2026-04-03 09:50:00.713636 | orchestrator | 2026-04-03 09:50:00 | INFO  | It takes a moment until task 486dd3f6-a098-4161-8a04-a3681dff7bbc (barbican) has been started and output is visible here. 2026-04-03 09:50:15.044017 | orchestrator | 2026-04-03 09:50:15.044150 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:50:15.044162 | orchestrator | 2026-04-03 09:50:15.044169 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:50:15.044176 | orchestrator | Friday 03 April 2026 09:50:05 +0000 (0:00:01.680) 0:00:01.680 ********** 2026-04-03 09:50:15.044183 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:50:15.044208 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:50:15.044214 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:50:15.044221 | orchestrator | 2026-04-03 09:50:15.044227 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:50:15.044233 | orchestrator | Friday 03 April 2026 09:50:07 +0000 (0:00:01.761) 0:00:03.441 ********** 2026-04-03 09:50:15.044240 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-03 09:50:15.044247 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-03 09:50:15.044253 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-03 09:50:15.044259 | orchestrator | 2026-04-03 09:50:15.044266 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-03 09:50:15.044272 | orchestrator | 2026-04-03 09:50:15.044279 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-03 09:50:15.044285 | orchestrator | Friday 03 April 2026 09:50:09 +0000 (0:00:02.373) 0:00:05.815 ********** 2026-04-03 09:50:15.044292 | orchestrator | included: /ansible/roles/barbican/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:50:15.044299 | orchestrator | 2026-04-03 09:50:15.044306 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-03 09:50:15.044312 | orchestrator | Friday 03 April 2026 09:50:13 +0000 (0:00:03.423) 0:00:09.238 ********** 2026-04-03 09:50:15.044323 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:15.044345 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:15.044367 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:15.044381 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:15.044389 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:15.044399 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:15.044407 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:15.044414 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:15.044425 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.004877 | orchestrator | 2026-04-03 09:50:26.004993 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-03 09:50:26.005011 | orchestrator | Friday 03 April 2026 09:50:16 +0000 (0:00:03.107) 0:00:12.345 ********** 2026-04-03 09:50:26.005024 | orchestrator | ok: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-03 09:50:26.005036 | orchestrator | ok: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-03 09:50:26.005104 | orchestrator | ok: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-03 09:50:26.005117 | orchestrator | 2026-04-03 09:50:26.005129 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-03 09:50:26.005140 | orchestrator | Friday 03 April 2026 09:50:18 +0000 (0:00:02.039) 0:00:14.385 ********** 2026-04-03 09:50:26.005152 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:26.005165 | orchestrator | 2026-04-03 09:50:26.005176 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-03 09:50:26.005187 | orchestrator | Friday 03 April 2026 09:50:19 +0000 (0:00:01.103) 0:00:15.489 ********** 2026-04-03 09:50:26.005198 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:26.005209 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:50:26.005220 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:50:26.005230 | orchestrator | 2026-04-03 09:50:26.005242 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-03 09:50:26.005252 | orchestrator | Friday 03 April 2026 09:50:21 +0000 (0:00:01.615) 0:00:17.105 ********** 2026-04-03 09:50:26.005264 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:50:26.005275 | orchestrator | 2026-04-03 09:50:26.005293 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-03 09:50:26.005312 | orchestrator | Friday 03 April 2026 09:50:22 +0000 (0:00:01.897) 0:00:19.002 ********** 2026-04-03 09:50:26.005354 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:26.005381 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:26.005456 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:26.005476 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.005491 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.005511 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.005526 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.005549 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:26.005572 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:29.454491 | orchestrator | 2026-04-03 09:50:29.454584 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-03 09:50:29.454598 | orchestrator | Friday 03 April 2026 09:50:27 +0000 (0:00:04.218) 0:00:23.221 ********** 2026-04-03 09:50:29.454611 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:29.454624 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454647 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454675 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:29.454685 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:29.454709 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454716 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454723 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:50:29.454730 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:29.454742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454755 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:29.454762 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:50:29.454769 | orchestrator | 2026-04-03 09:50:29.454776 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-03 09:50:29.454783 | orchestrator | Friday 03 April 2026 09:50:29 +0000 (0:00:01.994) 0:00:25.215 ********** 2026-04-03 09:50:29.454796 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:32.586391 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586541 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:32.586582 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:32.586634 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586654 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586671 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:50:32.586751 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:32.586772 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586809 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:32.586826 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:50:32.586843 | orchestrator | 2026-04-03 09:50:32.586861 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-03 09:50:32.586880 | orchestrator | Friday 03 April 2026 09:50:31 +0000 (0:00:01.904) 0:00:27.120 ********** 2026-04-03 09:50:32.586893 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:32.586913 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:46.361590 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:46.361722 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361736 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361745 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361753 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361774 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361782 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:46.361796 | orchestrator | 2026-04-03 09:50:46.361804 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-03 09:50:46.361813 | orchestrator | Friday 03 April 2026 09:50:36 +0000 (0:00:05.510) 0:00:32.631 ********** 2026-04-03 09:50:46.361820 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:50:46.361827 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:50:46.361835 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:50:46.361842 | orchestrator | 2026-04-03 09:50:46.361849 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-03 09:50:46.361856 | orchestrator | Friday 03 April 2026 09:50:39 +0000 (0:00:02.662) 0:00:35.293 ********** 2026-04-03 09:50:46.361866 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:50:46.361875 | orchestrator | 2026-04-03 09:50:46.361882 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-03 09:50:46.361889 | orchestrator | Friday 03 April 2026 09:50:41 +0000 (0:00:02.455) 0:00:37.749 ********** 2026-04-03 09:50:46.361896 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:46.361903 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:50:46.361910 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:50:46.361917 | orchestrator | 2026-04-03 09:50:46.361925 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-03 09:50:46.361932 | orchestrator | Friday 03 April 2026 09:50:43 +0000 (0:00:01.604) 0:00:39.353 ********** 2026-04-03 09:50:46.361940 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:46.361948 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:46.361962 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:52.081023 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081174 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081192 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081205 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081217 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081250 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:52.081262 | orchestrator | 2026-04-03 09:50:52.081275 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-03 09:50:52.081388 | orchestrator | Friday 03 April 2026 09:50:51 +0000 (0:00:08.157) 0:00:47.511 ********** 2026-04-03 09:50:52.081450 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:52.081468 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:52.081509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:52.081522 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:50:52.081536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:52.081569 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:56.142678 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:56.142779 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:50:56.142799 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:50:56.142813 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:50:56.142823 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:50:56.142853 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:50:56.142862 | orchestrator | 2026-04-03 09:50:56.142871 | orchestrator | TASK [service-check-containers : barbican | Check containers] ****************** 2026-04-03 09:50:56.142880 | orchestrator | Friday 03 April 2026 09:50:53 +0000 (0:00:02.365) 0:00:49.876 ********** 2026-04-03 09:50:56.142908 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:56.142926 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:56.142936 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:50:56.142953 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:56.142964 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:50:56.142982 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-03 09:51:00.395658 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:51:00.395759 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:51:00.395774 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:51:00.395803 | orchestrator | 2026-04-03 09:51:00.395815 | orchestrator | TASK [service-check-containers : barbican | Notify handlers to restart containers] *** 2026-04-03 09:51:00.395825 | orchestrator | Friday 03 April 2026 09:50:58 +0000 (0:00:04.346) 0:00:54.223 ********** 2026-04-03 09:51:00.395835 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:51:00.395846 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:51:00.395855 | orchestrator | } 2026-04-03 09:51:00.395864 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:51:00.395873 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:51:00.395882 | orchestrator | } 2026-04-03 09:51:00.395890 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:51:00.395899 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:51:00.395908 | orchestrator | } 2026-04-03 09:51:00.395917 | orchestrator | 2026-04-03 09:51:00.395926 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:51:00.395935 | orchestrator | Friday 03 April 2026 09:50:59 +0000 (0:00:01.430) 0:00:55.653 ********** 2026-04-03 09:51:00.395948 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:51:00.395981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:51:00.395992 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:51:00.396001 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:51:00.396011 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:51:00.396028 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:51:00.396038 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:51:00.396047 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:51:00.396067 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:53:57.962733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-03 09:53:57.962878 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:53:57.962940 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:53:57.962965 | orchestrator | 2026-04-03 09:53:57.962987 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-03 09:53:57.963007 | orchestrator | Friday 03 April 2026 09:51:02 +0000 (0:00:02.459) 0:00:58.113 ********** 2026-04-03 09:53:57.963026 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:53:57.963045 | orchestrator | 2026-04-03 09:53:57.963064 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 09:53:57.963083 | orchestrator | Friday 03 April 2026 09:51:16 +0000 (0:00:14.192) 0:01:12.305 ********** 2026-04-03 09:53:57.963101 | orchestrator | 2026-04-03 09:53:57.963119 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 09:53:57.963137 | orchestrator | Friday 03 April 2026 09:51:16 +0000 (0:00:00.445) 0:01:12.751 ********** 2026-04-03 09:53:57.963154 | orchestrator | 2026-04-03 09:53:57.963172 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-03 09:53:57.963190 | orchestrator | Friday 03 April 2026 09:51:17 +0000 (0:00:00.460) 0:01:13.212 ********** 2026-04-03 09:53:57.963209 | orchestrator | 2026-04-03 09:53:57.963228 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-03 09:53:57.963248 | orchestrator | Friday 03 April 2026 09:51:17 +0000 (0:00:00.795) 0:01:14.007 ********** 2026-04-03 09:53:57.963268 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:53:57.963288 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:53:57.963307 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:53:57.963325 | orchestrator | 2026-04-03 09:53:57.963344 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-03 09:53:57.963362 | orchestrator | Friday 03 April 2026 09:53:31 +0000 (0:02:14.008) 0:03:28.016 ********** 2026-04-03 09:53:57.963380 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:53:57.963398 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:53:57.963451 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:53:57.963472 | orchestrator | 2026-04-03 09:53:57.963491 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-03 09:53:57.963508 | orchestrator | Friday 03 April 2026 09:53:44 +0000 (0:00:12.651) 0:03:40.667 ********** 2026-04-03 09:53:57.963526 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:53:57.963544 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:53:57.963562 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:53:57.963581 | orchestrator | 2026-04-03 09:53:57.963599 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:53:57.963619 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 09:53:57.963640 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 09:53:57.963658 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 09:53:57.963677 | orchestrator | 2026-04-03 09:53:57.963695 | orchestrator | 2026-04-03 09:53:57.963714 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:53:57.963733 | orchestrator | Friday 03 April 2026 09:53:57 +0000 (0:00:12.984) 0:03:53.652 ********** 2026-04-03 09:53:57.963751 | orchestrator | =============================================================================== 2026-04-03 09:53:57.963770 | orchestrator | barbican : Restart barbican-api container ----------------------------- 134.01s 2026-04-03 09:53:57.963809 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 14.19s 2026-04-03 09:53:57.963827 | orchestrator | barbican : Restart barbican-worker container --------------------------- 12.98s 2026-04-03 09:53:57.963846 | orchestrator | barbican : Restart barbican-keystone-listener container ---------------- 12.65s 2026-04-03 09:53:57.963882 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 8.16s 2026-04-03 09:53:57.963930 | orchestrator | barbican : Copying over config.json files for services ------------------ 5.51s 2026-04-03 09:53:57.963951 | orchestrator | service-check-containers : barbican | Check containers ------------------ 4.35s 2026-04-03 09:53:57.963971 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 4.22s 2026-04-03 09:53:57.963990 | orchestrator | barbican : include_tasks ------------------------------------------------ 3.42s 2026-04-03 09:53:57.964008 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 3.11s 2026-04-03 09:53:57.964026 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 2.66s 2026-04-03 09:53:57.964045 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.46s 2026-04-03 09:53:57.964066 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 2.46s 2026-04-03 09:53:57.964085 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.37s 2026-04-03 09:53:57.964103 | orchestrator | barbican : Copying over existing policy file ---------------------------- 2.36s 2026-04-03 09:53:57.964123 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 2.04s 2026-04-03 09:53:57.964142 | orchestrator | service-cert-copy : barbican | Copying over backend internal TLS certificate --- 1.99s 2026-04-03 09:53:57.964165 | orchestrator | service-cert-copy : barbican | Copying over backend internal TLS key ---- 1.90s 2026-04-03 09:53:57.964186 | orchestrator | barbican : include_tasks ------------------------------------------------ 1.89s 2026-04-03 09:53:57.964206 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.76s 2026-04-03 09:53:58.171215 | orchestrator | + osism apply -a upgrade designate 2026-04-03 09:53:59.514214 | orchestrator | 2026-04-03 09:53:59 | INFO  | Prepare task for execution of designate. 2026-04-03 09:53:59.584511 | orchestrator | 2026-04-03 09:53:59 | INFO  | Task 0069e159-f26e-432c-81bd-60ff477f0bdd (designate) was prepared for execution. 2026-04-03 09:53:59.584606 | orchestrator | 2026-04-03 09:53:59 | INFO  | It takes a moment until task 0069e159-f26e-432c-81bd-60ff477f0bdd (designate) has been started and output is visible here. 2026-04-03 09:54:13.810420 | orchestrator | 2026-04-03 09:54:13.810576 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:54:13.810594 | orchestrator | 2026-04-03 09:54:13.810608 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:54:13.810620 | orchestrator | Friday 03 April 2026 09:54:04 +0000 (0:00:01.411) 0:00:01.411 ********** 2026-04-03 09:54:13.810631 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:54:13.810643 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:54:13.810654 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:54:13.810673 | orchestrator | 2026-04-03 09:54:13.810694 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:54:13.810715 | orchestrator | Friday 03 April 2026 09:54:06 +0000 (0:00:01.988) 0:00:03.400 ********** 2026-04-03 09:54:13.810737 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-03 09:54:13.810757 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-03 09:54:13.810776 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-03 09:54:13.810787 | orchestrator | 2026-04-03 09:54:13.810799 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-03 09:54:13.810811 | orchestrator | 2026-04-03 09:54:13.810822 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 09:54:13.810833 | orchestrator | Friday 03 April 2026 09:54:08 +0000 (0:00:02.080) 0:00:05.480 ********** 2026-04-03 09:54:13.810869 | orchestrator | included: /ansible/roles/designate/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:54:13.810881 | orchestrator | 2026-04-03 09:54:13.810892 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-03 09:54:13.810903 | orchestrator | Friday 03 April 2026 09:54:11 +0000 (0:00:03.141) 0:00:08.621 ********** 2026-04-03 09:54:13.810917 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:13.810951 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:13.810987 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:13.811003 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811026 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811039 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811058 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811073 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811086 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:13.811108 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.783978 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784086 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784118 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784132 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784143 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784156 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784186 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784220 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:21.784233 | orchestrator | 2026-04-03 09:54:21.784246 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-03 09:54:21.784259 | orchestrator | Friday 03 April 2026 09:54:15 +0000 (0:00:04.361) 0:00:12.983 ********** 2026-04-03 09:54:21.784270 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:54:21.784283 | orchestrator | 2026-04-03 09:54:21.784294 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-03 09:54:21.784305 | orchestrator | Friday 03 April 2026 09:54:17 +0000 (0:00:01.114) 0:00:14.097 ********** 2026-04-03 09:54:21.784315 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:54:21.784326 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:54:21.784337 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:54:21.784348 | orchestrator | 2026-04-03 09:54:21.784358 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 09:54:21.784369 | orchestrator | Friday 03 April 2026 09:54:18 +0000 (0:00:01.394) 0:00:15.492 ********** 2026-04-03 09:54:21.784380 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 09:54:21.784391 | orchestrator | 2026-04-03 09:54:21.784401 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-03 09:54:21.784412 | orchestrator | Friday 03 April 2026 09:54:20 +0000 (0:00:01.900) 0:00:17.392 ********** 2026-04-03 09:54:21.784429 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:21.784486 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:21.784520 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:25.749280 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749407 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749422 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749434 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749542 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749560 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749592 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749606 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749624 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749635 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749657 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749669 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:25.749687 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:28.056927 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:28.057077 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:28.057098 | orchestrator | 2026-04-03 09:54:28.057112 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-03 09:54:28.057126 | orchestrator | Friday 03 April 2026 09:54:27 +0000 (0:00:06.733) 0:00:24.126 ********** 2026-04-03 09:54:28.057140 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:28.057177 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:28.057191 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:28.057221 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:28.057241 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:28.057252 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:28.057273 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:28.057285 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:28.057305 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.819837 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.819988 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:30.820017 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820057 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:54:30.820072 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820084 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820095 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820106 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:54:30.820136 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820154 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820166 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:30.820185 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:54:30.820197 | orchestrator | 2026-04-03 09:54:30.820210 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-03 09:54:30.820223 | orchestrator | Friday 03 April 2026 09:54:29 +0000 (0:00:02.865) 0:00:26.991 ********** 2026-04-03 09:54:30.820235 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:30.820250 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:30.820271 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:31.240540 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:54:31.240679 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:31.240691 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240701 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:54:31.240729 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240753 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240775 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240785 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240795 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240806 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:54:31.240818 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240828 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:31.240850 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:54:35.745416 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:35.745578 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:54:35.745608 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:54:35.745629 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:54:35.745648 | orchestrator | 2026-04-03 09:54:35.745667 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-03 09:54:35.745686 | orchestrator | Friday 03 April 2026 09:54:32 +0000 (0:00:02.517) 0:00:29.509 ********** 2026-04-03 09:54:35.745706 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:35.745734 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:35.745849 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:35.745876 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:35.745896 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:35.745912 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:35.745932 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:35.745950 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:35.746006 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925289 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925303 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925314 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925325 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925372 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925402 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925414 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925424 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:42.925434 | orchestrator | 2026-04-03 09:54:42.925447 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-03 09:54:42.925458 | orchestrator | Friday 03 April 2026 09:54:39 +0000 (0:00:07.285) 0:00:36.795 ********** 2026-04-03 09:54:42.925469 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:42.925557 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:42.925578 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:54:54.234201 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234321 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234338 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234373 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234400 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234442 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234455 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234466 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234543 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234561 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:54:54.234581 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:05.970926 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:05.971027 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:05.971065 | orchestrator | 2026-04-03 09:55:05.971081 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-03 09:55:05.971093 | orchestrator | Friday 03 April 2026 09:54:55 +0000 (0:00:16.068) 0:00:52.864 ********** 2026-04-03 09:55:05.971104 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 09:55:05.971116 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 09:55:05.971127 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-03 09:55:05.971138 | orchestrator | 2026-04-03 09:55:05.971149 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-03 09:55:05.971160 | orchestrator | Friday 03 April 2026 09:55:00 +0000 (0:00:04.955) 0:00:57.819 ********** 2026-04-03 09:55:05.971171 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 09:55:05.971182 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 09:55:05.971193 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-03 09:55:05.971203 | orchestrator | 2026-04-03 09:55:05.971214 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-03 09:55:05.971225 | orchestrator | Friday 03 April 2026 09:55:04 +0000 (0:00:03.501) 0:01:01.321 ********** 2026-04-03 09:55:05.971251 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:05.971284 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:05.971299 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:05.971366 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:05.971379 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:05.971396 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:05.971408 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:05.971428 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:08.827874 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.827953 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.827963 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.827978 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:08.827985 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.827991 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.828008 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:08.828021 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:08.828028 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:08.828034 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:08.828041 | orchestrator | 2026-04-03 09:55:08.828048 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-03 09:55:08.828055 | orchestrator | Friday 03 April 2026 09:55:08 +0000 (0:00:03.939) 0:01:05.261 ********** 2026-04-03 09:55:08.828066 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:08.828080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:09.771320 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:09.771408 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:09.771440 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771454 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771567 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:09.771584 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771595 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771607 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771624 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:09.771635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771654 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:09.771674 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:13.647472 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:13.647630 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:13.647668 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:13.647683 | orchestrator | 2026-04-03 09:55:13.647696 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-03 09:55:13.647709 | orchestrator | Friday 03 April 2026 09:55:11 +0000 (0:00:03.572) 0:01:08.833 ********** 2026-04-03 09:55:13.647720 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:55:13.647733 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:55:13.647744 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:55:13.647755 | orchestrator | 2026-04-03 09:55:13.647767 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-03 09:55:13.647800 | orchestrator | Friday 03 April 2026 09:55:13 +0000 (0:00:01.310) 0:01:10.144 ********** 2026-04-03 09:55:13.647814 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:13.647830 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:55:13.647864 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:13.647876 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:13.647893 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:13.647905 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:55:13.647929 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:55:13.647941 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:13.647961 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:55:16.899841 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.899953 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.899990 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900026 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900039 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:55:16.900055 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:16.900089 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:55:16.900102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900113 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900131 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900151 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:55:16.900162 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:55:16.900174 | orchestrator | 2026-04-03 09:55:16.900186 | orchestrator | TASK [service-check-containers : designate | Check containers] ***************** 2026-04-03 09:55:16.900198 | orchestrator | Friday 03 April 2026 09:55:15 +0000 (0:00:02.232) 0:01:12.377 ********** 2026-04-03 09:55:16.900209 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:55:16.900230 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:55:20.309402 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 09:55:20.309611 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309642 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309661 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309679 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309719 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309747 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309777 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309793 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309810 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309824 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309841 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:20.309867 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:24.294665 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:24.294781 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:24.294798 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-03 09:55:24.294811 | orchestrator | 2026-04-03 09:55:24.294825 | orchestrator | TASK [service-check-containers : designate | Notify handlers to restart containers] *** 2026-04-03 09:55:24.294837 | orchestrator | Friday 03 April 2026 09:55:22 +0000 (0:00:06.971) 0:01:19.349 ********** 2026-04-03 09:55:24.294849 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:55:24.294862 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:55:24.294873 | orchestrator | } 2026-04-03 09:55:24.294897 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:55:24.294909 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:55:24.294920 | orchestrator | } 2026-04-03 09:55:24.294931 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:55:24.294941 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:55:24.294952 | orchestrator | } 2026-04-03 09:55:24.294963 | orchestrator | 2026-04-03 09:55:24.294974 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:55:24.294985 | orchestrator | Friday 03 April 2026 09:55:23 +0000 (0:00:01.411) 0:01:20.761 ********** 2026-04-03 09:55:24.294998 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:24.295054 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:55:24.295075 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:55:24.295087 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:55:24.295099 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:55:24.295110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:55:24.295122 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:55:24.295136 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:55:24.295171 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:56:12.763303 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763418 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763436 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763448 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763461 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:56:12.763498 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 09:56:12.763543 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-03 09:56:12.763558 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763570 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763581 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-03 09:56:12.763639 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:56:12.763651 | orchestrator | 2026-04-03 09:56:12.763664 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-03 09:56:12.763677 | orchestrator | Friday 03 April 2026 09:55:25 +0000 (0:00:02.297) 0:01:23.058 ********** 2026-04-03 09:56:12.763696 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:56:12.763714 | orchestrator | 2026-04-03 09:56:12.763733 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 09:56:12.763752 | orchestrator | Friday 03 April 2026 09:55:42 +0000 (0:00:16.134) 0:01:39.192 ********** 2026-04-03 09:56:12.763771 | orchestrator | 2026-04-03 09:56:12.763790 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 09:56:12.763806 | orchestrator | Friday 03 April 2026 09:55:42 +0000 (0:00:00.669) 0:01:39.862 ********** 2026-04-03 09:56:12.763823 | orchestrator | 2026-04-03 09:56:12.763841 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-03 09:56:12.763861 | orchestrator | Friday 03 April 2026 09:55:43 +0000 (0:00:00.421) 0:01:40.283 ********** 2026-04-03 09:56:12.763881 | orchestrator | 2026-04-03 09:56:12.763898 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-03 09:56:12.763917 | orchestrator | Friday 03 April 2026 09:55:43 +0000 (0:00:00.764) 0:01:41.048 ********** 2026-04-03 09:56:12.763936 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:56:12.763954 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:56:12.763971 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:56:12.763989 | orchestrator | 2026-04-03 09:56:12.764008 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-03 09:56:12.764027 | orchestrator | Friday 03 April 2026 09:55:59 +0000 (0:00:15.295) 0:01:56.343 ********** 2026-04-03 09:56:12.764045 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:56:12.764064 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:56:12.764085 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:56:12.764120 | orchestrator | 2026-04-03 09:56:12.764154 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-03 09:56:12.764189 | orchestrator | Friday 03 April 2026 09:56:12 +0000 (0:00:13.507) 0:02:09.851 ********** 2026-04-03 09:58:06.675610 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:58:06.675773 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:58:06.675792 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:58:06.675804 | orchestrator | 2026-04-03 09:58:06.675817 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-03 09:58:06.675830 | orchestrator | Friday 03 April 2026 09:56:26 +0000 (0:00:13.358) 0:02:23.209 ********** 2026-04-03 09:58:06.675841 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:58:06.675853 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:58:06.675864 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:58:06.675874 | orchestrator | 2026-04-03 09:58:06.675886 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-03 09:58:06.675897 | orchestrator | Friday 03 April 2026 09:57:29 +0000 (0:01:03.549) 0:03:26.759 ********** 2026-04-03 09:58:06.675907 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:58:06.675918 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:58:06.675929 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:58:06.675940 | orchestrator | 2026-04-03 09:58:06.675952 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-03 09:58:06.675963 | orchestrator | Friday 03 April 2026 09:57:43 +0000 (0:00:13.373) 0:03:40.132 ********** 2026-04-03 09:58:06.675974 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:58:06.675985 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:58:06.676023 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:58:06.676034 | orchestrator | 2026-04-03 09:58:06.676045 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-03 09:58:06.676056 | orchestrator | Friday 03 April 2026 09:57:57 +0000 (0:00:14.392) 0:03:54.525 ********** 2026-04-03 09:58:06.676067 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:58:06.676077 | orchestrator | 2026-04-03 09:58:06.676088 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:58:06.676100 | orchestrator | testbed-node-0 : ok=22  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-03 09:58:06.676113 | orchestrator | testbed-node-1 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 09:58:06.676123 | orchestrator | testbed-node-2 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 09:58:06.676134 | orchestrator | 2026-04-03 09:58:06.676147 | orchestrator | 2026-04-03 09:58:06.676160 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:58:06.676173 | orchestrator | Friday 03 April 2026 09:58:06 +0000 (0:00:08.932) 0:04:03.457 ********** 2026-04-03 09:58:06.676186 | orchestrator | =============================================================================== 2026-04-03 09:58:06.676199 | orchestrator | designate : Restart designate-producer container ----------------------- 63.55s 2026-04-03 09:58:06.676211 | orchestrator | designate : Running Designate bootstrap container ---------------------- 16.13s 2026-04-03 09:58:06.676224 | orchestrator | designate : Copying over designate.conf -------------------------------- 16.07s 2026-04-03 09:58:06.676237 | orchestrator | designate : Restart designate-backend-bind9 container ------------------ 15.29s 2026-04-03 09:58:06.676249 | orchestrator | designate : Restart designate-worker container ------------------------- 14.40s 2026-04-03 09:58:06.676262 | orchestrator | designate : Restart designate-api container ---------------------------- 13.51s 2026-04-03 09:58:06.676276 | orchestrator | designate : Restart designate-mdns container --------------------------- 13.37s 2026-04-03 09:58:06.676289 | orchestrator | designate : Restart designate-central container ------------------------ 13.36s 2026-04-03 09:58:06.676302 | orchestrator | designate : Non-destructive DNS pools update ---------------------------- 8.93s 2026-04-03 09:58:06.676312 | orchestrator | designate : Copying over config.json files for services ----------------- 7.29s 2026-04-03 09:58:06.676323 | orchestrator | service-check-containers : designate | Check containers ----------------- 6.97s 2026-04-03 09:58:06.676334 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 6.73s 2026-04-03 09:58:06.676344 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 4.96s 2026-04-03 09:58:06.676355 | orchestrator | designate : Ensuring config directories exist --------------------------- 4.36s 2026-04-03 09:58:06.676366 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 3.94s 2026-04-03 09:58:06.676377 | orchestrator | designate : Copying over rndc.key --------------------------------------- 3.57s 2026-04-03 09:58:06.676387 | orchestrator | designate : Copying over named.conf ------------------------------------- 3.50s 2026-04-03 09:58:06.676398 | orchestrator | designate : include_tasks ----------------------------------------------- 3.14s 2026-04-03 09:58:06.676409 | orchestrator | service-cert-copy : designate | Copying over backend internal TLS certificate --- 2.86s 2026-04-03 09:58:06.676420 | orchestrator | service-cert-copy : designate | Copying over backend internal TLS key --- 2.52s 2026-04-03 09:58:06.878172 | orchestrator | + osism apply -a upgrade ceilometer 2026-04-03 09:58:08.141132 | orchestrator | 2026-04-03 09:58:08 | INFO  | Prepare task for execution of ceilometer. 2026-04-03 09:58:08.204498 | orchestrator | 2026-04-03 09:58:08 | INFO  | Task a6be12dc-6114-4705-a499-7bb499ff21f9 (ceilometer) was prepared for execution. 2026-04-03 09:58:08.204614 | orchestrator | 2026-04-03 09:58:08 | INFO  | It takes a moment until task a6be12dc-6114-4705-a499-7bb499ff21f9 (ceilometer) has been started and output is visible here. 2026-04-03 09:58:20.579573 | orchestrator | 2026-04-03 09:58:20.579669 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 09:58:20.579687 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 09:58:20.579699 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 09:58:20.579723 | orchestrator | 2026-04-03 09:58:20.579788 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 09:58:20.579809 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 09:58:20.579828 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 09:58:20.579863 | orchestrator | Friday 03 April 2026 09:58:12 +0000 (0:00:01.309) 0:00:01.309 ********** 2026-04-03 09:58:20.579883 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:58:20.579903 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:58:20.579923 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:58:20.579937 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:58:20.579947 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:58:20.579958 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:58:20.579969 | orchestrator | 2026-04-03 09:58:20.579980 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 09:58:20.579991 | orchestrator | Friday 03 April 2026 09:58:14 +0000 (0:00:01.187) 0:00:02.496 ********** 2026-04-03 09:58:20.580002 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580014 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580024 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580035 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580046 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580057 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-03 09:58:20.580068 | orchestrator | 2026-04-03 09:58:20.580079 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-03 09:58:20.580090 | orchestrator | 2026-04-03 09:58:20.580101 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-03 09:58:20.580112 | orchestrator | Friday 03 April 2026 09:58:15 +0000 (0:00:01.323) 0:00:03.819 ********** 2026-04-03 09:58:20.580123 | orchestrator | included: /ansible/roles/ceilometer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:58:20.580135 | orchestrator | 2026-04-03 09:58:20.580146 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-03 09:58:20.580157 | orchestrator | Friday 03 April 2026 09:58:16 +0000 (0:00:01.646) 0:00:05.465 ********** 2026-04-03 09:58:20.580172 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:20.580186 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:20.580219 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:20.580275 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580299 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580319 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580338 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580358 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580390 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:20.580410 | orchestrator | 2026-04-03 09:58:20.580427 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-03 09:58:20.580446 | orchestrator | Friday 03 April 2026 09:58:19 +0000 (0:00:02.237) 0:00:07.703 ********** 2026-04-03 09:58:20.580484 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:58:24.820042 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:58:24.820132 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:58:24.820144 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:58:24.820151 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:58:24.820157 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:58:24.820164 | orchestrator | 2026-04-03 09:58:24.820173 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-03 09:58:24.820182 | orchestrator | Friday 03 April 2026 09:58:21 +0000 (0:00:02.573) 0:00:10.276 ********** 2026-04-03 09:58:24.820190 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:58:24.820197 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:58:24.820204 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:58:24.820211 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:58:24.820217 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:58:24.820224 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:58:24.820231 | orchestrator | 2026-04-03 09:58:24.820238 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-03 09:58:24.820245 | orchestrator | Friday 03 April 2026 09:58:22 +0000 (0:00:00.586) 0:00:10.863 ********** 2026-04-03 09:58:24.820251 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:24.820258 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:24.820264 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:24.820271 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:24.820278 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:24.820285 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:24.820291 | orchestrator | 2026-04-03 09:58:24.820298 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-03 09:58:24.820307 | orchestrator | Friday 03 April 2026 09:58:23 +0000 (0:00:00.687) 0:00:11.550 ********** 2026-04-03 09:58:24.820314 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:58:24.820321 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:58:24.820328 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:58:24.820335 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:58:24.820341 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:58:24.820347 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:58:24.820354 | orchestrator | 2026-04-03 09:58:24.820361 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-03 09:58:24.820368 | orchestrator | Friday 03 April 2026 09:58:23 +0000 (0:00:00.667) 0:00:12.218 ********** 2026-04-03 09:58:24.820405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:24.820416 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820424 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:24.820431 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:24.820454 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820461 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:24.820469 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:24.820475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820532 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:24.820541 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820549 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:24.820556 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820563 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:24.820570 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:24.820576 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:24.820583 | orchestrator | 2026-04-03 09:58:24.820591 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-03 09:58:24.820598 | orchestrator | Friday 03 April 2026 09:58:24 +0000 (0:00:00.859) 0:00:13.078 ********** 2026-04-03 09:58:24.820619 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:31.760026 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760185 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:31.760213 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760230 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:31.760249 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:31.760266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760283 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:31.760317 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760335 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:31.760369 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:31.760387 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760414 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:31.760429 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:31.760445 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:31.760460 | orchestrator | 2026-04-03 09:58:31.760477 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-03 09:58:31.760494 | orchestrator | Friday 03 April 2026 09:58:25 +0000 (0:00:01.258) 0:00:14.336 ********** 2026-04-03 09:58:31.760510 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:58:31.760524 | orchestrator | 2026-04-03 09:58:31.760540 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-03 09:58:31.760555 | orchestrator | Friday 03 April 2026 09:58:26 +0000 (0:00:00.798) 0:00:15.135 ********** 2026-04-03 09:58:31.760569 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:58:31.760585 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:58:31.760600 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:58:31.760615 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:58:31.760631 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:58:31.760646 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:58:31.760661 | orchestrator | 2026-04-03 09:58:31.760677 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-03 09:58:31.760692 | orchestrator | Friday 03 April 2026 09:58:27 +0000 (0:00:00.623) 0:00:15.759 ********** 2026-04-03 09:58:31.760707 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:58:31.760723 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:58:31.760739 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:58:31.760778 | orchestrator | ok: [testbed-node-3] 2026-04-03 09:58:31.760797 | orchestrator | ok: [testbed-node-4] 2026-04-03 09:58:31.760814 | orchestrator | ok: [testbed-node-5] 2026-04-03 09:58:31.760830 | orchestrator | 2026-04-03 09:58:31.760845 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-03 09:58:31.760864 | orchestrator | Friday 03 April 2026 09:58:28 +0000 (0:00:01.176) 0:00:16.935 ********** 2026-04-03 09:58:31.760885 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:31.760899 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:31.760915 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:31.760929 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:31.760943 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:31.760955 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:31.760968 | orchestrator | 2026-04-03 09:58:31.760983 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-03 09:58:31.760997 | orchestrator | Friday 03 April 2026 09:58:29 +0000 (0:00:00.612) 0:00:17.547 ********** 2026-04-03 09:58:31.761011 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:31.761024 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:31.761038 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:31.761065 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:31.761077 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:31.761086 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:31.761094 | orchestrator | 2026-04-03 09:58:31.761103 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-03 09:58:31.761112 | orchestrator | Friday 03 April 2026 09:58:29 +0000 (0:00:00.815) 0:00:18.363 ********** 2026-04-03 09:58:31.761121 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:58:31.761129 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:58:31.761138 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:58:31.761154 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:58:31.761163 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:58:31.761171 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:58:31.761180 | orchestrator | 2026-04-03 09:58:31.761189 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-03 09:58:31.761197 | orchestrator | Friday 03 April 2026 09:58:31 +0000 (0:00:01.577) 0:00:19.941 ********** 2026-04-03 09:58:31.761220 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:35.411262 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411349 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:35.411359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:35.411366 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411372 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:35.411378 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:35.411419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411426 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411432 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:35.411449 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:35.411454 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411461 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:35.411467 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411472 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:35.411478 | orchestrator | 2026-04-03 09:58:35.411485 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-03 09:58:35.411493 | orchestrator | Friday 03 April 2026 09:58:32 +0000 (0:00:01.118) 0:00:21.059 ********** 2026-04-03 09:58:35.411499 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:35.411504 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:35.411515 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:35.411520 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:35.411525 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:35.411531 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:35.411536 | orchestrator | 2026-04-03 09:58:35.411542 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-03 09:58:35.411548 | orchestrator | Friday 03 April 2026 09:58:33 +0000 (0:00:00.771) 0:00:21.831 ********** 2026-04-03 09:58:35.411553 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:58:35.411558 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:58:35.411563 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:58:35.411569 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:58:35.411574 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:58:35.411580 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:58:35.411585 | orchestrator | 2026-04-03 09:58:35.411590 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-03 09:58:35.411596 | orchestrator | Friday 03 April 2026 09:58:35 +0000 (0:00:01.738) 0:00:23.570 ********** 2026-04-03 09:58:35.411601 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:35.411611 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:35.411617 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:35.411629 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:40.770270 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:40.770391 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:40.770459 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:40.770483 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:40.770501 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:40.770538 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:40.770559 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:40.770579 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:40.770598 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:40.770637 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:40.770650 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:40.770661 | orchestrator | 2026-04-03 09:58:40.770673 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-03 09:58:40.770686 | orchestrator | Friday 03 April 2026 09:58:36 +0000 (0:00:01.060) 0:00:24.631 ********** 2026-04-03 09:58:40.770707 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:40.770718 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:40.770729 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:40.770740 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:40.770750 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:40.770761 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:40.770801 | orchestrator | 2026-04-03 09:58:40.770815 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-03 09:58:40.770828 | orchestrator | Friday 03 April 2026 09:58:36 +0000 (0:00:00.636) 0:00:25.267 ********** 2026-04-03 09:58:40.770841 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:40.770853 | orchestrator | 2026-04-03 09:58:40.770866 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-03 09:58:40.770878 | orchestrator | Friday 03 April 2026 09:58:36 +0000 (0:00:00.136) 0:00:25.403 ********** 2026-04-03 09:58:40.770890 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:40.770903 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:40.770915 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:40.770928 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:40.770940 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:40.770953 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:40.770966 | orchestrator | 2026-04-03 09:58:40.770978 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-03 09:58:40.770991 | orchestrator | Friday 03 April 2026 09:58:37 +0000 (0:00:00.780) 0:00:26.184 ********** 2026-04-03 09:58:40.771005 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 09:58:40.771019 | orchestrator | 2026-04-03 09:58:40.771031 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-03 09:58:40.771044 | orchestrator | Friday 03 April 2026 09:58:39 +0000 (0:00:01.699) 0:00:27.884 ********** 2026-04-03 09:58:40.771058 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:40.771078 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:40.771093 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:40.771122 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536159 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536280 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536298 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536342 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536367 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:42.536403 | orchestrator | 2026-04-03 09:58:42.536417 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-03 09:58:42.536429 | orchestrator | Friday 03 April 2026 09:58:41 +0000 (0:00:02.223) 0:00:30.107 ********** 2026-04-03 09:58:42.536461 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:42.536475 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:42.536486 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:42.536498 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:42.536511 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:42.536522 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:42.536539 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:42.536551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:42.536569 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:42.536581 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:42.536599 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:46.187553 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.187692 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:46.187720 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.187741 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:46.187764 | orchestrator | 2026-04-03 09:58:46.187861 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-03 09:58:46.187883 | orchestrator | Friday 03 April 2026 09:58:42 +0000 (0:00:01.233) 0:00:31.341 ********** 2026-04-03 09:58:46.187905 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:46.187947 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.187998 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:46.188018 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:58:46.188062 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.188084 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:58:46.188102 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:58:46.188122 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.188140 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:58:46.188158 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.188189 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:58:46.188217 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.188237 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:58:46.188255 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:58:46.188275 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:58:46.188295 | orchestrator | 2026-04-03 09:58:46.188315 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-03 09:58:46.188335 | orchestrator | Friday 03 April 2026 09:58:44 +0000 (0:00:01.866) 0:00:33.208 ********** 2026-04-03 09:58:46.188369 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:50.286610 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:50.286721 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:50.286755 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286836 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286850 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286862 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286933 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.286955 | orchestrator | 2026-04-03 09:58:50.286969 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-03 09:58:50.286981 | orchestrator | Friday 03 April 2026 09:58:47 +0000 (0:00:02.535) 0:00:35.743 ********** 2026-04-03 09:58:50.286999 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:58:50.287011 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:50.287023 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:58:50.287042 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:00.835449 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.835565 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.835625 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.835640 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.835652 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.835664 | orchestrator | 2026-04-03 09:59:00.835677 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-03 09:59:00.835690 | orchestrator | Friday 03 April 2026 09:58:52 +0000 (0:00:05.035) 0:00:40.778 ********** 2026-04-03 09:59:00.835701 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:59:00.835713 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:59:00.835724 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:59:00.835735 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:59:00.835745 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:59:00.835756 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:59:00.835767 | orchestrator | 2026-04-03 09:59:00.835779 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-03 09:59:00.835838 | orchestrator | Friday 03 April 2026 09:58:53 +0000 (0:00:01.646) 0:00:42.425 ********** 2026-04-03 09:59:00.835850 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:59:00.835861 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:59:00.835872 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:59:00.835883 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:00.835893 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:00.835921 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:00.835932 | orchestrator | 2026-04-03 09:59:00.835943 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-03 09:59:00.835955 | orchestrator | Friday 03 April 2026 09:58:54 +0000 (0:00:00.642) 0:00:43.068 ********** 2026-04-03 09:59:00.835966 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:00.835986 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:59:00.836001 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:00.836014 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:00.836027 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:59:00.836040 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:59:00.836052 | orchestrator | 2026-04-03 09:59:00.836065 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-03 09:59:00.836079 | orchestrator | Friday 03 April 2026 09:58:56 +0000 (0:00:01.546) 0:00:44.614 ********** 2026-04-03 09:59:00.836091 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:00.836104 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:00.836116 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:00.836128 | orchestrator | ok: [testbed-node-0] 2026-04-03 09:59:00.836141 | orchestrator | ok: [testbed-node-1] 2026-04-03 09:59:00.836153 | orchestrator | ok: [testbed-node-2] 2026-04-03 09:59:00.836166 | orchestrator | 2026-04-03 09:59:00.836179 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-03 09:59:00.836191 | orchestrator | Friday 03 April 2026 09:58:57 +0000 (0:00:01.482) 0:00:46.096 ********** 2026-04-03 09:59:00.836204 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 09:59:00.836217 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 09:59:00.836230 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 09:59:00.836243 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 09:59:00.836256 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 09:59:00.836268 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 09:59:00.836281 | orchestrator | 2026-04-03 09:59:00.836294 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-03 09:59:00.836308 | orchestrator | Friday 03 April 2026 09:58:59 +0000 (0:00:01.642) 0:00:47.739 ********** 2026-04-03 09:59:00.836328 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:00.836342 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:00.836354 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:00.836366 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:00.836391 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:02.417881 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:02.418004 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:02.418077 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:02.418091 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:02.418103 | orchestrator | 2026-04-03 09:59:02.418116 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-03 09:59:02.418153 | orchestrator | Friday 03 April 2026 09:59:01 +0000 (0:00:02.295) 0:00:50.035 ********** 2026-04-03 09:59:02.418166 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:02.418179 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:02.418191 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:59:02.418223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:02.418235 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:02.418253 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:59:02.418265 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:02.418276 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:02.418295 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:59:02.418306 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:02.418318 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:02.418338 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.124719 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:06.124878 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.124898 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:06.124911 | orchestrator | 2026-04-03 09:59:06.124925 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-03 09:59:06.124937 | orchestrator | Friday 03 April 2026 09:59:02 +0000 (0:00:01.075) 0:00:51.110 ********** 2026-04-03 09:59:06.124948 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:59:06.124959 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:59:06.124970 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:59:06.124981 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:06.124992 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:06.125002 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:06.125013 | orchestrator | 2026-04-03 09:59:06.125025 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-03 09:59:06.125051 | orchestrator | Friday 03 April 2026 09:59:03 +0000 (0:00:00.602) 0:00:51.713 ********** 2026-04-03 09:59:06.125064 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:06.125097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125109 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:59:06.125121 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:06.125133 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125144 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:59:06.125175 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:06.125187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125203 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125223 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:59:06.125234 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:06.125245 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125259 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:06.125272 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:06.125285 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:06.125298 | orchestrator | 2026-04-03 09:59:06.125311 | orchestrator | TASK [service-check-containers : ceilometer | Check containers] **************** 2026-04-03 09:59:06.125324 | orchestrator | Friday 03 April 2026 09:59:04 +0000 (0:00:01.531) 0:00:53.244 ********** 2026-04-03 09:59:06.125346 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:08.274309 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:08.274426 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-03 09:59:08.274465 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274480 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274492 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274504 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274535 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274553 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-03 09:59:08.274573 | orchestrator | 2026-04-03 09:59:08.274587 | orchestrator | TASK [service-check-containers : ceilometer | Notify handlers to restart containers] *** 2026-04-03 09:59:08.274600 | orchestrator | Friday 03 April 2026 09:59:07 +0000 (0:00:02.478) 0:00:55.723 ********** 2026-04-03 09:59:08.274611 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 09:59:08.274623 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274634 | orchestrator | } 2026-04-03 09:59:08.274645 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 09:59:08.274656 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274667 | orchestrator | } 2026-04-03 09:59:08.274677 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 09:59:08.274709 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274732 | orchestrator | } 2026-04-03 09:59:08.274744 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 09:59:08.274754 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274765 | orchestrator | } 2026-04-03 09:59:08.274776 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 09:59:08.274787 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274823 | orchestrator | } 2026-04-03 09:59:08.274834 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 09:59:08.274849 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 09:59:08.274861 | orchestrator | } 2026-04-03 09:59:08.274874 | orchestrator | 2026-04-03 09:59:08.274887 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 09:59:08.274901 | orchestrator | Friday 03 April 2026 09:59:07 +0000 (0:00:00.692) 0:00:56.415 ********** 2026-04-03 09:59:08.274915 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:08.274930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:08.274944 | orchestrator | skipping: [testbed-node-0] 2026-04-03 09:59:08.274966 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:55.492593 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:55.492778 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-03 09:59:55.492803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:55.492817 | orchestrator | skipping: [testbed-node-1] 2026-04-03 09:59:55.492832 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:55.492918 | orchestrator | skipping: [testbed-node-2] 2026-04-03 09:59:55.492931 | orchestrator | skipping: [testbed-node-3] 2026-04-03 09:59:55.492942 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:55.492953 | orchestrator | skipping: [testbed-node-4] 2026-04-03 09:59:55.492984 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-03 09:59:55.493019 | orchestrator | skipping: [testbed-node-5] 2026-04-03 09:59:55.493031 | orchestrator | 2026-04-03 09:59:55.493044 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-03 09:59:55.493056 | orchestrator | Friday 03 April 2026 09:59:09 +0000 (0:00:01.943) 0:00:58.359 ********** 2026-04-03 09:59:55.493067 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:59:55.493078 | orchestrator | 2026-04-03 09:59:55.493089 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493102 | orchestrator | Friday 03 April 2026 09:59:18 +0000 (0:00:08.846) 0:01:07.205 ********** 2026-04-03 09:59:55.493114 | orchestrator | 2026-04-03 09:59:55.493127 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493139 | orchestrator | Friday 03 April 2026 09:59:18 +0000 (0:00:00.084) 0:01:07.290 ********** 2026-04-03 09:59:55.493151 | orchestrator | 2026-04-03 09:59:55.493164 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493177 | orchestrator | Friday 03 April 2026 09:59:18 +0000 (0:00:00.079) 0:01:07.370 ********** 2026-04-03 09:59:55.493189 | orchestrator | 2026-04-03 09:59:55.493201 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493220 | orchestrator | Friday 03 April 2026 09:59:19 +0000 (0:00:00.291) 0:01:07.661 ********** 2026-04-03 09:59:55.493233 | orchestrator | 2026-04-03 09:59:55.493246 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493258 | orchestrator | Friday 03 April 2026 09:59:19 +0000 (0:00:00.076) 0:01:07.737 ********** 2026-04-03 09:59:55.493270 | orchestrator | 2026-04-03 09:59:55.493282 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-03 09:59:55.493295 | orchestrator | Friday 03 April 2026 09:59:19 +0000 (0:00:00.074) 0:01:07.812 ********** 2026-04-03 09:59:55.493307 | orchestrator | 2026-04-03 09:59:55.493319 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-03 09:59:55.493332 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 09:59:55.493345 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 09:59:55.493370 | orchestrator | Friday 03 April 2026 09:59:19 +0000 (0:00:00.075) 0:01:07.887 ********** 2026-04-03 09:59:55.493382 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:59:55.493395 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:59:55.493408 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:59:55.493420 | orchestrator | 2026-04-03 09:59:55.493433 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-03 09:59:55.493446 | orchestrator | Friday 03 April 2026 09:59:31 +0000 (0:00:11.759) 0:01:19.646 ********** 2026-04-03 09:59:55.493458 | orchestrator | changed: [testbed-node-2] 2026-04-03 09:59:55.493470 | orchestrator | changed: [testbed-node-1] 2026-04-03 09:59:55.493481 | orchestrator | changed: [testbed-node-0] 2026-04-03 09:59:55.493492 | orchestrator | 2026-04-03 09:59:55.493503 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-03 09:59:55.493514 | orchestrator | Friday 03 April 2026 09:59:42 +0000 (0:00:11.295) 0:01:30.941 ********** 2026-04-03 09:59:55.493525 | orchestrator | changed: [testbed-node-5] 2026-04-03 09:59:55.493535 | orchestrator | changed: [testbed-node-3] 2026-04-03 09:59:55.493546 | orchestrator | changed: [testbed-node-4] 2026-04-03 09:59:55.493565 | orchestrator | 2026-04-03 09:59:55.493576 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 09:59:55.493588 | orchestrator | testbed-node-0 : ok=26  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-03 09:59:55.493601 | orchestrator | testbed-node-1 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 09:59:55.493612 | orchestrator | testbed-node-2 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 09:59:55.493623 | orchestrator | testbed-node-3 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 09:59:55.493634 | orchestrator | testbed-node-4 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 09:59:55.493644 | orchestrator | testbed-node-5 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-03 09:59:55.493655 | orchestrator | 2026-04-03 09:59:55.493666 | orchestrator | 2026-04-03 09:59:55.493677 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 09:59:55.493688 | orchestrator | Friday 03 April 2026 09:59:55 +0000 (0:00:13.025) 0:01:43.967 ********** 2026-04-03 09:59:55.493699 | orchestrator | =============================================================================== 2026-04-03 09:59:55.493710 | orchestrator | ceilometer : Restart ceilometer-compute container ---------------------- 13.03s 2026-04-03 09:59:55.493721 | orchestrator | ceilometer : Restart ceilometer-notification container ----------------- 11.76s 2026-04-03 09:59:55.493731 | orchestrator | ceilometer : Restart ceilometer-central container ---------------------- 11.30s 2026-04-03 09:59:55.493742 | orchestrator | ceilometer : Running Ceilometer bootstrap container --------------------- 8.85s 2026-04-03 09:59:55.493753 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 5.04s 2026-04-03 09:59:55.493771 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 2.57s 2026-04-03 09:59:55.914149 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 2.54s 2026-04-03 09:59:55.914249 | orchestrator | service-check-containers : ceilometer | Check containers ---------------- 2.48s 2026-04-03 09:59:55.914264 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 2.30s 2026-04-03 09:59:55.914276 | orchestrator | ceilometer : Ensuring config directories exist -------------------------- 2.24s 2026-04-03 09:59:55.914287 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 2.22s 2026-04-03 09:59:55.914298 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.94s 2026-04-03 09:59:55.914309 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 1.87s 2026-04-03 09:59:55.914320 | orchestrator | ceilometer : Check custom gnocchi_resources.yaml exists ----------------- 1.74s 2026-04-03 09:59:55.914330 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 1.70s 2026-04-03 09:59:55.914341 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 1.65s 2026-04-03 09:59:55.914351 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 1.65s 2026-04-03 09:59:55.914381 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 1.64s 2026-04-03 09:59:55.914392 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 1.58s 2026-04-03 09:59:55.914403 | orchestrator | ceilometer : Copying over event_definitions.yaml for notification service --- 1.55s 2026-04-03 09:59:56.123252 | orchestrator | + osism apply -a upgrade aodh 2026-04-03 09:59:57.455210 | orchestrator | 2026-04-03 09:59:57 | INFO  | Prepare task for execution of aodh. 2026-04-03 09:59:57.520406 | orchestrator | 2026-04-03 09:59:57 | INFO  | Task b97adfab-fa07-4e85-8da4-9585f60be0b9 (aodh) was prepared for execution. 2026-04-03 09:59:57.520563 | orchestrator | 2026-04-03 09:59:57 | INFO  | It takes a moment until task b97adfab-fa07-4e85-8da4-9585f60be0b9 (aodh) has been started and output is visible here. 2026-04-03 10:00:12.122733 | orchestrator | 2026-04-03 10:00:12.122918 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:00:12.122945 | orchestrator | 2026-04-03 10:00:12.122968 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:00:12.122998 | orchestrator | Friday 03 April 2026 10:00:02 +0000 (0:00:01.823) 0:00:01.823 ********** 2026-04-03 10:00:12.123021 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:00:12.123042 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:00:12.123062 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:00:12.123083 | orchestrator | 2026-04-03 10:00:12.123105 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:00:12.123126 | orchestrator | Friday 03 April 2026 10:00:04 +0000 (0:00:01.823) 0:00:03.646 ********** 2026-04-03 10:00:12.123147 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-03 10:00:12.123167 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-03 10:00:12.123188 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-03 10:00:12.123202 | orchestrator | 2026-04-03 10:00:12.123214 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-03 10:00:12.123227 | orchestrator | 2026-04-03 10:00:12.123239 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-03 10:00:12.123252 | orchestrator | Friday 03 April 2026 10:00:06 +0000 (0:00:02.411) 0:00:06.057 ********** 2026-04-03 10:00:12.123264 | orchestrator | included: /ansible/roles/aodh/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:00:12.123278 | orchestrator | 2026-04-03 10:00:12.123290 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-03 10:00:12.123302 | orchestrator | Friday 03 April 2026 10:00:09 +0000 (0:00:03.141) 0:00:09.198 ********** 2026-04-03 10:00:12.123318 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:12.123340 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:12.123416 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:12.123442 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123461 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123484 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123506 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123525 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123553 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:12.123577 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:16.846444 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:16.846592 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:16.846617 | orchestrator | 2026-04-03 10:00:16.846637 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-03 10:00:16.846649 | orchestrator | Friday 03 April 2026 10:00:13 +0000 (0:00:03.384) 0:00:12.583 ********** 2026-04-03 10:00:16.846658 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:16.846668 | orchestrator | 2026-04-03 10:00:16.846677 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-03 10:00:16.846685 | orchestrator | Friday 03 April 2026 10:00:14 +0000 (0:00:01.151) 0:00:13.735 ********** 2026-04-03 10:00:16.846694 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:16.846702 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:00:16.846709 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:00:16.846717 | orchestrator | 2026-04-03 10:00:16.846725 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-03 10:00:16.846734 | orchestrator | Friday 03 April 2026 10:00:16 +0000 (0:00:01.560) 0:00:15.296 ********** 2026-04-03 10:00:16.846743 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:16.846803 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:16.846813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:16.846842 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:16.846851 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:16.846920 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:16.846934 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:16.846952 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:16.846970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:16.846980 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:00:16.847000 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:22.696117 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:22.696258 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:22.696278 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:22.696328 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:00:22.696345 | orchestrator | 2026-04-03 10:00:22.696359 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-03 10:00:22.696373 | orchestrator | Friday 03 April 2026 10:00:17 +0000 (0:00:01.870) 0:00:17.166 ********** 2026-04-03 10:00:22.696385 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:00:22.696397 | orchestrator | 2026-04-03 10:00:22.696408 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-03 10:00:22.696419 | orchestrator | Friday 03 April 2026 10:00:19 +0000 (0:00:01.754) 0:00:18.921 ********** 2026-04-03 10:00:22.696446 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:22.696482 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:22.696496 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:22.696521 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:22.696533 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:22.696550 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:22.696561 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:22.696580 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:26.219691 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:26.219765 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:26.219787 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:26.219792 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:26.219796 | orchestrator | 2026-04-03 10:00:26.219802 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-03 10:00:26.219807 | orchestrator | Friday 03 April 2026 10:00:24 +0000 (0:00:05.268) 0:00:24.189 ********** 2026-04-03 10:00:26.219823 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:26.219838 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:26.219844 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:26.219852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:26.219856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:26.219863 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:26.219919 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:26.219928 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:26.219939 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.353922 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.354071 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:00:28.354089 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:28.354098 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.354121 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.354139 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:00:28.354147 | orchestrator | 2026-04-03 10:00:28.354158 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-03 10:00:28.354168 | orchestrator | Friday 03 April 2026 10:00:27 +0000 (0:00:02.659) 0:00:26.848 ********** 2026-04-03 10:00:28.354177 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:28.354205 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:28.354231 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:28.354240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.354251 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:28.354259 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:28.354267 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:28.354280 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:28.354295 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:33.293106 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:33.293243 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:33.293261 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:00:33.293301 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:33.293323 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:33.293343 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:00:33.293361 | orchestrator | 2026-04-03 10:00:33.293382 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-03 10:00:33.293401 | orchestrator | Friday 03 April 2026 10:00:29 +0000 (0:00:02.120) 0:00:28.969 ********** 2026-04-03 10:00:33.293455 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:33.293511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:33.293536 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:33.293568 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:33.293590 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:33.293624 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:33.293644 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:33.293673 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429203 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429305 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429330 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429360 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429369 | orchestrator | 2026-04-03 10:00:42.429380 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-03 10:00:42.429389 | orchestrator | Friday 03 April 2026 10:00:35 +0000 (0:00:05.982) 0:00:34.951 ********** 2026-04-03 10:00:42.429398 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:42.429426 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:42.429464 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:42.429475 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429491 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429499 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429507 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:42.429523 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616446 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616560 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616591 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616601 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616610 | orchestrator | 2026-04-03 10:00:51.616620 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-03 10:00:51.616630 | orchestrator | Friday 03 April 2026 10:00:45 +0000 (0:00:09.960) 0:00:44.912 ********** 2026-04-03 10:00:51.616638 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:00:51.616647 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:00:51.616655 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:00:51.616662 | orchestrator | 2026-04-03 10:00:51.616671 | orchestrator | TASK [service-check-containers : aodh | Check containers] ********************** 2026-04-03 10:00:51.616678 | orchestrator | Friday 03 April 2026 10:00:48 +0000 (0:00:02.902) 0:00:47.815 ********** 2026-04-03 10:00:51.616687 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:51.616715 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:51.616736 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:00:51.616746 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616755 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616763 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-03 10:00:51.616778 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767729 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767847 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767860 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767869 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767877 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-03 10:00:55.767885 | orchestrator | 2026-04-03 10:00:55.767936 | orchestrator | TASK [service-check-containers : aodh | Notify handlers to restart containers] *** 2026-04-03 10:00:55.767947 | orchestrator | Friday 03 April 2026 10:00:53 +0000 (0:00:05.051) 0:00:52.866 ********** 2026-04-03 10:00:55.767956 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:00:55.767965 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:00:55.767973 | orchestrator | } 2026-04-03 10:00:55.767981 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:00:55.767989 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:00:55.767997 | orchestrator | } 2026-04-03 10:00:55.768004 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:00:55.768012 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:00:55.768020 | orchestrator | } 2026-04-03 10:00:55.768027 | orchestrator | 2026-04-03 10:00:55.768036 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:00:55.768043 | orchestrator | Friday 03 April 2026 10:00:55 +0000 (0:00:01.629) 0:00:54.496 ********** 2026-04-03 10:00:55.768066 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:55.768090 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:55.768100 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:00:55.768108 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:00:55.768116 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:00:55.768125 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:00:55.768133 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:00:55.768152 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:02:14.670210 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:02:14.670341 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:02:14.670366 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:02:14.670389 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-03 10:02:14.670405 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-03 10:02:14.670420 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-03 10:02:14.670462 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:02:14.670479 | orchestrator | 2026-04-03 10:02:14.670496 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-03 10:02:14.670512 | orchestrator | Friday 03 April 2026 10:00:57 +0000 (0:00:02.307) 0:00:56.803 ********** 2026-04-03 10:02:14.670527 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:14.670542 | orchestrator | 2026-04-03 10:02:14.670555 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 10:02:14.670568 | orchestrator | Friday 03 April 2026 10:01:14 +0000 (0:00:17.031) 0:01:13.835 ********** 2026-04-03 10:02:14.670582 | orchestrator | 2026-04-03 10:02:14.670596 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 10:02:14.670611 | orchestrator | Friday 03 April 2026 10:01:15 +0000 (0:00:00.451) 0:01:14.286 ********** 2026-04-03 10:02:14.670626 | orchestrator | 2026-04-03 10:02:14.670660 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-03 10:02:14.670677 | orchestrator | Friday 03 April 2026 10:01:15 +0000 (0:00:00.454) 0:01:14.741 ********** 2026-04-03 10:02:14.670691 | orchestrator | 2026-04-03 10:02:14.670714 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-03 10:02:14.670729 | orchestrator | Friday 03 April 2026 10:01:16 +0000 (0:00:00.977) 0:01:15.718 ********** 2026-04-03 10:02:14.670743 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:14.670758 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:02:14.670772 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:02:14.670787 | orchestrator | 2026-04-03 10:02:14.670800 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-03 10:02:14.670815 | orchestrator | Friday 03 April 2026 10:01:29 +0000 (0:00:12.853) 0:01:28.572 ********** 2026-04-03 10:02:14.670830 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:02:14.670846 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:02:14.670861 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:14.670876 | orchestrator | 2026-04-03 10:02:14.670891 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-03 10:02:14.670906 | orchestrator | Friday 03 April 2026 10:01:42 +0000 (0:00:13.274) 0:01:41.846 ********** 2026-04-03 10:02:14.670922 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:02:14.671045 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:02:14.671065 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:14.671082 | orchestrator | 2026-04-03 10:02:14.671098 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-03 10:02:14.671114 | orchestrator | Friday 03 April 2026 10:01:55 +0000 (0:00:13.297) 0:01:55.144 ********** 2026-04-03 10:02:14.671128 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:02:14.671137 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:14.671145 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:02:14.671154 | orchestrator | 2026-04-03 10:02:14.671163 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:02:14.671173 | orchestrator | testbed-node-0 : ok=16  changed=9  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:02:14.671183 | orchestrator | testbed-node-1 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:02:14.671192 | orchestrator | testbed-node-2 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:02:14.671217 | orchestrator | 2026-04-03 10:02:14.671226 | orchestrator | 2026-04-03 10:02:14.671235 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:02:14.671243 | orchestrator | Friday 03 April 2026 10:02:14 +0000 (0:00:18.409) 0:02:13.554 ********** 2026-04-03 10:02:14.671252 | orchestrator | =============================================================================== 2026-04-03 10:02:14.671261 | orchestrator | aodh : Restart aodh-notifier container --------------------------------- 18.41s 2026-04-03 10:02:14.671270 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 17.03s 2026-04-03 10:02:14.671279 | orchestrator | aodh : Restart aodh-listener container --------------------------------- 13.30s 2026-04-03 10:02:14.671287 | orchestrator | aodh : Restart aodh-evaluator container -------------------------------- 13.27s 2026-04-03 10:02:14.671296 | orchestrator | aodh : Restart aodh-api container -------------------------------------- 12.85s 2026-04-03 10:02:14.671305 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------- 9.96s 2026-04-03 10:02:14.671313 | orchestrator | aodh : Copying over config.json files for services ---------------------- 5.98s 2026-04-03 10:02:14.671322 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 5.26s 2026-04-03 10:02:14.671331 | orchestrator | service-check-containers : aodh | Check containers ---------------------- 5.05s 2026-04-03 10:02:14.671339 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 3.39s 2026-04-03 10:02:14.671348 | orchestrator | aodh : include_tasks ---------------------------------------------------- 3.14s 2026-04-03 10:02:14.671356 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 2.90s 2026-04-03 10:02:14.671365 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS certificate --- 2.66s 2026-04-03 10:02:14.671375 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.41s 2026-04-03 10:02:14.671384 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.31s 2026-04-03 10:02:14.671392 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 2.12s 2026-04-03 10:02:14.671401 | orchestrator | aodh : Flush handlers --------------------------------------------------- 1.88s 2026-04-03 10:02:14.671409 | orchestrator | aodh : Copying over existing policy file -------------------------------- 1.87s 2026-04-03 10:02:14.671418 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.82s 2026-04-03 10:02:14.671427 | orchestrator | aodh : include_tasks ---------------------------------------------------- 1.76s 2026-04-03 10:02:14.859815 | orchestrator | ++ semver 10.0.0 7.0.0 2026-04-03 10:02:14.914682 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 10:02:14.914772 | orchestrator | + osism apply -a bootstrap octavia 2026-04-03 10:02:16.264504 | orchestrator | 2026-04-03 10:02:16 | INFO  | Prepare task for execution of octavia. 2026-04-03 10:02:16.337020 | orchestrator | 2026-04-03 10:02:16 | INFO  | Task c53d388d-8241-4739-b17b-75c2490f2a8e (octavia) was prepared for execution. 2026-04-03 10:02:16.337112 | orchestrator | 2026-04-03 10:02:16 | INFO  | It takes a moment until task c53d388d-8241-4739-b17b-75c2490f2a8e (octavia) has been started and output is visible here. 2026-04-03 10:02:55.719933 | orchestrator | 2026-04-03 10:02:55.720076 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:02:55.720093 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 10:02:55.720125 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 10:02:55.720148 | orchestrator | 2026-04-03 10:02:55.720159 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:02:55.720170 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 10:02:55.720181 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 10:02:55.720225 | orchestrator | Friday 03 April 2026 10:02:20 +0000 (0:00:01.054) 0:00:01.054 ********** 2026-04-03 10:02:55.720236 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:02:55.720248 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:02:55.720259 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:02:55.720269 | orchestrator | 2026-04-03 10:02:55.720280 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:02:55.720290 | orchestrator | Friday 03 April 2026 10:02:21 +0000 (0:00:01.001) 0:00:02.056 ********** 2026-04-03 10:02:55.720301 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-03 10:02:55.720312 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-03 10:02:55.720322 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-03 10:02:55.720333 | orchestrator | 2026-04-03 10:02:55.720344 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-03 10:02:55.720354 | orchestrator | 2026-04-03 10:02:55.720365 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 10:02:55.720376 | orchestrator | Friday 03 April 2026 10:02:22 +0000 (0:00:00.710) 0:00:02.767 ********** 2026-04-03 10:02:55.720386 | orchestrator | included: /ansible/roles/octavia/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:02:55.720397 | orchestrator | 2026-04-03 10:02:55.720408 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-03 10:02:55.720419 | orchestrator | Friday 03 April 2026 10:02:23 +0000 (0:00:01.113) 0:00:03.880 ********** 2026-04-03 10:02:55.720429 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:02:55.720440 | orchestrator | 2026-04-03 10:02:55.720451 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-03 10:02:55.720461 | orchestrator | Friday 03 April 2026 10:02:26 +0000 (0:00:02.669) 0:00:06.549 ********** 2026-04-03 10:02:55.720474 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:02:55.720488 | orchestrator | 2026-04-03 10:02:55.720500 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-03 10:02:55.720512 | orchestrator | Friday 03 April 2026 10:02:28 +0000 (0:00:02.159) 0:00:08.709 ********** 2026-04-03 10:02:55.720524 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:02:55.720536 | orchestrator | 2026-04-03 10:02:55.720550 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-03 10:02:55.720563 | orchestrator | Friday 03 April 2026 10:02:30 +0000 (0:00:02.278) 0:00:10.987 ********** 2026-04-03 10:02:55.720575 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:02:55.720587 | orchestrator | 2026-04-03 10:02:55.720599 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-03 10:02:55.720612 | orchestrator | Friday 03 April 2026 10:02:33 +0000 (0:00:02.568) 0:00:13.556 ********** 2026-04-03 10:02:55.720625 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:02:55.720637 | orchestrator | 2026-04-03 10:02:55.720650 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:02:55.720664 | orchestrator | testbed-node-0 : ok=8  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:02:55.720677 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:02:55.720692 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:02:55.720705 | orchestrator | 2026-04-03 10:02:55.720717 | orchestrator | 2026-04-03 10:02:55.720730 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:02:55.720742 | orchestrator | Friday 03 April 2026 10:02:55 +0000 (0:00:22.147) 0:00:35.704 ********** 2026-04-03 10:02:55.720752 | orchestrator | =============================================================================== 2026-04-03 10:02:55.720770 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 22.15s 2026-04-03 10:02:55.720781 | orchestrator | octavia : Creating Octavia database ------------------------------------- 2.67s 2026-04-03 10:02:55.720791 | orchestrator | octavia : Creating Octavia persistence database user and setting permissions --- 2.57s 2026-04-03 10:02:55.720803 | orchestrator | octavia : Creating Octavia database user and setting permissions -------- 2.28s 2026-04-03 10:02:55.720813 | orchestrator | octavia : Creating Octavia persistence database ------------------------- 2.16s 2026-04-03 10:02:55.720824 | orchestrator | octavia : include_tasks ------------------------------------------------- 1.11s 2026-04-03 10:02:55.720835 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.00s 2026-04-03 10:02:55.720845 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.71s 2026-04-03 10:02:55.916428 | orchestrator | + osism apply -a upgrade octavia 2026-04-03 10:02:57.247297 | orchestrator | 2026-04-03 10:02:57 | INFO  | Prepare task for execution of octavia. 2026-04-03 10:02:57.312057 | orchestrator | 2026-04-03 10:02:57 | INFO  | Task f74824b6-5cd5-4555-a586-45373a997ad3 (octavia) was prepared for execution. 2026-04-03 10:02:57.312163 | orchestrator | 2026-04-03 10:02:57 | INFO  | It takes a moment until task f74824b6-5cd5-4555-a586-45373a997ad3 (octavia) has been started and output is visible here. 2026-04-03 10:03:35.571839 | orchestrator | 2026-04-03 10:03:35.571936 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:03:35.571981 | orchestrator | 2026-04-03 10:03:35.571993 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:03:35.572002 | orchestrator | Friday 03 April 2026 10:03:02 +0000 (0:00:01.658) 0:00:01.658 ********** 2026-04-03 10:03:35.572010 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:03:35.572088 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:03:35.572097 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:03:35.572106 | orchestrator | 2026-04-03 10:03:35.572114 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:03:35.572122 | orchestrator | Friday 03 April 2026 10:03:04 +0000 (0:00:01.794) 0:00:03.453 ********** 2026-04-03 10:03:35.572131 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-03 10:03:35.572140 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-03 10:03:35.572148 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-03 10:03:35.572156 | orchestrator | 2026-04-03 10:03:35.572164 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-03 10:03:35.572172 | orchestrator | 2026-04-03 10:03:35.572180 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 10:03:35.572189 | orchestrator | Friday 03 April 2026 10:03:05 +0000 (0:00:01.827) 0:00:05.281 ********** 2026-04-03 10:03:35.572197 | orchestrator | included: /ansible/roles/octavia/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:03:35.572206 | orchestrator | 2026-04-03 10:03:35.572214 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 10:03:35.572222 | orchestrator | Friday 03 April 2026 10:03:07 +0000 (0:00:01.921) 0:00:07.203 ********** 2026-04-03 10:03:35.572230 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:03:35.572238 | orchestrator | 2026-04-03 10:03:35.572247 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-03 10:03:35.572255 | orchestrator | Friday 03 April 2026 10:03:09 +0000 (0:00:01.861) 0:00:09.065 ********** 2026-04-03 10:03:35.572263 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:03:35.572270 | orchestrator | 2026-04-03 10:03:35.572278 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-03 10:03:35.572286 | orchestrator | Friday 03 April 2026 10:03:15 +0000 (0:00:05.373) 0:00:14.439 ********** 2026-04-03 10:03:35.572294 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:03:35.572321 | orchestrator | 2026-04-03 10:03:35.572330 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-03 10:03:35.572338 | orchestrator | Friday 03 April 2026 10:03:19 +0000 (0:00:04.386) 0:00:18.825 ********** 2026-04-03 10:03:35.572346 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-03 10:03:35.572354 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-03 10:03:35.572362 | orchestrator | 2026-04-03 10:03:35.572370 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-03 10:03:35.572378 | orchestrator | Friday 03 April 2026 10:03:27 +0000 (0:00:08.270) 0:00:27.096 ********** 2026-04-03 10:03:35.572387 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:03:35.572396 | orchestrator | 2026-04-03 10:03:35.572406 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-03 10:03:35.572416 | orchestrator | Friday 03 April 2026 10:03:32 +0000 (0:00:04.566) 0:00:31.662 ********** 2026-04-03 10:03:35.572425 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:03:35.572435 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:03:35.572445 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:03:35.572455 | orchestrator | 2026-04-03 10:03:35.572465 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-03 10:03:35.572474 | orchestrator | Friday 03 April 2026 10:03:33 +0000 (0:00:01.413) 0:00:33.076 ********** 2026-04-03 10:03:35.572487 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:35.572527 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:35.572540 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:35.572551 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:35.572567 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:35.572578 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:35.572588 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:35.572608 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:40.241866 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:40.241974 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242135 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242160 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242172 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242199 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242232 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:40.242245 | orchestrator | 2026-04-03 10:03:40.242258 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-03 10:03:40.242281 | orchestrator | Friday 03 April 2026 10:03:37 +0000 (0:00:03.700) 0:00:36.777 ********** 2026-04-03 10:03:40.242292 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:03:40.242304 | orchestrator | 2026-04-03 10:03:40.242315 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-03 10:03:40.242326 | orchestrator | Friday 03 April 2026 10:03:38 +0000 (0:00:01.124) 0:00:37.901 ********** 2026-04-03 10:03:40.242337 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:03:40.242348 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:03:40.242358 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:03:40.242370 | orchestrator | 2026-04-03 10:03:40.242381 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-03 10:03:40.242391 | orchestrator | Friday 03 April 2026 10:03:39 +0000 (0:00:01.309) 0:00:39.211 ********** 2026-04-03 10:03:40.242410 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:40.242435 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:40.242456 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:40.242483 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:40.242516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:44.849840 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:03:44.849948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:44.849970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:44.849984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:44.849997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:44.850137 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:44.850156 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:03:44.850210 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:44.850224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:44.850236 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:44.850247 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:44.850258 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:44.850269 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:03:44.850281 | orchestrator | 2026-04-03 10:03:44.850293 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-03 10:03:44.850306 | orchestrator | Friday 03 April 2026 10:03:41 +0000 (0:00:01.751) 0:00:40.962 ********** 2026-04-03 10:03:44.850318 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:03:44.850336 | orchestrator | 2026-04-03 10:03:44.850348 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-03 10:03:44.850358 | orchestrator | Friday 03 April 2026 10:03:43 +0000 (0:00:01.739) 0:00:42.701 ********** 2026-04-03 10:03:44.850385 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:48.233746 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:48.233884 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:48.233911 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:48.233932 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:48.234001 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:03:48.234201 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234230 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234248 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234269 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234287 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234334 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234353 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:48.234384 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:50.156253 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:03:50.156343 | orchestrator | 2026-04-03 10:03:50.156354 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-03 10:03:50.156364 | orchestrator | Friday 03 April 2026 10:03:49 +0000 (0:00:06.227) 0:00:48.929 ********** 2026-04-03 10:03:50.156374 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:50.156386 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:50.156425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:50.156434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:50.156456 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:50.156464 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:03:50.156474 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:50.156482 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:50.156496 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:50.156507 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:50.156514 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:50.156522 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:03:50.156535 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:51.845207 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:51.845302 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:51.845346 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:51.845380 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:51.845399 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:03:51.845419 | orchestrator | 2026-04-03 10:03:51.845431 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-03 10:03:51.845442 | orchestrator | Friday 03 April 2026 10:03:51 +0000 (0:00:01.812) 0:00:50.742 ********** 2026-04-03 10:03:51.845453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:51.845483 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:51.845495 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:51.845513 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:51.845523 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:51.845538 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:03:51.845548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:51.845559 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:51.845576 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:55.523945 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:55.524080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:55.524094 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:03:55.524117 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:03:55.524129 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:03:55.524138 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:03:55.524160 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:03:55.524175 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:03:55.524183 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:03:55.524190 | orchestrator | 2026-04-03 10:03:55.524199 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-03 10:03:55.524208 | orchestrator | Friday 03 April 2026 10:03:53 +0000 (0:00:01.709) 0:00:52.451 ********** 2026-04-03 10:03:55.524216 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:55.524229 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:55.524237 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:03:55.524255 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:06.200652 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:06.200785 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:06.200820 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200844 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200856 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200870 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200921 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200982 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:06.200994 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:06.201012 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:06.201023 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:06.201035 | orchestrator | 2026-04-03 10:04:06.201078 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-03 10:04:06.201091 | orchestrator | Friday 03 April 2026 10:03:59 +0000 (0:00:06.617) 0:00:59.069 ********** 2026-04-03 10:04:06.201102 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 10:04:06.201114 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 10:04:06.201124 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-03 10:04:06.201144 | orchestrator | 2026-04-03 10:04:06.201156 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-03 10:04:06.201167 | orchestrator | Friday 03 April 2026 10:04:02 +0000 (0:00:02.713) 0:01:01.783 ********** 2026-04-03 10:04:06.201188 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:20.063154 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:20.063287 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:20.063306 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:20.063320 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:20.063353 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:20.063382 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063396 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063413 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063425 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063437 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063456 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063468 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:20.063487 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:45.418140 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:45.418267 | orchestrator | 2026-04-03 10:04:45.418298 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-03 10:04:45.418320 | orchestrator | Friday 03 April 2026 10:04:21 +0000 (0:00:18.853) 0:01:20.637 ********** 2026-04-03 10:04:45.418349 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:04:45.418362 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:04:45.418373 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:04:45.418384 | orchestrator | 2026-04-03 10:04:45.418395 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-03 10:04:45.418406 | orchestrator | Friday 03 April 2026 10:04:24 +0000 (0:00:02.984) 0:01:23.621 ********** 2026-04-03 10:04:45.418418 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418430 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418440 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418451 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418463 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418496 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418507 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418518 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418529 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418539 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418550 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418560 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418571 | orchestrator | 2026-04-03 10:04:45.418582 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-03 10:04:45.418593 | orchestrator | Friday 03 April 2026 10:04:30 +0000 (0:00:06.068) 0:01:29.690 ********** 2026-04-03 10:04:45.418604 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418614 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418625 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418636 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418646 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418657 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418672 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418689 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418707 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418726 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418746 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418765 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418784 | orchestrator | 2026-04-03 10:04:45.418796 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-03 10:04:45.418807 | orchestrator | Friday 03 April 2026 10:04:36 +0000 (0:00:06.129) 0:01:35.820 ********** 2026-04-03 10:04:45.418817 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418828 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418839 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-03 10:04:45.418850 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418861 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418872 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-03 10:04:45.418882 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418894 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418912 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-03 10:04:45.418929 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418946 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418963 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-03 10:04:45.418980 | orchestrator | 2026-04-03 10:04:45.418997 | orchestrator | TASK [service-check-containers : octavia | Check containers] ******************* 2026-04-03 10:04:45.419015 | orchestrator | Friday 03 April 2026 10:04:42 +0000 (0:00:06.521) 0:01:42.342 ********** 2026-04-03 10:04:45.419060 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:45.419141 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:45.419161 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-03 10:04:45.419173 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:45.419185 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:45.419219 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-03 10:04:50.840490 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840618 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840634 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840647 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840659 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840671 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840722 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840741 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840753 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-03 10:04:50.840765 | orchestrator | 2026-04-03 10:04:50.840778 | orchestrator | TASK [service-check-containers : octavia | Notify handlers to restart containers] *** 2026-04-03 10:04:50.840791 | orchestrator | Friday 03 April 2026 10:04:49 +0000 (0:00:06.146) 0:01:48.489 ********** 2026-04-03 10:04:50.840802 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:04:50.840815 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:04:50.840845 | orchestrator | } 2026-04-03 10:04:50.840856 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:04:50.840867 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:04:50.840877 | orchestrator | } 2026-04-03 10:04:50.840888 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:04:50.840899 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:04:50.840910 | orchestrator | } 2026-04-03 10:04:50.840921 | orchestrator | 2026-04-03 10:04:50.840932 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:04:50.840943 | orchestrator | Friday 03 April 2026 10:04:50 +0000 (0:00:01.364) 0:01:49.853 ********** 2026-04-03 10:04:50.840956 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:04:50.840978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:04:50.840999 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.079918 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.080017 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:04:51.080036 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:04:51.080052 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:04:51.080101 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:04:51.080154 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.080196 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.080218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:04:51.080230 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:04:51.080242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-03 10:04:51.080255 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-03 10:04:51.080266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.080285 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-03 10:04:51.080304 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-03 10:06:21.576581 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:06:21.576701 | orchestrator | 2026-04-03 10:06:21.576719 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-03 10:06:21.576750 | orchestrator | Friday 03 April 2026 10:04:52 +0000 (0:00:02.239) 0:01:52.092 ********** 2026-04-03 10:06:21.576762 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.576773 | orchestrator | 2026-04-03 10:06:21.576784 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 10:06:21.576796 | orchestrator | Friday 03 April 2026 10:05:06 +0000 (0:00:13.591) 0:02:05.684 ********** 2026-04-03 10:06:21.576807 | orchestrator | 2026-04-03 10:06:21.576818 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 10:06:21.576829 | orchestrator | Friday 03 April 2026 10:05:06 +0000 (0:00:00.443) 0:02:06.127 ********** 2026-04-03 10:06:21.576840 | orchestrator | 2026-04-03 10:06:21.576851 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-03 10:06:21.576862 | orchestrator | Friday 03 April 2026 10:05:07 +0000 (0:00:00.452) 0:02:06.580 ********** 2026-04-03 10:06:21.576873 | orchestrator | 2026-04-03 10:06:21.576883 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-03 10:06:21.576894 | orchestrator | Friday 03 April 2026 10:05:07 +0000 (0:00:00.793) 0:02:07.373 ********** 2026-04-03 10:06:21.576905 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.576916 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:06:21.576927 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:06:21.576938 | orchestrator | 2026-04-03 10:06:21.576949 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-03 10:06:21.576960 | orchestrator | Friday 03 April 2026 10:05:26 +0000 (0:00:18.659) 0:02:26.033 ********** 2026-04-03 10:06:21.576971 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:06:21.576982 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:06:21.576993 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.577004 | orchestrator | 2026-04-03 10:06:21.577015 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-03 10:06:21.577026 | orchestrator | Friday 03 April 2026 10:05:41 +0000 (0:00:14.431) 0:02:40.464 ********** 2026-04-03 10:06:21.577037 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:06:21.577069 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.577081 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:06:21.577091 | orchestrator | 2026-04-03 10:06:21.577103 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-03 10:06:21.577115 | orchestrator | Friday 03 April 2026 10:05:54 +0000 (0:00:13.163) 0:02:53.628 ********** 2026-04-03 10:06:21.577153 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:06:21.577167 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.577180 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:06:21.577192 | orchestrator | 2026-04-03 10:06:21.577205 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-03 10:06:21.577218 | orchestrator | Friday 03 April 2026 10:06:07 +0000 (0:00:13.238) 0:03:06.866 ********** 2026-04-03 10:06:21.577230 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:06:21.577243 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:06:21.577256 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:06:21.577273 | orchestrator | 2026-04-03 10:06:21.577294 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:06:21.577315 | orchestrator | testbed-node-0 : ok=27  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:06:21.577336 | orchestrator | testbed-node-1 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:06:21.577356 | orchestrator | testbed-node-2 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:06:21.577373 | orchestrator | 2026-04-03 10:06:21.577392 | orchestrator | 2026-04-03 10:06:21.577411 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:06:21.577433 | orchestrator | Friday 03 April 2026 10:06:21 +0000 (0:00:13.675) 0:03:20.542 ********** 2026-04-03 10:06:21.577453 | orchestrator | =============================================================================== 2026-04-03 10:06:21.577474 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 18.85s 2026-04-03 10:06:21.577496 | orchestrator | octavia : Restart octavia-api container -------------------------------- 18.66s 2026-04-03 10:06:21.577517 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 14.43s 2026-04-03 10:06:21.577529 | orchestrator | octavia : Restart octavia-worker container ----------------------------- 13.68s 2026-04-03 10:06:21.577540 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 13.59s 2026-04-03 10:06:21.577551 | orchestrator | octavia : Restart octavia-housekeeping container ----------------------- 13.24s 2026-04-03 10:06:21.577561 | orchestrator | octavia : Restart octavia-health-manager container --------------------- 13.16s 2026-04-03 10:06:21.577572 | orchestrator | octavia : Get security groups for octavia ------------------------------- 8.27s 2026-04-03 10:06:21.577583 | orchestrator | octavia : Copying over config.json files for services ------------------- 6.62s 2026-04-03 10:06:21.577593 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 6.52s 2026-04-03 10:06:21.577604 | orchestrator | service-cert-copy : octavia | Copying over extra CA certificates -------- 6.23s 2026-04-03 10:06:21.577615 | orchestrator | service-check-containers : octavia | Check containers ------------------- 6.15s 2026-04-03 10:06:21.577625 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 6.13s 2026-04-03 10:06:21.577636 | orchestrator | octavia : Copying certificate files for octavia-worker ------------------ 6.07s 2026-04-03 10:06:21.577666 | orchestrator | octavia : Get amphora flavor info --------------------------------------- 5.37s 2026-04-03 10:06:21.577678 | orchestrator | octavia : Get loadbalancer management network --------------------------- 4.57s 2026-04-03 10:06:21.577688 | orchestrator | octavia : Get service project id ---------------------------------------- 4.39s 2026-04-03 10:06:21.577707 | orchestrator | octavia : Ensuring config directories exist ----------------------------- 3.70s 2026-04-03 10:06:21.577729 | orchestrator | octavia : Copying over Octavia SSH key ---------------------------------- 2.98s 2026-04-03 10:06:21.577740 | orchestrator | octavia : Copying over octavia-wsgi.conf -------------------------------- 2.71s 2026-04-03 10:06:21.757402 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-03 10:06:21.757502 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/310-openstack-extended.sh 2026-04-03 10:06:23.118008 | orchestrator | 2026-04-03 10:06:23 | INFO  | Prepare task for execution of gnocchi. 2026-04-03 10:06:23.194542 | orchestrator | 2026-04-03 10:06:23 | INFO  | Task edc29c3e-8b24-44a0-9f2d-3fd96e84909c (gnocchi) was prepared for execution. 2026-04-03 10:06:23.194659 | orchestrator | 2026-04-03 10:06:23 | INFO  | It takes a moment until task edc29c3e-8b24-44a0-9f2d-3fd96e84909c (gnocchi) has been started and output is visible here. 2026-04-03 10:06:35.206407 | orchestrator | 2026-04-03 10:06:35.206523 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:06:35.206540 | orchestrator | 2026-04-03 10:06:35.206552 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:06:35.206564 | orchestrator | Friday 03 April 2026 10:06:28 +0000 (0:00:01.694) 0:00:01.694 ********** 2026-04-03 10:06:35.206575 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:06:35.206587 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:06:35.206598 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:06:35.206609 | orchestrator | 2026-04-03 10:06:35.206620 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:06:35.206631 | orchestrator | Friday 03 April 2026 10:06:29 +0000 (0:00:01.680) 0:00:03.374 ********** 2026-04-03 10:06:35.206642 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-03 10:06:35.206654 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-03 10:06:35.206665 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-03 10:06:35.206676 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-03 10:06:35.206687 | orchestrator | 2026-04-03 10:06:35.206698 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-03 10:06:35.206709 | orchestrator | skipping: no hosts matched 2026-04-03 10:06:35.206721 | orchestrator | 2026-04-03 10:06:35.206732 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:06:35.206743 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:06:35.206756 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:06:35.206767 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-03 10:06:35.206777 | orchestrator | 2026-04-03 10:06:35.206788 | orchestrator | 2026-04-03 10:06:35.206800 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:06:35.206811 | orchestrator | Friday 03 April 2026 10:06:34 +0000 (0:00:04.993) 0:00:08.368 ********** 2026-04-03 10:06:35.206821 | orchestrator | =============================================================================== 2026-04-03 10:06:35.206832 | orchestrator | Group hosts based on enabled services ----------------------------------- 4.99s 2026-04-03 10:06:35.206844 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.68s 2026-04-03 10:06:36.700422 | orchestrator | 2026-04-03 10:06:36 | INFO  | Prepare task for execution of manila. 2026-04-03 10:06:36.765533 | orchestrator | 2026-04-03 10:06:36 | INFO  | Task d11acb7e-f442-4687-a1a9-693cb9fa61e8 (manila) was prepared for execution. 2026-04-03 10:06:36.765601 | orchestrator | 2026-04-03 10:06:36 | INFO  | It takes a moment until task d11acb7e-f442-4687-a1a9-693cb9fa61e8 (manila) has been started and output is visible here. 2026-04-03 10:06:52.681834 | orchestrator | 2026-04-03 10:06:52.681953 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:06:52.681967 | orchestrator | 2026-04-03 10:06:52.681976 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:06:52.681985 | orchestrator | Friday 03 April 2026 10:06:41 +0000 (0:00:01.729) 0:00:01.729 ********** 2026-04-03 10:06:52.681993 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:06:52.682002 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:06:52.682010 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:06:52.682061 | orchestrator | 2026-04-03 10:06:52.682070 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:06:52.682078 | orchestrator | Friday 03 April 2026 10:06:43 +0000 (0:00:01.846) 0:00:03.575 ********** 2026-04-03 10:06:52.682085 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-03 10:06:52.682094 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-03 10:06:52.682101 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-03 10:06:52.682109 | orchestrator | 2026-04-03 10:06:52.682117 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-03 10:06:52.682125 | orchestrator | 2026-04-03 10:06:52.682133 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 10:06:52.682198 | orchestrator | Friday 03 April 2026 10:06:45 +0000 (0:00:01.522) 0:00:05.098 ********** 2026-04-03 10:06:52.682211 | orchestrator | included: /ansible/roles/manila/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:06:52.682220 | orchestrator | 2026-04-03 10:06:52.682228 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-03 10:06:52.682247 | orchestrator | Friday 03 April 2026 10:06:50 +0000 (0:00:05.085) 0:00:10.183 ********** 2026-04-03 10:06:52.682338 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:06:52.682354 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:06:52.682363 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:06:52.682424 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682443 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682452 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682463 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682474 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682489 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:06:52.682505 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:10.735337 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:10.735473 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:10.735493 | orchestrator | 2026-04-03 10:07:10.735507 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 10:07:10.735520 | orchestrator | Friday 03 April 2026 10:06:54 +0000 (0:00:03.989) 0:00:14.173 ********** 2026-04-03 10:07:10.735532 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:07:10.735544 | orchestrator | 2026-04-03 10:07:10.735555 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-03 10:07:10.735566 | orchestrator | Friday 03 April 2026 10:06:56 +0000 (0:00:01.909) 0:00:16.082 ********** 2026-04-03 10:07:10.735577 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:07:10.735588 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:07:10.735599 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:07:10.735610 | orchestrator | 2026-04-03 10:07:10.735621 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-03 10:07:10.735632 | orchestrator | Friday 03 April 2026 10:06:58 +0000 (0:00:02.065) 0:00:18.148 ********** 2026-04-03 10:07:10.735644 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735657 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735689 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735701 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735712 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735722 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735733 | orchestrator | 2026-04-03 10:07:10.735744 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-03 10:07:10.735755 | orchestrator | Friday 03 April 2026 10:07:00 +0000 (0:00:02.519) 0:00:20.667 ********** 2026-04-03 10:07:10.735766 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735777 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735790 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735803 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735834 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-03 10:07:10.735847 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-03 10:07:10.735861 | orchestrator | 2026-04-03 10:07:10.735875 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-03 10:07:10.735888 | orchestrator | Friday 03 April 2026 10:07:02 +0000 (0:00:02.209) 0:00:22.876 ********** 2026-04-03 10:07:10.735900 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-03 10:07:10.735913 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-03 10:07:10.735926 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-03 10:07:10.735939 | orchestrator | 2026-04-03 10:07:10.735951 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-03 10:07:10.735969 | orchestrator | Friday 03 April 2026 10:07:04 +0000 (0:00:01.921) 0:00:24.798 ********** 2026-04-03 10:07:10.735983 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:10.735994 | orchestrator | 2026-04-03 10:07:10.736005 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-03 10:07:10.736015 | orchestrator | Friday 03 April 2026 10:07:06 +0000 (0:00:01.194) 0:00:25.992 ********** 2026-04-03 10:07:10.736026 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:10.736037 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:07:10.736048 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:07:10.736058 | orchestrator | 2026-04-03 10:07:10.736070 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-03 10:07:10.736080 | orchestrator | Friday 03 April 2026 10:07:07 +0000 (0:00:01.404) 0:00:27.396 ********** 2026-04-03 10:07:10.736092 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:07:10.736110 | orchestrator | 2026-04-03 10:07:10.736121 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-03 10:07:10.736132 | orchestrator | Friday 03 April 2026 10:07:09 +0000 (0:00:01.830) 0:00:29.226 ********** 2026-04-03 10:07:10.736145 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:10.736181 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:10.736202 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:14.742496 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742595 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742636 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742650 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742663 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742674 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742704 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742722 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742742 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:14.742754 | orchestrator | 2026-04-03 10:07:14.742768 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-03 10:07:14.742780 | orchestrator | Friday 03 April 2026 10:07:14 +0000 (0:00:04.870) 0:00:34.097 ********** 2026-04-03 10:07:14.742793 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:14.742806 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:14.742825 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:16.966775 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966888 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966901 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:16.966909 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966916 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:16.966925 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966953 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966967 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966974 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:07:16.966981 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966988 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.966995 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:07:16.967002 | orchestrator | 2026-04-03 10:07:16.967011 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-03 10:07:16.967020 | orchestrator | Friday 03 April 2026 10:07:16 +0000 (0:00:02.211) 0:00:36.308 ********** 2026-04-03 10:07:16.967027 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:16.967034 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:16.967056 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:20.234134 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234313 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234332 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234344 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:20.234359 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:20.234413 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234445 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234458 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234469 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:07:20.234481 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234493 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:20.234504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:07:20.234515 | orchestrator | 2026-04-03 10:07:20.234527 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-03 10:07:20.234540 | orchestrator | Friday 03 April 2026 10:07:18 +0000 (0:00:02.415) 0:00:38.724 ********** 2026-04-03 10:07:20.234551 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:20.234584 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:26.800043 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:26.800152 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800213 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800250 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800277 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800307 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800320 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800331 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800343 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800362 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:26.800375 | orchestrator | 2026-04-03 10:07:26.800389 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-03 10:07:26.800401 | orchestrator | Friday 03 April 2026 10:07:24 +0000 (0:00:05.381) 0:00:44.105 ********** 2026-04-03 10:07:26.800418 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:26.800438 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:37.617838 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:37.617958 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.617967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:37.617985 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.617991 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:37.618010 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.618065 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:37.618078 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.618085 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.618095 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:37.618102 | orchestrator | 2026-04-03 10:07:37.618111 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-03 10:07:37.618118 | orchestrator | Friday 03 April 2026 10:07:32 +0000 (0:00:08.007) 0:00:52.113 ********** 2026-04-03 10:07:37.618126 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-03 10:07:37.618133 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-03 10:07:37.618139 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-03 10:07:37.618145 | orchestrator | 2026-04-03 10:07:37.618152 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-03 10:07:37.618158 | orchestrator | Friday 03 April 2026 10:07:37 +0000 (0:00:04.838) 0:00:56.951 ********** 2026-04-03 10:07:37.618207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:40.710074 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710233 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710252 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710265 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:40.710292 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:40.710306 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710371 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:07:40.710383 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:40.710399 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710422 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:40.710465 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:07:40.710477 | orchestrator | 2026-04-03 10:07:40.710489 | orchestrator | TASK [service-check-containers : manila | Check containers] ******************** 2026-04-03 10:07:40.710504 | orchestrator | Friday 03 April 2026 10:07:39 +0000 (0:00:02.278) 0:00:59.229 ********** 2026-04-03 10:07:40.710534 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:44.741982 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:44.742216 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:07:44.742240 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742252 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742285 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742318 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742332 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742349 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742362 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742374 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742393 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-03 10:07:44.742405 | orchestrator | 2026-04-03 10:07:44.742418 | orchestrator | TASK [service-check-containers : manila | Notify handlers to restart containers] *** 2026-04-03 10:07:44.742431 | orchestrator | Friday 03 April 2026 10:07:44 +0000 (0:00:05.102) 0:01:04.332 ********** 2026-04-03 10:07:44.742444 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:07:44.742456 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:07:44.742467 | orchestrator | } 2026-04-03 10:07:44.742478 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:07:44.742489 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:07:44.742502 | orchestrator | } 2026-04-03 10:07:44.742515 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:07:44.742535 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:07:46.678724 | orchestrator | } 2026-04-03 10:07:46.678826 | orchestrator | 2026-04-03 10:07:46.678844 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:07:46.678857 | orchestrator | Friday 03 April 2026 10:07:45 +0000 (0:00:01.415) 0:01:05.747 ********** 2026-04-03 10:07:46.678872 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:46.678906 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.678920 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.678955 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.678967 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:07:46.678997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:46.679010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.679021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.679038 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.679049 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:07:46.679061 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:07:46.679080 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-03 10:07:46.679099 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-03 10:11:20.968673 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-03 10:11:20.968790 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:11:20.968808 | orchestrator | 2026-04-03 10:11:20.968822 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-03 10:11:20.968834 | orchestrator | Friday 03 April 2026 10:07:48 +0000 (0:00:02.446) 0:01:08.194 ********** 2026-04-03 10:11:20.968845 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:11:20.968856 | orchestrator | 2026-04-03 10:11:20.968867 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 10:11:20.968878 | orchestrator | Friday 03 April 2026 10:08:08 +0000 (0:00:20.024) 0:01:28.219 ********** 2026-04-03 10:11:20.968889 | orchestrator | 2026-04-03 10:11:20.968900 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 10:11:20.968910 | orchestrator | Friday 03 April 2026 10:08:08 +0000 (0:00:00.490) 0:01:28.709 ********** 2026-04-03 10:11:20.968921 | orchestrator | 2026-04-03 10:11:20.968932 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-03 10:11:20.968959 | orchestrator | Friday 03 April 2026 10:08:09 +0000 (0:00:00.460) 0:01:29.169 ********** 2026-04-03 10:11:20.969007 | orchestrator | 2026-04-03 10:11:20.969026 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-03 10:11:20.969045 | orchestrator | Friday 03 April 2026 10:08:10 +0000 (0:00:00.805) 0:01:29.975 ********** 2026-04-03 10:11:20.969062 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:11:20.969079 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:11:20.969096 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:11:20.969112 | orchestrator | 2026-04-03 10:11:20.969131 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-03 10:11:20.969150 | orchestrator | Friday 03 April 2026 10:08:27 +0000 (0:00:17.422) 0:01:47.398 ********** 2026-04-03 10:11:20.969169 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:11:20.969187 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:11:20.969202 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:11:20.969215 | orchestrator | 2026-04-03 10:11:20.969228 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-03 10:11:20.969241 | orchestrator | Friday 03 April 2026 10:08:46 +0000 (0:00:18.680) 0:02:06.079 ********** 2026-04-03 10:11:20.969253 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:11:20.969266 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:11:20.969278 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:11:20.969318 | orchestrator | 2026-04-03 10:11:20.969331 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-03 10:11:20.969343 | orchestrator | Friday 03 April 2026 10:08:59 +0000 (0:00:13.039) 0:02:19.119 ********** 2026-04-03 10:11:20.969355 | orchestrator | 2026-04-03 10:11:20.969368 | orchestrator | STILL ALIVE [task 'manila : Restart manila-share container' is running] ******** 2026-04-03 10:11:20.969380 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:11:20.969392 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:11:20.969405 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:11:20.969417 | orchestrator | 2026-04-03 10:11:20.969429 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:11:20.969442 | orchestrator | testbed-node-0 : ok=21  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:11:20.969456 | orchestrator | testbed-node-1 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:11:20.969468 | orchestrator | testbed-node-2 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:11:20.969480 | orchestrator | 2026-04-03 10:11:20.969493 | orchestrator | 2026-04-03 10:11:20.969505 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:11:20.969518 | orchestrator | Friday 03 April 2026 10:11:20 +0000 (0:02:21.296) 0:04:40.415 ********** 2026-04-03 10:11:20.969530 | orchestrator | =============================================================================== 2026-04-03 10:11:20.969542 | orchestrator | manila : Restart manila-share container ------------------------------- 141.30s 2026-04-03 10:11:20.969555 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 20.02s 2026-04-03 10:11:20.969566 | orchestrator | manila : Restart manila-data container --------------------------------- 18.68s 2026-04-03 10:11:20.969577 | orchestrator | manila : Restart manila-api container ---------------------------------- 17.42s 2026-04-03 10:11:20.969588 | orchestrator | manila : Restart manila-scheduler container ---------------------------- 13.04s 2026-04-03 10:11:20.969599 | orchestrator | manila : Copying over manila.conf --------------------------------------- 8.01s 2026-04-03 10:11:20.969609 | orchestrator | manila : Copying over config.json files for services -------------------- 5.38s 2026-04-03 10:11:20.969620 | orchestrator | service-check-containers : manila | Check containers -------------------- 5.10s 2026-04-03 10:11:20.969631 | orchestrator | manila : include_tasks -------------------------------------------------- 5.09s 2026-04-03 10:11:20.969660 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 4.87s 2026-04-03 10:11:20.969682 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 4.84s 2026-04-03 10:11:20.969693 | orchestrator | manila : Ensuring config directories exist ------------------------------ 3.99s 2026-04-03 10:11:20.969703 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 2.52s 2026-04-03 10:11:20.969714 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.45s 2026-04-03 10:11:20.969724 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS key ------ 2.42s 2026-04-03 10:11:20.969735 | orchestrator | manila : Copying over existing policy file ------------------------------ 2.28s 2026-04-03 10:11:20.969746 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS certificate --- 2.21s 2026-04-03 10:11:20.969757 | orchestrator | manila : Copy over ceph Manila keyrings --------------------------------- 2.21s 2026-04-03 10:11:20.969768 | orchestrator | manila : Ensuring manila service ceph config subdir exists -------------- 2.07s 2026-04-03 10:11:20.969779 | orchestrator | manila : Ensuring config directory has correct owner and permission ----- 1.92s 2026-04-03 10:11:21.172659 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-03 10:11:21.172746 | orchestrator | + osism migrate rabbitmq3to4 delete 2026-04-03 10:11:27.497834 | orchestrator | 2026-04-03 10:11:27 | ERROR  | Unable to get ansible vault password 2026-04-03 10:11:27.497946 | orchestrator | 2026-04-03 10:11:27 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 10:11:27.497964 | orchestrator | 2026-04-03 10:11:27 | ERROR  | Dropping encrypted entries 2026-04-03 10:11:27.531983 | orchestrator | 2026-04-03 10:11:27 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 10:11:27.761456 | orchestrator | 2026-04-03 10:11:27 | INFO  | Found 128 classic queue(s) in vhost '/' 2026-04-03 10:11:27.822348 | orchestrator | 2026-04-03 10:11:27 | INFO  | Deleted queue: alarm.all.sample 2026-04-03 10:11:27.883369 | orchestrator | 2026-04-03 10:11:27 | INFO  | Deleted queue: alarming.sample 2026-04-03 10:11:27.929080 | orchestrator | 2026-04-03 10:11:27 | INFO  | Deleted queue: barbican.workers 2026-04-03 10:11:27.990104 | orchestrator | 2026-04-03 10:11:27 | INFO  | Deleted queue: barbican.workers.barbican.queue 2026-04-03 10:11:28.036503 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: barbican.workers_fanout_634ddae349034d8cbc9d72bf8ae7e69a 2026-04-03 10:11:28.083152 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: barbican.workers_fanout_7bd1dc15a26740d5a9ca2b711fe054b6 2026-04-03 10:11:28.142965 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: barbican.workers_fanout_ac237e574a204322bbee1a262170dfca 2026-04-03 10:11:28.191493 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: barbican_notifications.info 2026-04-03 10:11:28.247020 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central 2026-04-03 10:11:28.331240 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central.testbed-node-0 2026-04-03 10:11:28.377754 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central.testbed-node-1 2026-04-03 10:11:28.426736 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central.testbed-node-2 2026-04-03 10:11:28.470149 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_1c07ade158134d129f71636a1f344413 2026-04-03 10:11:28.509931 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_416c6eb5969c444bb3c52f4f5d696784 2026-04-03 10:11:28.547611 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_6a162abff07442069054bf3124c430de 2026-04-03 10:11:28.590156 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_a871dab2baa34ee6b569eca52c826319 2026-04-03 10:11:28.632884 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_b36eb7df16fd49529aa6669ea40ab022 2026-04-03 10:11:28.683572 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: central_fanout_cfd0e4b384cf4f73ba3dc5aefde57b86 2026-04-03 10:11:28.728188 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-backup 2026-04-03 10:11:28.776738 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-backup.testbed-node-0 2026-04-03 10:11:28.827449 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-backup.testbed-node-1 2026-04-03 10:11:28.891093 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-backup.testbed-node-2 2026-04-03 10:11:28.942565 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-scheduler 2026-04-03 10:11:28.996426 | orchestrator | 2026-04-03 10:11:28 | INFO  | Deleted queue: cinder-scheduler.testbed-node-0 2026-04-03 10:11:29.048921 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-scheduler.testbed-node-1 2026-04-03 10:11:29.104421 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-scheduler.testbed-node-2 2026-04-03 10:11:29.152607 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume 2026-04-03 10:11:29.205623 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes 2026-04-03 10:11:29.253549 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 2026-04-03 10:11:29.296372 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes 2026-04-03 10:11:29.348477 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 2026-04-03 10:11:29.396796 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes 2026-04-03 10:11:29.435608 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 2026-04-03 10:11:29.481874 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: compute 2026-04-03 10:11:29.518724 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: compute.testbed-node-3 2026-04-03 10:11:29.562372 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: compute.testbed-node-4 2026-04-03 10:11:29.614598 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: compute.testbed-node-5 2026-04-03 10:11:29.660277 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: conductor 2026-04-03 10:11:29.705098 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: conductor.testbed-node-0 2026-04-03 10:11:29.753281 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: conductor.testbed-node-1 2026-04-03 10:11:29.809900 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: conductor.testbed-node-2 2026-04-03 10:11:29.867760 | orchestrator | 2026-04-03 10:11:29 | INFO  | Deleted queue: event.sample 2026-04-03 10:11:29.903106 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.11:47228 -> 192.168.16.11:5672 2026-04-03 10:11:29.920426 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.12:52908 -> 192.168.16.10:5672 2026-04-03 10:11:29.936080 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.11:39430 -> 192.168.16.10:5672 2026-04-03 10:11:29.955876 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.12:52920 -> 192.168.16.10:5672 2026-04-03 10:11:29.974087 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.11:39520 -> 192.168.16.10:5672 2026-04-03 10:11:29.993207 | orchestrator | 2026-04-03 10:11:29 | INFO  | Closed connection: 192.168.16.12:51020 -> 192.168.16.11:5672 2026-04-03 10:11:30.009937 | orchestrator | 2026-04-03 10:11:30 | INFO  | Closed connection: 192.168.16.10:54274 -> 192.168.16.10:5672 2026-04-03 10:11:30.028691 | orchestrator | 2026-04-03 10:11:30 | INFO  | Closed connection: 192.168.16.10:54264 -> 192.168.16.10:5672 2026-04-03 10:11:30.049007 | orchestrator | 2026-04-03 10:11:30 | INFO  | Closed connection: 192.168.16.10:42452 -> 192.168.16.11:5672 2026-04-03 10:11:30.049103 | orchestrator | 2026-04-03 10:11:30 | INFO  | Closed 9 connection(s) for queue: magnum-conductor 2026-04-03 10:11:30.076112 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor 2026-04-03 10:11:30.117469 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor.cre24ozvki7j 2026-04-03 10:11:30.160536 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor.kcisounizhqo 2026-04-03 10:11:30.211477 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor.wmfrw7pq6kho 2026-04-03 10:11:30.254803 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_054944816b704c8087606457a1635e4a 2026-04-03 10:11:30.296335 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_3fab08c024ea4da78113b669810d6451 2026-04-03 10:11:30.337793 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_41ee208d5db647b7ad10fc67235d57d0 2026-04-03 10:11:30.380763 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_5431c7da8e3c45d68ff9f6ce25a68fb7 2026-04-03 10:11:30.433997 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_a3de3897f1f74451abd281b24fdbc335 2026-04-03 10:11:30.466374 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_b06d738881f14bf3acc8c20de5d52b21 2026-04-03 10:11:30.504730 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_c41351fa0a7341bd9852825bab17f6bc 2026-04-03 10:11:30.541105 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_dedbda64b11a4a1b9424040cd87ad107 2026-04-03 10:11:30.581475 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: magnum-conductor_fanout_e9065fc22494427cbea06d64bb5548e0 2026-04-03 10:11:30.635872 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-data 2026-04-03 10:11:30.687221 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-data.testbed-node-0 2026-04-03 10:11:30.734185 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-data.testbed-node-1 2026-04-03 10:11:30.791676 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-data.testbed-node-2 2026-04-03 10:11:30.838169 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-scheduler 2026-04-03 10:11:30.890597 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-scheduler.testbed-node-0 2026-04-03 10:11:30.945922 | orchestrator | 2026-04-03 10:11:30 | INFO  | Deleted queue: manila-scheduler.testbed-node-1 2026-04-03 10:11:31.013784 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-scheduler.testbed-node-2 2026-04-03 10:11:31.060682 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share 2026-04-03 10:11:31.104704 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share.testbed-node-0@cephfsnative1 2026-04-03 10:11:31.152211 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share.testbed-node-1@cephfsnative1 2026-04-03 10:11:31.201216 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share.testbed-node-2@cephfsnative1 2026-04-03 10:11:31.244016 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share_fanout_7c83306b89394aeab6ea25e3fcb26462 2026-04-03 10:11:31.284405 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share_fanout_b7715d9fed924473834717a4cb62339f 2026-04-03 10:11:31.324184 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: manila-share_fanout_e25bd8d782a442eb966d6492bc699ea3 2026-04-03 10:11:31.459536 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: notifications.audit 2026-04-03 10:11:31.611909 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: notifications.critical 2026-04-03 10:11:31.763144 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: notifications.debug 2026-04-03 10:11:31.893920 | orchestrator | 2026-04-03 10:11:31 | INFO  | Deleted queue: notifications.error 2026-04-03 10:11:32.023933 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: notifications.info 2026-04-03 10:11:32.150515 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: notifications.sample 2026-04-03 10:11:32.321566 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: notifications.warn 2026-04-03 10:11:32.366378 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: octavia_provisioning_v2 2026-04-03 10:11:32.419955 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-0 2026-04-03 10:11:32.475597 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-1 2026-04-03 10:11:32.521728 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-2 2026-04-03 10:11:32.557020 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer 2026-04-03 10:11:32.593091 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer.testbed-node-0 2026-04-03 10:11:32.638779 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer.testbed-node-1 2026-04-03 10:11:32.683666 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer.testbed-node-2 2026-04-03 10:11:32.720482 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_0d63aa80b14f476f89e8e6e3bc2ae5db 2026-04-03 10:11:32.765465 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_3c083d226f434571aea79c28f95dac9a 2026-04-03 10:11:32.801779 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_7557334d7e404bd5ad1d3d60ead64a66 2026-04-03 10:11:32.838628 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_87c3606e01d8408088d5c950ab4a12ca 2026-04-03 10:11:32.884998 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_d45c05123fd54567ba3861f7d7771e8a 2026-04-03 10:11:32.935586 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: producer_fanout_f3874f5e8acc45769fa2f7438b7660be 2026-04-03 10:11:32.978904 | orchestrator | 2026-04-03 10:11:32 | INFO  | Deleted queue: q-plugin 2026-04-03 10:11:33.024866 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-plugin.testbed-node-0 2026-04-03 10:11:33.072568 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-plugin.testbed-node-1 2026-04-03 10:11:33.116644 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-plugin.testbed-node-2 2026-04-03 10:11:33.157939 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-reports-plugin 2026-04-03 10:11:33.195113 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-reports-plugin.testbed-node-0 2026-04-03 10:11:33.233818 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-reports-plugin.testbed-node-1 2026-04-03 10:11:33.282726 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-reports-plugin.testbed-node-2 2026-04-03 10:11:33.323541 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-server-resource-versions 2026-04-03 10:11:33.379160 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-0 2026-04-03 10:11:33.421887 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-1 2026-04-03 10:11:33.478917 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-2 2026-04-03 10:11:33.514869 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_055b1de3563a4788b4c5910cc6aeccc4 2026-04-03 10:11:33.553938 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_20ced56fb53946449e64a16495bfc380 2026-04-03 10:11:33.593666 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_42be2a4b14804fbba441844549537d40 2026-04-03 10:11:33.628373 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_5e4e301e0b9b49eea98063ad72695046 2026-04-03 10:11:33.666161 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_a134d02641044f0c96369ac0ab44715f 2026-04-03 10:11:33.711022 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_b3c7ed48cc5d46d4b84d853c5aacab86 2026-04-03 10:11:33.755199 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_bb4c79afa001435da18770c23c0ab41c 2026-04-03 10:11:33.793693 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_bbf724cf4b0b4183acb68b4d96d4718f 2026-04-03 10:11:33.825788 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_bf856eeeeb5b4db6bd63b9cc97f27ead 2026-04-03 10:11:33.856573 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_ebf4541372dd4c3ca8ceaf735b18ef13 2026-04-03 10:11:33.892472 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: reply_facddf1eded649a7b232a7cb83a2aa40 2026-04-03 10:11:33.938323 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: scheduler 2026-04-03 10:11:33.983133 | orchestrator | 2026-04-03 10:11:33 | INFO  | Deleted queue: scheduler.testbed-node-0 2026-04-03 10:11:34.020536 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: scheduler.testbed-node-1 2026-04-03 10:11:34.070735 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: scheduler.testbed-node-2 2026-04-03 10:11:34.112744 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker 2026-04-03 10:11:34.160909 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker.testbed-node-0 2026-04-03 10:11:34.208542 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker.testbed-node-1 2026-04-03 10:11:34.258264 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker.testbed-node-2 2026-04-03 10:11:34.304395 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_06a570ebb88f4be1a8d5f4adc3095d6f 2026-04-03 10:11:34.348565 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_5294b318ddeb46debe696111bfbfeb2b 2026-04-03 10:11:34.385737 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_7d7f85b33b8e4e9f8ff995c18afaa8ae 2026-04-03 10:11:34.428748 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_a18ee502dad84bebb691d28e37a81c37 2026-04-03 10:11:34.470541 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_d05e8d0a17a944c2883313c0a4420bae 2026-04-03 10:11:34.513848 | orchestrator | 2026-04-03 10:11:34 | INFO  | Deleted queue: worker_fanout_efb1accb575645dea1052036ac658161 2026-04-03 10:11:34.513936 | orchestrator | 2026-04-03 10:11:34 | INFO  | Successfully deleted 128 queue(s) in vhost '/' 2026-04-03 10:11:34.878288 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-03 10:11:41.342259 | orchestrator | 2026-04-03 10:11:41 | ERROR  | Unable to get ansible vault password 2026-04-03 10:11:41.342419 | orchestrator | 2026-04-03 10:11:41 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 10:11:41.342437 | orchestrator | 2026-04-03 10:11:41 | ERROR  | Dropping encrypted entries 2026-04-03 10:11:41.376046 | orchestrator | 2026-04-03 10:11:41 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 10:11:41.540930 | orchestrator | 2026-04-03 10:11:41 | INFO  | Found 13 classic queue(s) in vhost '/': 2026-04-03 10:11:41.541033 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-03 10:11:41.541050 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor.cre24ozvki7j (vhost: /, messages: 0) 2026-04-03 10:11:41.541063 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor.kcisounizhqo (vhost: /, messages: 0) 2026-04-03 10:11:41.541074 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor.wmfrw7pq6kho (vhost: /, messages: 0) 2026-04-03 10:11:41.541105 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_054944816b704c8087606457a1635e4a (vhost: /, messages: 0) 2026-04-03 10:11:41.541119 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_3fab08c024ea4da78113b669810d6451 (vhost: /, messages: 0) 2026-04-03 10:11:41.541130 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_41ee208d5db647b7ad10fc67235d57d0 (vhost: /, messages: 0) 2026-04-03 10:11:41.541141 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_5431c7da8e3c45d68ff9f6ce25a68fb7 (vhost: /, messages: 0) 2026-04-03 10:11:41.541152 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_a3de3897f1f74451abd281b24fdbc335 (vhost: /, messages: 0) 2026-04-03 10:11:41.541163 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_b06d738881f14bf3acc8c20de5d52b21 (vhost: /, messages: 0) 2026-04-03 10:11:41.541174 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_c41351fa0a7341bd9852825bab17f6bc (vhost: /, messages: 0) 2026-04-03 10:11:41.541185 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_dedbda64b11a4a1b9424040cd87ad107 (vhost: /, messages: 0) 2026-04-03 10:11:41.541196 | orchestrator | 2026-04-03 10:11:41 | INFO  |  - magnum-conductor_fanout_e9065fc22494427cbea06d64bb5548e0 (vhost: /, messages: 0) 2026-04-03 10:11:41.797509 | orchestrator | + osism migrate rabbitmq3to4 list --vhost openstack --quorum 2026-04-03 10:11:48.347753 | orchestrator | 2026-04-03 10:11:48 | ERROR  | Unable to get ansible vault password 2026-04-03 10:11:48.347882 | orchestrator | 2026-04-03 10:11:48 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 10:11:48.347901 | orchestrator | 2026-04-03 10:11:48 | ERROR  | Dropping encrypted entries 2026-04-03 10:11:48.382383 | orchestrator | 2026-04-03 10:11:48 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 10:11:48.592232 | orchestrator | 2026-04-03 10:11:48 | INFO  | Found 192 quorum queue(s) in vhost 'openstack': 2026-04-03 10:11:48.592382 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - alarm.all.sample (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592791 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - alarming.sample (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592815 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican.workers (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592827 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican.workers.barbican.queue (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592838 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican.workers_fanout_testbed-node-0:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592850 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican.workers_fanout_testbed-node-1:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592861 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican.workers_fanout_testbed-node-2:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592872 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - barbican_notifications.info (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592883 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592894 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592905 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592947 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592962 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-0:designate-central:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592973 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-0:designate-central:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592984 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-1:designate-central:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.592995 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-1:designate-central:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593005 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-2:designate-central:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593087 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - central_fanout_testbed-node-2:designate-central:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593103 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593599 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593785 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593849 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593873 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup_fanout_testbed-node-0:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.593894 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup_fanout_testbed-node-1:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594107 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-backup_fanout_testbed-node-2:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594166 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594229 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594707 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594888 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594908 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler_fanout_testbed-node-0:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.594920 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler_fanout_testbed-node-1:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.595045 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-scheduler_fanout_testbed-node-2:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597347 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597424 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597439 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597452 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_testbed-node-0:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597464 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597476 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597490 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_testbed-node-1:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597508 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597527 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597545 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_testbed-node-2:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597580 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume_fanout_testbed-node-0:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597592 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume_fanout_testbed-node-1:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597603 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - cinder-volume_fanout_testbed-node-2:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597614 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597638 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute.testbed-node-3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597650 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute.testbed-node-4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597661 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute.testbed-node-5 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597696 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute_fanout_testbed-node-3:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597708 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute_fanout_testbed-node-4:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597719 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - compute_fanout_testbed-node-5:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597730 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597740 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597751 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597927 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597946 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597957 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597968 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597979 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.597990 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.598000 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.598011 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - event.sample (vhost: openstack, messages: 7) 2026-04-03 10:11:48.598074 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data (vhost: openstack, messages: 0) 2026-04-03 10:11:48.598226 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.598749 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.598975 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.599107 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data_fanout_testbed-node-0:manila-data:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.599420 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data_fanout_testbed-node-1:manila-data:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.599443 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-data_fanout_testbed-node-2:manila-data:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.599723 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler (vhost: openstack, messages: 0) 2026-04-03 10:11:48.599937 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600240 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600260 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600621 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler_fanout_testbed-node-0:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600657 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler_fanout_testbed-node-1:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600861 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-scheduler_fanout_testbed-node-2:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.600881 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601155 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601184 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601517 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601923 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share_fanout_testbed-node-0:manila-share:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601944 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share_fanout_testbed-node-1:manila-share:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.601955 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - manila-share_fanout_testbed-node-2:manila-share:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.602189 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.audit (vhost: openstack, messages: 0) 2026-04-03 10:11:48.602209 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.critical (vhost: openstack, messages: 0) 2026-04-03 10:11:48.602468 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.debug (vhost: openstack, messages: 0) 2026-04-03 10:11:48.602606 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.error (vhost: openstack, messages: 0) 2026-04-03 10:11:48.603041 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.info (vhost: openstack, messages: 0) 2026-04-03 10:11:48.603060 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.sample (vhost: openstack, messages: 0) 2026-04-03 10:11:48.603412 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - notifications.warn (vhost: openstack, messages: 0) 2026-04-03 10:11:48.603433 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604010 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604051 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604057 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604104 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-0:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604530 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-1:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604577 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-2:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.604588 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-cinder (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605019 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-glance (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605051 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-ironic (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605352 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-keystone (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605373 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-neutron (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605475 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - osism-listener-nova (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605715 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605733 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.605984 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606097 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606197 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606347 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606564 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606710 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606725 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.606857 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607032 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607217 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607232 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607514 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607909 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607937 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607987 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.607994 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.609991 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610070 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610081 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610090 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610110 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610118 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610127 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610135 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610145 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610158 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610170 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610178 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610185 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610193 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610201 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610209 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610225 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610324 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610356 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610422 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610615 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.610632 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611834 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611851 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611860 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611868 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611904 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611923 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611932 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611941 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611949 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.611958 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612022 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612161 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612177 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612249 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612573 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612684 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612845 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612861 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.612935 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-0:designate-manage:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613041 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-0:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613241 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-0:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613366 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-1:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613380 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-1:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613460 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-2:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613688 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-2:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613796 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-3:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.613810 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-4:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614128 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - reply_testbed-node-5:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614147 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614167 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614271 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614389 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614494 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614507 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614636 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614738 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614841 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.614943 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615064 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615077 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615261 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615417 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615432 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615532 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615637 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615762 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615775 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.615886 | orchestrator | 2026-04-03 10:11:48 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-03 10:11:48.900492 | orchestrator | + osism migrate rabbitmq3to4 delete-exchanges 2026-04-03 10:11:55.463158 | orchestrator | 2026-04-03 10:11:55 | ERROR  | Unable to get ansible vault password 2026-04-03 10:11:55.463230 | orchestrator | 2026-04-03 10:11:55 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 10:11:55.463238 | orchestrator | 2026-04-03 10:11:55 | ERROR  | Dropping encrypted entries 2026-04-03 10:11:55.497600 | orchestrator | 2026-04-03 10:11:55 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 10:11:55.520658 | orchestrator | 2026-04-03 10:11:55 | INFO  | Found 27 exchange(s) in vhost '/' 2026-04-03 10:11:55.562583 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: aodh 2026-04-03 10:11:55.603618 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: ceilometer 2026-04-03 10:11:55.640626 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: cinder 2026-04-03 10:11:55.680738 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: designate 2026-04-03 10:11:55.720456 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: dns 2026-04-03 10:11:55.761078 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: glance 2026-04-03 10:11:55.803505 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: heat 2026-04-03 10:11:55.841249 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: ironic 2026-04-03 10:11:55.882289 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: keystone 2026-04-03 10:11:55.918092 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: l3_agent_fanout 2026-04-03 10:11:55.968110 | orchestrator | 2026-04-03 10:11:55 | INFO  | Deleted exchange: magnum 2026-04-03 10:11:56.032168 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: magnum-conductor_fanout 2026-04-03 10:11:56.076229 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron 2026-04-03 10:11:56.114133 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron-vo-Network-1.1_fanout 2026-04-03 10:11:56.153189 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron-vo-Port-1.10_fanout 2026-04-03 10:11:56.198627 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron-vo-SecurityGroup-1.6_fanout 2026-04-03 10:11:56.234931 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron-vo-SecurityGroupRule-1.3_fanout 2026-04-03 10:11:56.271161 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: neutron-vo-Subnet-1.2_fanout 2026-04-03 10:11:56.307869 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: nova 2026-04-03 10:11:56.349399 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: octavia 2026-04-03 10:11:56.391081 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: openstack 2026-04-03 10:11:56.426193 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: q-agent-notifier-port-update_fanout 2026-04-03 10:11:56.468688 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: q-agent-notifier-security_group-update_fanout 2026-04-03 10:11:56.509219 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: scheduler_fanout 2026-04-03 10:11:56.547361 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: swift 2026-04-03 10:11:56.591587 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: trove 2026-04-03 10:11:56.629396 | orchestrator | 2026-04-03 10:11:56 | INFO  | Deleted exchange: zaqar 2026-04-03 10:11:56.629561 | orchestrator | 2026-04-03 10:11:56 | INFO  | Successfully deleted 27 exchange(s) in vhost '/' 2026-04-03 10:11:56.900952 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-03 10:12:03.422248 | orchestrator | 2026-04-03 10:12:03 | ERROR  | Unable to get ansible vault password 2026-04-03 10:12:03.422443 | orchestrator | 2026-04-03 10:12:03 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-03 10:12:03.422472 | orchestrator | 2026-04-03 10:12:03 | ERROR  | Dropping encrypted entries 2026-04-03 10:12:03.456436 | orchestrator | 2026-04-03 10:12:03 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-03 10:12:03.471230 | orchestrator | 2026-04-03 10:12:03 | INFO  | No exchanges found in vhost '/' 2026-04-03 10:12:03.721530 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-03 10:12:03.721655 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/400-monitoring.sh 2026-04-03 10:12:05.084973 | orchestrator | 2026-04-03 10:12:05 | INFO  | Prepare task for execution of prometheus. 2026-04-03 10:12:05.152227 | orchestrator | 2026-04-03 10:12:05 | INFO  | Task 492a62a4-94c8-4173-a456-150b932b836f (prometheus) was prepared for execution. 2026-04-03 10:12:05.152448 | orchestrator | 2026-04-03 10:12:05 | INFO  | It takes a moment until task 492a62a4-94c8-4173-a456-150b932b836f (prometheus) has been started and output is visible here. 2026-04-03 10:12:22.697492 | orchestrator | 2026-04-03 10:12:22.697608 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:12:22.697625 | orchestrator | 2026-04-03 10:12:22.697637 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:12:22.697648 | orchestrator | Friday 03 April 2026 10:12:10 +0000 (0:00:01.558) 0:00:01.558 ********** 2026-04-03 10:12:22.697660 | orchestrator | ok: [testbed-manager] 2026-04-03 10:12:22.697672 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:12:22.697682 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:12:22.697693 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:12:22.697703 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:12:22.697714 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:12:22.697725 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:12:22.697735 | orchestrator | 2026-04-03 10:12:22.697746 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:12:22.697773 | orchestrator | Friday 03 April 2026 10:12:12 +0000 (0:00:02.761) 0:00:04.320 ********** 2026-04-03 10:12:22.697785 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697796 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697807 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697817 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697828 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697838 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697849 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-03 10:12:22.697860 | orchestrator | 2026-04-03 10:12:22.697870 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-03 10:12:22.697881 | orchestrator | 2026-04-03 10:12:22.697891 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-03 10:12:22.697902 | orchestrator | Friday 03 April 2026 10:12:15 +0000 (0:00:02.893) 0:00:07.213 ********** 2026-04-03 10:12:22.697914 | orchestrator | included: /ansible/roles/prometheus/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 10:12:22.697926 | orchestrator | 2026-04-03 10:12:22.697937 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-03 10:12:22.697950 | orchestrator | Friday 03 April 2026 10:12:19 +0000 (0:00:04.124) 0:00:11.337 ********** 2026-04-03 10:12:22.697969 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 10:12:22.698008 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698096 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698130 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698151 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698164 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698177 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:22.698190 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:22.698213 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:22.698226 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:22.698239 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:22.698260 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:23.658680 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658789 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:23.658807 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:12:23.658849 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:23.658862 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658873 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658909 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:23.658922 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658933 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:23.658944 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:23.658963 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658975 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658986 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.658998 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:23.659022 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:31.400609 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:31.400724 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:31.400762 | orchestrator | 2026-04-03 10:12:31.400778 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-03 10:12:31.400791 | orchestrator | Friday 03 April 2026 10:12:24 +0000 (0:00:05.133) 0:00:16.471 ********** 2026-04-03 10:12:31.400803 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-03 10:12:31.400815 | orchestrator | 2026-04-03 10:12:31.400826 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-03 10:12:31.400837 | orchestrator | Friday 03 April 2026 10:12:28 +0000 (0:00:03.612) 0:00:20.084 ********** 2026-04-03 10:12:31.400851 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 10:12:31.400865 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400876 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400920 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400934 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400952 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400964 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400975 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:31.400987 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:31.400998 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:31.401015 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:31.401035 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:33.600381 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600564 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600631 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600655 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:33.600676 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:33.600695 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600774 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600825 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:33.600859 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600884 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:12:33.600906 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600923 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600939 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:33.600965 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:33.601001 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:36.479750 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:36.479859 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:36.479875 | orchestrator | 2026-04-03 10:12:36.479889 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-03 10:12:36.479901 | orchestrator | Friday 03 April 2026 10:12:34 +0000 (0:00:06.375) 0:00:26.459 ********** 2026-04-03 10:12:36.479916 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 10:12:36.479930 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:36.479959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:36.479991 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:36.480023 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:36.480036 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:36.480047 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:36.480059 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:36.480071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:36.480088 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:36.480116 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:12:37.324934 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:37.325037 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:12:37.325056 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:37.325069 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:37.325081 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:12:37.325094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:37.325105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:37.325139 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:12:37.325172 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:37.325185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:37.325217 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:37.325230 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:37.325241 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:37.325252 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:37.325263 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:12:37.325274 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:37.325300 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:37.325313 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:37.325361 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:39.959475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:39.959581 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:12:39.959600 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:39.959612 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:12:39.959624 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:39.959635 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:12:39.959646 | orchestrator | 2026-04-03 10:12:39.959658 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-03 10:12:39.959696 | orchestrator | Friday 03 April 2026 10:12:38 +0000 (0:00:03.605) 0:00:30.064 ********** 2026-04-03 10:12:39.959726 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 10:12:39.959741 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:39.959753 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:39.959785 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:39.959798 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:39.959810 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:39.959828 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:39.959839 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:39.959855 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:39.959867 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:39.959884 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881275 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881419 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:40.881435 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:40.881480 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:12:40.881491 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881498 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881506 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:12:40.881529 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881534 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:12:40.881538 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:40.881550 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:40.881555 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:40.881561 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:12:40.881571 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:40.881577 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:40.881583 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:12:40.881589 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:12:40.881601 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:12:46.129138 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:12:46.129251 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:46.129293 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:12:46.129306 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:46.129318 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:12:46.129377 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:12:46.129389 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:12:46.129401 | orchestrator | 2026-04-03 10:12:46.129413 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-03 10:12:46.129425 | orchestrator | Friday 03 April 2026 10:12:42 +0000 (0:00:04.129) 0:00:34.194 ********** 2026-04-03 10:12:46.129454 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 10:12:46.129488 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129502 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129523 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129534 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129545 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129562 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129573 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:12:46.129585 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:46.129605 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:48.522402 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:48.522521 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522539 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522552 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522581 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522594 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:48.522606 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:48.522660 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:12:48.522673 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522684 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522695 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522715 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:12:48.522729 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522740 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:12:48.522766 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:13:25.122735 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:13:25.122853 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:13:25.122870 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:13:25.122899 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:13:25.122912 | orchestrator | 2026-04-03 10:13:25.122926 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-03 10:13:25.122939 | orchestrator | Friday 03 April 2026 10:12:51 +0000 (0:00:08.608) 0:00:42.803 ********** 2026-04-03 10:13:25.122950 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 10:13:25.122964 | orchestrator | 2026-04-03 10:13:25.122976 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-03 10:13:25.122987 | orchestrator | Friday 03 April 2026 10:12:53 +0000 (0:00:02.346) 0:00:45.150 ********** 2026-04-03 10:13:25.122998 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:13:25.123033 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:13:25.123044 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:13:25.123055 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:13:25.123066 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:13:25.123076 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:13:25.123087 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:13:25.123098 | orchestrator | 2026-04-03 10:13:25.123108 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-03 10:13:25.123119 | orchestrator | Friday 03 April 2026 10:12:55 +0000 (0:00:02.094) 0:00:47.245 ********** 2026-04-03 10:13:25.123130 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 10:13:25.123141 | orchestrator | 2026-04-03 10:13:25.123152 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-03 10:13:25.123162 | orchestrator | Friday 03 April 2026 10:12:57 +0000 (0:00:01.779) 0:00:49.024 ********** 2026-04-03 10:13:25.123173 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123186 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123198 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123209 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123220 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123230 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 10:13:25.123241 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123252 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123265 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123278 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123290 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123303 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 10:13:25.123315 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123328 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123383 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123397 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123410 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123422 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-03 10:13:25.123435 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123447 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123459 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123474 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123493 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123514 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-03 10:13:25.123535 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123554 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123568 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123581 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123593 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123605 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-03 10:13:25.123616 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123627 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123638 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123648 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123659 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123678 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-03 10:13:25.123689 | orchestrator | [WARNING]: Skipped 2026-04-03 10:13:25.123700 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123710 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-03 10:13:25.123721 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-03 10:13:25.123732 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-03 10:13:25.123742 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-03 10:13:25.123753 | orchestrator | 2026-04-03 10:13:25.123764 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-03 10:13:25.123780 | orchestrator | Friday 03 April 2026 10:13:01 +0000 (0:00:03.719) 0:00:52.744 ********** 2026-04-03 10:13:25.123791 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123803 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123814 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:13:25.123824 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:13:25.123835 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123846 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:13:25.123856 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123867 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:13:25.123878 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123888 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:13:25.123899 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-03 10:13:25.123910 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:13:25.123920 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-03 10:13:25.123931 | orchestrator | 2026-04-03 10:13:25.123941 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-03 10:13:25.123952 | orchestrator | Friday 03 April 2026 10:13:20 +0000 (0:00:18.739) 0:01:11.483 ********** 2026-04-03 10:13:25.123963 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.123973 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:13:25.123984 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.123995 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:13:25.124005 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.124016 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:13:25.124027 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.124038 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:13:25.124048 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.124059 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:13:25.124070 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-03 10:13:25.124080 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:13:25.124091 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-03 10:13:25.124102 | orchestrator | 2026-04-03 10:13:25.124112 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-03 10:13:25.124123 | orchestrator | Friday 03 April 2026 10:13:24 +0000 (0:00:04.526) 0:01:16.009 ********** 2026-04-03 10:13:25.124149 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128327 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.128513 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128533 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.128545 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128557 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.128568 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128579 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.128590 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-03 10:14:06.128601 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128612 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.128623 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-03 10:14:06.128634 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.128645 | orchestrator | 2026-04-03 10:14:06.128658 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-03 10:14:06.128671 | orchestrator | Friday 03 April 2026 10:13:27 +0000 (0:00:03.063) 0:01:19.073 ********** 2026-04-03 10:14:06.128682 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 10:14:06.128693 | orchestrator | 2026-04-03 10:14:06.128704 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-03 10:14:06.128716 | orchestrator | Friday 03 April 2026 10:13:29 +0000 (0:00:01.884) 0:01:20.957 ********** 2026-04-03 10:14:06.128727 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:06.128738 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.128749 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.128760 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.128771 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.128782 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.128809 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.128821 | orchestrator | 2026-04-03 10:14:06.128832 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-03 10:14:06.128844 | orchestrator | Friday 03 April 2026 10:13:31 +0000 (0:00:02.001) 0:01:22.959 ********** 2026-04-03 10:14:06.128857 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:06.128869 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.128883 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.128895 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.128908 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:14:06.128921 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:14:06.128934 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:14:06.128947 | orchestrator | 2026-04-03 10:14:06.128960 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-03 10:14:06.128973 | orchestrator | Friday 03 April 2026 10:13:34 +0000 (0:00:03.270) 0:01:26.229 ********** 2026-04-03 10:14:06.128986 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129000 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129013 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129025 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129063 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:06.129077 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129090 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.129102 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.129116 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.129129 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.129141 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129154 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.129167 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-03 10:14:06.129180 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.129193 | orchestrator | 2026-04-03 10:14:06.129207 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-03 10:14:06.129219 | orchestrator | Friday 03 April 2026 10:13:37 +0000 (0:00:03.075) 0:01:29.306 ********** 2026-04-03 10:14:06.129230 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129241 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.129251 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129262 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.129273 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129284 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.129295 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129306 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.129334 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129345 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.129356 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-03 10:14:06.129386 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.129398 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-03 10:14:06.129409 | orchestrator | 2026-04-03 10:14:06.129420 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-03 10:14:06.129430 | orchestrator | Friday 03 April 2026 10:13:40 +0000 (0:00:02.805) 0:01:32.113 ********** 2026-04-03 10:14:06.129441 | orchestrator | [WARNING]: Skipped 2026-04-03 10:14:06.129454 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-03 10:14:06.129465 | orchestrator | due to this access issue: 2026-04-03 10:14:06.129476 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-03 10:14:06.129487 | orchestrator | not a directory 2026-04-03 10:14:06.129498 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-03 10:14:06.129509 | orchestrator | 2026-04-03 10:14:06.129520 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-03 10:14:06.129531 | orchestrator | Friday 03 April 2026 10:13:43 +0000 (0:00:02.449) 0:01:34.562 ********** 2026-04-03 10:14:06.129542 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:06.129553 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.129563 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.129574 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.129585 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.129596 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.129607 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.129617 | orchestrator | 2026-04-03 10:14:06.129628 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-03 10:14:06.129648 | orchestrator | Friday 03 April 2026 10:13:45 +0000 (0:00:01.980) 0:01:36.543 ********** 2026-04-03 10:14:06.129659 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:06.129670 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.129681 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.129691 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.129702 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.129713 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.129729 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.129740 | orchestrator | 2026-04-03 10:14:06.129751 | orchestrator | TASK [prometheus : Check for the existence of Prometheus v2 container volume] *** 2026-04-03 10:14:06.129762 | orchestrator | Friday 03 April 2026 10:13:47 +0000 (0:00:02.429) 0:01:38.972 ********** 2026-04-03 10:14:06.129773 | orchestrator | ok: [testbed-manager] 2026-04-03 10:14:06.129784 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:14:06.129795 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:14:06.129806 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:14:06.129817 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:14:06.129827 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:14:06.129838 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:14:06.129849 | orchestrator | 2026-04-03 10:14:06.129860 | orchestrator | TASK [prometheus : Gracefully stop Prometheus] ********************************* 2026-04-03 10:14:06.129871 | orchestrator | Friday 03 April 2026 10:13:49 +0000 (0:00:02.430) 0:01:41.403 ********** 2026-04-03 10:14:06.129882 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.129893 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.129903 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.129914 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.129925 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.129936 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.129947 | orchestrator | changed: [testbed-manager] 2026-04-03 10:14:06.129957 | orchestrator | 2026-04-03 10:14:06.129968 | orchestrator | TASK [prometheus : Create new Prometheus v3 volume] **************************** 2026-04-03 10:14:06.129979 | orchestrator | Friday 03 April 2026 10:13:58 +0000 (0:00:08.204) 0:01:49.607 ********** 2026-04-03 10:14:06.129990 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.130001 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.130012 | orchestrator | changed: [testbed-manager] 2026-04-03 10:14:06.130107 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.130119 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.130130 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.130150 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.130168 | orchestrator | 2026-04-03 10:14:06.130189 | orchestrator | TASK [prometheus : Move _data from old to new volume] ************************** 2026-04-03 10:14:06.130216 | orchestrator | Friday 03 April 2026 10:14:00 +0000 (0:00:02.309) 0:01:51.917 ********** 2026-04-03 10:14:06.130236 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.130254 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.130273 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.130291 | orchestrator | changed: [testbed-manager] 2026-04-03 10:14:06.130308 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.130328 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.130347 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.130392 | orchestrator | 2026-04-03 10:14:06.130413 | orchestrator | TASK [prometheus : Remove old Prometheus v2 volume] **************************** 2026-04-03 10:14:06.130425 | orchestrator | Friday 03 April 2026 10:14:02 +0000 (0:00:02.097) 0:01:54.015 ********** 2026-04-03 10:14:06.130436 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:06.130447 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:06.130457 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:06.130468 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:06.130478 | orchestrator | changed: [testbed-manager] 2026-04-03 10:14:06.130489 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:14:06.130518 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:06.130536 | orchestrator | 2026-04-03 10:14:06.130555 | orchestrator | TASK [service-check-containers : prometheus | Check containers] **************** 2026-04-03 10:14:06.130573 | orchestrator | Friday 03 April 2026 10:14:04 +0000 (0:00:02.344) 0:01:56.359 ********** 2026-04-03 10:14:06.130615 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-03 10:14:08.095028 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095197 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095222 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095281 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095303 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095495 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095522 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-03 10:14:08.095559 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:08.095585 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:08.095601 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:08.095615 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:08.095627 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:08.095652 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:08.095667 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:08.095694 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:14:14.574411 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574516 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574526 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574535 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574562 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574570 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574578 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574600 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574615 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574623 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-03 10:14:14.574632 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574647 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574655 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-03 10:14:14.574663 | orchestrator | 2026-04-03 10:14:14.574672 | orchestrator | TASK [service-check-containers : prometheus | Notify handlers to restart containers] *** 2026-04-03 10:14:14.574681 | orchestrator | Friday 03 April 2026 10:14:11 +0000 (0:00:06.674) 0:02:03.034 ********** 2026-04-03 10:14:14.574689 | orchestrator | changed: [testbed-manager] => { 2026-04-03 10:14:14.574698 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574706 | orchestrator | } 2026-04-03 10:14:14.574713 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:14:14.574720 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574728 | orchestrator | } 2026-04-03 10:14:14.574735 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:14:14.574743 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574750 | orchestrator | } 2026-04-03 10:14:14.574757 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:14:14.574765 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574773 | orchestrator | } 2026-04-03 10:14:14.574780 | orchestrator | changed: [testbed-node-3] => { 2026-04-03 10:14:14.574787 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574795 | orchestrator | } 2026-04-03 10:14:14.574803 | orchestrator | changed: [testbed-node-4] => { 2026-04-03 10:14:14.574810 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574818 | orchestrator | } 2026-04-03 10:14:14.574825 | orchestrator | changed: [testbed-node-5] => { 2026-04-03 10:14:14.574833 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:14:14.574840 | orchestrator | } 2026-04-03 10:14:14.574848 | orchestrator | 2026-04-03 10:14:14.574856 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:14:14.574864 | orchestrator | Friday 03 April 2026 10:14:13 +0000 (0:00:02.438) 0:02:05.472 ********** 2026-04-03 10:14:14.574880 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:14.801549 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801666 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:14.801676 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-03 10:14:14.801685 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801693 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:14.801725 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:14.801737 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:14:14.801745 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801753 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:14:14.801762 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:14.801769 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801776 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:14.801789 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583225 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:15.583333 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:15.583351 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:15.583402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:15.583430 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583449 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-03 10:14:15.583468 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:14:15.583487 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:14:15.583504 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:14:15.583522 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:15.583607 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583623 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583634 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:14:15.583645 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:15.583656 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583667 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583678 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:14:15.583689 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-03 10:14:15.583701 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-03 10:14:15.583737 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-03 10:16:42.907728 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:16:42.907849 | orchestrator | 2026-04-03 10:16:42.907867 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.907881 | orchestrator | Friday 03 April 2026 10:14:17 +0000 (0:00:03.226) 0:02:08.699 ********** 2026-04-03 10:16:42.907892 | orchestrator | 2026-04-03 10:16:42.907903 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.907914 | orchestrator | Friday 03 April 2026 10:14:17 +0000 (0:00:00.454) 0:02:09.154 ********** 2026-04-03 10:16:42.907925 | orchestrator | 2026-04-03 10:16:42.907936 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.907947 | orchestrator | Friday 03 April 2026 10:14:18 +0000 (0:00:00.441) 0:02:09.595 ********** 2026-04-03 10:16:42.907957 | orchestrator | 2026-04-03 10:16:42.907968 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.907979 | orchestrator | Friday 03 April 2026 10:14:18 +0000 (0:00:00.446) 0:02:10.041 ********** 2026-04-03 10:16:42.907990 | orchestrator | 2026-04-03 10:16:42.908001 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.908011 | orchestrator | Friday 03 April 2026 10:14:19 +0000 (0:00:00.451) 0:02:10.493 ********** 2026-04-03 10:16:42.908022 | orchestrator | 2026-04-03 10:16:42.908033 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.908043 | orchestrator | Friday 03 April 2026 10:14:19 +0000 (0:00:00.449) 0:02:10.943 ********** 2026-04-03 10:16:42.908054 | orchestrator | 2026-04-03 10:16:42.908065 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-03 10:16:42.908075 | orchestrator | Friday 03 April 2026 10:14:20 +0000 (0:00:00.718) 0:02:11.662 ********** 2026-04-03 10:16:42.908086 | orchestrator | 2026-04-03 10:16:42.908097 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-03 10:16:42.908108 | orchestrator | Friday 03 April 2026 10:14:21 +0000 (0:00:00.852) 0:02:12.514 ********** 2026-04-03 10:16:42.908119 | orchestrator | changed: [testbed-manager] 2026-04-03 10:16:42.908129 | orchestrator | 2026-04-03 10:16:42.908140 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-03 10:16:42.908151 | orchestrator | Friday 03 April 2026 10:14:45 +0000 (0:00:24.172) 0:02:36.687 ********** 2026-04-03 10:16:42.908162 | orchestrator | changed: [testbed-manager] 2026-04-03 10:16:42.908173 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:16:42.908183 | orchestrator | changed: [testbed-node-4] 2026-04-03 10:16:42.908194 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:16:42.908205 | orchestrator | changed: [testbed-node-3] 2026-04-03 10:16:42.908216 | orchestrator | changed: [testbed-node-5] 2026-04-03 10:16:42.908228 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:16:42.908241 | orchestrator | 2026-04-03 10:16:42.908253 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-03 10:16:42.908266 | orchestrator | Friday 03 April 2026 10:15:03 +0000 (0:00:18.191) 0:02:54.878 ********** 2026-04-03 10:16:42.908307 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:16:42.908321 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:16:42.908332 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:16:42.908345 | orchestrator | 2026-04-03 10:16:42.908357 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-03 10:16:42.908370 | orchestrator | Friday 03 April 2026 10:15:16 +0000 (0:00:13.523) 0:03:08.402 ********** 2026-04-03 10:16:42.908382 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:16:42.908395 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:16:42.908407 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:16:42.908419 | orchestrator | 2026-04-03 10:16:42.908451 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-03 10:16:42.908464 | orchestrator | Friday 03 April 2026 10:15:30 +0000 (0:00:13.096) 0:03:21.499 ********** 2026-04-03 10:16:42.908477 | orchestrator | changed: [testbed-node-3] 2026-04-03 10:16:42.908489 | orchestrator | changed: [testbed-manager] 2026-04-03 10:16:42.908501 | orchestrator | changed: [testbed-node-4] 2026-04-03 10:16:42.908514 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:16:42.908526 | orchestrator | changed: [testbed-node-5] 2026-04-03 10:16:42.908537 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:16:42.908550 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:16:42.908562 | orchestrator | 2026-04-03 10:16:42.908574 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-03 10:16:42.908587 | orchestrator | Friday 03 April 2026 10:15:47 +0000 (0:00:17.737) 0:03:39.236 ********** 2026-04-03 10:16:42.908599 | orchestrator | changed: [testbed-manager] 2026-04-03 10:16:42.908611 | orchestrator | 2026-04-03 10:16:42.908624 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-03 10:16:42.908636 | orchestrator | Friday 03 April 2026 10:16:03 +0000 (0:00:15.457) 0:03:54.694 ********** 2026-04-03 10:16:42.908647 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:16:42.908658 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:16:42.908669 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:16:42.908679 | orchestrator | 2026-04-03 10:16:42.908690 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-03 10:16:42.908700 | orchestrator | Friday 03 April 2026 10:16:16 +0000 (0:00:13.041) 0:04:07.736 ********** 2026-04-03 10:16:42.908711 | orchestrator | changed: [testbed-manager] 2026-04-03 10:16:42.908722 | orchestrator | 2026-04-03 10:16:42.908733 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-03 10:16:42.908744 | orchestrator | Friday 03 April 2026 10:16:28 +0000 (0:00:12.724) 0:04:20.460 ********** 2026-04-03 10:16:42.908754 | orchestrator | changed: [testbed-node-5] 2026-04-03 10:16:42.908765 | orchestrator | changed: [testbed-node-3] 2026-04-03 10:16:42.908775 | orchestrator | changed: [testbed-node-4] 2026-04-03 10:16:42.908786 | orchestrator | 2026-04-03 10:16:42.908812 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:16:42.908824 | orchestrator | testbed-manager : ok=28  changed=14  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 10:16:42.908856 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 10:16:42.908867 | orchestrator | testbed-node-1 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 10:16:42.908879 | orchestrator | testbed-node-2 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-03 10:16:42.908890 | orchestrator | testbed-node-3 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 10:16:42.908901 | orchestrator | testbed-node-4 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 10:16:42.908921 | orchestrator | testbed-node-5 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 10:16:42.908932 | orchestrator | 2026-04-03 10:16:42.908943 | orchestrator | 2026-04-03 10:16:42.908954 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:16:42.908964 | orchestrator | Friday 03 April 2026 10:16:42 +0000 (0:00:13.485) 0:04:33.946 ********** 2026-04-03 10:16:42.908975 | orchestrator | =============================================================================== 2026-04-03 10:16:42.908986 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 24.17s 2026-04-03 10:16:42.908996 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 18.74s 2026-04-03 10:16:42.909007 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 18.19s 2026-04-03 10:16:42.909018 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 17.74s 2026-04-03 10:16:42.909028 | orchestrator | prometheus : Restart prometheus-alertmanager container ----------------- 15.46s 2026-04-03 10:16:42.909039 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container -------------- 13.52s 2026-04-03 10:16:42.909049 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container ------------- 13.48s 2026-04-03 10:16:42.909060 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ----------- 13.10s 2026-04-03 10:16:42.909070 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container ------- 13.04s 2026-04-03 10:16:42.909081 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------ 12.73s 2026-04-03 10:16:42.909092 | orchestrator | prometheus : Copying over config.json files ----------------------------- 8.61s 2026-04-03 10:16:42.909102 | orchestrator | prometheus : Gracefully stop Prometheus --------------------------------- 8.20s 2026-04-03 10:16:42.909113 | orchestrator | service-check-containers : prometheus | Check containers ---------------- 6.67s 2026-04-03 10:16:42.909124 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 6.38s 2026-04-03 10:16:42.909134 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 5.13s 2026-04-03 10:16:42.909145 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 4.53s 2026-04-03 10:16:42.909156 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 4.13s 2026-04-03 10:16:42.909166 | orchestrator | prometheus : include_tasks ---------------------------------------------- 4.12s 2026-04-03 10:16:42.909177 | orchestrator | prometheus : Flush handlers --------------------------------------------- 3.81s 2026-04-03 10:16:42.909187 | orchestrator | prometheus : Find prometheus host config overrides ---------------------- 3.72s 2026-04-03 10:16:44.505293 | orchestrator | 2026-04-03 10:16:44 | INFO  | Prepare task for execution of grafana. 2026-04-03 10:16:44.576367 | orchestrator | 2026-04-03 10:16:44 | INFO  | Task 74456837-addb-4f11-8f0e-6c20a431c6b6 (grafana) was prepared for execution. 2026-04-03 10:16:44.576687 | orchestrator | 2026-04-03 10:16:44 | INFO  | It takes a moment until task 74456837-addb-4f11-8f0e-6c20a431c6b6 (grafana) has been started and output is visible here. 2026-04-03 10:16:58.579232 | orchestrator | 2026-04-03 10:16:58.579332 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:16:58.579344 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 10:16:58.579354 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 10:16:58.579369 | orchestrator | 2026-04-03 10:16:58.579377 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:16:58.579384 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 10:16:58.579392 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 10:16:58.579478 | orchestrator | Friday 03 April 2026 10:16:49 +0000 (0:00:01.445) 0:00:01.445 ********** 2026-04-03 10:16:58.579488 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:16:58.579497 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:16:58.579504 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:16:58.579511 | orchestrator | 2026-04-03 10:16:58.579517 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:16:58.579525 | orchestrator | Friday 03 April 2026 10:16:50 +0000 (0:00:00.621) 0:00:02.067 ********** 2026-04-03 10:16:58.579532 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-03 10:16:58.579539 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-03 10:16:58.579546 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-03 10:16:58.579554 | orchestrator | 2026-04-03 10:16:58.579561 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-03 10:16:58.579568 | orchestrator | 2026-04-03 10:16:58.579575 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-03 10:16:58.579582 | orchestrator | Friday 03 April 2026 10:16:50 +0000 (0:00:00.717) 0:00:02.784 ********** 2026-04-03 10:16:58.579589 | orchestrator | included: /ansible/roles/grafana/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:16:58.579597 | orchestrator | 2026-04-03 10:16:58.579604 | orchestrator | TASK [grafana : Checking if Grafana container needs upgrading] ***************** 2026-04-03 10:16:58.579611 | orchestrator | Friday 03 April 2026 10:16:51 +0000 (0:00:01.077) 0:00:03.862 ********** 2026-04-03 10:16:58.579618 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:16:58.579625 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:16:58.579632 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:16:58.579639 | orchestrator | 2026-04-03 10:16:58.579646 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-03 10:16:58.579653 | orchestrator | Friday 03 April 2026 10:16:53 +0000 (0:00:01.964) 0:00:05.826 ********** 2026-04-03 10:16:58.579663 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579673 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579695 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579708 | orchestrator | 2026-04-03 10:16:58.579716 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-03 10:16:58.579723 | orchestrator | Friday 03 April 2026 10:16:54 +0000 (0:00:00.846) 0:00:06.673 ********** 2026-04-03 10:16:58.579730 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 10:16:58.579737 | orchestrator | 2026-04-03 10:16:58.579744 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-03 10:16:58.579751 | orchestrator | Friday 03 April 2026 10:16:55 +0000 (0:00:01.357) 0:00:08.031 ********** 2026-04-03 10:16:58.579758 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:16:58.579765 | orchestrator | 2026-04-03 10:16:58.579776 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-03 10:16:58.579783 | orchestrator | Friday 03 April 2026 10:16:57 +0000 (0:00:01.127) 0:00:09.158 ********** 2026-04-03 10:16:58.579790 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579798 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579805 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:16:58.579813 | orchestrator | 2026-04-03 10:16:58.579820 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-03 10:16:58.579827 | orchestrator | Friday 03 April 2026 10:16:58 +0000 (0:00:01.231) 0:00:10.390 ********** 2026-04-03 10:16:58.579840 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:16:58.579851 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:17:02.305597 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:02.305699 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:17:02.305716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:02.305728 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:17:02.305740 | orchestrator | 2026-04-03 10:17:02.305753 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-03 10:17:02.305765 | orchestrator | Friday 03 April 2026 10:16:58 +0000 (0:00:00.484) 0:00:10.875 ********** 2026-04-03 10:17:02.305777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:02.305788 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:17:02.305800 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:02.305834 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:17:02.305864 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:02.305876 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:17:02.305887 | orchestrator | 2026-04-03 10:17:02.305898 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-03 10:17:02.305909 | orchestrator | Friday 03 April 2026 10:16:59 +0000 (0:00:00.945) 0:00:11.821 ********** 2026-04-03 10:17:02.305926 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:02.305939 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:02.305951 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:02.305969 | orchestrator | 2026-04-03 10:17:02.305981 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-03 10:17:02.305992 | orchestrator | Friday 03 April 2026 10:17:01 +0000 (0:00:01.417) 0:00:13.239 ********** 2026-04-03 10:17:02.306004 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:02.306088 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:11.446818 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:11.446935 | orchestrator | 2026-04-03 10:17:11.446952 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-03 10:17:11.446965 | orchestrator | Friday 03 April 2026 10:17:03 +0000 (0:00:01.799) 0:00:15.038 ********** 2026-04-03 10:17:11.446976 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:17:11.446988 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:17:11.446999 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:17:11.447011 | orchestrator | 2026-04-03 10:17:11.447022 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-03 10:17:11.447033 | orchestrator | Friday 03 April 2026 10:17:03 +0000 (0:00:00.332) 0:00:15.371 ********** 2026-04-03 10:17:11.447044 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 10:17:11.447056 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 10:17:11.447066 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-03 10:17:11.447077 | orchestrator | 2026-04-03 10:17:11.447088 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-03 10:17:11.447099 | orchestrator | Friday 03 April 2026 10:17:04 +0000 (0:00:01.272) 0:00:16.644 ********** 2026-04-03 10:17:11.447109 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 10:17:11.447141 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 10:17:11.447153 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-03 10:17:11.447163 | orchestrator | 2026-04-03 10:17:11.447174 | orchestrator | TASK [grafana : Check if the folder for custom grafana dashboards exists] ****** 2026-04-03 10:17:11.447185 | orchestrator | Friday 03 April 2026 10:17:05 +0000 (0:00:01.311) 0:00:17.955 ********** 2026-04-03 10:17:11.447196 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 10:17:11.447207 | orchestrator | 2026-04-03 10:17:11.447218 | orchestrator | TASK [grafana : Remove templated Grafana dashboards] *************************** 2026-04-03 10:17:11.447229 | orchestrator | Friday 03 April 2026 10:17:06 +0000 (0:00:00.776) 0:00:18.731 ********** 2026-04-03 10:17:11.447239 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:17:11.447250 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:17:11.447260 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:17:11.447271 | orchestrator | 2026-04-03 10:17:11.447282 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-03 10:17:11.447292 | orchestrator | Friday 03 April 2026 10:17:07 +0000 (0:00:00.965) 0:00:19.697 ********** 2026-04-03 10:17:11.447303 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:17:11.447314 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:17:11.447324 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:17:11.447335 | orchestrator | 2026-04-03 10:17:11.447346 | orchestrator | TASK [service-check-containers : grafana | Check containers] ******************* 2026-04-03 10:17:11.447357 | orchestrator | Friday 03 April 2026 10:17:09 +0000 (0:00:01.634) 0:00:21.331 ********** 2026-04-03 10:17:11.447369 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:11.447400 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:11.447420 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:17:11.447439 | orchestrator | 2026-04-03 10:17:11.447483 | orchestrator | TASK [service-check-containers : grafana | Notify handlers to restart containers] *** 2026-04-03 10:17:11.447495 | orchestrator | Friday 03 April 2026 10:17:10 +0000 (0:00:01.235) 0:00:22.567 ********** 2026-04-03 10:17:11.447506 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:17:11.447516 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:17:11.447527 | orchestrator | } 2026-04-03 10:17:11.447538 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:17:11.447548 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:17:11.447559 | orchestrator | } 2026-04-03 10:17:11.447569 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:17:11.447580 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:17:11.447591 | orchestrator | } 2026-04-03 10:17:11.447601 | orchestrator | 2026-04-03 10:17:11.447612 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:17:11.447623 | orchestrator | Friday 03 April 2026 10:17:10 +0000 (0:00:00.370) 0:00:22.938 ********** 2026-04-03 10:17:11.447634 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:11.447646 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:17:11.447657 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:17:11.447668 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:17:11.447687 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:18:58.311651 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:18:58.311769 | orchestrator | 2026-04-03 10:18:58.311786 | orchestrator | TASK [grafana : Stopping all Grafana instances but the first node] ************* 2026-04-03 10:18:58.311799 | orchestrator | Friday 03 April 2026 10:17:11 +0000 (0:00:00.858) 0:00:23.796 ********** 2026-04-03 10:18:58.311810 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:18:58.311844 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:18:58.311856 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:18:58.311866 | orchestrator | 2026-04-03 10:18:58.311891 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 10:18:58.311902 | orchestrator | Friday 03 April 2026 10:17:17 +0000 (0:00:05.999) 0:00:29.796 ********** 2026-04-03 10:18:58.311913 | orchestrator | 2026-04-03 10:18:58.311924 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 10:18:58.311935 | orchestrator | Friday 03 April 2026 10:17:17 +0000 (0:00:00.078) 0:00:29.874 ********** 2026-04-03 10:18:58.311945 | orchestrator | 2026-04-03 10:18:58.311956 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-03 10:18:58.311966 | orchestrator | Friday 03 April 2026 10:17:17 +0000 (0:00:00.076) 0:00:29.951 ********** 2026-04-03 10:18:58.311977 | orchestrator | 2026-04-03 10:18:58.311987 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-03 10:18:58.311998 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 10:18:58.312009 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 10:18:58.312031 | orchestrator | Friday 03 April 2026 10:17:18 +0000 (0:00:00.255) 0:00:30.206 ********** 2026-04-03 10:18:58.312041 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:18:58.312052 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:18:58.312062 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:18:58.312073 | orchestrator | 2026-04-03 10:18:58.312083 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-03 10:18:58.312094 | orchestrator | Friday 03 April 2026 10:17:56 +0000 (0:00:38.349) 0:01:08.555 ********** 2026-04-03 10:18:58.312104 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:18:58.312115 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:18:58.312125 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-03 10:18:58.312137 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-03 10:18:58.312148 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:18:58.312159 | orchestrator | 2026-04-03 10:18:58.312170 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-03 10:18:58.312181 | orchestrator | Friday 03 April 2026 10:18:23 +0000 (0:00:26.651) 0:01:35.207 ********** 2026-04-03 10:18:58.312191 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:18:58.312202 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:18:58.312212 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:18:58.312223 | orchestrator | 2026-04-03 10:18:58.312233 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:18:58.312245 | orchestrator | testbed-node-0 : ok=19  changed=6  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:18:58.312257 | orchestrator | testbed-node-1 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:18:58.312281 | orchestrator | testbed-node-2 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:18:58.312292 | orchestrator | 2026-04-03 10:18:58.312302 | orchestrator | 2026-04-03 10:18:58.312314 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:18:58.312325 | orchestrator | Friday 03 April 2026 10:18:58 +0000 (0:00:34.825) 0:02:10.033 ********** 2026-04-03 10:18:58.312335 | orchestrator | =============================================================================== 2026-04-03 10:18:58.312346 | orchestrator | grafana : Restart first grafana container ------------------------------ 38.35s 2026-04-03 10:18:58.312357 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 34.83s 2026-04-03 10:18:58.312376 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 26.65s 2026-04-03 10:18:58.312387 | orchestrator | grafana : Stopping all Grafana instances but the first node ------------- 6.00s 2026-04-03 10:18:58.312398 | orchestrator | grafana : Checking if Grafana container needs upgrading ----------------- 1.96s 2026-04-03 10:18:58.312408 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 1.80s 2026-04-03 10:18:58.312419 | orchestrator | grafana : Copying over custom dashboards -------------------------------- 1.63s 2026-04-03 10:18:58.312429 | orchestrator | grafana : Copying over config.json files -------------------------------- 1.42s 2026-04-03 10:18:58.312440 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 1.36s 2026-04-03 10:18:58.312450 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 1.31s 2026-04-03 10:18:58.312461 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 1.27s 2026-04-03 10:18:58.312471 | orchestrator | service-check-containers : grafana | Check containers ------------------- 1.24s 2026-04-03 10:18:58.312482 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 1.23s 2026-04-03 10:18:58.312523 | orchestrator | grafana : include_tasks ------------------------------------------------- 1.13s 2026-04-03 10:18:58.312551 | orchestrator | grafana : include_tasks ------------------------------------------------- 1.08s 2026-04-03 10:18:58.312562 | orchestrator | grafana : Remove templated Grafana dashboards --------------------------- 0.97s 2026-04-03 10:18:58.312573 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS key ----- 0.95s 2026-04-03 10:18:58.312583 | orchestrator | service-check-containers : Include tasks -------------------------------- 0.86s 2026-04-03 10:18:58.312599 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 0.85s 2026-04-03 10:18:58.312610 | orchestrator | grafana : Check if the folder for custom grafana dashboards exists ------ 0.78s 2026-04-03 10:18:58.512852 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/510-clusterapi.sh 2026-04-03 10:18:58.520762 | orchestrator | + set -e 2026-04-03 10:18:58.520829 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 10:18:58.520839 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 10:18:58.520847 | orchestrator | ++ INTERACTIVE=false 2026-04-03 10:18:58.520854 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 10:18:58.521239 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 10:18:58.521254 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 10:18:58.522314 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 10:18:58.528315 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 10:18:58.528355 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 10:18:58.529241 | orchestrator | ++ semver 10.0.0 8.0.0 2026-04-03 10:18:58.581230 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-03 10:18:58.581335 | orchestrator | + osism apply clusterapi 2026-04-03 10:18:59.903061 | orchestrator | 2026-04-03 10:18:59 | INFO  | Prepare task for execution of clusterapi. 2026-04-03 10:18:59.971322 | orchestrator | 2026-04-03 10:18:59 | INFO  | Task 3c9f9c09-0ca8-4ec2-a919-96c484a5cb62 (clusterapi) was prepared for execution. 2026-04-03 10:18:59.971429 | orchestrator | 2026-04-03 10:18:59 | INFO  | It takes a moment until task 3c9f9c09-0ca8-4ec2-a919-96c484a5cb62 (clusterapi) has been started and output is visible here. 2026-04-03 10:20:12.802900 | orchestrator | 2026-04-03 10:20:12.803011 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-03 10:20:12.803028 | orchestrator | 2026-04-03 10:20:12.803038 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-03 10:20:12.803049 | orchestrator | Friday 03 April 2026 10:19:05 +0000 (0:00:01.565) 0:00:01.565 ********** 2026-04-03 10:20:12.803059 | orchestrator | included: cert_manager for testbed-manager 2026-04-03 10:20:12.803069 | orchestrator | 2026-04-03 10:20:12.803079 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-03 10:20:12.803089 | orchestrator | Friday 03 April 2026 10:19:06 +0000 (0:00:01.840) 0:00:03.406 ********** 2026-04-03 10:20:12.803123 | orchestrator | ok: [testbed-manager] 2026-04-03 10:20:12.803133 | orchestrator | 2026-04-03 10:20:12.803143 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-03 10:20:12.803153 | orchestrator | Friday 03 April 2026 10:19:11 +0000 (0:00:04.584) 0:00:07.990 ********** 2026-04-03 10:20:12.803163 | orchestrator | ok: [testbed-manager] 2026-04-03 10:20:12.803172 | orchestrator | 2026-04-03 10:20:12.803182 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-03 10:20:12.803191 | orchestrator | 2026-04-03 10:20:12.803201 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-03 10:20:12.803211 | orchestrator | Friday 03 April 2026 10:19:16 +0000 (0:00:05.031) 0:00:13.022 ********** 2026-04-03 10:20:12.803220 | orchestrator | ok: [testbed-manager] 2026-04-03 10:20:12.803230 | orchestrator | 2026-04-03 10:20:12.803239 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-03 10:20:12.803248 | orchestrator | Friday 03 April 2026 10:19:18 +0000 (0:00:02.190) 0:00:15.213 ********** 2026-04-03 10:20:12.803258 | orchestrator | ok: [testbed-manager] 2026-04-03 10:20:12.803267 | orchestrator | 2026-04-03 10:20:12.803277 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-03 10:20:12.803286 | orchestrator | Friday 03 April 2026 10:19:20 +0000 (0:00:01.274) 0:00:16.488 ********** 2026-04-03 10:20:12.803296 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:20:12.803306 | orchestrator | 2026-04-03 10:20:12.803315 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-03 10:20:12.803325 | orchestrator | Friday 03 April 2026 10:19:21 +0000 (0:00:01.154) 0:00:17.642 ********** 2026-04-03 10:20:12.803334 | orchestrator | ok: [testbed-manager] 2026-04-03 10:20:12.803344 | orchestrator | 2026-04-03 10:20:12.803354 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-03 10:20:12.803363 | orchestrator | Friday 03 April 2026 10:20:09 +0000 (0:00:47.830) 0:01:05.473 ********** 2026-04-03 10:20:12.803373 | orchestrator | changed: [testbed-manager] 2026-04-03 10:20:12.803382 | orchestrator | 2026-04-03 10:20:12.803392 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:20:12.803402 | orchestrator | testbed-manager : ok=7  changed=1  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-03 10:20:12.803413 | orchestrator | 2026-04-03 10:20:12.803423 | orchestrator | 2026-04-03 10:20:12.803432 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:20:12.803442 | orchestrator | Friday 03 April 2026 10:20:12 +0000 (0:00:03.454) 0:01:08.928 ********** 2026-04-03 10:20:12.803451 | orchestrator | =============================================================================== 2026-04-03 10:20:12.803461 | orchestrator | Upgrade the CAPI management cluster ------------------------------------ 47.83s 2026-04-03 10:20:12.803471 | orchestrator | cert_manager : Deploy cert-manager -------------------------------------- 5.03s 2026-04-03 10:20:12.803480 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 4.58s 2026-04-03 10:20:12.803490 | orchestrator | Install openstack-resource-controller ----------------------------------- 3.45s 2026-04-03 10:20:12.803499 | orchestrator | Get capi-system namespace phase ----------------------------------------- 2.19s 2026-04-03 10:20:12.803509 | orchestrator | Include cert_manager role ----------------------------------------------- 1.84s 2026-04-03 10:20:12.803546 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 1.28s 2026-04-03 10:20:12.803557 | orchestrator | Initialize the CAPI management cluster ---------------------------------- 1.15s 2026-04-03 10:20:13.002303 | orchestrator | + osism apply -a upgrade magnum 2026-04-03 10:20:14.372518 | orchestrator | 2026-04-03 10:20:14 | INFO  | Prepare task for execution of magnum. 2026-04-03 10:20:14.440435 | orchestrator | 2026-04-03 10:20:14 | INFO  | Task 2537817a-8875-4f67-a213-c78a57e4acb2 (magnum) was prepared for execution. 2026-04-03 10:20:14.440619 | orchestrator | 2026-04-03 10:20:14 | INFO  | It takes a moment until task 2537817a-8875-4f67-a213-c78a57e4acb2 (magnum) has been started and output is visible here. 2026-04-03 10:20:27.528248 | orchestrator | 2026-04-03 10:20:27.528348 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:20:27.528364 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-03 10:20:27.528377 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-03 10:20:27.528399 | orchestrator | 2026-04-03 10:20:27.528411 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:20:27.528421 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-03 10:20:27.528432 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-03 10:20:27.528454 | orchestrator | Friday 03 April 2026 10:20:19 +0000 (0:00:01.301) 0:00:01.301 ********** 2026-04-03 10:20:27.528465 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:20:27.528476 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:20:27.528487 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:20:27.528497 | orchestrator | 2026-04-03 10:20:27.528508 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:20:27.528519 | orchestrator | Friday 03 April 2026 10:20:20 +0000 (0:00:00.860) 0:00:02.162 ********** 2026-04-03 10:20:27.528571 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-03 10:20:27.528582 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-03 10:20:27.528593 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-03 10:20:27.528646 | orchestrator | 2026-04-03 10:20:27.528658 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-03 10:20:27.528669 | orchestrator | 2026-04-03 10:20:27.528679 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-03 10:20:27.528690 | orchestrator | Friday 03 April 2026 10:20:20 +0000 (0:00:00.820) 0:00:02.982 ********** 2026-04-03 10:20:27.528701 | orchestrator | included: /ansible/roles/magnum/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:20:27.528712 | orchestrator | 2026-04-03 10:20:27.528723 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-03 10:20:27.528734 | orchestrator | Friday 03 April 2026 10:20:22 +0000 (0:00:01.656) 0:00:04.638 ********** 2026-04-03 10:20:27.528751 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:27.528767 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:27.528833 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:27.528850 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:27.528864 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:27.528877 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:27.528897 | orchestrator | 2026-04-03 10:20:27.528909 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-03 10:20:27.528922 | orchestrator | Friday 03 April 2026 10:20:24 +0000 (0:00:02.122) 0:00:06.761 ********** 2026-04-03 10:20:27.528934 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:20:27.528947 | orchestrator | 2026-04-03 10:20:27.528960 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-03 10:20:27.528973 | orchestrator | Friday 03 April 2026 10:20:24 +0000 (0:00:00.102) 0:00:06.864 ********** 2026-04-03 10:20:27.528985 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:20:27.528997 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:20:27.529009 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:20:27.529022 | orchestrator | 2026-04-03 10:20:27.529034 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-03 10:20:27.529046 | orchestrator | Friday 03 April 2026 10:20:25 +0000 (0:00:00.362) 0:00:07.227 ********** 2026-04-03 10:20:27.529059 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-03 10:20:27.529072 | orchestrator | 2026-04-03 10:20:27.529084 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-03 10:20:27.529097 | orchestrator | Friday 03 April 2026 10:20:26 +0000 (0:00:00.958) 0:00:08.185 ********** 2026-04-03 10:20:27.529123 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.312762 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.312898 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.312963 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:32.313007 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:32.313048 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:32.313061 | orchestrator | 2026-04-03 10:20:32.313075 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-03 10:20:32.313088 | orchestrator | Friday 03 April 2026 10:20:28 +0000 (0:00:02.542) 0:00:10.727 ********** 2026-04-03 10:20:32.313099 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:20:32.313111 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:20:32.313122 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:20:32.313133 | orchestrator | 2026-04-03 10:20:32.313144 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-03 10:20:32.313155 | orchestrator | Friday 03 April 2026 10:20:28 +0000 (0:00:00.288) 0:00:11.016 ********** 2026-04-03 10:20:32.313166 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:20:32.313177 | orchestrator | 2026-04-03 10:20:32.313188 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-03 10:20:32.313199 | orchestrator | Friday 03 April 2026 10:20:29 +0000 (0:00:01.031) 0:00:12.047 ********** 2026-04-03 10:20:32.313211 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.313233 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.313251 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:32.313272 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:33.715852 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:33.716005 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:33.716024 | orchestrator | 2026-04-03 10:20:33.716038 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-03 10:20:33.716050 | orchestrator | Friday 03 April 2026 10:20:32 +0000 (0:00:02.498) 0:00:14.546 ********** 2026-04-03 10:20:33.716080 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:33.716094 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:33.716106 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:20:33.716138 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:33.716159 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:33.716171 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:33.716182 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:20:33.716199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:33.716210 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:20:33.716221 | orchestrator | 2026-04-03 10:20:33.716233 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-03 10:20:33.716244 | orchestrator | Friday 03 April 2026 10:20:33 +0000 (0:00:00.808) 0:00:15.354 ********** 2026-04-03 10:20:33.716263 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:37.167160 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:37.167262 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:20:37.167282 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:37.167314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:37.167326 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:20:37.167338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:37.167392 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:37.167405 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:20:37.167416 | orchestrator | 2026-04-03 10:20:37.167429 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-03 10:20:37.167442 | orchestrator | Friday 03 April 2026 10:20:34 +0000 (0:00:01.440) 0:00:16.795 ********** 2026-04-03 10:20:37.167454 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:37.167472 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:37.167485 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:37.167514 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.341954 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.342125 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.342144 | orchestrator | 2026-04-03 10:20:43.342157 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-03 10:20:43.342169 | orchestrator | Friday 03 April 2026 10:20:37 +0000 (0:00:02.607) 0:00:19.402 ********** 2026-04-03 10:20:43.342201 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:43.342238 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:43.342271 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:43.342284 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.342301 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.342312 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:20:43.342331 | orchestrator | 2026-04-03 10:20:43.342343 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-03 10:20:43.342354 | orchestrator | Friday 03 April 2026 10:20:42 +0000 (0:00:05.617) 0:00:25.019 ********** 2026-04-03 10:20:43.342374 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:46.718227 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:46.718352 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:20:46.718393 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:46.718413 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:46.718457 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:20:46.718473 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:20:46.718511 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:20:46.718527 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:20:46.718587 | orchestrator | 2026-04-03 10:20:46.718605 | orchestrator | TASK [service-check-containers : magnum | Check containers] ******************** 2026-04-03 10:20:46.718622 | orchestrator | Friday 03 April 2026 10:20:44 +0000 (0:00:01.279) 0:00:26.298 ********** 2026-04-03 10:20:46.718637 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:46.718660 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:46.718687 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-03 10:20:46.718712 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:21:11.352044 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:21:11.352163 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-03 10:21:11.352197 | orchestrator | 2026-04-03 10:21:11.352210 | orchestrator | TASK [service-check-containers : magnum | Notify handlers to restart containers] *** 2026-04-03 10:21:11.352221 | orchestrator | Friday 03 April 2026 10:20:46 +0000 (0:00:02.618) 0:00:28.917 ********** 2026-04-03 10:21:11.352232 | orchestrator | changed: [testbed-node-0] => { 2026-04-03 10:21:11.352242 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:21:11.352252 | orchestrator | } 2026-04-03 10:21:11.352262 | orchestrator | changed: [testbed-node-1] => { 2026-04-03 10:21:11.352272 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:21:11.352281 | orchestrator | } 2026-04-03 10:21:11.352290 | orchestrator | changed: [testbed-node-2] => { 2026-04-03 10:21:11.352300 | orchestrator |  "msg": "Notifying handlers" 2026-04-03 10:21:11.352309 | orchestrator | } 2026-04-03 10:21:11.352319 | orchestrator | 2026-04-03 10:21:11.352329 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-03 10:21:11.352339 | orchestrator | Friday 03 April 2026 10:20:47 +0000 (0:00:00.387) 0:00:29.305 ********** 2026-04-03 10:21:11.352352 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:21:11.352364 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:21:11.352375 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:21:11.352402 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:21:11.352419 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:21:11.352437 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:21:11.352448 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-03 10:21:11.352458 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-03 10:21:11.352468 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:21:11.352478 | orchestrator | 2026-04-03 10:21:11.352488 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-03 10:21:11.352497 | orchestrator | Friday 03 April 2026 10:20:48 +0000 (0:00:01.478) 0:00:30.783 ********** 2026-04-03 10:21:11.352507 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:21:11.352517 | orchestrator | 2026-04-03 10:21:11.352526 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 10:21:11.352536 | orchestrator | Friday 03 April 2026 10:21:11 +0000 (0:00:22.533) 0:00:53.317 ********** 2026-04-03 10:21:11.352571 | orchestrator | 2026-04-03 10:21:11.352584 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 10:21:11.352602 | orchestrator | Friday 03 April 2026 10:21:11 +0000 (0:00:00.076) 0:00:53.394 ********** 2026-04-03 10:21:57.010989 | orchestrator | 2026-04-03 10:21:57.011105 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-03 10:21:57.011122 | orchestrator | Friday 03 April 2026 10:21:11 +0000 (0:00:00.075) 0:00:53.469 ********** 2026-04-03 10:21:57.011134 | orchestrator | 2026-04-03 10:21:57.011146 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-03 10:21:57.011157 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-03 10:21:57.011192 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-03 10:21:57.011215 | orchestrator | Friday 03 April 2026 10:21:11 +0000 (0:00:00.088) 0:00:53.557 ********** 2026-04-03 10:21:57.011226 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:21:57.011238 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:21:57.011249 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:21:57.011259 | orchestrator | 2026-04-03 10:21:57.011270 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-03 10:21:57.011282 | orchestrator | Friday 03 April 2026 10:21:32 +0000 (0:00:21.287) 0:01:14.845 ********** 2026-04-03 10:21:57.011293 | orchestrator | changed: [testbed-node-2] 2026-04-03 10:21:57.011304 | orchestrator | changed: [testbed-node-1] 2026-04-03 10:21:57.011314 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:21:57.011325 | orchestrator | 2026-04-03 10:21:57.011335 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:21:57.011347 | orchestrator | testbed-node-0 : ok=16  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-03 10:21:57.011359 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:21:57.011385 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-03 10:21:57.011396 | orchestrator | 2026-04-03 10:21:57.011407 | orchestrator | 2026-04-03 10:21:57.011418 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:21:57.011429 | orchestrator | Friday 03 April 2026 10:21:56 +0000 (0:00:23.932) 0:01:38.778 ********** 2026-04-03 10:21:57.011440 | orchestrator | =============================================================================== 2026-04-03 10:21:57.011450 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 23.93s 2026-04-03 10:21:57.011461 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 22.53s 2026-04-03 10:21:57.011471 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 21.29s 2026-04-03 10:21:57.011482 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 5.62s 2026-04-03 10:21:57.011492 | orchestrator | service-check-containers : magnum | Check containers -------------------- 2.62s 2026-04-03 10:21:57.011503 | orchestrator | magnum : Copying over config.json files for services -------------------- 2.61s 2026-04-03 10:21:57.011514 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 2.54s 2026-04-03 10:21:57.011524 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 2.50s 2026-04-03 10:21:57.011537 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 2.12s 2026-04-03 10:21:57.011549 | orchestrator | magnum : include_tasks -------------------------------------------------- 1.66s 2026-04-03 10:21:57.011584 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.48s 2026-04-03 10:21:57.011597 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS key ------ 1.44s 2026-04-03 10:21:57.011610 | orchestrator | magnum : Copying over existing policy file ------------------------------ 1.28s 2026-04-03 10:21:57.011622 | orchestrator | magnum : include_tasks -------------------------------------------------- 1.03s 2026-04-03 10:21:57.011634 | orchestrator | magnum : Check if kubeconfig file is supplied --------------------------- 0.96s 2026-04-03 10:21:57.011646 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.86s 2026-04-03 10:21:57.011659 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.82s 2026-04-03 10:21:57.011672 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS certificate --- 0.81s 2026-04-03 10:21:57.011685 | orchestrator | service-check-containers : magnum | Notify handlers to restart containers --- 0.39s 2026-04-03 10:21:57.011706 | orchestrator | magnum : Set magnum policy file ----------------------------------------- 0.36s 2026-04-03 10:21:57.817479 | orchestrator | ok: Runtime: 3:24:42.560456 2026-04-03 10:21:58.207368 | 2026-04-03 10:21:58.207512 | TASK [Bootstrap services] 2026-04-03 10:21:58.743568 | orchestrator | skipping: Conditional result was False 2026-04-03 10:21:58.769470 | 2026-04-03 10:21:58.769645 | TASK [Run checks after the upgrade] 2026-04-03 10:21:59.464759 | orchestrator | + set -e 2026-04-03 10:21:59.464931 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 10:21:59.464951 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 10:21:59.464968 | orchestrator | ++ INTERACTIVE=false 2026-04-03 10:21:59.464979 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 10:21:59.464989 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 10:21:59.465001 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 10:21:59.465398 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 10:21:59.469639 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 10:21:59.469712 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 10:21:59.469728 | orchestrator | + echo 2026-04-03 10:21:59.469738 | orchestrator | 2026-04-03 10:21:59.469748 | orchestrator | # CHECK 2026-04-03 10:21:59.469757 | orchestrator | 2026-04-03 10:21:59.469775 | orchestrator | + echo '# CHECK' 2026-04-03 10:21:59.469784 | orchestrator | + echo 2026-04-03 10:21:59.469797 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 10:21:59.470700 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-03 10:21:59.528847 | orchestrator | 2026-04-03 10:21:59.528983 | orchestrator | ## Containers @ testbed-manager 2026-04-03 10:21:59.529011 | orchestrator | 2026-04-03 10:21:59.529036 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 10:21:59.529056 | orchestrator | + echo 2026-04-03 10:21:59.529077 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-03 10:21:59.529097 | orchestrator | + echo 2026-04-03 10:21:59.529117 | orchestrator | + osism container testbed-manager ps 2026-04-03 10:22:01.100433 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 10:22:01.100629 | orchestrator | 576e3546ac02 registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328 "dumb-init --single-…" 5 minutes ago Up 5 minutes prometheus_blackbox_exporter 2026-04-03 10:22:01.100659 | orchestrator | cf2fc66f45fd registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328 "dumb-init --single-…" 6 minutes ago Up 5 minutes prometheus_alertmanager 2026-04-03 10:22:01.100673 | orchestrator | b7bdf96d1e6d registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-03 10:22:01.100684 | orchestrator | ec2b943001e0 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-03 10:22:01.100696 | orchestrator | 350d56550d87 registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_server 2026-04-03 10:22:01.100708 | orchestrator | a28e856e8ee6 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-03 10:22:01.100725 | orchestrator | dda83c23a407 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-03 10:22:01.100737 | orchestrator | 3df546679f3c registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-03 10:22:01.100776 | orchestrator | 7849d11a8267 registry.osism.tech/osism/openstackclient:2025.1 "/usr/bin/dumb-init …" 3 hours ago Up 3 hours openstackclient 2026-04-03 10:22:01.100789 | orchestrator | 2894fbe2e377 registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" 3 hours ago Up 3 hours (healthy) manager-inventory_reconciler-1 2026-04-03 10:22:01.100800 | orchestrator | 86444c87e74b registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" 3 hours ago Up 3 hours (healthy) osismclient 2026-04-03 10:22:01.100812 | orchestrator | 1b3e556cb60d registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-ansible 2026-04-03 10:22:01.100823 | orchestrator | db2a7636a418 registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) kolla-ansible 2026-04-03 10:22:01.100861 | orchestrator | 10c19a613a94 registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) ceph-ansible 2026-04-03 10:22:01.100874 | orchestrator | 9290e38fdbcf registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-kubernetes 2026-04-03 10:22:01.100885 | orchestrator | 1d54ce10c97c registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-03 10:22:01.100896 | orchestrator | 1056dba781a5 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-openstack-1 2026-04-03 10:22:01.100907 | orchestrator | 415ae4414d6b registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-flower-1 2026-04-03 10:22:01.100918 | orchestrator | 0017a50fdf62 registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" 3 hours ago Up 3 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-03 10:22:01.100929 | orchestrator | 7ea1b165eacb registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up About an hour (healthy) manager-listener-1 2026-04-03 10:22:01.100940 | orchestrator | 4a37e8b7974e registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-beat-1 2026-04-03 10:22:01.100951 | orchestrator | ab510183c934 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" 5 hours ago Up 5 hours cephclient 2026-04-03 10:22:01.100971 | orchestrator | 9eac53bd51e9 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 5 hours ago Up 5 hours (healthy) 80/tcp phpmyadmin 2026-04-03 10:22:01.100982 | orchestrator | f1425466f2eb registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 5 hours ago Up 5 hours (healthy) 8080/tcp homer 2026-04-03 10:22:01.100993 | orchestrator | 397c59606551 registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 5 hours ago Up 5 hours 80/tcp cgit 2026-04-03 10:22:01.101004 | orchestrator | 663e8b30f5b5 registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-03 10:22:01.101020 | orchestrator | 77c585af9f52 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 6 hours ago Up 3 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-03 10:22:01.101032 | orchestrator | f9697c0afa26 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-03 10:22:01.101043 | orchestrator | 8c50f9b6b789 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 6379/tcp manager-redis-1 2026-04-03 10:22:01.101062 | orchestrator | f2bc5fd89ede registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-03 10:22:01.243408 | orchestrator | 2026-04-03 10:22:01.243515 | orchestrator | ## Images @ testbed-manager 2026-04-03 10:22:01.243530 | orchestrator | 2026-04-03 10:22:01.243543 | orchestrator | + echo 2026-04-03 10:22:01.243554 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-03 10:22:01.243598 | orchestrator | + echo 2026-04-03 10:22:01.243611 | orchestrator | + osism container testbed-manager images 2026-04-03 10:22:02.749171 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 10:22:02.749264 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 cd42573b3301 6 hours ago 239MB 2026-04-03 10:22:02.749276 | orchestrator | registry.osism.tech/osism/openstackclient 2025.1 cb6f0f54a79e 6 hours ago 213MB 2026-04-03 10:22:02.749285 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20260328.0 38f6ca42e9a0 3 days ago 635MB 2026-04-03 10:22:02.749293 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 6 days ago 590MB 2026-04-03 10:22:02.749301 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 6 days ago 683MB 2026-04-03 10:22:02.749309 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 6 days ago 277MB 2026-04-03 10:22:02.749317 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter 0.25.0.20260328 1bf017fd7bf3 6 days ago 319MB 2026-04-03 10:22:02.749348 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager 0.28.1.20260328 d1986023a383 6 days ago 415MB 2026-04-03 10:22:02.749356 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 6 days ago 368MB 2026-04-03 10:22:02.749365 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-server 3.2.1.20260328 4f5732d5eb69 6 days ago 860MB 2026-04-03 10:22:02.749373 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 6 days ago 317MB 2026-04-03 10:22:02.749381 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20260322.0 3e18c5de9bc5 11 days ago 634MB 2026-04-03 10:22:02.749389 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20260322.0 c68c1f5728ae 11 days ago 1.24GB 2026-04-03 10:22:02.749397 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20260322.0 f6e7e0d58bb1 11 days ago 585MB 2026-04-03 10:22:02.749405 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20260322.0 9806642932fd 11 days ago 357MB 2026-04-03 10:22:02.749413 | orchestrator | registry.osism.tech/osism/osism 0.20260320.0 5d0420989a40 13 days ago 408MB 2026-04-03 10:22:02.749421 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20260320.0 80b833af5991 13 days ago 232MB 2026-04-03 10:22:02.749429 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 2 months ago 41.4MB 2026-04-03 10:22:02.749447 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-03 10:22:02.749455 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-03 10:22:02.749496 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 10:22:02.749505 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 10:22:02.749513 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 10:22:02.749521 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-03 10:22:02.749529 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 10:22:02.749536 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-03 10:22:02.749545 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-03 10:22:02.749553 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 10:22:02.749561 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-03 10:22:02.749595 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-03 10:22:02.749603 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-03 10:22:02.749628 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-03 10:22:02.749637 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-03 10:22:02.749645 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-03 10:22:02.749658 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 4 months ago 334MB 2026-04-03 10:22:02.749666 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 5 months ago 742MB 2026-04-03 10:22:02.749674 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 7 months ago 275MB 2026-04-03 10:22:02.749682 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 8 months ago 226MB 2026-04-03 10:22:02.749690 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 10 months ago 453MB 2026-04-03 10:22:02.749697 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-03 10:22:02.749705 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-03 10:22:02.893243 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 10:22:02.893346 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-03 10:22:02.940982 | orchestrator | 2026-04-03 10:22:02.941085 | orchestrator | ## Containers @ testbed-node-0 2026-04-03 10:22:02.941102 | orchestrator | 2026-04-03 10:22:02.941114 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 10:22:02.941125 | orchestrator | + echo 2026-04-03 10:22:02.941137 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-03 10:22:02.941148 | orchestrator | + echo 2026-04-03 10:22:02.941159 | orchestrator | + osism container testbed-node-0 ps 2026-04-03 10:22:04.459814 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 10:22:04.459938 | orchestrator | f66179a5d55d registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 10 seconds ago Up 8 seconds (health: starting) magnum_conductor 2026-04-03 10:22:04.460030 | orchestrator | 4bf392021c32 registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 43 seconds ago Up 41 seconds (healthy) magnum_api 2026-04-03 10:22:04.460045 | orchestrator | bfd37046bd21 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 4 minutes ago Up 4 minutes grafana 2026-04-03 10:22:04.460057 | orchestrator | 793afa4cafba registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 5 minutes ago Up 5 minutes prometheus_elasticsearch_exporter 2026-04-03 10:22:04.460077 | orchestrator | 66cc8df7cd57 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-03 10:22:04.460089 | orchestrator | 563069f86a2c registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-03 10:22:04.460101 | orchestrator | ac16a3e47f56 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_mysqld_exporter 2026-04-03 10:22:04.460118 | orchestrator | e4b7b3c0fe26 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-03 10:22:04.460137 | orchestrator | 1bc774a8334c registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-03 10:22:04.460182 | orchestrator | c2961824c37c registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-03 10:22:04.460220 | orchestrator | 43590edee059 registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-03 10:22:04.460234 | orchestrator | 5dd90c8028ef registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-03 10:22:04.460245 | orchestrator | 73b2768f47f1 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-03 10:22:04.460256 | orchestrator | 36c309181841 registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_housekeeping 2026-04-03 10:22:04.460267 | orchestrator | a5046dc9baed registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-03 10:22:04.460278 | orchestrator | 2f6478f5cd26 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-03 10:22:04.460289 | orchestrator | 3531e4e4f7ce registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-03 10:22:04.460317 | orchestrator | b06ad371c615 registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-03 10:22:04.460329 | orchestrator | 36f5867b35a9 registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-03 10:22:04.460340 | orchestrator | fead733cc567 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_evaluator 2026-04-03 10:22:04.460351 | orchestrator | 449a83ba6951 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-03 10:22:04.460368 | orchestrator | 60b4f89d1e47 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes ceilometer_central 2026-04-03 10:22:04.460379 | orchestrator | 98b9242ce696 registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-03 10:22:04.460389 | orchestrator | e1e8bb0a7471 registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-03 10:22:04.460400 | orchestrator | 2da08bbc7ae8 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-03 10:22:04.460411 | orchestrator | e078dc93bc4f registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_producer 2026-04-03 10:22:04.460430 | orchestrator | cccc3df7472c registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_central 2026-04-03 10:22:04.460441 | orchestrator | 2348e57a09d7 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_api 2026-04-03 10:22:04.460452 | orchestrator | 76f2363e751f registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 10:22:04.460463 | orchestrator | e9916d311854 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 10:22:04.460473 | orchestrator | c04cc625e5a4 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 10:22:04.460484 | orchestrator | 658cc778d517 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 10:22:04.460495 | orchestrator | f0dfe66ba404 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-03 10:22:04.460506 | orchestrator | c5bf56673415 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-03 10:22:04.460517 | orchestrator | bd541ec527ba registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-03 10:22:04.460527 | orchestrator | 3ba487f2b7f4 registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-03 10:22:04.460538 | orchestrator | 38d90778d620 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 38 minutes ago Up 37 minutes (healthy) glance_api 2026-04-03 10:22:04.460561 | orchestrator | 1d9418c8c504 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) skyline_console 2026-04-03 10:22:04.460604 | orchestrator | 48b823fd21fd registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) skyline_apiserver 2026-04-03 10:22:04.460615 | orchestrator | b07e3eac12d7 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) horizon 2026-04-03 10:22:04.460626 | orchestrator | 4e20a0131cf9 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 56 minutes ago Up 46 minutes (healthy) nova_novncproxy 2026-04-03 10:22:04.460637 | orchestrator | ae5601fab376 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" 57 minutes ago Up 46 minutes (healthy) nova_conductor 2026-04-03 10:22:04.460647 | orchestrator | 3ef95741bb22 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-03 10:22:04.460665 | orchestrator | b7bfa1e76cec registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 45 minutes (healthy) nova_api 2026-04-03 10:22:04.460676 | orchestrator | 1a0cd1a7d595 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 46 minutes (healthy) nova_scheduler 2026-04-03 10:22:04.460687 | orchestrator | 49954e6445ac registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-03 10:22:04.460698 | orchestrator | a638480c0a48 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-03 10:22:04.460714 | orchestrator | 93d943775adf registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-03 10:22:04.460725 | orchestrator | 3ca84ff675aa registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-03 10:22:04.460736 | orchestrator | 0d8f6fbe52ee registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-03 10:22:04.460747 | orchestrator | 9910dee71b04 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-03 10:22:04.460758 | orchestrator | 5b8dca912a9e registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-0 2026-04-03 10:22:04.460768 | orchestrator | 48d75555448e registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-0 2026-04-03 10:22:04.460779 | orchestrator | 2d39cb2dda67 registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-03 10:22:04.460790 | orchestrator | f32a01cc9bbb registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-03 10:22:04.460801 | orchestrator | 8594c1650121 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-03 10:22:04.460819 | orchestrator | a63bd468c11f registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-03 10:22:04.460831 | orchestrator | 36d871f77a5d registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-03 10:22:04.460842 | orchestrator | 1ab251cbaef0 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-03 10:22:04.460853 | orchestrator | 928962accfea registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-03 10:22:04.460873 | orchestrator | 189864fc3549 registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-03 10:22:04.460885 | orchestrator | deb5b3662bcc registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-03 10:22:04.460901 | orchestrator | 2896b101633c registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-03 10:22:04.460912 | orchestrator | 89e84d8210d2 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-03 10:22:04.460923 | orchestrator | cdb9d0cc1912 registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-03 10:22:04.460934 | orchestrator | ef9638dd67c4 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-03 10:22:04.460945 | orchestrator | 9a51a4860672 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-03 10:22:04.460956 | orchestrator | 83fc1f3b039e registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-03 10:22:04.460967 | orchestrator | 0041f4cffc7a registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-03 10:22:04.460978 | orchestrator | 2e01c4480d4e registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-03 10:22:04.460989 | orchestrator | 32c68ea553f7 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-03 10:22:04.461000 | orchestrator | 20c2ac583ea8 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-03 10:22:04.461011 | orchestrator | 4fcaaef28000 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-03 10:22:04.609149 | orchestrator | 2026-04-03 10:22:04.609260 | orchestrator | ## Images @ testbed-node-0 2026-04-03 10:22:04.609276 | orchestrator | 2026-04-03 10:22:04.609287 | orchestrator | + echo 2026-04-03 10:22:04.609299 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-03 10:22:04.609311 | orchestrator | + echo 2026-04-03 10:22:04.609322 | orchestrator | + osism container testbed-node-0 images 2026-04-03 10:22:06.274634 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 10:22:06.274772 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 6 days ago 288MB 2026-04-03 10:22:06.274800 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 6 days ago 1.54GB 2026-04-03 10:22:06.274857 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 6 days ago 1.57GB 2026-04-03 10:22:06.274879 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 6 days ago 590MB 2026-04-03 10:22:06.274899 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 6 days ago 277MB 2026-04-03 10:22:06.274919 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 6 days ago 1.04GB 2026-04-03 10:22:06.274938 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 6 days ago 350MB 2026-04-03 10:22:06.274959 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 6 days ago 427MB 2026-04-03 10:22:06.274978 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 6 days ago 683MB 2026-04-03 10:22:06.275020 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 6 days ago 277MB 2026-04-03 10:22:06.275041 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 6 days ago 285MB 2026-04-03 10:22:06.275061 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 6 days ago 293MB 2026-04-03 10:22:06.275082 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 6 days ago 293MB 2026-04-03 10:22:06.275096 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 6 days ago 284MB 2026-04-03 10:22:06.275112 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 6 days ago 284MB 2026-04-03 10:22:06.275130 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 6 days ago 1.2GB 2026-04-03 10:22:06.275148 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 6 days ago 463MB 2026-04-03 10:22:06.275165 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 6 days ago 309MB 2026-04-03 10:22:06.275181 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 6 days ago 368MB 2026-04-03 10:22:06.275198 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 6 days ago 303MB 2026-04-03 10:22:06.275233 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 6 days ago 312MB 2026-04-03 10:22:06.275251 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 6 days ago 317MB 2026-04-03 10:22:06.275269 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 6 days ago 301MB 2026-04-03 10:22:06.275285 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 6 days ago 301MB 2026-04-03 10:22:06.275302 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 6 days ago 301MB 2026-04-03 10:22:06.275319 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 6 days ago 301MB 2026-04-03 10:22:06.275335 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 6 days ago 1.09GB 2026-04-03 10:22:06.275374 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 6 days ago 1.06GB 2026-04-03 10:22:06.275394 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 6 days ago 1.05GB 2026-04-03 10:22:06.275435 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 6 days ago 997MB 2026-04-03 10:22:06.275455 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 6 days ago 996MB 2026-04-03 10:22:06.275472 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 6 days ago 1.07GB 2026-04-03 10:22:06.275489 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 6 days ago 1.07GB 2026-04-03 10:22:06.275505 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 6 days ago 1.05GB 2026-04-03 10:22:06.275523 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 6 days ago 1.05GB 2026-04-03 10:22:06.275540 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 6 days ago 1.05GB 2026-04-03 10:22:06.275557 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 6 days ago 996MB 2026-04-03 10:22:06.275608 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 6 days ago 995MB 2026-04-03 10:22:06.275627 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 6 days ago 995MB 2026-04-03 10:22:06.275658 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 6 days ago 995MB 2026-04-03 10:22:06.275677 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 6 days ago 994MB 2026-04-03 10:22:06.275696 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 6 days ago 1.12GB 2026-04-03 10:22:06.275714 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 6 days ago 1.79GB 2026-04-03 10:22:06.275732 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 6 days ago 1.43GB 2026-04-03 10:22:06.275751 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 6 days ago 1.43GB 2026-04-03 10:22:06.275769 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 6 days ago 1.44GB 2026-04-03 10:22:06.275788 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 6 days ago 1.24GB 2026-04-03 10:22:06.275806 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 6 days ago 1.07GB 2026-04-03 10:22:06.275824 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 6 days ago 1.02GB 2026-04-03 10:22:06.275842 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 6 days ago 1GB 2026-04-03 10:22:06.275860 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 6 days ago 1GB 2026-04-03 10:22:06.275877 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 6 days ago 1GB 2026-04-03 10:22:06.275913 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 6 days ago 1.27GB 2026-04-03 10:22:06.275933 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 6 days ago 1.15GB 2026-04-03 10:22:06.275951 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 6 days ago 1.01GB 2026-04-03 10:22:06.275970 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 6 days ago 1GB 2026-04-03 10:22:06.275995 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 6 days ago 1GB 2026-04-03 10:22:06.276015 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 6 days ago 1.01GB 2026-04-03 10:22:06.276035 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 6 days ago 1GB 2026-04-03 10:22:06.276053 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 6 days ago 1GB 2026-04-03 10:22:06.276083 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 6 days ago 1.23GB 2026-04-03 10:22:06.276095 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 6 days ago 1.39GB 2026-04-03 10:22:06.276106 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 6 days ago 1.23GB 2026-04-03 10:22:06.276117 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 6 days ago 1.23GB 2026-04-03 10:22:06.276128 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 6 days ago 1.07GB 2026-04-03 10:22:06.276139 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 6 days ago 1.07GB 2026-04-03 10:22:06.276150 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 6 days ago 1.07GB 2026-04-03 10:22:06.276161 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 6 days ago 1.24GB 2026-04-03 10:22:06.276172 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 6 days ago 301MB 2026-04-03 10:22:06.276182 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 10:22:06.276193 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 10:22:06.276204 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 10:22:06.276215 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 10:22:06.276233 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 10:22:06.276245 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 10:22:06.276262 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 10:22:06.276280 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 10:22:06.276299 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 10:22:06.276330 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 10:22:06.276349 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 10:22:06.276360 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 10:22:06.276371 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 10:22:06.276382 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 10:22:06.276393 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 10:22:06.276403 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 10:22:06.276414 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 10:22:06.276425 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 10:22:06.276435 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 10:22:06.276446 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 10:22:06.276457 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 10:22:06.276475 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 10:22:06.276487 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 10:22:06.276498 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 10:22:06.276508 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 10:22:06.276519 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 10:22:06.276530 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 10:22:06.276541 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 10:22:06.276551 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 10:22:06.276562 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 10:22:06.276642 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 10:22:06.276654 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 10:22:06.276665 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 10:22:06.276675 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 10:22:06.276694 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 10:22:06.276705 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 10:22:06.276715 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 10:22:06.276726 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 10:22:06.276737 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 10:22:06.276747 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 10:22:06.276758 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 10:22:06.276769 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 10:22:06.276786 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 10:22:06.276798 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 10:22:06.276809 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 10:22:06.276825 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 10:22:06.276836 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 10:22:06.276847 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 10:22:06.276857 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 10:22:06.276868 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 10:22:06.276879 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 10:22:06.276896 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 10:22:06.276908 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 10:22:06.276919 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 10:22:06.276930 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 10:22:06.276940 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 10:22:06.276951 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 10:22:06.276962 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 10:22:06.276973 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 10:22:06.276990 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 10:22:06.277001 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 10:22:06.277012 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 10:22:06.277023 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 10:22:06.277033 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 10:22:06.277044 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 10:22:06.277055 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 10:22:06.277066 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 10:22:06.277076 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 10:22:06.277087 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 10:22:06.431227 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 10:22:06.431826 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-03 10:22:06.490770 | orchestrator | 2026-04-03 10:22:06.490891 | orchestrator | ## Containers @ testbed-node-1 2026-04-03 10:22:06.490918 | orchestrator | 2026-04-03 10:22:06.490939 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 10:22:06.490959 | orchestrator | + echo 2026-04-03 10:22:06.490980 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-03 10:22:06.490999 | orchestrator | + echo 2026-04-03 10:22:06.491019 | orchestrator | + osism container testbed-node-1 ps 2026-04-03 10:22:08.022271 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 10:22:08.022396 | orchestrator | 3da1306e231f registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 14 seconds ago Up 12 seconds (health: starting) magnum_conductor 2026-04-03 10:22:08.022415 | orchestrator | 2a154e2f887c registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 38 seconds ago Up 36 seconds (healthy) magnum_api 2026-04-03 10:22:08.022427 | orchestrator | cd0bfda43e20 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-03 10:22:08.022438 | orchestrator | 5f347545aca8 registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 5 minutes ago Up 5 minutes prometheus_elasticsearch_exporter 2026-04-03 10:22:08.022451 | orchestrator | 04e10a85a498 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-03 10:22:08.022463 | orchestrator | 1235dff345b5 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-03 10:22:08.022474 | orchestrator | 3983aa110d28 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_mysqld_exporter 2026-04-03 10:22:08.022516 | orchestrator | 1127ab033870 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-03 10:22:08.022544 | orchestrator | 161d055c43a3 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-03 10:22:08.022556 | orchestrator | 465fd966d51b registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-03 10:22:08.022613 | orchestrator | 274edd217e7a registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-03 10:22:08.022625 | orchestrator | f21891cb3846 registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-03 10:22:08.022637 | orchestrator | dcd0ea9a091d registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-03 10:22:08.022648 | orchestrator | a12144b63802 registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_housekeeping 2026-04-03 10:22:08.022659 | orchestrator | a8b52c4466c5 registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-03 10:22:08.022670 | orchestrator | 9cf7192fe2c1 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-03 10:22:08.022681 | orchestrator | 6371aa66572d registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-03 10:22:08.022712 | orchestrator | 0af13622e32d registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-03 10:22:08.022724 | orchestrator | 8c931ca0af5a registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-03 10:22:08.022734 | orchestrator | ea4c0fd7ed21 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_evaluator 2026-04-03 10:22:08.022745 | orchestrator | f22300740764 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-03 10:22:08.022756 | orchestrator | 3be04174e942 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes ceilometer_central 2026-04-03 10:22:08.022767 | orchestrator | d2080ef6f58a registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-03 10:22:08.022778 | orchestrator | b5347d5363b6 registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-03 10:22:08.022797 | orchestrator | 1eb3f90bead8 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-03 10:22:08.022808 | orchestrator | 3bf5e32f0c9d registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_producer 2026-04-03 10:22:08.022819 | orchestrator | 2973830ad9e0 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_central 2026-04-03 10:22:08.022830 | orchestrator | ab6907d9dd8f registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_api 2026-04-03 10:22:08.022840 | orchestrator | 0c0f98566a83 registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 10:22:08.022851 | orchestrator | 813d5fbf0321 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 10:22:08.022862 | orchestrator | 0e0fa64a1054 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 10:22:08.022872 | orchestrator | b11439fd65c3 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 10:22:08.022883 | orchestrator | 53d3fbcf6888 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-03 10:22:08.022894 | orchestrator | 946792e6d3c8 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-03 10:22:08.022913 | orchestrator | 1d7cd6ca9fd6 registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-03 10:22:08.022924 | orchestrator | bbd62b1ae26e registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-03 10:22:08.022940 | orchestrator | 1e94d1e7b3a9 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 37 minutes ago Up 37 minutes (healthy) glance_api 2026-04-03 10:22:08.022952 | orchestrator | 3dbb7898c26e registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) skyline_console 2026-04-03 10:22:08.022963 | orchestrator | fffe0ac92d54 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 42 minutes ago Up 41 minutes (healthy) skyline_apiserver 2026-04-03 10:22:08.022993 | orchestrator | 8816e54a5f80 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) horizon 2026-04-03 10:22:08.023011 | orchestrator | 3fa1ded01642 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 56 minutes ago Up 46 minutes (healthy) nova_novncproxy 2026-04-03 10:22:08.023022 | orchestrator | 403c9399a266 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" 57 minutes ago Up 46 minutes (healthy) nova_conductor 2026-04-03 10:22:08.023033 | orchestrator | 0fc6a8c7fcb4 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-03 10:22:08.023044 | orchestrator | 85bd24242636 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 46 minutes (healthy) nova_api 2026-04-03 10:22:08.023055 | orchestrator | 2ceae5e571a2 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 46 minutes (healthy) nova_scheduler 2026-04-03 10:22:08.023066 | orchestrator | 314eed5cf13a registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-03 10:22:08.023078 | orchestrator | e844acc32ff1 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-03 10:22:08.023088 | orchestrator | 836e14382858 registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-03 10:22:08.023100 | orchestrator | 06ee3f07aa21 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-03 10:22:08.023111 | orchestrator | 1a137980291c registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-03 10:22:08.023134 | orchestrator | b102db14ca41 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-03 10:22:08.023146 | orchestrator | d66bbd3731b7 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-1 2026-04-03 10:22:08.023157 | orchestrator | bf7da6f68ee6 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-1 2026-04-03 10:22:08.023168 | orchestrator | e619673677be registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-03 10:22:08.023179 | orchestrator | 35bdbcbb95dc registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-03 10:22:08.023190 | orchestrator | 35670f994167 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-03 10:22:08.023207 | orchestrator | e3dde3998054 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-03 10:22:08.023230 | orchestrator | 0e9be7ae806e registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-03 10:22:08.023241 | orchestrator | 357961c0cd47 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-03 10:22:08.023252 | orchestrator | cb8f3ad536ae registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-03 10:22:08.023263 | orchestrator | 944f676156d7 registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-03 10:22:08.023274 | orchestrator | 208000739b67 registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-03 10:22:08.023285 | orchestrator | 7a884a1bb764 registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-03 10:22:08.023296 | orchestrator | b5fb51864ab1 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-03 10:22:08.023307 | orchestrator | 01d44b929e5d registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-03 10:22:08.023318 | orchestrator | 5edf738055b2 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-03 10:22:08.023329 | orchestrator | 02b3cfcd238e registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-03 10:22:08.023340 | orchestrator | 5e2377e817f7 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-03 10:22:08.023351 | orchestrator | 4c89dc32ffbc registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-03 10:22:08.023362 | orchestrator | 220a04b604d2 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-03 10:22:08.023374 | orchestrator | 8d5f1a837526 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-03 10:22:08.023385 | orchestrator | 684758c6b05e registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-03 10:22:08.023396 | orchestrator | 20db8918920d registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-03 10:22:08.173918 | orchestrator | 2026-04-03 10:22:08.174065 | orchestrator | ## Images @ testbed-node-1 2026-04-03 10:22:08.174086 | orchestrator | 2026-04-03 10:22:08.174099 | orchestrator | + echo 2026-04-03 10:22:08.174111 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-03 10:22:08.174148 | orchestrator | + echo 2026-04-03 10:22:08.174159 | orchestrator | + osism container testbed-node-1 images 2026-04-03 10:22:09.754765 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 10:22:09.754879 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 6 days ago 288MB 2026-04-03 10:22:09.754896 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 6 days ago 1.54GB 2026-04-03 10:22:09.754908 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 6 days ago 1.57GB 2026-04-03 10:22:09.754920 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 6 days ago 590MB 2026-04-03 10:22:09.754931 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 6 days ago 277MB 2026-04-03 10:22:09.754941 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 6 days ago 1.04GB 2026-04-03 10:22:09.754957 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 6 days ago 427MB 2026-04-03 10:22:09.754968 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 6 days ago 350MB 2026-04-03 10:22:09.754979 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 6 days ago 683MB 2026-04-03 10:22:09.755009 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 6 days ago 277MB 2026-04-03 10:22:09.755031 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 6 days ago 285MB 2026-04-03 10:22:09.755043 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 6 days ago 293MB 2026-04-03 10:22:09.755053 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 6 days ago 293MB 2026-04-03 10:22:09.755064 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 6 days ago 284MB 2026-04-03 10:22:09.755075 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 6 days ago 284MB 2026-04-03 10:22:09.755086 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 6 days ago 1.2GB 2026-04-03 10:22:09.755097 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 6 days ago 463MB 2026-04-03 10:22:09.755108 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 6 days ago 309MB 2026-04-03 10:22:09.755118 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 6 days ago 368MB 2026-04-03 10:22:09.755129 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 6 days ago 303MB 2026-04-03 10:22:09.755140 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 6 days ago 312MB 2026-04-03 10:22:09.755151 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 6 days ago 317MB 2026-04-03 10:22:09.755162 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 6 days ago 301MB 2026-04-03 10:22:09.755173 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 6 days ago 301MB 2026-04-03 10:22:09.755202 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 6 days ago 301MB 2026-04-03 10:22:09.755214 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 6 days ago 301MB 2026-04-03 10:22:09.755225 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 6 days ago 1.09GB 2026-04-03 10:22:09.755236 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 6 days ago 1.06GB 2026-04-03 10:22:09.755247 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 6 days ago 1.05GB 2026-04-03 10:22:09.755274 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 6 days ago 997MB 2026-04-03 10:22:09.755289 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 6 days ago 996MB 2026-04-03 10:22:09.755302 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 6 days ago 1.07GB 2026-04-03 10:22:09.755314 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 6 days ago 1.07GB 2026-04-03 10:22:09.755327 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 6 days ago 1.05GB 2026-04-03 10:22:09.755340 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 6 days ago 1.05GB 2026-04-03 10:22:09.755352 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 6 days ago 1.05GB 2026-04-03 10:22:09.755365 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 6 days ago 996MB 2026-04-03 10:22:09.755378 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 6 days ago 995MB 2026-04-03 10:22:09.755390 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 6 days ago 995MB 2026-04-03 10:22:09.755403 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 6 days ago 995MB 2026-04-03 10:22:09.755415 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 6 days ago 994MB 2026-04-03 10:22:09.755428 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 6 days ago 1.12GB 2026-04-03 10:22:09.755440 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 6 days ago 1.79GB 2026-04-03 10:22:09.755452 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 6 days ago 1.43GB 2026-04-03 10:22:09.755464 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 6 days ago 1.43GB 2026-04-03 10:22:09.755477 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 6 days ago 1.44GB 2026-04-03 10:22:09.755489 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 6 days ago 1.24GB 2026-04-03 10:22:09.755501 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 6 days ago 1.07GB 2026-04-03 10:22:09.755514 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 6 days ago 1.02GB 2026-04-03 10:22:09.755533 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 6 days ago 1GB 2026-04-03 10:22:09.755546 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 6 days ago 1GB 2026-04-03 10:22:09.755559 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 6 days ago 1GB 2026-04-03 10:22:09.755625 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 6 days ago 1.27GB 2026-04-03 10:22:09.755639 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 6 days ago 1.15GB 2026-04-03 10:22:09.755653 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 6 days ago 1.01GB 2026-04-03 10:22:09.755664 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 6 days ago 1GB 2026-04-03 10:22:09.755676 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 6 days ago 1GB 2026-04-03 10:22:09.755687 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 6 days ago 1.01GB 2026-04-03 10:22:09.755699 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 6 days ago 1GB 2026-04-03 10:22:09.755711 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 6 days ago 1GB 2026-04-03 10:22:09.755731 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 6 days ago 1.23GB 2026-04-03 10:22:09.755743 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 6 days ago 1.39GB 2026-04-03 10:22:09.755761 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 6 days ago 1.23GB 2026-04-03 10:22:09.755773 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 6 days ago 1.23GB 2026-04-03 10:22:09.755784 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 6 days ago 1.07GB 2026-04-03 10:22:09.755796 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 6 days ago 1.07GB 2026-04-03 10:22:09.755807 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 6 days ago 1.07GB 2026-04-03 10:22:09.755823 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 6 days ago 1.24GB 2026-04-03 10:22:09.755834 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 6 days ago 301MB 2026-04-03 10:22:09.755846 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 10:22:09.755857 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 10:22:09.755869 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 10:22:09.755880 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 10:22:09.755892 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 10:22:09.755909 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 10:22:09.755921 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 10:22:09.755933 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 10:22:09.755944 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 10:22:09.755956 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 10:22:09.755967 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 10:22:09.755979 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 10:22:09.755995 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 10:22:09.756007 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 10:22:09.756019 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 10:22:09.756030 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 10:22:09.756042 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 10:22:09.756053 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 10:22:09.756065 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 10:22:09.756076 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 10:22:09.756088 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 10:22:09.756105 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 10:22:09.756116 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 10:22:09.756127 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 10:22:09.756138 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 10:22:09.756149 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 10:22:09.756160 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 10:22:09.756171 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 10:22:09.756181 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 10:22:09.756196 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 10:22:09.756213 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 10:22:09.756224 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 10:22:09.756235 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 10:22:09.756251 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 10:22:09.756269 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 10:22:09.756280 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 10:22:09.756291 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 10:22:09.756302 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 10:22:09.756312 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 10:22:09.756323 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 10:22:09.756334 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 10:22:09.756344 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 10:22:09.756355 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 10:22:09.756366 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 10:22:09.756377 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 10:22:09.756388 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 10:22:09.756398 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 10:22:09.756409 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 10:22:09.756420 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 10:22:09.756431 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 10:22:09.756441 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 10:22:09.756458 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 10:22:09.756470 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 10:22:09.756481 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 10:22:09.756491 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 10:22:09.756509 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 10:22:09.756520 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 10:22:09.756531 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 10:22:09.756541 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 10:22:09.756552 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 10:22:09.756563 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 10:22:09.756604 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 10:22:09.756637 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 10:22:09.756657 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 10:22:09.756675 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 10:22:09.756687 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 10:22:09.756698 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 10:22:09.756708 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 10:22:09.756719 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 10:22:09.907758 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-03 10:22:09.907854 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-03 10:22:09.964104 | orchestrator | 2026-04-03 10:22:09.964187 | orchestrator | ## Containers @ testbed-node-2 2026-04-03 10:22:09.964199 | orchestrator | 2026-04-03 10:22:09.964208 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 10:22:09.964217 | orchestrator | + echo 2026-04-03 10:22:09.964225 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-03 10:22:09.964234 | orchestrator | + echo 2026-04-03 10:22:09.964242 | orchestrator | + osism container testbed-node-2 ps 2026-04-03 10:22:11.529348 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-03 10:22:11.529435 | orchestrator | f2ad7c34811e registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 18 seconds ago Up 16 seconds (health: starting) magnum_conductor 2026-04-03 10:22:11.529448 | orchestrator | 6d64d67a58da registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 40 seconds ago Up 38 seconds (healthy) magnum_api 2026-04-03 10:22:11.529457 | orchestrator | b482d48da5c6 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-03 10:22:11.529465 | orchestrator | 926a03a12cbd registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 5 minutes ago Up 5 minutes prometheus_elasticsearch_exporter 2026-04-03 10:22:11.529495 | orchestrator | e86331c5e212 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-03 10:22:11.529505 | orchestrator | 3b3b13cd0778 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-03 10:22:11.529513 | orchestrator | 2516c3323a97 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_mysqld_exporter 2026-04-03 10:22:11.529521 | orchestrator | a235a30779e8 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-03 10:22:11.529529 | orchestrator | 7215c3c330d4 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-03 10:22:11.529537 | orchestrator | aea48336ae61 registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-03 10:22:11.529544 | orchestrator | 177743f805e2 registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-03 10:22:11.529565 | orchestrator | 3eea5bb5e19d registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-03 10:22:11.529603 | orchestrator | 9b6866bdc7d5 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-03 10:22:11.529611 | orchestrator | 8a85571ec00f registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_housekeeping 2026-04-03 10:22:11.529619 | orchestrator | 4a89c9b7ec17 registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-03 10:22:11.529627 | orchestrator | 80912180aac2 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-03 10:22:11.529635 | orchestrator | efc362830c3e registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-03 10:22:11.529657 | orchestrator | 77d065077aaa registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-03 10:22:11.529666 | orchestrator | ca0036e5cc20 registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-03 10:22:11.529675 | orchestrator | 067c1c60c0f5 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_evaluator 2026-04-03 10:22:11.529682 | orchestrator | 712025696ad3 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-03 10:22:11.529696 | orchestrator | 21e016522c7e registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes ceilometer_central 2026-04-03 10:22:11.529704 | orchestrator | 38a74099523e registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-03 10:22:11.529712 | orchestrator | 38a2dad52fd8 registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-03 10:22:11.529720 | orchestrator | 2ff974f47ea5 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-03 10:22:11.529727 | orchestrator | f09c274fe614 registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_producer 2026-04-03 10:22:11.529735 | orchestrator | 29f45a916537 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_central 2026-04-03 10:22:11.529743 | orchestrator | 74a83a8f7bc9 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 25 minutes (healthy) designate_api 2026-04-03 10:22:11.529751 | orchestrator | 9f4950016c7d registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-03 10:22:11.529759 | orchestrator | ef36092477ba registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-03 10:22:11.529766 | orchestrator | 756494905ed7 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-03 10:22:11.529774 | orchestrator | 26c2831df3a2 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-03 10:22:11.529782 | orchestrator | 2c64e944d973 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-03 10:22:11.529790 | orchestrator | 83e70b3bd225 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-03 10:22:11.529798 | orchestrator | bb495a8498ce registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-03 10:22:11.529806 | orchestrator | 5fd02f35346d registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-03 10:22:11.529818 | orchestrator | c7665ef0e949 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 37 minutes ago Up 37 minutes (healthy) glance_api 2026-04-03 10:22:11.529826 | orchestrator | 44f48874b43a registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) skyline_console 2026-04-03 10:22:11.529840 | orchestrator | 6ac043ead4d6 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) skyline_apiserver 2026-04-03 10:22:11.529848 | orchestrator | 04e452ac517c registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) horizon 2026-04-03 10:22:11.529856 | orchestrator | a495796a9551 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 56 minutes ago Up 46 minutes (healthy) nova_novncproxy 2026-04-03 10:22:11.529863 | orchestrator | 260e560fdf80 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" 57 minutes ago Up 46 minutes (healthy) nova_conductor 2026-04-03 10:22:11.529878 | orchestrator | f847c946e08a registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-03 10:22:11.529886 | orchestrator | 6c5370d6d00b registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 46 minutes (healthy) nova_api 2026-04-03 10:22:11.529896 | orchestrator | f495a3b73b9f registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 46 minutes (healthy) nova_scheduler 2026-04-03 10:22:11.529906 | orchestrator | ff8c08421be8 registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-03 10:22:11.529915 | orchestrator | 81819c34f3d3 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-03 10:22:11.529924 | orchestrator | 1104f4084d67 registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-03 10:22:11.529933 | orchestrator | 350861d63a3e registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-03 10:22:11.529946 | orchestrator | c28ea4469cef registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-03 10:22:11.529955 | orchestrator | 818eeaf009a0 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-03 10:22:11.529964 | orchestrator | 0253e790671f registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-2 2026-04-03 10:22:11.529973 | orchestrator | e6d5268af19d registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-2 2026-04-03 10:22:11.529982 | orchestrator | b21357c4a697 registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-03 10:22:11.529991 | orchestrator | c59e60e51cc6 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-03 10:22:11.530005 | orchestrator | f5fdc589f597 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-03 10:22:11.530065 | orchestrator | d243dc197203 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-03 10:22:11.530076 | orchestrator | 1ebbe4c1dfa9 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-03 10:22:11.530086 | orchestrator | ac97de11da83 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-03 10:22:11.530095 | orchestrator | 41bccbf368d1 registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-03 10:22:11.530104 | orchestrator | 56f7f1d915c9 registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-03 10:22:11.530113 | orchestrator | b4f3933d08bb registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-03 10:22:11.530122 | orchestrator | 190895d70ce0 registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-03 10:22:11.530131 | orchestrator | 80e94bbbfb3b registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-03 10:22:11.530140 | orchestrator | 1c7b1490d465 registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-03 10:22:11.530149 | orchestrator | c594d9bbb386 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-03 10:22:11.530158 | orchestrator | 929a1ecacac8 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-03 10:22:11.530167 | orchestrator | 3904ce90e410 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-03 10:22:11.530181 | orchestrator | 92c9ed416715 registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-03 10:22:11.530191 | orchestrator | b169f8433f3d registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-03 10:22:11.530200 | orchestrator | cbdd9a3b3142 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-03 10:22:11.530207 | orchestrator | 49019c78f2b4 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-03 10:22:11.530221 | orchestrator | 3fc5ba835c82 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-03 10:22:11.682071 | orchestrator | 2026-04-03 10:22:11.682188 | orchestrator | ## Images @ testbed-node-2 2026-04-03 10:22:11.682213 | orchestrator | 2026-04-03 10:22:11.682230 | orchestrator | + echo 2026-04-03 10:22:11.682247 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-03 10:22:11.682264 | orchestrator | + echo 2026-04-03 10:22:11.682280 | orchestrator | + osism container testbed-node-2 images 2026-04-03 10:22:13.276895 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-03 10:22:13.276992 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 6 days ago 288MB 2026-04-03 10:22:13.277006 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 6 days ago 1.54GB 2026-04-03 10:22:13.277016 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 6 days ago 1.57GB 2026-04-03 10:22:13.277026 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 6 days ago 590MB 2026-04-03 10:22:13.277036 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 6 days ago 277MB 2026-04-03 10:22:13.277045 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 6 days ago 1.04GB 2026-04-03 10:22:13.277055 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 6 days ago 427MB 2026-04-03 10:22:13.277064 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 6 days ago 350MB 2026-04-03 10:22:13.277073 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 6 days ago 683MB 2026-04-03 10:22:13.277083 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 6 days ago 277MB 2026-04-03 10:22:13.277093 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 6 days ago 285MB 2026-04-03 10:22:13.277102 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 6 days ago 293MB 2026-04-03 10:22:13.277112 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 6 days ago 293MB 2026-04-03 10:22:13.277121 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 6 days ago 284MB 2026-04-03 10:22:13.277130 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 6 days ago 284MB 2026-04-03 10:22:13.277140 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 6 days ago 1.2GB 2026-04-03 10:22:13.277149 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 6 days ago 463MB 2026-04-03 10:22:13.277159 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 6 days ago 309MB 2026-04-03 10:22:13.277168 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 6 days ago 368MB 2026-04-03 10:22:13.277178 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 6 days ago 303MB 2026-04-03 10:22:13.277211 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 6 days ago 312MB 2026-04-03 10:22:13.277222 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 6 days ago 317MB 2026-04-03 10:22:13.277232 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 6 days ago 301MB 2026-04-03 10:22:13.277241 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 6 days ago 301MB 2026-04-03 10:22:13.277251 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 6 days ago 301MB 2026-04-03 10:22:13.277261 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 6 days ago 301MB 2026-04-03 10:22:13.277270 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 6 days ago 1.09GB 2026-04-03 10:22:13.277280 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 6 days ago 1.06GB 2026-04-03 10:22:13.277289 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 6 days ago 1.05GB 2026-04-03 10:22:13.277314 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 6 days ago 997MB 2026-04-03 10:22:13.277325 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 6 days ago 996MB 2026-04-03 10:22:13.277334 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 6 days ago 1.07GB 2026-04-03 10:22:13.277344 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 6 days ago 1.07GB 2026-04-03 10:22:13.277353 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 6 days ago 1.05GB 2026-04-03 10:22:13.277363 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 6 days ago 1.05GB 2026-04-03 10:22:13.277372 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 6 days ago 1.05GB 2026-04-03 10:22:13.277382 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 6 days ago 996MB 2026-04-03 10:22:13.277391 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 6 days ago 995MB 2026-04-03 10:22:13.277417 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 6 days ago 995MB 2026-04-03 10:22:13.277427 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 6 days ago 995MB 2026-04-03 10:22:13.277437 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 6 days ago 994MB 2026-04-03 10:22:13.277448 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 6 days ago 1.12GB 2026-04-03 10:22:13.277460 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 6 days ago 1.79GB 2026-04-03 10:22:13.277471 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 6 days ago 1.43GB 2026-04-03 10:22:13.277482 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 6 days ago 1.43GB 2026-04-03 10:22:13.277500 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 6 days ago 1.44GB 2026-04-03 10:22:13.277511 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 6 days ago 1.24GB 2026-04-03 10:22:13.277522 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 6 days ago 1.07GB 2026-04-03 10:22:13.277534 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 6 days ago 1.02GB 2026-04-03 10:22:13.277545 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 6 days ago 1GB 2026-04-03 10:22:13.277556 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 6 days ago 1GB 2026-04-03 10:22:13.277633 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 6 days ago 1GB 2026-04-03 10:22:13.277652 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 6 days ago 1.27GB 2026-04-03 10:22:13.277664 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 6 days ago 1.15GB 2026-04-03 10:22:13.277675 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 6 days ago 1.01GB 2026-04-03 10:22:13.277686 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 6 days ago 1GB 2026-04-03 10:22:13.277696 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 6 days ago 1GB 2026-04-03 10:22:13.277706 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 6 days ago 1.01GB 2026-04-03 10:22:13.277715 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 6 days ago 1GB 2026-04-03 10:22:13.277725 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 6 days ago 1GB 2026-04-03 10:22:13.277742 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 6 days ago 1.23GB 2026-04-03 10:22:13.277752 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 6 days ago 1.39GB 2026-04-03 10:22:13.277762 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 6 days ago 1.23GB 2026-04-03 10:22:13.277772 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 6 days ago 1.23GB 2026-04-03 10:22:13.277781 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 6 days ago 1.07GB 2026-04-03 10:22:13.277791 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 6 days ago 1.07GB 2026-04-03 10:22:13.277800 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 6 days ago 1.07GB 2026-04-03 10:22:13.277810 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 6 days ago 1.24GB 2026-04-03 10:22:13.277819 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 6 days ago 301MB 2026-04-03 10:22:13.277829 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-03 10:22:13.277845 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-03 10:22:13.277855 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-03 10:22:13.277864 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-03 10:22:13.277874 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-03 10:22:13.277884 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-03 10:22:13.277894 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-03 10:22:13.277903 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-03 10:22:13.277913 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-03 10:22:13.277922 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-03 10:22:13.277931 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-03 10:22:13.277941 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-03 10:22:13.277951 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-03 10:22:13.277970 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-03 10:22:13.277980 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-03 10:22:13.277989 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-03 10:22:13.277999 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-03 10:22:13.278008 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-03 10:22:13.278069 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-03 10:22:13.278080 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-03 10:22:13.278089 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-03 10:22:13.278104 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-03 10:22:13.278114 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-03 10:22:13.278124 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-03 10:22:13.278134 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-03 10:22:13.278143 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-03 10:22:13.278160 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-03 10:22:13.278170 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-03 10:22:13.278179 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-03 10:22:13.278189 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-03 10:22:13.278199 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-03 10:22:13.278208 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-03 10:22:13.278218 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-03 10:22:13.278227 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-03 10:22:13.278236 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-03 10:22:13.278246 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-03 10:22:13.278256 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-03 10:22:13.278265 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-03 10:22:13.278275 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-03 10:22:13.278284 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-03 10:22:13.278294 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-03 10:22:13.278304 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-03 10:22:13.278313 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-03 10:22:13.278323 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-03 10:22:13.278332 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-03 10:22:13.278342 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-03 10:22:13.278351 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-03 10:22:13.278361 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-03 10:22:13.278370 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-03 10:22:13.278380 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-03 10:22:13.278390 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-03 10:22:13.278411 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-03 10:22:13.278422 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-03 10:22:13.278431 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-03 10:22:13.278441 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-03 10:22:13.278451 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-03 10:22:13.278460 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-03 10:22:13.278470 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-03 10:22:13.278479 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-03 10:22:13.278489 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-03 10:22:13.278498 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-03 10:22:13.278508 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-03 10:22:13.278517 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-03 10:22:13.278527 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-03 10:22:13.278537 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-03 10:22:13.278546 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-03 10:22:13.278555 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-03 10:22:13.278565 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-03 10:22:13.278626 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 10 months ago 1.27GB 2026-04-03 10:22:13.430359 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-03 10:22:13.438412 | orchestrator | + set -e 2026-04-03 10:22:13.438473 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 10:22:13.438486 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 10:22:13.438497 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 10:22:13.438508 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 10:22:13.438519 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 10:22:13.438530 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 10:22:13.438542 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 10:22:13.438553 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 10:22:13.438564 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 10:22:13.438619 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 10:22:13.438631 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 10:22:13.438642 | orchestrator | ++ export ARA=false 2026-04-03 10:22:13.438653 | orchestrator | ++ ARA=false 2026-04-03 10:22:13.438663 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 10:22:13.438674 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 10:22:13.438685 | orchestrator | ++ export TEMPEST=false 2026-04-03 10:22:13.438696 | orchestrator | ++ TEMPEST=false 2026-04-03 10:22:13.438707 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 10:22:13.438718 | orchestrator | ++ IS_ZUUL=true 2026-04-03 10:22:13.438756 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 10:22:13.438768 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 10:22:13.438778 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 10:22:13.438789 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 10:22:13.438800 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 10:22:13.438810 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 10:22:13.438834 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 10:22:13.438845 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 10:22:13.438856 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 10:22:13.438866 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 10:22:13.438877 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-03 10:22:13.438888 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-03 10:22:13.438899 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-03 10:22:13.438910 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-03 10:22:13.445976 | orchestrator | + set -e 2026-04-03 10:22:13.448055 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 10:22:13.448153 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 10:22:13.448180 | orchestrator | ++ INTERACTIVE=false 2026-04-03 10:22:13.448198 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 10:22:13.448216 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 10:22:13.448234 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 10:22:13.449254 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 10:22:13.454962 | orchestrator | 2026-04-03 10:22:13.455025 | orchestrator | # Ceph status 2026-04-03 10:22:13.455037 | orchestrator | 2026-04-03 10:22:13.455055 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 10:22:13.455070 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 10:22:13.455084 | orchestrator | + echo 2026-04-03 10:22:13.455099 | orchestrator | + echo '# Ceph status' 2026-04-03 10:22:13.455113 | orchestrator | + echo 2026-04-03 10:22:13.455128 | orchestrator | + ceph -s 2026-04-03 10:22:14.120644 | orchestrator | cluster: 2026-04-03 10:22:14.120746 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-03 10:22:14.120762 | orchestrator | health: HEALTH_OK 2026-04-03 10:22:14.120774 | orchestrator | 2026-04-03 10:22:14.120786 | orchestrator | services: 2026-04-03 10:22:14.120798 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 2h) 2026-04-03 10:22:14.120823 | orchestrator | mgr: testbed-node-0(active, since 2h), standbys: testbed-node-1, testbed-node-2 2026-04-03 10:22:14.120835 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-03 10:22:14.120846 | orchestrator | osd: 6 osds: 6 up (since 106m), 6 in (since 4h) 2026-04-03 10:22:14.120858 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-03 10:22:14.120869 | orchestrator | 2026-04-03 10:22:14.120880 | orchestrator | data: 2026-04-03 10:22:14.120891 | orchestrator | volumes: 1/1 healthy 2026-04-03 10:22:14.120902 | orchestrator | pools: 14 pools, 401 pgs 2026-04-03 10:22:14.120913 | orchestrator | objects: 821 objects, 2.8 GiB 2026-04-03 10:22:14.120924 | orchestrator | usage: 7.9 GiB used, 112 GiB / 120 GiB avail 2026-04-03 10:22:14.120935 | orchestrator | pgs: 401 active+clean 2026-04-03 10:22:14.120946 | orchestrator | 2026-04-03 10:22:14.120957 | orchestrator | io: 2026-04-03 10:22:14.120968 | orchestrator | client: 852 B/s rd, 255 B/s wr, 1 op/s rd, 0 op/s wr 2026-04-03 10:22:14.120979 | orchestrator | 2026-04-03 10:22:14.167745 | orchestrator | 2026-04-03 10:22:14.167832 | orchestrator | # Ceph versions 2026-04-03 10:22:14.167845 | orchestrator | 2026-04-03 10:22:14.167855 | orchestrator | + echo 2026-04-03 10:22:14.167865 | orchestrator | + echo '# Ceph versions' 2026-04-03 10:22:14.167877 | orchestrator | + echo 2026-04-03 10:22:14.167886 | orchestrator | + ceph versions 2026-04-03 10:22:14.811904 | orchestrator | { 2026-04-03 10:22:14.812903 | orchestrator | "mon": { 2026-04-03 10:22:14.812939 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 10:22:14.812953 | orchestrator | }, 2026-04-03 10:22:14.812964 | orchestrator | "mgr": { 2026-04-03 10:22:14.812975 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 10:22:14.812986 | orchestrator | }, 2026-04-03 10:22:14.812996 | orchestrator | "osd": { 2026-04-03 10:22:14.813007 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-03 10:22:14.813018 | orchestrator | }, 2026-04-03 10:22:14.813029 | orchestrator | "mds": { 2026-04-03 10:22:14.813039 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 10:22:14.813080 | orchestrator | }, 2026-04-03 10:22:14.813091 | orchestrator | "rgw": { 2026-04-03 10:22:14.813102 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-03 10:22:14.813113 | orchestrator | }, 2026-04-03 10:22:14.813124 | orchestrator | "overall": { 2026-04-03 10:22:14.813135 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-03 10:22:14.813146 | orchestrator | } 2026-04-03 10:22:14.813157 | orchestrator | } 2026-04-03 10:22:14.858486 | orchestrator | 2026-04-03 10:22:14.858610 | orchestrator | # Ceph OSD tree 2026-04-03 10:22:14.858625 | orchestrator | 2026-04-03 10:22:14.858637 | orchestrator | + echo 2026-04-03 10:22:14.858648 | orchestrator | + echo '# Ceph OSD tree' 2026-04-03 10:22:14.858660 | orchestrator | + echo 2026-04-03 10:22:14.858671 | orchestrator | + ceph osd df tree 2026-04-03 10:22:15.478795 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-03 10:22:15.478897 | orchestrator | -1 0.11691 - 120 GiB 7.9 GiB 7.6 GiB 46 KiB 309 MiB 112 GiB 6.62 1.00 - root default 2026-04-03 10:22:15.478912 | orchestrator | -5 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 15 KiB 96 MiB 37 GiB 6.60 1.00 - host testbed-node-3 2026-04-03 10:22:15.478923 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.4 GiB 1.3 GiB 7 KiB 46 MiB 19 GiB 6.91 1.04 190 up osd.1 2026-04-03 10:22:15.478934 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.2 GiB 8 KiB 50 MiB 19 GiB 6.29 0.95 202 up osd.4 2026-04-03 10:22:15.478945 | orchestrator | -3 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 16 KiB 100 MiB 37 GiB 6.61 1.00 - host testbed-node-4 2026-04-03 10:22:15.478956 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.1 GiB 9 KiB 46 MiB 19 GiB 5.76 0.87 189 up osd.0 2026-04-03 10:22:15.478966 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.4 GiB 7 KiB 54 MiB 18 GiB 7.46 1.13 201 up osd.3 2026-04-03 10:22:15.478977 | orchestrator | -7 0.03897 - 40 GiB 2.7 GiB 2.5 GiB 15 KiB 113 MiB 37 GiB 6.64 1.00 - host testbed-node-5 2026-04-03 10:22:15.478988 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1.6 GiB 1.5 GiB 6 KiB 54 MiB 18 GiB 7.79 1.18 191 up osd.2 2026-04-03 10:22:15.478998 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 1.1 GiB 1.0 GiB 9 KiB 58 MiB 19 GiB 5.49 0.83 197 up osd.5 2026-04-03 10:22:15.479009 | orchestrator | TOTAL 120 GiB 7.9 GiB 7.6 GiB 48 KiB 309 MiB 112 GiB 6.62 2026-04-03 10:22:15.479020 | orchestrator | MIN/MAX VAR: 0.83/1.18 STDDEV: 0.84 2026-04-03 10:22:15.520797 | orchestrator | 2026-04-03 10:22:15.520893 | orchestrator | # Ceph monitor status 2026-04-03 10:22:15.520910 | orchestrator | 2026-04-03 10:22:15.520922 | orchestrator | + echo 2026-04-03 10:22:15.520933 | orchestrator | + echo '# Ceph monitor status' 2026-04-03 10:22:15.520944 | orchestrator | + echo 2026-04-03 10:22:15.520955 | orchestrator | + ceph mon stat 2026-04-03 10:22:16.122504 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 34, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-03 10:22:16.174351 | orchestrator | 2026-04-03 10:22:16.174438 | orchestrator | # Ceph quorum status 2026-04-03 10:22:16.174450 | orchestrator | 2026-04-03 10:22:16.174459 | orchestrator | + echo 2026-04-03 10:22:16.174468 | orchestrator | + echo '# Ceph quorum status' 2026-04-03 10:22:16.174476 | orchestrator | + echo 2026-04-03 10:22:16.174485 | orchestrator | + ceph quorum_status 2026-04-03 10:22:16.174495 | orchestrator | + jq 2026-04-03 10:22:16.783360 | orchestrator | { 2026-04-03 10:22:16.783458 | orchestrator | "election_epoch": 34, 2026-04-03 10:22:16.783473 | orchestrator | "quorum": [ 2026-04-03 10:22:16.783485 | orchestrator | 0, 2026-04-03 10:22:16.783496 | orchestrator | 1, 2026-04-03 10:22:16.783507 | orchestrator | 2 2026-04-03 10:22:16.783518 | orchestrator | ], 2026-04-03 10:22:16.783529 | orchestrator | "quorum_names": [ 2026-04-03 10:22:16.783627 | orchestrator | "testbed-node-0", 2026-04-03 10:22:16.783641 | orchestrator | "testbed-node-1", 2026-04-03 10:22:16.783652 | orchestrator | "testbed-node-2" 2026-04-03 10:22:16.783662 | orchestrator | ], 2026-04-03 10:22:16.783674 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-03 10:22:16.783685 | orchestrator | "quorum_age": 8202, 2026-04-03 10:22:16.783696 | orchestrator | "features": { 2026-04-03 10:22:16.783707 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-03 10:22:16.783717 | orchestrator | "quorum_mon": [ 2026-04-03 10:22:16.783728 | orchestrator | "kraken", 2026-04-03 10:22:16.783739 | orchestrator | "luminous", 2026-04-03 10:22:16.783749 | orchestrator | "mimic", 2026-04-03 10:22:16.783760 | orchestrator | "osdmap-prune", 2026-04-03 10:22:16.783771 | orchestrator | "nautilus", 2026-04-03 10:22:16.783781 | orchestrator | "octopus", 2026-04-03 10:22:16.783792 | orchestrator | "pacific", 2026-04-03 10:22:16.783802 | orchestrator | "elector-pinging", 2026-04-03 10:22:16.783813 | orchestrator | "quincy", 2026-04-03 10:22:16.783824 | orchestrator | "reef" 2026-04-03 10:22:16.783834 | orchestrator | ] 2026-04-03 10:22:16.783845 | orchestrator | }, 2026-04-03 10:22:16.783856 | orchestrator | "monmap": { 2026-04-03 10:22:16.783866 | orchestrator | "epoch": 1, 2026-04-03 10:22:16.783877 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-03 10:22:16.783888 | orchestrator | "modified": "2026-04-03T05:38:49.986205Z", 2026-04-03 10:22:16.783899 | orchestrator | "created": "2026-04-03T05:38:49.986205Z", 2026-04-03 10:22:16.783910 | orchestrator | "min_mon_release": 18, 2026-04-03 10:22:16.783921 | orchestrator | "min_mon_release_name": "reef", 2026-04-03 10:22:16.783931 | orchestrator | "election_strategy": 1, 2026-04-03 10:22:16.783942 | orchestrator | "disallowed_leaders: ": "", 2026-04-03 10:22:16.783953 | orchestrator | "stretch_mode": false, 2026-04-03 10:22:16.783963 | orchestrator | "tiebreaker_mon": "", 2026-04-03 10:22:16.783974 | orchestrator | "removed_ranks: ": "", 2026-04-03 10:22:16.783984 | orchestrator | "features": { 2026-04-03 10:22:16.783995 | orchestrator | "persistent": [ 2026-04-03 10:22:16.784006 | orchestrator | "kraken", 2026-04-03 10:22:16.784016 | orchestrator | "luminous", 2026-04-03 10:22:16.784026 | orchestrator | "mimic", 2026-04-03 10:22:16.784037 | orchestrator | "osdmap-prune", 2026-04-03 10:22:16.784048 | orchestrator | "nautilus", 2026-04-03 10:22:16.784058 | orchestrator | "octopus", 2026-04-03 10:22:16.784068 | orchestrator | "pacific", 2026-04-03 10:22:16.784079 | orchestrator | "elector-pinging", 2026-04-03 10:22:16.784090 | orchestrator | "quincy", 2026-04-03 10:22:16.784101 | orchestrator | "reef" 2026-04-03 10:22:16.784112 | orchestrator | ], 2026-04-03 10:22:16.784122 | orchestrator | "optional": [] 2026-04-03 10:22:16.784133 | orchestrator | }, 2026-04-03 10:22:16.784143 | orchestrator | "mons": [ 2026-04-03 10:22:16.784154 | orchestrator | { 2026-04-03 10:22:16.784165 | orchestrator | "rank": 0, 2026-04-03 10:22:16.784175 | orchestrator | "name": "testbed-node-0", 2026-04-03 10:22:16.784186 | orchestrator | "public_addrs": { 2026-04-03 10:22:16.784197 | orchestrator | "addrvec": [ 2026-04-03 10:22:16.784207 | orchestrator | { 2026-04-03 10:22:16.784218 | orchestrator | "type": "v2", 2026-04-03 10:22:16.784229 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-03 10:22:16.784239 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784250 | orchestrator | }, 2026-04-03 10:22:16.784260 | orchestrator | { 2026-04-03 10:22:16.784271 | orchestrator | "type": "v1", 2026-04-03 10:22:16.784282 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-03 10:22:16.784292 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784303 | orchestrator | } 2026-04-03 10:22:16.784313 | orchestrator | ] 2026-04-03 10:22:16.784324 | orchestrator | }, 2026-04-03 10:22:16.784335 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-03 10:22:16.784345 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-03 10:22:16.784356 | orchestrator | "priority": 0, 2026-04-03 10:22:16.784367 | orchestrator | "weight": 0, 2026-04-03 10:22:16.784377 | orchestrator | "crush_location": "{}" 2026-04-03 10:22:16.784388 | orchestrator | }, 2026-04-03 10:22:16.784398 | orchestrator | { 2026-04-03 10:22:16.784409 | orchestrator | "rank": 1, 2026-04-03 10:22:16.784420 | orchestrator | "name": "testbed-node-1", 2026-04-03 10:22:16.784431 | orchestrator | "public_addrs": { 2026-04-03 10:22:16.784442 | orchestrator | "addrvec": [ 2026-04-03 10:22:16.784452 | orchestrator | { 2026-04-03 10:22:16.784463 | orchestrator | "type": "v2", 2026-04-03 10:22:16.784474 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-03 10:22:16.784496 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784507 | orchestrator | }, 2026-04-03 10:22:16.784518 | orchestrator | { 2026-04-03 10:22:16.784529 | orchestrator | "type": "v1", 2026-04-03 10:22:16.784539 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-03 10:22:16.784550 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784576 | orchestrator | } 2026-04-03 10:22:16.784588 | orchestrator | ] 2026-04-03 10:22:16.784598 | orchestrator | }, 2026-04-03 10:22:16.784609 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-03 10:22:16.784620 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-03 10:22:16.784630 | orchestrator | "priority": 0, 2026-04-03 10:22:16.784641 | orchestrator | "weight": 0, 2026-04-03 10:22:16.784652 | orchestrator | "crush_location": "{}" 2026-04-03 10:22:16.784663 | orchestrator | }, 2026-04-03 10:22:16.784673 | orchestrator | { 2026-04-03 10:22:16.784684 | orchestrator | "rank": 2, 2026-04-03 10:22:16.784694 | orchestrator | "name": "testbed-node-2", 2026-04-03 10:22:16.784705 | orchestrator | "public_addrs": { 2026-04-03 10:22:16.784716 | orchestrator | "addrvec": [ 2026-04-03 10:22:16.784726 | orchestrator | { 2026-04-03 10:22:16.784737 | orchestrator | "type": "v2", 2026-04-03 10:22:16.784748 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-03 10:22:16.784758 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784769 | orchestrator | }, 2026-04-03 10:22:16.784779 | orchestrator | { 2026-04-03 10:22:16.784790 | orchestrator | "type": "v1", 2026-04-03 10:22:16.784800 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-03 10:22:16.784811 | orchestrator | "nonce": 0 2026-04-03 10:22:16.784821 | orchestrator | } 2026-04-03 10:22:16.784832 | orchestrator | ] 2026-04-03 10:22:16.784843 | orchestrator | }, 2026-04-03 10:22:16.784853 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-03 10:22:16.784864 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-03 10:22:16.784875 | orchestrator | "priority": 0, 2026-04-03 10:22:16.784885 | orchestrator | "weight": 0, 2026-04-03 10:22:16.784896 | orchestrator | "crush_location": "{}" 2026-04-03 10:22:16.784906 | orchestrator | } 2026-04-03 10:22:16.784917 | orchestrator | ] 2026-04-03 10:22:16.784927 | orchestrator | } 2026-04-03 10:22:16.784938 | orchestrator | } 2026-04-03 10:22:16.784949 | orchestrator | 2026-04-03 10:22:16.784960 | orchestrator | # Ceph free space status 2026-04-03 10:22:16.784971 | orchestrator | 2026-04-03 10:22:16.784982 | orchestrator | + echo 2026-04-03 10:22:16.784993 | orchestrator | + echo '# Ceph free space status' 2026-04-03 10:22:16.785003 | orchestrator | + echo 2026-04-03 10:22:16.785014 | orchestrator | + ceph df 2026-04-03 10:22:17.348400 | orchestrator | --- RAW STORAGE --- 2026-04-03 10:22:17.348475 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-03 10:22:17.348494 | orchestrator | hdd 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.62 2026-04-03 10:22:17.348501 | orchestrator | TOTAL 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.62 2026-04-03 10:22:17.348507 | orchestrator | 2026-04-03 10:22:17.348513 | orchestrator | --- POOLS --- 2026-04-03 10:22:17.348519 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-03 10:22:17.348527 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 52 GiB 2026-04-03 10:22:17.348533 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-03 10:22:17.348538 | orchestrator | cephfs_metadata 3 16 9.2 KiB 22 113 KiB 0 35 GiB 2026-04-03 10:22:17.348544 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-03 10:22:17.348549 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-03 10:22:17.348555 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-03 10:22:17.348599 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-03 10:22:17.348606 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-03 10:22:17.348620 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 52 GiB 2026-04-03 10:22:17.348626 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 10:22:17.348631 | orchestrator | volumes 11 32 325 MiB 267 974 MiB 0.90 35 GiB 2026-04-03 10:22:17.348652 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 5.99 35 GiB 2026-04-03 10:22:17.348658 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 10:22:17.348663 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-03 10:22:17.405824 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-03 10:22:17.468361 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-03 10:22:17.468439 | orchestrator | + osism apply facts 2026-04-03 10:22:18.788291 | orchestrator | 2026-04-03 10:22:18 | INFO  | Prepare task for execution of facts. 2026-04-03 10:22:18.864185 | orchestrator | 2026-04-03 10:22:18 | INFO  | Task 3daf895b-eefa-421b-98c4-067e533c8072 (facts) was prepared for execution. 2026-04-03 10:22:18.864285 | orchestrator | 2026-04-03 10:22:18 | INFO  | It takes a moment until task 3daf895b-eefa-421b-98c4-067e533c8072 (facts) has been started and output is visible here. 2026-04-03 10:22:42.126541 | orchestrator | 2026-04-03 10:22:42.126633 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-03 10:22:42.126644 | orchestrator | 2026-04-03 10:22:42.126652 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-03 10:22:42.126661 | orchestrator | Friday 03 April 2026 10:22:24 +0000 (0:00:02.184) 0:00:02.185 ********** 2026-04-03 10:22:42.126668 | orchestrator | ok: [testbed-manager] 2026-04-03 10:22:42.126676 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:22:42.126683 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:22:42.126691 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:22:42.126698 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:22:42.126705 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:22:42.126712 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:22:42.126719 | orchestrator | 2026-04-03 10:22:42.126726 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-03 10:22:42.126733 | orchestrator | Friday 03 April 2026 10:22:27 +0000 (0:00:03.301) 0:00:05.486 ********** 2026-04-03 10:22:42.126740 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:22:42.126748 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:22:42.126755 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:22:42.126763 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:22:42.126770 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:22:42.126777 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:22:42.126783 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:22:42.126790 | orchestrator | 2026-04-03 10:22:42.126798 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-03 10:22:42.126805 | orchestrator | 2026-04-03 10:22:42.126812 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-03 10:22:42.126819 | orchestrator | Friday 03 April 2026 10:22:31 +0000 (0:00:03.239) 0:00:08.725 ********** 2026-04-03 10:22:42.126826 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:22:42.126833 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:22:42.126840 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:22:42.126847 | orchestrator | ok: [testbed-manager] 2026-04-03 10:22:42.126854 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:22:42.126861 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:22:42.126868 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:22:42.126875 | orchestrator | 2026-04-03 10:22:42.126882 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-03 10:22:42.126889 | orchestrator | 2026-04-03 10:22:42.126896 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-03 10:22:42.126904 | orchestrator | Friday 03 April 2026 10:22:38 +0000 (0:00:07.189) 0:00:15.915 ********** 2026-04-03 10:22:42.126911 | orchestrator | skipping: [testbed-manager] 2026-04-03 10:22:42.126918 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:22:42.126925 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:22:42.126932 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:22:42.126939 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:22:42.126946 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:22:42.126974 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:22:42.126981 | orchestrator | 2026-04-03 10:22:42.126989 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:22:42.126996 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127004 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127012 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127019 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127026 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127033 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127040 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:22:42.127047 | orchestrator | 2026-04-03 10:22:42.127054 | orchestrator | 2026-04-03 10:22:42.127062 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:22:42.127071 | orchestrator | Friday 03 April 2026 10:22:41 +0000 (0:00:03.392) 0:00:19.307 ********** 2026-04-03 10:22:42.127079 | orchestrator | =============================================================================== 2026-04-03 10:22:42.127088 | orchestrator | Gathers facts about hosts ----------------------------------------------- 7.19s 2026-04-03 10:22:42.127096 | orchestrator | Gather facts for all hosts ---------------------------------------------- 3.39s 2026-04-03 10:22:42.127104 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 3.30s 2026-04-03 10:22:42.127112 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 3.24s 2026-04-03 10:22:42.335478 | orchestrator | + osism validate ceph-mons 2026-04-03 10:23:52.914295 | orchestrator | 2026-04-03 10:23:52.914468 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-03 10:23:52.914498 | orchestrator | 2026-04-03 10:23:52.914519 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 10:23:52.914539 | orchestrator | Friday 03 April 2026 10:22:59 +0000 (0:00:01.715) 0:00:01.715 ********** 2026-04-03 10:23:52.914557 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.914575 | orchestrator | 2026-04-03 10:23:52.914594 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 10:23:52.914613 | orchestrator | Friday 03 April 2026 10:23:01 +0000 (0:00:02.840) 0:00:04.556 ********** 2026-04-03 10:23:52.914632 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.914650 | orchestrator | 2026-04-03 10:23:52.914668 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 10:23:52.914686 | orchestrator | Friday 03 April 2026 10:23:03 +0000 (0:00:01.717) 0:00:06.273 ********** 2026-04-03 10:23:52.914706 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.914726 | orchestrator | 2026-04-03 10:23:52.914743 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-03 10:23:52.914755 | orchestrator | Friday 03 April 2026 10:23:04 +0000 (0:00:01.142) 0:00:07.416 ********** 2026-04-03 10:23:52.914766 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.914777 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:23:52.914788 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:23:52.914799 | orchestrator | 2026-04-03 10:23:52.914812 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-03 10:23:52.914849 | orchestrator | Friday 03 April 2026 10:23:06 +0000 (0:00:01.717) 0:00:09.134 ********** 2026-04-03 10:23:52.914864 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:23:52.914876 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.914888 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:23:52.914900 | orchestrator | 2026-04-03 10:23:52.914913 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-03 10:23:52.914925 | orchestrator | Friday 03 April 2026 10:23:09 +0000 (0:00:02.506) 0:00:11.641 ********** 2026-04-03 10:23:52.914955 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.914969 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:23:52.914982 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:23:52.914994 | orchestrator | 2026-04-03 10:23:52.915006 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-03 10:23:52.915018 | orchestrator | Friday 03 April 2026 10:23:10 +0000 (0:00:01.388) 0:00:13.029 ********** 2026-04-03 10:23:52.915030 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915042 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:23:52.915054 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:23:52.915067 | orchestrator | 2026-04-03 10:23:52.915079 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:23:52.915091 | orchestrator | Friday 03 April 2026 10:23:11 +0000 (0:00:01.349) 0:00:14.378 ********** 2026-04-03 10:23:52.915103 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915115 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:23:52.915127 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:23:52.915140 | orchestrator | 2026-04-03 10:23:52.915153 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-03 10:23:52.915166 | orchestrator | Friday 03 April 2026 10:23:13 +0000 (0:00:01.393) 0:00:15.772 ********** 2026-04-03 10:23:52.915178 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915189 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:23:52.915199 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:23:52.915210 | orchestrator | 2026-04-03 10:23:52.915221 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-03 10:23:52.915231 | orchestrator | Friday 03 April 2026 10:23:14 +0000 (0:00:01.416) 0:00:17.188 ********** 2026-04-03 10:23:52.915242 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915253 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:23:52.915264 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:23:52.915274 | orchestrator | 2026-04-03 10:23:52.915285 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:23:52.915296 | orchestrator | Friday 03 April 2026 10:23:16 +0000 (0:00:01.513) 0:00:18.702 ********** 2026-04-03 10:23:52.915307 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915317 | orchestrator | 2026-04-03 10:23:52.915328 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:23:52.915339 | orchestrator | Friday 03 April 2026 10:23:17 +0000 (0:00:01.278) 0:00:19.981 ********** 2026-04-03 10:23:52.915349 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915360 | orchestrator | 2026-04-03 10:23:52.915482 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:23:52.915496 | orchestrator | Friday 03 April 2026 10:23:18 +0000 (0:00:01.286) 0:00:21.268 ********** 2026-04-03 10:23:52.915507 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915518 | orchestrator | 2026-04-03 10:23:52.915529 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:23:52.915539 | orchestrator | Friday 03 April 2026 10:23:19 +0000 (0:00:01.247) 0:00:22.516 ********** 2026-04-03 10:23:52.915550 | orchestrator | 2026-04-03 10:23:52.915561 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:23:52.915572 | orchestrator | Friday 03 April 2026 10:23:20 +0000 (0:00:00.460) 0:00:22.977 ********** 2026-04-03 10:23:52.915582 | orchestrator | 2026-04-03 10:23:52.915593 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:23:52.915623 | orchestrator | Friday 03 April 2026 10:23:21 +0000 (0:00:00.662) 0:00:23.640 ********** 2026-04-03 10:23:52.915634 | orchestrator | 2026-04-03 10:23:52.915645 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:23:52.915656 | orchestrator | Friday 03 April 2026 10:23:21 +0000 (0:00:00.830) 0:00:24.470 ********** 2026-04-03 10:23:52.915666 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915677 | orchestrator | 2026-04-03 10:23:52.915688 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-03 10:23:52.915699 | orchestrator | Friday 03 April 2026 10:23:23 +0000 (0:00:01.286) 0:00:25.757 ********** 2026-04-03 10:23:52.915710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915720 | orchestrator | 2026-04-03 10:23:52.915753 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-03 10:23:52.915765 | orchestrator | Friday 03 April 2026 10:23:24 +0000 (0:00:01.275) 0:00:27.033 ********** 2026-04-03 10:23:52.915776 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915787 | orchestrator | 2026-04-03 10:23:52.915797 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-03 10:23:52.915808 | orchestrator | Friday 03 April 2026 10:23:25 +0000 (0:00:01.156) 0:00:28.189 ********** 2026-04-03 10:23:52.915819 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:23:52.915829 | orchestrator | 2026-04-03 10:23:52.915840 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-03 10:23:52.915851 | orchestrator | Friday 03 April 2026 10:23:28 +0000 (0:00:02.792) 0:00:30.982 ********** 2026-04-03 10:23:52.915861 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915872 | orchestrator | 2026-04-03 10:23:52.915883 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-03 10:23:52.915894 | orchestrator | Friday 03 April 2026 10:23:29 +0000 (0:00:01.431) 0:00:32.413 ********** 2026-04-03 10:23:52.915904 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.915915 | orchestrator | 2026-04-03 10:23:52.915926 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-03 10:23:52.915936 | orchestrator | Friday 03 April 2026 10:23:30 +0000 (0:00:01.175) 0:00:33.589 ********** 2026-04-03 10:23:52.915947 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.915958 | orchestrator | 2026-04-03 10:23:52.915968 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-03 10:23:52.915979 | orchestrator | Friday 03 April 2026 10:23:32 +0000 (0:00:01.331) 0:00:34.921 ********** 2026-04-03 10:23:52.915990 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.916001 | orchestrator | 2026-04-03 10:23:52.916012 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-03 10:23:52.916023 | orchestrator | Friday 03 April 2026 10:23:33 +0000 (0:00:01.284) 0:00:36.206 ********** 2026-04-03 10:23:52.916033 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.916044 | orchestrator | 2026-04-03 10:23:52.916054 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-03 10:23:52.916065 | orchestrator | Friday 03 April 2026 10:23:34 +0000 (0:00:01.155) 0:00:37.361 ********** 2026-04-03 10:23:52.916076 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.916086 | orchestrator | 2026-04-03 10:23:52.916097 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-03 10:23:52.916108 | orchestrator | Friday 03 April 2026 10:23:35 +0000 (0:00:01.204) 0:00:38.565 ********** 2026-04-03 10:23:52.916119 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.916129 | orchestrator | 2026-04-03 10:23:52.916140 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-03 10:23:52.916150 | orchestrator | Friday 03 April 2026 10:23:37 +0000 (0:00:01.165) 0:00:39.731 ********** 2026-04-03 10:23:52.916161 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:23:52.916172 | orchestrator | 2026-04-03 10:23:52.916183 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-03 10:23:52.916193 | orchestrator | Friday 03 April 2026 10:23:39 +0000 (0:00:02.370) 0:00:42.102 ********** 2026-04-03 10:23:52.916212 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.916223 | orchestrator | 2026-04-03 10:23:52.916234 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-03 10:23:52.916245 | orchestrator | Friday 03 April 2026 10:23:40 +0000 (0:00:01.329) 0:00:43.432 ********** 2026-04-03 10:23:52.916255 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.916266 | orchestrator | 2026-04-03 10:23:52.916277 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-03 10:23:52.916288 | orchestrator | Friday 03 April 2026 10:23:41 +0000 (0:00:01.168) 0:00:44.600 ********** 2026-04-03 10:23:52.916298 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:23:52.916309 | orchestrator | 2026-04-03 10:23:52.916320 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-03 10:23:52.916330 | orchestrator | Friday 03 April 2026 10:23:43 +0000 (0:00:01.157) 0:00:45.758 ********** 2026-04-03 10:23:52.916341 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.916352 | orchestrator | 2026-04-03 10:23:52.916378 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-03 10:23:52.916389 | orchestrator | Friday 03 April 2026 10:23:44 +0000 (0:00:01.121) 0:00:46.879 ********** 2026-04-03 10:23:52.916400 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.916411 | orchestrator | 2026-04-03 10:23:52.916422 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 10:23:52.916432 | orchestrator | Friday 03 April 2026 10:23:45 +0000 (0:00:01.193) 0:00:48.073 ********** 2026-04-03 10:23:52.916443 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.916454 | orchestrator | 2026-04-03 10:23:52.916465 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 10:23:52.916475 | orchestrator | Friday 03 April 2026 10:23:46 +0000 (0:00:01.331) 0:00:49.405 ********** 2026-04-03 10:23:52.916486 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:23:52.916496 | orchestrator | 2026-04-03 10:23:52.916507 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:23:52.916518 | orchestrator | Friday 03 April 2026 10:23:48 +0000 (0:00:01.305) 0:00:50.710 ********** 2026-04-03 10:23:52.916528 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.916539 | orchestrator | 2026-04-03 10:23:52.916555 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:23:52.916566 | orchestrator | Friday 03 April 2026 10:23:51 +0000 (0:00:03.016) 0:00:53.727 ********** 2026-04-03 10:23:52.916577 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.916587 | orchestrator | 2026-04-03 10:23:52.916598 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:23:52.916609 | orchestrator | Friday 03 April 2026 10:23:52 +0000 (0:00:01.492) 0:00:55.219 ********** 2026-04-03 10:23:52.916619 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:23:52.916630 | orchestrator | 2026-04-03 10:23:52.916647 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:24:00.097502 | orchestrator | Friday 03 April 2026 10:23:53 +0000 (0:00:01.261) 0:00:56.480 ********** 2026-04-03 10:24:00.097630 | orchestrator | 2026-04-03 10:24:00.097646 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:24:00.097659 | orchestrator | Friday 03 April 2026 10:23:54 +0000 (0:00:00.443) 0:00:56.924 ********** 2026-04-03 10:24:00.097670 | orchestrator | 2026-04-03 10:24:00.097681 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:24:00.097692 | orchestrator | Friday 03 April 2026 10:23:54 +0000 (0:00:00.467) 0:00:57.392 ********** 2026-04-03 10:24:00.097703 | orchestrator | 2026-04-03 10:24:00.097714 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 10:24:00.097724 | orchestrator | Friday 03 April 2026 10:23:55 +0000 (0:00:00.850) 0:00:58.243 ********** 2026-04-03 10:24:00.097736 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:24:00.097774 | orchestrator | 2026-04-03 10:24:00.097786 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:24:00.097796 | orchestrator | Friday 03 April 2026 10:23:58 +0000 (0:00:02.402) 0:01:00.645 ********** 2026-04-03 10:24:00.097807 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-03 10:24:00.097818 | orchestrator |  "msg": [ 2026-04-03 10:24:00.097829 | orchestrator |  "Validator run completed.", 2026-04-03 10:24:00.097840 | orchestrator |  "You can find the report file here:", 2026-04-03 10:24:00.097851 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-03T10:23:00+00:00-report.json", 2026-04-03 10:24:00.097863 | orchestrator |  "on the following host:", 2026-04-03 10:24:00.097874 | orchestrator |  "testbed-manager" 2026-04-03 10:24:00.097885 | orchestrator |  ] 2026-04-03 10:24:00.097895 | orchestrator | } 2026-04-03 10:24:00.097907 | orchestrator | 2026-04-03 10:24:00.097918 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:24:00.097930 | orchestrator | testbed-node-0 : ok=24  changed=4  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-03 10:24:00.097942 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:24:00.097954 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:24:00.097964 | orchestrator | 2026-04-03 10:24:00.097975 | orchestrator | 2026-04-03 10:24:00.097986 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:24:00.097996 | orchestrator | Friday 03 April 2026 10:23:59 +0000 (0:00:01.696) 0:01:02.341 ********** 2026-04-03 10:24:00.098007 | orchestrator | =============================================================================== 2026-04-03 10:24:00.098077 | orchestrator | Aggregate test results step one ----------------------------------------- 3.02s 2026-04-03 10:24:00.098091 | orchestrator | Get timestamp for report file ------------------------------------------- 2.84s 2026-04-03 10:24:00.098101 | orchestrator | Get monmap info from one mon container ---------------------------------- 2.79s 2026-04-03 10:24:00.098112 | orchestrator | Get container info ------------------------------------------------------ 2.51s 2026-04-03 10:24:00.098123 | orchestrator | Write report file ------------------------------------------------------- 2.40s 2026-04-03 10:24:00.098133 | orchestrator | Gather status data ------------------------------------------------------ 2.37s 2026-04-03 10:24:00.098144 | orchestrator | Flush handlers ---------------------------------------------------------- 1.95s 2026-04-03 10:24:00.098165 | orchestrator | Flush handlers ---------------------------------------------------------- 1.76s 2026-04-03 10:24:00.098176 | orchestrator | Prepare test data for container existance test -------------------------- 1.72s 2026-04-03 10:24:00.098186 | orchestrator | Create report output directory ------------------------------------------ 1.72s 2026-04-03 10:24:00.098197 | orchestrator | Print report file information ------------------------------------------- 1.70s 2026-04-03 10:24:00.098207 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 1.51s 2026-04-03 10:24:00.098218 | orchestrator | Aggregate test results step two ----------------------------------------- 1.49s 2026-04-03 10:24:00.098229 | orchestrator | Set quorum test data ---------------------------------------------------- 1.43s 2026-04-03 10:24:00.098240 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 1.42s 2026-04-03 10:24:00.098251 | orchestrator | Prepare test data ------------------------------------------------------- 1.39s 2026-04-03 10:24:00.098261 | orchestrator | Set test result to failed if container is missing ----------------------- 1.39s 2026-04-03 10:24:00.098272 | orchestrator | Set test result to passed if container is existing ---------------------- 1.35s 2026-04-03 10:24:00.098283 | orchestrator | Set validation result to passed if no test failed ----------------------- 1.33s 2026-04-03 10:24:00.098303 | orchestrator | Pass quorum test if all monitors are in quorum -------------------------- 1.33s 2026-04-03 10:24:00.304579 | orchestrator | + osism validate ceph-mgrs 2026-04-03 10:25:04.264435 | orchestrator | 2026-04-03 10:25:04.264553 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-03 10:25:04.264570 | orchestrator | 2026-04-03 10:25:04.264583 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 10:25:04.264595 | orchestrator | Friday 03 April 2026 10:24:17 +0000 (0:00:02.079) 0:00:02.079 ********** 2026-04-03 10:25:04.264606 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.264618 | orchestrator | 2026-04-03 10:25:04.264629 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 10:25:04.264640 | orchestrator | Friday 03 April 2026 10:24:20 +0000 (0:00:02.854) 0:00:04.933 ********** 2026-04-03 10:25:04.264651 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.264662 | orchestrator | 2026-04-03 10:25:04.264673 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 10:25:04.264685 | orchestrator | Friday 03 April 2026 10:24:21 +0000 (0:00:01.751) 0:00:06.685 ********** 2026-04-03 10:25:04.264696 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.264708 | orchestrator | 2026-04-03 10:25:04.264719 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-03 10:25:04.264730 | orchestrator | Friday 03 April 2026 10:24:22 +0000 (0:00:01.105) 0:00:07.790 ********** 2026-04-03 10:25:04.264742 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.264753 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:25:04.264764 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:25:04.264775 | orchestrator | 2026-04-03 10:25:04.264786 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-03 10:25:04.264798 | orchestrator | Friday 03 April 2026 10:24:24 +0000 (0:00:01.784) 0:00:09.575 ********** 2026-04-03 10:25:04.264809 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:25:04.264820 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:25:04.264831 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.264842 | orchestrator | 2026-04-03 10:25:04.264853 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-03 10:25:04.264865 | orchestrator | Friday 03 April 2026 10:24:27 +0000 (0:00:02.614) 0:00:12.190 ********** 2026-04-03 10:25:04.264876 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.264888 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:25:04.264899 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:25:04.264910 | orchestrator | 2026-04-03 10:25:04.264921 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-03 10:25:04.264932 | orchestrator | Friday 03 April 2026 10:24:28 +0000 (0:00:01.430) 0:00:13.620 ********** 2026-04-03 10:25:04.264943 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.264954 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:25:04.264966 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:25:04.264977 | orchestrator | 2026-04-03 10:25:04.264988 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:25:04.264999 | orchestrator | Friday 03 April 2026 10:24:30 +0000 (0:00:01.332) 0:00:14.953 ********** 2026-04-03 10:25:04.265010 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265021 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:25:04.265032 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:25:04.265043 | orchestrator | 2026-04-03 10:25:04.265055 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-03 10:25:04.265066 | orchestrator | Friday 03 April 2026 10:24:31 +0000 (0:00:01.469) 0:00:16.423 ********** 2026-04-03 10:25:04.265077 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265088 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:25:04.265099 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:25:04.265110 | orchestrator | 2026-04-03 10:25:04.265121 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-03 10:25:04.265157 | orchestrator | Friday 03 April 2026 10:24:32 +0000 (0:00:01.305) 0:00:17.728 ********** 2026-04-03 10:25:04.265169 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265181 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:25:04.265192 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:25:04.265203 | orchestrator | 2026-04-03 10:25:04.265214 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:25:04.265225 | orchestrator | Friday 03 April 2026 10:24:34 +0000 (0:00:01.310) 0:00:19.038 ********** 2026-04-03 10:25:04.265264 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265277 | orchestrator | 2026-04-03 10:25:04.265303 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:25:04.265324 | orchestrator | Friday 03 April 2026 10:24:35 +0000 (0:00:01.279) 0:00:20.318 ********** 2026-04-03 10:25:04.265335 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265346 | orchestrator | 2026-04-03 10:25:04.265357 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:25:04.265368 | orchestrator | Friday 03 April 2026 10:24:36 +0000 (0:00:01.280) 0:00:21.598 ********** 2026-04-03 10:25:04.265378 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265389 | orchestrator | 2026-04-03 10:25:04.265400 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.265410 | orchestrator | Friday 03 April 2026 10:24:38 +0000 (0:00:01.295) 0:00:22.894 ********** 2026-04-03 10:25:04.265421 | orchestrator | 2026-04-03 10:25:04.265432 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.265442 | orchestrator | Friday 03 April 2026 10:24:38 +0000 (0:00:00.442) 0:00:23.336 ********** 2026-04-03 10:25:04.265453 | orchestrator | 2026-04-03 10:25:04.265464 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.265474 | orchestrator | Friday 03 April 2026 10:24:39 +0000 (0:00:00.628) 0:00:23.965 ********** 2026-04-03 10:25:04.265485 | orchestrator | 2026-04-03 10:25:04.265496 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:25:04.265506 | orchestrator | Friday 03 April 2026 10:24:39 +0000 (0:00:00.792) 0:00:24.757 ********** 2026-04-03 10:25:04.265517 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265528 | orchestrator | 2026-04-03 10:25:04.265539 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-03 10:25:04.265549 | orchestrator | Friday 03 April 2026 10:24:41 +0000 (0:00:01.314) 0:00:26.072 ********** 2026-04-03 10:25:04.265560 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265571 | orchestrator | 2026-04-03 10:25:04.265599 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-03 10:25:04.265611 | orchestrator | Friday 03 April 2026 10:24:42 +0000 (0:00:01.256) 0:00:27.328 ********** 2026-04-03 10:25:04.265622 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265632 | orchestrator | 2026-04-03 10:25:04.265643 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-03 10:25:04.265654 | orchestrator | Friday 03 April 2026 10:24:43 +0000 (0:00:01.111) 0:00:28.440 ********** 2026-04-03 10:25:04.265665 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:25:04.265676 | orchestrator | 2026-04-03 10:25:04.265687 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-03 10:25:04.265697 | orchestrator | Friday 03 April 2026 10:24:46 +0000 (0:00:03.087) 0:00:31.527 ********** 2026-04-03 10:25:04.265708 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265719 | orchestrator | 2026-04-03 10:25:04.265730 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-03 10:25:04.265741 | orchestrator | Friday 03 April 2026 10:24:47 +0000 (0:00:01.297) 0:00:32.824 ********** 2026-04-03 10:25:04.265751 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265762 | orchestrator | 2026-04-03 10:25:04.265773 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-03 10:25:04.265783 | orchestrator | Friday 03 April 2026 10:24:49 +0000 (0:00:01.318) 0:00:34.143 ********** 2026-04-03 10:25:04.265802 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265813 | orchestrator | 2026-04-03 10:25:04.265824 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-03 10:25:04.265835 | orchestrator | Friday 03 April 2026 10:24:50 +0000 (0:00:01.179) 0:00:35.323 ********** 2026-04-03 10:25:04.265846 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:25:04.265857 | orchestrator | 2026-04-03 10:25:04.265867 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 10:25:04.265878 | orchestrator | Friday 03 April 2026 10:24:51 +0000 (0:00:01.139) 0:00:36.462 ********** 2026-04-03 10:25:04.265889 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.265900 | orchestrator | 2026-04-03 10:25:04.265911 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 10:25:04.265921 | orchestrator | Friday 03 April 2026 10:24:53 +0000 (0:00:01.462) 0:00:37.925 ********** 2026-04-03 10:25:04.265932 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:25:04.265943 | orchestrator | 2026-04-03 10:25:04.265953 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:25:04.265964 | orchestrator | Friday 03 April 2026 10:24:54 +0000 (0:00:01.486) 0:00:39.411 ********** 2026-04-03 10:25:04.265975 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.265986 | orchestrator | 2026-04-03 10:25:04.265996 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:25:04.266007 | orchestrator | Friday 03 April 2026 10:24:57 +0000 (0:00:02.466) 0:00:41.878 ********** 2026-04-03 10:25:04.266069 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.266081 | orchestrator | 2026-04-03 10:25:04.266092 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:25:04.266103 | orchestrator | Friday 03 April 2026 10:24:58 +0000 (0:00:01.373) 0:00:43.252 ********** 2026-04-03 10:25:04.266130 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.266142 | orchestrator | 2026-04-03 10:25:04.266153 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.266164 | orchestrator | Friday 03 April 2026 10:24:59 +0000 (0:00:01.257) 0:00:44.510 ********** 2026-04-03 10:25:04.266174 | orchestrator | 2026-04-03 10:25:04.266185 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.266196 | orchestrator | Friday 03 April 2026 10:25:00 +0000 (0:00:00.447) 0:00:44.957 ********** 2026-04-03 10:25:04.266207 | orchestrator | 2026-04-03 10:25:04.266218 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:25:04.266228 | orchestrator | Friday 03 April 2026 10:25:00 +0000 (0:00:00.479) 0:00:45.437 ********** 2026-04-03 10:25:04.266287 | orchestrator | 2026-04-03 10:25:04.266299 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 10:25:04.266310 | orchestrator | Friday 03 April 2026 10:25:01 +0000 (0:00:00.858) 0:00:46.296 ********** 2026-04-03 10:25:04.266321 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:04.266331 | orchestrator | 2026-04-03 10:25:04.266342 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:25:04.266353 | orchestrator | Friday 03 April 2026 10:25:03 +0000 (0:00:02.364) 0:00:48.660 ********** 2026-04-03 10:25:04.266363 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-03 10:25:04.266374 | orchestrator |  "msg": [ 2026-04-03 10:25:04.266385 | orchestrator |  "Validator run completed.", 2026-04-03 10:25:04.266396 | orchestrator |  "You can find the report file here:", 2026-04-03 10:25:04.266407 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-03T10:24:18+00:00-report.json", 2026-04-03 10:25:04.266419 | orchestrator |  "on the following host:", 2026-04-03 10:25:04.266430 | orchestrator |  "testbed-manager" 2026-04-03 10:25:04.266441 | orchestrator |  ] 2026-04-03 10:25:04.266460 | orchestrator | } 2026-04-03 10:25:04.266471 | orchestrator | 2026-04-03 10:25:04.266482 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:25:04.266494 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 10:25:04.266506 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:25:04.266530 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:25:06.049133 | orchestrator | 2026-04-03 10:25:06.049205 | orchestrator | 2026-04-03 10:25:06.049212 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:25:06.049219 | orchestrator | Friday 03 April 2026 10:25:05 +0000 (0:00:01.798) 0:00:50.458 ********** 2026-04-03 10:25:06.049223 | orchestrator | =============================================================================== 2026-04-03 10:25:06.049228 | orchestrator | Gather list of mgr modules ---------------------------------------------- 3.09s 2026-04-03 10:25:06.049263 | orchestrator | Get timestamp for report file ------------------------------------------- 2.85s 2026-04-03 10:25:06.049269 | orchestrator | Get container info ------------------------------------------------------ 2.61s 2026-04-03 10:25:06.049273 | orchestrator | Aggregate test results step one ----------------------------------------- 2.47s 2026-04-03 10:25:06.049278 | orchestrator | Write report file ------------------------------------------------------- 2.36s 2026-04-03 10:25:06.049282 | orchestrator | Flush handlers ---------------------------------------------------------- 1.86s 2026-04-03 10:25:06.049286 | orchestrator | Print report file information ------------------------------------------- 1.80s 2026-04-03 10:25:06.049291 | orchestrator | Flush handlers ---------------------------------------------------------- 1.79s 2026-04-03 10:25:06.049295 | orchestrator | Prepare test data for container existance test -------------------------- 1.79s 2026-04-03 10:25:06.049299 | orchestrator | Create report output directory ------------------------------------------ 1.75s 2026-04-03 10:25:06.049303 | orchestrator | Set validation result to failed if a test failed ------------------------ 1.49s 2026-04-03 10:25:06.049307 | orchestrator | Prepare test data ------------------------------------------------------- 1.47s 2026-04-03 10:25:06.049311 | orchestrator | Set validation result to passed if no test failed ----------------------- 1.46s 2026-04-03 10:25:06.049316 | orchestrator | Set test result to failed if container is missing ----------------------- 1.43s 2026-04-03 10:25:06.049320 | orchestrator | Aggregate test results step two ----------------------------------------- 1.37s 2026-04-03 10:25:06.049324 | orchestrator | Set test result to passed if container is existing ---------------------- 1.33s 2026-04-03 10:25:06.049328 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 1.32s 2026-04-03 10:25:06.049332 | orchestrator | Print report file information ------------------------------------------- 1.31s 2026-04-03 10:25:06.049336 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 1.31s 2026-04-03 10:25:06.049340 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 1.31s 2026-04-03 10:25:06.252956 | orchestrator | + osism validate ceph-osds 2026-04-03 10:25:39.102392 | orchestrator | 2026-04-03 10:25:39.102470 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-03 10:25:39.102477 | orchestrator | 2026-04-03 10:25:39.102482 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-03 10:25:39.102486 | orchestrator | Friday 03 April 2026 10:25:23 +0000 (0:00:01.917) 0:00:01.917 ********** 2026-04-03 10:25:39.102491 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:39.102495 | orchestrator | 2026-04-03 10:25:39.102499 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-03 10:25:39.102503 | orchestrator | Friday 03 April 2026 10:25:26 +0000 (0:00:02.782) 0:00:04.700 ********** 2026-04-03 10:25:39.102520 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:39.102524 | orchestrator | 2026-04-03 10:25:39.102528 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-03 10:25:39.102531 | orchestrator | Friday 03 April 2026 10:25:27 +0000 (0:00:01.267) 0:00:05.968 ********** 2026-04-03 10:25:39.102535 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:25:39.102539 | orchestrator | 2026-04-03 10:25:39.102543 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-03 10:25:39.102546 | orchestrator | Friday 03 April 2026 10:25:29 +0000 (0:00:01.724) 0:00:07.692 ********** 2026-04-03 10:25:39.102550 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:25:39.102555 | orchestrator | 2026-04-03 10:25:39.102558 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-03 10:25:39.102562 | orchestrator | Friday 03 April 2026 10:25:30 +0000 (0:00:01.147) 0:00:08.840 ********** 2026-04-03 10:25:39.102566 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:25:39.102570 | orchestrator | 2026-04-03 10:25:39.102574 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-03 10:25:39.102577 | orchestrator | Friday 03 April 2026 10:25:31 +0000 (0:00:01.154) 0:00:09.994 ********** 2026-04-03 10:25:39.102581 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:25:39.102585 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:25:39.102588 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:25:39.102592 | orchestrator | 2026-04-03 10:25:39.102596 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-03 10:25:39.102599 | orchestrator | Friday 03 April 2026 10:25:33 +0000 (0:00:01.890) 0:00:11.884 ********** 2026-04-03 10:25:39.102603 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:25:39.102607 | orchestrator | 2026-04-03 10:25:39.102610 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-03 10:25:39.102614 | orchestrator | Friday 03 April 2026 10:25:34 +0000 (0:00:01.148) 0:00:13.033 ********** 2026-04-03 10:25:39.102618 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:25:39.102621 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:25:39.102626 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:25:39.102629 | orchestrator | 2026-04-03 10:25:39.102633 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-03 10:25:39.102637 | orchestrator | Friday 03 April 2026 10:25:35 +0000 (0:00:01.517) 0:00:14.551 ********** 2026-04-03 10:25:39.102640 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:25:39.102644 | orchestrator | 2026-04-03 10:25:39.102648 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:25:39.102661 | orchestrator | Friday 03 April 2026 10:25:37 +0000 (0:00:01.376) 0:00:15.927 ********** 2026-04-03 10:25:39.102665 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:25:39.102669 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:25:39.102673 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:25:39.102676 | orchestrator | 2026-04-03 10:25:39.102680 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-03 10:25:39.102684 | orchestrator | Friday 03 April 2026 10:25:38 +0000 (0:00:01.367) 0:00:17.295 ********** 2026-04-03 10:25:39.102689 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'd594e5fb2e87c9288eb9c38c40e702f47eff5c8b74c65a74d4c50f8293782090', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 5 minutes'})  2026-04-03 10:25:39.102696 | orchestrator | skipping: [testbed-node-3] => (item={'id': '3d1ca0ee0e683e6bdd60f6380ec39ea38042d167cd05545c3d4f59e13696edd1', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-03 10:25:39.102701 | orchestrator | skipping: [testbed-node-3] => (item={'id': '539c25f71eb8b9e2b78063eeb971fe9dbf02be9d701a6954f999e34229b5c4b2', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-03 10:25:39.102708 | orchestrator | skipping: [testbed-node-3] => (item={'id': '30dea1984e88e8c7afd50683aae81e87f23b14e4297fde95f453fe78605269d2', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-03 10:25:39.102712 | orchestrator | skipping: [testbed-node-3] => (item={'id': '097373e4ac17262e2d5781d547f541019ac11667303094a176e268fbb8d61ba7', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 10:25:39.102727 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f2db9925113ef64bff3dc8570f3811aa8aa085c7a2a8d6ffcbae905955fd8827', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 56 minutes (healthy)'})  2026-04-03 10:25:39.102732 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f85d7f383c186cdf0b00f24d1c1bfdc09d1cd2c1aa8ecdaf09000fa60091a95e', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 56 minutes (healthy)'})  2026-04-03 10:25:39.102736 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'e3e4a49874c84595045ae14cd17fa6189ba41967e46abf8478a677ff6c49c036', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 10:25:39.102748 | orchestrator | skipping: [testbed-node-3] => (item={'id': '0c02b1ea6315e0e2c6f194d23da5daea1e735d19d1addc23ef3914d398b3be8f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 10:25:39.102752 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'eb646ae3afd98ef4eb87ea2f955e873a996d0ba8f0f7fac94793f2d63d2a9e99', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 10:25:39.102755 | orchestrator | skipping: [testbed-node-3] => (item={'id': '171333058cdbe6020b3fe10d6cdd38984e3c7f3bf2c19935d400586249b4c90d', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 10:25:39.102761 | orchestrator | ok: [testbed-node-3] => (item={'id': 'bdf0fe37fa932b8f0fec8e836337b0264f8228ecd2efff9244480d1db2a24655', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:25:39.102766 | orchestrator | ok: [testbed-node-3] => (item={'id': 'cdf1de99b1c2ab6da075e67e07bb970c8652440f3ea2a0d26965b7faf907fa34', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:25:39.102772 | orchestrator | skipping: [testbed-node-3] => (item={'id': '5c2d8559b4784b468b0cbc7a70fe2747879e5f8619bcaadea4571aafa217f557', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.102776 | orchestrator | skipping: [testbed-node-3] => (item={'id': '3053a64f21154c33d70741a7b6894c8023a2b2922e16a053fd7f8ca19e9f7a17', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:25:39.102780 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f248c8cd0ecb8839df3228f261af469567357eec6df9dfb0d179b8e398c730a0', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:25:39.102787 | orchestrator | skipping: [testbed-node-3] => (item={'id': '4ccc62efedbd687111b7f8fe9a72d6b014f89519b98b222a391c7404f8813e2b', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.102791 | orchestrator | skipping: [testbed-node-3] => (item={'id': '15d8271f4ee1cdcdb79f4424ab3e9eff14281ad12d93dd1f6a973e4e6a1c7dc7', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.102795 | orchestrator | skipping: [testbed-node-3] => (item={'id': '5c415fd0d93f6043dc1492b0407ffd35b1319ac7035fb6174b41f0496c0d665f', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.102799 | orchestrator | skipping: [testbed-node-4] => (item={'id': '21f92a2c590b48e33dd124c43e844f7c84b265420ce4a3a0305958b7ffd2d11d', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 5 minutes'})  2026-04-03 10:25:39.102805 | orchestrator | skipping: [testbed-node-4] => (item={'id': '9876289f16c605a44fd08d09b0af13ba4fbab2b040815313660e43b517d147d5', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-03 10:25:39.272245 | orchestrator | skipping: [testbed-node-4] => (item={'id': '8086cfad43d589c8de7043cdc77dd12f6be1d7176511ad661a9593ed9a883a53', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-03 10:25:39.272346 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'cc0ff62612d3b019b36cc8975b1feaa2a61c72e0732984268f9ee67d22a6c629', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-03 10:25:39.272364 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'afd95e77501ab415b16ceb2077b65d2852453447cc00a75405cfa5d9b8da62f8', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 10:25:39.272377 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'bdb5c1efc45eec8e1a7df6e09401c14fbb8177777a0aaa47e6b7af463bf4a379', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 55 minutes (healthy)'})  2026-04-03 10:25:39.272389 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'c7fd8355d960377bc1764c425e42a95fbbcdb68c422f27883f50ca04d4b65f2b', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 56 minutes (healthy)'})  2026-04-03 10:25:39.272401 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'bbd769f4426b8689ed10a2c8f96371bd235e145b1d6fc071424c2edb602b921d', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 10:25:39.272431 | orchestrator | skipping: [testbed-node-4] => (item={'id': '4e5c0d885f0ef2642d9da5655acf7a066f69c2bbf55f63902f3870b593473b1b', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 10:25:39.272443 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ac71e3d573690e296c7644477201a9da5116b4cf1022c92be6fb536043e56460', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 10:25:39.272474 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'fdf85ac072a9b03e9fd4c3f1852fb4811d970e26950041d4b99f37f79611352a', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 10:25:39.272488 | orchestrator | ok: [testbed-node-4] => (item={'id': '3f2115bb05342b99625398aac704dc22dff131087babb04ffd3529d765dca5dd', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:25:39.272500 | orchestrator | ok: [testbed-node-4] => (item={'id': '1080175cd6d6ab359cbeb40db56d9549c66440f02019bf7148bcde2b7dbdf4b4', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:25:39.272511 | orchestrator | skipping: [testbed-node-4] => (item={'id': '5385ae349555b6e941192236625255f6b4cb7c5398b40248d6a0fc1f209f5edc', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.272522 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'b9e49fb4c3fca620fecc91e934835d2acab033bf23985cf6d570401f679e6b8e', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:25:39.272533 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'fcc934755cc68f8a2545df41be2ba537b19242e390c672ab877b3a351bd87294', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:25:39.272563 | orchestrator | skipping: [testbed-node-4] => (item={'id': '744c9483b0a8331d275f4f026e2c6e0fa434c59eb1b850916095ee593d60d22d', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.272575 | orchestrator | skipping: [testbed-node-4] => (item={'id': '2e78b5ad371abf6031fcd8044b71830292279e4522c0f199841baaf879c10f18', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.272586 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'd110e5a55430c785f4c7a79d5639524d066dbfc9a5e569ba4c117311d2478ff6', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:25:39.272598 | orchestrator | skipping: [testbed-node-5] => (item={'id': '28cc6570779e40a3beaf1b8a300a19b603a15141da76643f98f9e61a95d09d09', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 5 minutes'})  2026-04-03 10:25:39.272609 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'e4cc2a14d7d0ec5626ccdd5513985eea6ee560adc183bed597456b2114e850eb', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-03 10:25:39.272620 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'a87816a3500e3d59e02357dfd526f3befded40bd90a919fb397784e946aace78', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-03 10:25:39.272631 | orchestrator | skipping: [testbed-node-5] => (item={'id': '21e51f6856cde29a4c463f72ae474c4920fd259588444a8e41e9a9e8fe8a9a2a', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-03 10:25:39.272642 | orchestrator | skipping: [testbed-node-5] => (item={'id': '3e6a5f672fdbc4eb3315c61bd4e9950c741c7f385ab02b4de041ff76246c8070', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-03 10:25:39.272660 | orchestrator | skipping: [testbed-node-5] => (item={'id': '5faa416bbd2b97c9c050791de1d89336c6256fec039a85a400c535c34b8baf00', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 55 minutes (healthy)'})  2026-04-03 10:25:39.272678 | orchestrator | skipping: [testbed-node-5] => (item={'id': '6559f612d045342349f26bb07b984f963171b2ed54cf82b62902462f1d3099a9', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 56 minutes (healthy)'})  2026-04-03 10:25:39.272690 | orchestrator | skipping: [testbed-node-5] => (item={'id': '67da8c11e97933495624835fe675316dcc374145cbc9ebee1525bed03726bb25', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-03 10:25:39.272701 | orchestrator | skipping: [testbed-node-5] => (item={'id': '5c64a02a5e05a7d5e8964e8ced4d1e37535ebbb59aad405b9cc8a17aadf75d1f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 10:25:39.272712 | orchestrator | skipping: [testbed-node-5] => (item={'id': '1dea3a30525521afd3b1545946046fd0c299aec3e4eb61a2fb26e7d2d6ba28db', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-03 10:25:39.272723 | orchestrator | skipping: [testbed-node-5] => (item={'id': '12d09a386f335867db73be0fdeef3f1729a5ca58023e7c40bd8247ca6e60347f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-03 10:25:39.272734 | orchestrator | ok: [testbed-node-5] => (item={'id': 'c53aa49c3e4979fcd9edb219da06690330cf98a2f5b5065eed726643254da3e7', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:25:39.272752 | orchestrator | ok: [testbed-node-5] => (item={'id': '0dadec5b2bfa880a80e9e55ff0d2a418a7c7155f5c5ba2bdd086b75e288bf910', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-03 10:26:17.201824 | orchestrator | skipping: [testbed-node-5] => (item={'id': '61929e7a2531284c5940796febf6d6f3a105490723a945ffc80936257ce05c7d', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:26:17.201942 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'e68e3d1906261817d5a3cd799e5b019d6d564c5b9fc3350edb5224630700824a', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:26:17.201961 | orchestrator | skipping: [testbed-node-5] => (item={'id': '6ab137ebb192108ffa179084c4d0eb2dedd5ce357f53161c4e3947ad217d4a92', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-03 10:26:17.201974 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'c4339d106df41c94c14970df608cf618e6029ddee2af09678e88557873cc6040', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:26:17.201986 | orchestrator | skipping: [testbed-node-5] => (item={'id': '1045a92899a895150f8bb90e59644c7667761f9a4d4265895fd64f05ae0489b5', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:26:17.202102 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2b43336d9a2e8a4d4938d29371051855ff5499b93fdcc13d0de5a8bb84eecf8f', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-03 10:26:17.202154 | orchestrator | 2026-04-03 10:26:17.202177 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-03 10:26:17.202218 | orchestrator | Friday 03 April 2026 10:25:40 +0000 (0:00:01.804) 0:00:19.099 ********** 2026-04-03 10:26:17.202236 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.202267 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.202285 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.202304 | orchestrator | 2026-04-03 10:26:17.202323 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-03 10:26:17.202342 | orchestrator | Friday 03 April 2026 10:25:41 +0000 (0:00:01.399) 0:00:20.499 ********** 2026-04-03 10:26:17.202361 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.202380 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:17.202398 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:17.202417 | orchestrator | 2026-04-03 10:26:17.202438 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-03 10:26:17.202459 | orchestrator | Friday 03 April 2026 10:25:43 +0000 (0:00:01.387) 0:00:21.886 ********** 2026-04-03 10:26:17.202480 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.202499 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.202517 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.202535 | orchestrator | 2026-04-03 10:26:17.202554 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:26:17.202573 | orchestrator | Friday 03 April 2026 10:25:44 +0000 (0:00:01.410) 0:00:23.296 ********** 2026-04-03 10:26:17.202595 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.202614 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.202632 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.202649 | orchestrator | 2026-04-03 10:26:17.202668 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-03 10:26:17.202687 | orchestrator | Friday 03 April 2026 10:25:46 +0000 (0:00:01.586) 0:00:24.883 ********** 2026-04-03 10:26:17.202707 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-03 10:26:17.202727 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-03 10:26:17.202746 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.202765 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-03 10:26:17.202784 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-03 10:26:17.202803 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:17.202821 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-03 10:26:17.202839 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-03 10:26:17.202858 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:17.202876 | orchestrator | 2026-04-03 10:26:17.202896 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-03 10:26:17.202912 | orchestrator | Friday 03 April 2026 10:25:47 +0000 (0:00:01.444) 0:00:26.327 ********** 2026-04-03 10:26:17.202923 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.202934 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.202944 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.202955 | orchestrator | 2026-04-03 10:26:17.202966 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-03 10:26:17.202976 | orchestrator | Friday 03 April 2026 10:25:49 +0000 (0:00:01.405) 0:00:27.733 ********** 2026-04-03 10:26:17.203007 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203031 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:17.203042 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:17.203053 | orchestrator | 2026-04-03 10:26:17.203063 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-03 10:26:17.203074 | orchestrator | Friday 03 April 2026 10:25:51 +0000 (0:00:02.115) 0:00:29.848 ********** 2026-04-03 10:26:17.203085 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203095 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:17.203106 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:17.203117 | orchestrator | 2026-04-03 10:26:17.203191 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-03 10:26:17.203204 | orchestrator | Friday 03 April 2026 10:25:52 +0000 (0:00:01.398) 0:00:31.247 ********** 2026-04-03 10:26:17.203215 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.203226 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.203237 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.203248 | orchestrator | 2026-04-03 10:26:17.203259 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:26:17.203270 | orchestrator | Friday 03 April 2026 10:25:53 +0000 (0:00:01.349) 0:00:32.597 ********** 2026-04-03 10:26:17.203281 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203292 | orchestrator | 2026-04-03 10:26:17.203303 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:26:17.203314 | orchestrator | Friday 03 April 2026 10:25:55 +0000 (0:00:01.297) 0:00:33.895 ********** 2026-04-03 10:26:17.203325 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203336 | orchestrator | 2026-04-03 10:26:17.203347 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:26:17.203357 | orchestrator | Friday 03 April 2026 10:25:56 +0000 (0:00:01.312) 0:00:35.207 ********** 2026-04-03 10:26:17.203368 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203379 | orchestrator | 2026-04-03 10:26:17.203390 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:17.203401 | orchestrator | Friday 03 April 2026 10:25:57 +0000 (0:00:01.264) 0:00:36.472 ********** 2026-04-03 10:26:17.203411 | orchestrator | 2026-04-03 10:26:17.203422 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:17.203433 | orchestrator | Friday 03 April 2026 10:25:58 +0000 (0:00:00.601) 0:00:37.074 ********** 2026-04-03 10:26:17.203444 | orchestrator | 2026-04-03 10:26:17.203455 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:17.203465 | orchestrator | Friday 03 April 2026 10:25:58 +0000 (0:00:00.475) 0:00:37.550 ********** 2026-04-03 10:26:17.203476 | orchestrator | 2026-04-03 10:26:17.203495 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:26:17.203506 | orchestrator | Friday 03 April 2026 10:25:59 +0000 (0:00:00.794) 0:00:38.345 ********** 2026-04-03 10:26:17.203517 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203527 | orchestrator | 2026-04-03 10:26:17.203538 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-03 10:26:17.203549 | orchestrator | Friday 03 April 2026 10:26:00 +0000 (0:00:01.297) 0:00:39.642 ********** 2026-04-03 10:26:17.203560 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203571 | orchestrator | 2026-04-03 10:26:17.203582 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:26:17.203593 | orchestrator | Friday 03 April 2026 10:26:02 +0000 (0:00:01.287) 0:00:40.930 ********** 2026-04-03 10:26:17.203604 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.203616 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.203634 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.203662 | orchestrator | 2026-04-03 10:26:17.203683 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-03 10:26:17.203702 | orchestrator | Friday 03 April 2026 10:26:03 +0000 (0:00:01.381) 0:00:42.311 ********** 2026-04-03 10:26:17.203732 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.203749 | orchestrator | 2026-04-03 10:26:17.203766 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-03 10:26:17.203785 | orchestrator | Friday 03 April 2026 10:26:04 +0000 (0:00:01.257) 0:00:43.569 ********** 2026-04-03 10:26:17.203803 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-03 10:26:17.203822 | orchestrator | 2026-04-03 10:26:17.203841 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-03 10:26:17.203855 | orchestrator | Friday 03 April 2026 10:26:08 +0000 (0:00:03.617) 0:00:47.186 ********** 2026-04-03 10:26:17.203866 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.203876 | orchestrator | 2026-04-03 10:26:17.203887 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-03 10:26:17.203897 | orchestrator | Friday 03 April 2026 10:26:09 +0000 (0:00:01.163) 0:00:48.350 ********** 2026-04-03 10:26:17.203908 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.203919 | orchestrator | 2026-04-03 10:26:17.203929 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-03 10:26:17.203940 | orchestrator | Friday 03 April 2026 10:26:11 +0000 (0:00:01.325) 0:00:49.676 ********** 2026-04-03 10:26:17.203950 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:17.203961 | orchestrator | 2026-04-03 10:26:17.203971 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-03 10:26:17.203982 | orchestrator | Friday 03 April 2026 10:26:12 +0000 (0:00:01.130) 0:00:50.807 ********** 2026-04-03 10:26:17.203992 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.204003 | orchestrator | 2026-04-03 10:26:17.204013 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:26:17.204024 | orchestrator | Friday 03 April 2026 10:26:13 +0000 (0:00:01.144) 0:00:51.952 ********** 2026-04-03 10:26:17.204034 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:17.204045 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:17.204056 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:17.204066 | orchestrator | 2026-04-03 10:26:17.204077 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-03 10:26:17.204087 | orchestrator | Friday 03 April 2026 10:26:14 +0000 (0:00:01.324) 0:00:53.276 ********** 2026-04-03 10:26:17.204098 | orchestrator | changed: [testbed-node-3] 2026-04-03 10:26:17.204108 | orchestrator | changed: [testbed-node-4] 2026-04-03 10:26:17.204174 | orchestrator | changed: [testbed-node-5] 2026-04-03 10:26:48.677617 | orchestrator | 2026-04-03 10:26:48.677707 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-03 10:26:48.677717 | orchestrator | Friday 03 April 2026 10:26:18 +0000 (0:00:03.729) 0:00:57.006 ********** 2026-04-03 10:26:48.677725 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.677732 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.677739 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.677746 | orchestrator | 2026-04-03 10:26:48.677753 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-03 10:26:48.677760 | orchestrator | Friday 03 April 2026 10:26:19 +0000 (0:00:01.337) 0:00:58.343 ********** 2026-04-03 10:26:48.677767 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.677773 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.677780 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.677786 | orchestrator | 2026-04-03 10:26:48.677793 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-03 10:26:48.677800 | orchestrator | Friday 03 April 2026 10:26:21 +0000 (0:00:01.555) 0:00:59.898 ********** 2026-04-03 10:26:48.677828 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:48.677837 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:48.677843 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:48.677850 | orchestrator | 2026-04-03 10:26:48.677857 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-03 10:26:48.677863 | orchestrator | Friday 03 April 2026 10:26:22 +0000 (0:00:01.339) 0:01:01.238 ********** 2026-04-03 10:26:48.677890 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.677896 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.677903 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.677909 | orchestrator | 2026-04-03 10:26:48.677916 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-03 10:26:48.677923 | orchestrator | Friday 03 April 2026 10:26:23 +0000 (0:00:01.334) 0:01:02.572 ********** 2026-04-03 10:26:48.677929 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:48.677936 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:48.677943 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:48.677949 | orchestrator | 2026-04-03 10:26:48.677956 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-03 10:26:48.677962 | orchestrator | Friday 03 April 2026 10:26:25 +0000 (0:00:01.531) 0:01:04.103 ********** 2026-04-03 10:26:48.677969 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:48.677975 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:48.677982 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:48.677988 | orchestrator | 2026-04-03 10:26:48.677995 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-03 10:26:48.678050 | orchestrator | Friday 03 April 2026 10:26:26 +0000 (0:00:01.284) 0:01:05.388 ********** 2026-04-03 10:26:48.678058 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.678066 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.678072 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.678114 | orchestrator | 2026-04-03 10:26:48.678122 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-03 10:26:48.678129 | orchestrator | Friday 03 April 2026 10:26:28 +0000 (0:00:01.575) 0:01:06.964 ********** 2026-04-03 10:26:48.678135 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.678142 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.678149 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.678155 | orchestrator | 2026-04-03 10:26:48.678162 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-03 10:26:48.678176 | orchestrator | Friday 03 April 2026 10:26:29 +0000 (0:00:01.541) 0:01:08.506 ********** 2026-04-03 10:26:48.678185 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.678192 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.678199 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.678207 | orchestrator | 2026-04-03 10:26:48.678215 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-03 10:26:48.678222 | orchestrator | Friday 03 April 2026 10:26:31 +0000 (0:00:01.679) 0:01:10.185 ********** 2026-04-03 10:26:48.678230 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:48.678237 | orchestrator | skipping: [testbed-node-4] 2026-04-03 10:26:48.678244 | orchestrator | skipping: [testbed-node-5] 2026-04-03 10:26:48.678252 | orchestrator | 2026-04-03 10:26:48.678260 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-03 10:26:48.678267 | orchestrator | Friday 03 April 2026 10:26:32 +0000 (0:00:01.343) 0:01:11.528 ********** 2026-04-03 10:26:48.678274 | orchestrator | ok: [testbed-node-3] 2026-04-03 10:26:48.678282 | orchestrator | ok: [testbed-node-4] 2026-04-03 10:26:48.678290 | orchestrator | ok: [testbed-node-5] 2026-04-03 10:26:48.678297 | orchestrator | 2026-04-03 10:26:48.678305 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-03 10:26:48.678312 | orchestrator | Friday 03 April 2026 10:26:34 +0000 (0:00:01.382) 0:01:12.911 ********** 2026-04-03 10:26:48.678320 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:26:48.678328 | orchestrator | 2026-04-03 10:26:48.678336 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-03 10:26:48.678343 | orchestrator | Friday 03 April 2026 10:26:35 +0000 (0:00:01.300) 0:01:14.212 ********** 2026-04-03 10:26:48.678351 | orchestrator | skipping: [testbed-node-3] 2026-04-03 10:26:48.678359 | orchestrator | 2026-04-03 10:26:48.678366 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-03 10:26:48.678374 | orchestrator | Friday 03 April 2026 10:26:37 +0000 (0:00:01.497) 0:01:15.709 ********** 2026-04-03 10:26:48.678388 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:26:48.678396 | orchestrator | 2026-04-03 10:26:48.678403 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-03 10:26:48.678411 | orchestrator | Friday 03 April 2026 10:26:39 +0000 (0:00:02.716) 0:01:18.426 ********** 2026-04-03 10:26:48.678418 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:26:48.678426 | orchestrator | 2026-04-03 10:26:48.678433 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-03 10:26:48.678441 | orchestrator | Friday 03 April 2026 10:26:41 +0000 (0:00:01.325) 0:01:19.752 ********** 2026-04-03 10:26:48.678449 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:26:48.678456 | orchestrator | 2026-04-03 10:26:48.678483 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:48.678496 | orchestrator | Friday 03 April 2026 10:26:42 +0000 (0:00:01.278) 0:01:21.031 ********** 2026-04-03 10:26:48.678508 | orchestrator | 2026-04-03 10:26:48.678523 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:48.678537 | orchestrator | Friday 03 April 2026 10:26:42 +0000 (0:00:00.472) 0:01:21.503 ********** 2026-04-03 10:26:48.678550 | orchestrator | 2026-04-03 10:26:48.678562 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-03 10:26:48.678572 | orchestrator | Friday 03 April 2026 10:26:43 +0000 (0:00:00.484) 0:01:21.987 ********** 2026-04-03 10:26:48.678582 | orchestrator | 2026-04-03 10:26:48.678593 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-03 10:26:48.678602 | orchestrator | Friday 03 April 2026 10:26:44 +0000 (0:00:00.809) 0:01:22.797 ********** 2026-04-03 10:26:48.678612 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-03 10:26:48.678623 | orchestrator | 2026-04-03 10:26:48.678634 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-03 10:26:48.678645 | orchestrator | Friday 03 April 2026 10:26:46 +0000 (0:00:02.400) 0:01:25.198 ********** 2026-04-03 10:26:48.678657 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-03 10:26:48.678665 | orchestrator |  "msg": [ 2026-04-03 10:26:48.678672 | orchestrator |  "Validator run completed.", 2026-04-03 10:26:48.678679 | orchestrator |  "You can find the report file here:", 2026-04-03 10:26:48.678685 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-03T10:25:24+00:00-report.json", 2026-04-03 10:26:48.678693 | orchestrator |  "on the following host:", 2026-04-03 10:26:48.678700 | orchestrator |  "testbed-manager" 2026-04-03 10:26:48.678707 | orchestrator |  ] 2026-04-03 10:26:48.678714 | orchestrator | } 2026-04-03 10:26:48.678721 | orchestrator | 2026-04-03 10:26:48.678728 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:26:48.678736 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-03 10:26:48.678744 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 10:26:48.678756 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-03 10:26:48.678763 | orchestrator | 2026-04-03 10:26:48.678770 | orchestrator | 2026-04-03 10:26:48.678776 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:26:48.678783 | orchestrator | Friday 03 April 2026 10:26:48 +0000 (0:00:01.739) 0:01:26.938 ********** 2026-04-03 10:26:48.678789 | orchestrator | =============================================================================== 2026-04-03 10:26:48.678796 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 3.73s 2026-04-03 10:26:48.678809 | orchestrator | Get ceph osd tree ------------------------------------------------------- 3.62s 2026-04-03 10:26:48.678816 | orchestrator | Get timestamp for report file ------------------------------------------- 2.78s 2026-04-03 10:26:48.678822 | orchestrator | Aggregate test results step one ----------------------------------------- 2.72s 2026-04-03 10:26:48.678829 | orchestrator | Write report file ------------------------------------------------------- 2.40s 2026-04-03 10:26:48.678835 | orchestrator | Set test result to failed if an OSD is not running ---------------------- 2.12s 2026-04-03 10:26:48.678842 | orchestrator | Calculate OSD devices for each host ------------------------------------- 1.89s 2026-04-03 10:26:48.678848 | orchestrator | Flush handlers ---------------------------------------------------------- 1.87s 2026-04-03 10:26:48.678855 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 1.80s 2026-04-03 10:26:48.678861 | orchestrator | Flush handlers ---------------------------------------------------------- 1.77s 2026-04-03 10:26:48.678868 | orchestrator | Print report file information ------------------------------------------- 1.74s 2026-04-03 10:26:48.678874 | orchestrator | Create report output directory ------------------------------------------ 1.72s 2026-04-03 10:26:48.678881 | orchestrator | Calculate sub test expression results ----------------------------------- 1.68s 2026-04-03 10:26:48.678888 | orchestrator | Prepare test data ------------------------------------------------------- 1.59s 2026-04-03 10:26:48.678894 | orchestrator | Prepare test data ------------------------------------------------------- 1.58s 2026-04-03 10:26:48.678901 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 1.56s 2026-04-03 10:26:48.678907 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 1.54s 2026-04-03 10:26:48.678914 | orchestrator | Fail if count of unencrypted OSDs does not match ------------------------ 1.53s 2026-04-03 10:26:48.678920 | orchestrator | Calculate OSD devices for each host ------------------------------------- 1.52s 2026-04-03 10:26:48.678927 | orchestrator | Set validation result to failed if a test failed ------------------------ 1.50s 2026-04-03 10:26:48.862990 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-03 10:26:48.872036 | orchestrator | + set -e 2026-04-03 10:26:48.872190 | orchestrator | + source /opt/manager-vars.sh 2026-04-03 10:26:48.872203 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-03 10:26:48.872212 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-03 10:26:48.872221 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-03 10:26:48.872230 | orchestrator | ++ CEPH_VERSION=reef 2026-04-03 10:26:48.872239 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-03 10:26:48.872249 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-03 10:26:48.872258 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-03 10:26:48.872267 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-03 10:26:48.872276 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-03 10:26:48.872284 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-03 10:26:48.872293 | orchestrator | ++ export ARA=false 2026-04-03 10:26:48.872302 | orchestrator | ++ ARA=false 2026-04-03 10:26:48.872311 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-03 10:26:48.872319 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-03 10:26:48.872328 | orchestrator | ++ export TEMPEST=false 2026-04-03 10:26:48.872337 | orchestrator | ++ TEMPEST=false 2026-04-03 10:26:48.872346 | orchestrator | ++ export IS_ZUUL=true 2026-04-03 10:26:48.872354 | orchestrator | ++ IS_ZUUL=true 2026-04-03 10:26:48.872363 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 10:26:48.872372 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.151 2026-04-03 10:26:48.872381 | orchestrator | ++ export EXTERNAL_API=false 2026-04-03 10:26:48.872389 | orchestrator | ++ EXTERNAL_API=false 2026-04-03 10:26:48.872398 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-03 10:26:48.872407 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-03 10:26:48.872415 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-03 10:26:48.872424 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-03 10:26:48.872433 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-03 10:26:48.872441 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-03 10:26:48.872450 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-03 10:26:48.872458 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-03 10:26:48.872467 | orchestrator | + source /etc/os-release 2026-04-03 10:26:48.872476 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-03 10:26:48.872485 | orchestrator | ++ NAME=Ubuntu 2026-04-03 10:26:48.872513 | orchestrator | ++ VERSION_ID=24.04 2026-04-03 10:26:48.872523 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-03 10:26:48.872531 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-03 10:26:48.872540 | orchestrator | ++ ID=ubuntu 2026-04-03 10:26:48.872549 | orchestrator | ++ ID_LIKE=debian 2026-04-03 10:26:48.872558 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-03 10:26:48.872566 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-03 10:26:48.872575 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-03 10:26:48.872584 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-03 10:26:48.872594 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-03 10:26:48.872602 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-03 10:26:48.872611 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-03 10:26:48.872621 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-03 10:26:48.872640 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-03 10:26:48.906234 | orchestrator | 2026-04-03 10:26:48.906320 | orchestrator | # Status of Elasticsearch 2026-04-03 10:26:48.906332 | orchestrator | 2026-04-03 10:26:48.906343 | orchestrator | + pushd /opt/configuration/contrib 2026-04-03 10:26:48.906354 | orchestrator | + echo 2026-04-03 10:26:48.906364 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-03 10:26:48.906374 | orchestrator | + echo 2026-04-03 10:26:48.906384 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-03 10:26:49.093338 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-03 10:26:49.093449 | orchestrator | 2026-04-03 10:26:49.093465 | orchestrator | # Status of MariaDB 2026-04-03 10:26:49.093478 | orchestrator | 2026-04-03 10:26:49.093489 | orchestrator | + echo 2026-04-03 10:26:49.093501 | orchestrator | + echo '# Status of MariaDB' 2026-04-03 10:26:49.093512 | orchestrator | + echo 2026-04-03 10:26:49.093845 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 10:26:49.140329 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 10:26:49.140410 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 10:26:49.140422 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-03 10:26:49.140434 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-03 10:26:49.224702 | orchestrator | Reading package lists... 2026-04-03 10:26:49.575206 | orchestrator | Building dependency tree... 2026-04-03 10:26:49.577316 | orchestrator | Reading state information... 2026-04-03 10:26:49.983963 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-03 10:26:49.984048 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded. 2026-04-03 10:26:50.694677 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-03 10:26:50.695269 | orchestrator | 2026-04-03 10:26:50.695305 | orchestrator | # Status of Prometheus 2026-04-03 10:26:50.695318 | orchestrator | 2026-04-03 10:26:50.695330 | orchestrator | + echo 2026-04-03 10:26:50.695341 | orchestrator | + echo '# Status of Prometheus' 2026-04-03 10:26:50.695352 | orchestrator | + echo 2026-04-03 10:26:50.695364 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-03 10:26:50.761590 | orchestrator | Unauthorized 2026-04-03 10:26:50.766498 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-03 10:26:50.837320 | orchestrator | Unauthorized 2026-04-03 10:26:50.840238 | orchestrator | 2026-04-03 10:26:50.840290 | orchestrator | # Status of RabbitMQ 2026-04-03 10:26:50.840303 | orchestrator | 2026-04-03 10:26:50.840315 | orchestrator | + echo 2026-04-03 10:26:50.840326 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-03 10:26:50.840338 | orchestrator | + echo 2026-04-03 10:26:50.841374 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-03 10:26:50.899303 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-03 10:26:50.899414 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-03 10:26:50.899431 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-03 10:26:51.463754 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-03 10:26:51.472850 | orchestrator | 2026-04-03 10:26:51.472916 | orchestrator | # Status of Redis 2026-04-03 10:26:51.472958 | orchestrator | 2026-04-03 10:26:51.472971 | orchestrator | + echo 2026-04-03 10:26:51.472982 | orchestrator | + echo '# Status of Redis' 2026-04-03 10:26:51.472994 | orchestrator | + echo 2026-04-03 10:26:51.473007 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-03 10:26:51.486828 | orchestrator | TCP OK - 0.005 second response time on 192.168.16.10 port 6379|time=0.005217s;;;0.000000;10.000000 2026-04-03 10:26:51.487689 | orchestrator | + popd 2026-04-03 10:26:51.487772 | orchestrator | 2026-04-03 10:26:51.487786 | orchestrator | # Create backup of MariaDB database 2026-04-03 10:26:51.487799 | orchestrator | 2026-04-03 10:26:51.487810 | orchestrator | + echo 2026-04-03 10:26:51.487842 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-03 10:26:51.487854 | orchestrator | + echo 2026-04-03 10:26:51.487866 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-03 10:26:52.813190 | orchestrator | 2026-04-03 10:26:52 | INFO  | Prepare task for execution of mariadb_backup. 2026-04-03 10:26:52.881127 | orchestrator | 2026-04-03 10:26:52 | INFO  | Task 835046fc-6a69-4267-8917-b4de5335dfa7 (mariadb_backup) was prepared for execution. 2026-04-03 10:26:52.881242 | orchestrator | 2026-04-03 10:26:52 | INFO  | It takes a moment until task 835046fc-6a69-4267-8917-b4de5335dfa7 (mariadb_backup) has been started and output is visible here. 2026-04-03 10:29:19.040751 | orchestrator | 2026-04-03 10:29:19.040867 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-03 10:29:19.040883 | orchestrator | 2026-04-03 10:29:19.040896 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-03 10:29:19.040991 | orchestrator | Friday 03 April 2026 10:26:57 +0000 (0:00:01.708) 0:00:01.708 ********** 2026-04-03 10:29:19.041003 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:29:19.041015 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:29:19.041026 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:29:19.041037 | orchestrator | 2026-04-03 10:29:19.041048 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-03 10:29:19.041059 | orchestrator | Friday 03 April 2026 10:26:59 +0000 (0:00:01.753) 0:00:03.462 ********** 2026-04-03 10:29:19.041071 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-03 10:29:19.041082 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-03 10:29:19.041093 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-03 10:29:19.041104 | orchestrator | 2026-04-03 10:29:19.041121 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-03 10:29:19.041141 | orchestrator | 2026-04-03 10:29:19.041158 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-03 10:29:19.041177 | orchestrator | Friday 03 April 2026 10:27:01 +0000 (0:00:01.892) 0:00:05.354 ********** 2026-04-03 10:29:19.041197 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-03 10:29:19.041216 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-03 10:29:19.041236 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-03 10:29:19.041254 | orchestrator | 2026-04-03 10:29:19.041266 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-03 10:29:19.041277 | orchestrator | Friday 03 April 2026 10:27:03 +0000 (0:00:01.991) 0:00:07.345 ********** 2026-04-03 10:29:19.041288 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-03 10:29:19.041301 | orchestrator | 2026-04-03 10:29:19.041314 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-03 10:29:19.041327 | orchestrator | Friday 03 April 2026 10:27:06 +0000 (0:00:02.493) 0:00:09.839 ********** 2026-04-03 10:29:19.041339 | orchestrator | ok: [testbed-node-0] 2026-04-03 10:29:19.041352 | orchestrator | ok: [testbed-node-2] 2026-04-03 10:29:19.041365 | orchestrator | ok: [testbed-node-1] 2026-04-03 10:29:19.041378 | orchestrator | 2026-04-03 10:29:19.041390 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-03 10:29:19.041426 | orchestrator | Friday 03 April 2026 10:27:10 +0000 (0:00:04.734) 0:00:14.573 ********** 2026-04-03 10:29:19.041439 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:29:19.041453 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:29:19.041465 | orchestrator | changed: [testbed-node-0] 2026-04-03 10:29:19.041478 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-03 10:29:19.041490 | orchestrator | 2026-04-03 10:29:19.041503 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-03 10:29:19.041529 | orchestrator | skipping: no hosts matched 2026-04-03 10:29:19.041544 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-03 10:29:19.041556 | orchestrator | 2026-04-03 10:29:19.041568 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-03 10:29:19.041581 | orchestrator | skipping: no hosts matched 2026-04-03 10:29:19.041595 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-03 10:29:19.041607 | orchestrator | mariadb_bootstrap_restart 2026-04-03 10:29:19.041619 | orchestrator | 2026-04-03 10:29:19.041632 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-03 10:29:19.041646 | orchestrator | skipping: no hosts matched 2026-04-03 10:29:19.041657 | orchestrator | 2026-04-03 10:29:19.041668 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-03 10:29:19.041678 | orchestrator | 2026-04-03 10:29:19.041689 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-03 10:29:19.041700 | orchestrator | Friday 03 April 2026 10:29:15 +0000 (0:02:04.739) 0:02:19.313 ********** 2026-04-03 10:29:19.041710 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:29:19.041721 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:29:19.041731 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:29:19.041742 | orchestrator | 2026-04-03 10:29:19.041752 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-03 10:29:19.041763 | orchestrator | Friday 03 April 2026 10:29:16 +0000 (0:00:01.343) 0:02:20.656 ********** 2026-04-03 10:29:19.041774 | orchestrator | skipping: [testbed-node-0] 2026-04-03 10:29:19.041784 | orchestrator | skipping: [testbed-node-1] 2026-04-03 10:29:19.041795 | orchestrator | skipping: [testbed-node-2] 2026-04-03 10:29:19.041805 | orchestrator | 2026-04-03 10:29:19.041816 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:29:19.041828 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-03 10:29:19.041839 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 10:29:19.041850 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-03 10:29:19.041860 | orchestrator | 2026-04-03 10:29:19.041871 | orchestrator | 2026-04-03 10:29:19.041881 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:29:19.041892 | orchestrator | Friday 03 April 2026 10:29:18 +0000 (0:00:01.760) 0:02:22.418 ********** 2026-04-03 10:29:19.041927 | orchestrator | =============================================================================== 2026-04-03 10:29:19.041940 | orchestrator | mariadb : Taking full database backup via Mariabackup ----------------- 124.74s 2026-04-03 10:29:19.041970 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 4.73s 2026-04-03 10:29:19.041982 | orchestrator | mariadb : include_tasks ------------------------------------------------- 2.49s 2026-04-03 10:29:19.041992 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 1.99s 2026-04-03 10:29:19.042003 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.89s 2026-04-03 10:29:19.042014 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 1.76s 2026-04-03 10:29:19.042097 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.75s 2026-04-03 10:29:19.042108 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 1.34s 2026-04-03 10:29:19.229661 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-03 10:29:19.235360 | orchestrator | + set -e 2026-04-03 10:29:19.235522 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-03 10:29:19.235557 | orchestrator | ++ export INTERACTIVE=false 2026-04-03 10:29:19.235573 | orchestrator | ++ INTERACTIVE=false 2026-04-03 10:29:19.235584 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-03 10:29:19.235595 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-03 10:29:19.235606 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-03 10:29:19.236605 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-03 10:29:19.242698 | orchestrator | 2026-04-03 10:29:19.242741 | orchestrator | # OpenStack endpoints 2026-04-03 10:29:19.242753 | orchestrator | 2026-04-03 10:29:19.242764 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-03 10:29:19.242775 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-03 10:29:19.242787 | orchestrator | + export OS_CLOUD=admin 2026-04-03 10:29:19.242799 | orchestrator | + OS_CLOUD=admin 2026-04-03 10:29:19.242810 | orchestrator | + echo 2026-04-03 10:29:19.242821 | orchestrator | + echo '# OpenStack endpoints' 2026-04-03 10:29:19.242832 | orchestrator | + echo 2026-04-03 10:29:19.242842 | orchestrator | + openstack endpoint list 2026-04-03 10:29:22.343390 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 10:29:22.343489 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-03 10:29:22.343503 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 10:29:22.343515 | orchestrator | | 082ee53dd9e54968add4014d233e6c06 | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-03 10:29:22.343526 | orchestrator | | 1b5f1cac262d48f0bd14fd22ee5898a2 | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-03 10:29:22.343554 | orchestrator | | 23134758f33448709a9b2cc57e9d27bc | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-03 10:29:22.343565 | orchestrator | | 323ba5c1a81c4c9ea3dc85f6ffe6d39a | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-03 10:29:22.343576 | orchestrator | | 3a8070fd23c94e1f96cf1b9a38e20b9b | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-03 10:29:22.343586 | orchestrator | | 3e0759293b614755b997159c5cf28e9d | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-03 10:29:22.343597 | orchestrator | | 4937ebcecc6a41c19d61e18b059d3ecf | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-03 10:29:22.343607 | orchestrator | | 50bf04dcd02f4fcdaf4e4d165fd8396f | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-03 10:29:22.343618 | orchestrator | | 5db384999a5b4a3491c708321d85709e | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-03 10:29:22.343629 | orchestrator | | 63dd909081fe4b24a1a17dc1ee0f69de | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-03 10:29:22.343639 | orchestrator | | 7000599b8b4648cca3db59c897c4e5ae | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-03 10:29:22.343677 | orchestrator | | 776a5fbfee3a4995bc60548c8f8287bf | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-03 10:29:22.343689 | orchestrator | | 7a79f4cbe8e34db0a4b336fb6b4a3e8e | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-03 10:29:22.343699 | orchestrator | | 7cdc566ae93e42babbad64c9ffa61f27 | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-03 10:29:22.343710 | orchestrator | | 7d192a0338d24a91936863d1279e8eb3 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-03 10:29:22.343721 | orchestrator | | 7d2f4e9edc9b4fb688591f843de03696 | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-03 10:29:22.343755 | orchestrator | | 7ee7ffd7e732424bad71f96decac54a0 | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-03 10:29:22.343767 | orchestrator | | 84c2945f0c9d4c5599e6648b26454668 | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-03 10:29:22.343778 | orchestrator | | 905f95551e48444bb8f96b75186eea83 | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-03 10:29:22.343789 | orchestrator | | 907de752841f4c969ddd67aba6deabba | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-03 10:29:22.343815 | orchestrator | | 9fee805f0be54dbcbd1d5b36b5cde04a | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-03 10:29:22.343827 | orchestrator | | a485fd156e644eb9aa6b317ff2be0c1d | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-03 10:29:22.343837 | orchestrator | | b0ce7996f1744cd0b9224edd10d22c43 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-03 10:29:22.343849 | orchestrator | | bd51fbb4cfe34ad5b79d29dc93fb9687 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-03 10:29:22.343860 | orchestrator | | c0be902481564a5c8a2aaa56b06d6095 | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-03 10:29:22.343870 | orchestrator | | d56709c96b7e4ca990f7f22892d64e20 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-03 10:29:22.343886 | orchestrator | | d7f31c525541456e859c9a15977384e0 | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-03 10:29:22.343920 | orchestrator | | dff60a77903047d7988618cc52fd9f4f | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-03 10:29:22.343934 | orchestrator | | e90930d768b744199f87e357be5b95b6 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-03 10:29:22.343946 | orchestrator | | efe4ff990c2d4cb299ee6d334420f669 | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-03 10:29:22.343958 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-03 10:29:22.589418 | orchestrator | 2026-04-03 10:29:22.589512 | orchestrator | # Cinder 2026-04-03 10:29:22.589526 | orchestrator | 2026-04-03 10:29:22.589538 | orchestrator | + echo 2026-04-03 10:29:22.589550 | orchestrator | + echo '# Cinder' 2026-04-03 10:29:22.589561 | orchestrator | + echo 2026-04-03 10:29:22.589572 | orchestrator | + openstack volume service list 2026-04-03 10:29:25.152836 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:25.152972 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-03 10:29:25.152984 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:25.152991 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-03T10:29:22.000000 | 2026-04-03 10:29:25.152998 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-03T10:29:23.000000 | 2026-04-03 10:29:25.153004 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-03T10:29:23.000000 | 2026-04-03 10:29:25.153011 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-03T10:29:20.000000 | 2026-04-03 10:29:25.153017 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-03T10:29:21.000000 | 2026-04-03 10:29:25.153023 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-03T10:29:22.000000 | 2026-04-03 10:29:25.153029 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-03T10:29:22.000000 | 2026-04-03 10:29:25.153036 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-03T10:29:21.000000 | 2026-04-03 10:29:25.153042 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-03T10:29:22.000000 | 2026-04-03 10:29:25.153048 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:25.429998 | orchestrator | 2026-04-03 10:29:25.430151 | orchestrator | # Neutron 2026-04-03 10:29:25.430168 | orchestrator | 2026-04-03 10:29:25.430180 | orchestrator | + echo 2026-04-03 10:29:25.430191 | orchestrator | + echo '# Neutron' 2026-04-03 10:29:25.430203 | orchestrator | + echo 2026-04-03 10:29:25.430214 | orchestrator | + openstack network agent list 2026-04-03 10:29:28.184569 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 10:29:28.184661 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-03 10:29:28.184674 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 10:29:28.184683 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 10:29:28.184692 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184701 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184709 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 10:29:28.184718 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184726 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184761 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-03 10:29:28.184770 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184792 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-03 10:29:28.184801 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-03 10:29:28.460346 | orchestrator | + openstack network service provider list 2026-04-03 10:29:30.975147 | orchestrator | +---------------+------+---------+ 2026-04-03 10:29:30.975296 | orchestrator | | Service Type | Name | Default | 2026-04-03 10:29:30.975323 | orchestrator | +---------------+------+---------+ 2026-04-03 10:29:30.975345 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-03 10:29:30.975363 | orchestrator | +---------------+------+---------+ 2026-04-03 10:29:31.242152 | orchestrator | 2026-04-03 10:29:31.242262 | orchestrator | # Nova 2026-04-03 10:29:31.242286 | orchestrator | 2026-04-03 10:29:31.242305 | orchestrator | + echo 2026-04-03 10:29:31.242324 | orchestrator | + echo '# Nova' 2026-04-03 10:29:31.242343 | orchestrator | + echo 2026-04-03 10:29:31.242362 | orchestrator | + openstack compute service list 2026-04-03 10:29:34.690971 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:34.691105 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-03 10:29:34.691131 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:34.691150 | orchestrator | | 153e83d0-197c-424c-aea7-5d9c0095cd3f | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-03T10:29:30.000000 | 2026-04-03 10:29:34.691170 | orchestrator | | 5953b1ef-81e8-4dd9-888e-c8a557ef4ba7 | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-03T10:29:30.000000 | 2026-04-03 10:29:34.691189 | orchestrator | | 07773ac9-d34b-44f3-b811-5df93b96a436 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-03T10:29:30.000000 | 2026-04-03 10:29:34.691207 | orchestrator | | 4034bdb8-9c06-4334-a2fa-0617e91f64f7 | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-03T10:29:31.000000 | 2026-04-03 10:29:34.691226 | orchestrator | | e420fc71-f52d-4617-ab61-d218e5b7f656 | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-03T10:29:28.000000 | 2026-04-03 10:29:34.691238 | orchestrator | | c1656c86-e9c0-4202-861d-cb4bb9e1d6cd | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-03T10:29:27.000000 | 2026-04-03 10:29:34.691249 | orchestrator | | c2381516-3631-4830-abb9-4ca7e0bb6aec | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-03T10:29:28.000000 | 2026-04-03 10:29:34.691261 | orchestrator | | f911c078-882f-4472-b8fa-6bfcd69f3011 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-03T10:29:24.000000 | 2026-04-03 10:29:34.691271 | orchestrator | | e9d6c8da-f400-46bc-a397-63574980d4b9 | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-03T10:29:31.000000 | 2026-04-03 10:29:34.691282 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-03 10:29:34.965488 | orchestrator | + openstack hypervisor list 2026-04-03 10:29:37.603245 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 10:29:37.603382 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-03 10:29:37.603409 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 10:29:37.603428 | orchestrator | | 0c05a848-94f4-46f4-9bd1-18f873432746 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-03 10:29:37.603481 | orchestrator | | 162dbafe-7b85-4621-bef4-d9ad4a22dc7c | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-03 10:29:37.603502 | orchestrator | | e340cede-51d7-4984-a9e0-2d91e82145f5 | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-03 10:29:37.603520 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-03 10:29:37.861409 | orchestrator | 2026-04-03 10:29:37.861509 | orchestrator | # Run OpenStack test play 2026-04-03 10:29:37.861526 | orchestrator | 2026-04-03 10:29:37.861538 | orchestrator | + echo 2026-04-03 10:29:37.861550 | orchestrator | + echo '# Run OpenStack test play' 2026-04-03 10:29:37.861561 | orchestrator | + echo 2026-04-03 10:29:37.861573 | orchestrator | + osism apply --environment openstack test 2026-04-03 10:29:39.165704 | orchestrator | 2026-04-03 10:29:39 | INFO  | Trying to run play test in environment openstack 2026-04-03 10:29:49.215336 | orchestrator | 2026-04-03 10:29:49 | INFO  | Prepare task for execution of test. 2026-04-03 10:29:49.301825 | orchestrator | 2026-04-03 10:29:49 | INFO  | Task befc9b40-d9f5-412a-a810-a82d266dafa0 (test) was prepared for execution. 2026-04-03 10:29:49.301980 | orchestrator | 2026-04-03 10:29:49 | INFO  | It takes a moment until task befc9b40-d9f5-412a-a810-a82d266dafa0 (test) has been started and output is visible here. 2026-04-03 10:32:27.030681 | orchestrator | 2026-04-03 10:32:27.030844 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-03 10:32:27.030862 | orchestrator | 2026-04-03 10:32:27.030875 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-03 10:32:27.030886 | orchestrator | Friday 03 April 2026 10:29:54 +0000 (0:00:01.385) 0:00:01.385 ********** 2026-04-03 10:32:27.030898 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.030909 | orchestrator | 2026-04-03 10:32:27.030920 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-03 10:32:27.030947 | orchestrator | Friday 03 April 2026 10:30:00 +0000 (0:00:06.059) 0:00:07.445 ********** 2026-04-03 10:32:27.030959 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.030970 | orchestrator | 2026-04-03 10:32:27.030980 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-03 10:32:27.030991 | orchestrator | Friday 03 April 2026 10:30:05 +0000 (0:00:05.216) 0:00:12.662 ********** 2026-04-03 10:32:27.031002 | orchestrator | changed: [localhost] 2026-04-03 10:32:27.031013 | orchestrator | 2026-04-03 10:32:27.031024 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-03 10:32:27.031035 | orchestrator | Friday 03 April 2026 10:30:14 +0000 (0:00:09.355) 0:00:22.017 ********** 2026-04-03 10:32:27.031045 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031056 | orchestrator | 2026-04-03 10:32:27.031067 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-03 10:32:27.031078 | orchestrator | Friday 03 April 2026 10:30:20 +0000 (0:00:05.236) 0:00:27.254 ********** 2026-04-03 10:32:27.031089 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031099 | orchestrator | 2026-04-03 10:32:27.031110 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-03 10:32:27.031121 | orchestrator | Friday 03 April 2026 10:30:25 +0000 (0:00:05.093) 0:00:32.347 ********** 2026-04-03 10:32:27.031132 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-03 10:32:27.031143 | orchestrator | ok: [localhost] => (item=member) 2026-04-03 10:32:27.031169 | orchestrator | changed: [localhost] => (item=creator) 2026-04-03 10:32:27.031181 | orchestrator | 2026-04-03 10:32:27.031192 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-03 10:32:27.031203 | orchestrator | Friday 03 April 2026 10:30:38 +0000 (0:00:13.668) 0:00:46.016 ********** 2026-04-03 10:32:27.031214 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031226 | orchestrator | 2026-04-03 10:32:27.031242 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-03 10:32:27.031260 | orchestrator | Friday 03 April 2026 10:30:44 +0000 (0:00:05.305) 0:00:51.321 ********** 2026-04-03 10:32:27.031306 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031327 | orchestrator | 2026-04-03 10:32:27.031346 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-03 10:32:27.031363 | orchestrator | Friday 03 April 2026 10:30:49 +0000 (0:00:05.108) 0:00:56.429 ********** 2026-04-03 10:32:27.031376 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031388 | orchestrator | 2026-04-03 10:32:27.031401 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-03 10:32:27.031414 | orchestrator | Friday 03 April 2026 10:30:54 +0000 (0:00:05.225) 0:01:01.655 ********** 2026-04-03 10:32:27.031427 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031439 | orchestrator | 2026-04-03 10:32:27.031452 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-03 10:32:27.031465 | orchestrator | Friday 03 April 2026 10:30:59 +0000 (0:00:04.752) 0:01:06.407 ********** 2026-04-03 10:32:27.031478 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031489 | orchestrator | 2026-04-03 10:32:27.031502 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-03 10:32:27.031515 | orchestrator | Friday 03 April 2026 10:31:04 +0000 (0:00:05.082) 0:01:11.490 ********** 2026-04-03 10:32:27.031527 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031540 | orchestrator | 2026-04-03 10:32:27.031553 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-03 10:32:27.031565 | orchestrator | Friday 03 April 2026 10:31:09 +0000 (0:00:05.095) 0:01:16.586 ********** 2026-04-03 10:32:27.031578 | orchestrator | ok: [localhost] => (item={'name': 'test-1'}) 2026-04-03 10:32:27.031589 | orchestrator | ok: [localhost] => (item={'name': 'test-2'}) 2026-04-03 10:32:27.031599 | orchestrator | ok: [localhost] => (item={'name': 'test-3'}) 2026-04-03 10:32:27.031610 | orchestrator | 2026-04-03 10:32:27.031621 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-03 10:32:27.031631 | orchestrator | Friday 03 April 2026 10:31:21 +0000 (0:00:12.640) 0:01:29.227 ********** 2026-04-03 10:32:27.031642 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-03 10:32:27.031653 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-03 10:32:27.031664 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-03 10:32:27.031674 | orchestrator | 2026-04-03 10:32:27.031685 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-03 10:32:27.031696 | orchestrator | Friday 03 April 2026 10:31:35 +0000 (0:00:13.049) 0:01:42.276 ********** 2026-04-03 10:32:27.031707 | orchestrator | ok: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-03 10:32:27.031718 | orchestrator | ok: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-03 10:32:27.031728 | orchestrator | ok: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-03 10:32:27.031760 | orchestrator | 2026-04-03 10:32:27.031771 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-03 10:32:27.031782 | orchestrator | 2026-04-03 10:32:27.031792 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-03 10:32:27.031803 | orchestrator | Friday 03 April 2026 10:31:49 +0000 (0:00:14.555) 0:01:56.832 ********** 2026-04-03 10:32:27.031814 | orchestrator | ok: [localhost] 2026-04-03 10:32:27.031825 | orchestrator | 2026-04-03 10:32:27.031853 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-03 10:32:27.031865 | orchestrator | Friday 03 April 2026 10:31:54 +0000 (0:00:05.008) 0:02:01.840 ********** 2026-04-03 10:32:27.031876 | orchestrator | skipping: [localhost] 2026-04-03 10:32:27.031886 | orchestrator | 2026-04-03 10:32:27.031897 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-03 10:32:27.031908 | orchestrator | Friday 03 April 2026 10:31:55 +0000 (0:00:01.121) 0:02:02.962 ********** 2026-04-03 10:32:27.031927 | orchestrator | skipping: [localhost] 2026-04-03 10:32:27.031938 | orchestrator | 2026-04-03 10:32:27.031949 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-03 10:32:27.031960 | orchestrator | Friday 03 April 2026 10:31:56 +0000 (0:00:01.120) 0:02:04.083 ********** 2026-04-03 10:32:27.031971 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-03 10:32:27.031981 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-03 10:32:27.031992 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-03 10:32:27.032003 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-03 10:32:27.032013 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-03 10:32:27.032024 | orchestrator | skipping: [localhost] 2026-04-03 10:32:27.032035 | orchestrator | 2026-04-03 10:32:27.032046 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-03 10:32:27.032056 | orchestrator | Friday 03 April 2026 10:31:58 +0000 (0:00:01.247) 0:02:05.331 ********** 2026-04-03 10:32:27.032067 | orchestrator | skipping: [localhost] 2026-04-03 10:32:27.032078 | orchestrator | 2026-04-03 10:32:27.032096 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-03 10:32:27.032108 | orchestrator | Friday 03 April 2026 10:31:59 +0000 (0:00:01.204) 0:02:06.535 ********** 2026-04-03 10:32:27.032119 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 10:32:27.032129 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 10:32:27.032140 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 10:32:27.032151 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 10:32:27.032161 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 10:32:27.032172 | orchestrator | 2026-04-03 10:32:27.032183 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-03 10:32:27.032193 | orchestrator | Friday 03 April 2026 10:32:05 +0000 (0:00:06.155) 0:02:12.690 ********** 2026-04-03 10:32:27.032204 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-03 10:32:27.032217 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j708999959468.4251', 'results_file': '/ansible/.ansible_async/j708999959468.4251', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:32:27.032232 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j295051929995.4276', 'results_file': '/ansible/.ansible_async/j295051929995.4276', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:32:27.032243 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j172606282901.4301', 'results_file': '/ansible/.ansible_async/j172606282901.4301', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:32:27.032254 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j222393696127.4326', 'results_file': '/ansible/.ansible_async/j222393696127.4326', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:32:27.032265 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j785314340957.4358', 'results_file': '/ansible/.ansible_async/j785314340957.4358', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:32:27.032276 | orchestrator | 2026-04-03 10:32:27.032287 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-03 10:32:27.032304 | orchestrator | Friday 03 April 2026 10:32:21 +0000 (0:00:15.855) 0:02:28.546 ********** 2026-04-03 10:32:27.032315 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 10:32:27.032326 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 10:32:27.032337 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 10:32:27.032347 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 10:32:27.032358 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 10:32:27.032369 | orchestrator | 2026-04-03 10:32:27.032380 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-03 10:32:27.032396 | orchestrator | Friday 03 April 2026 10:32:27 +0000 (0:00:05.724) 0:02:34.271 ********** 2026-04-03 10:33:28.263603 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j514878905698.4429', 'results_file': '/ansible/.ansible_async/j514878905698.4429', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263778 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j251086353026.4454', 'results_file': '/ansible/.ansible_async/j251086353026.4454', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263797 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j369997948699.4479', 'results_file': '/ansible/.ansible_async/j369997948699.4479', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263808 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j911212618437.4504', 'results_file': '/ansible/.ansible_async/j911212618437.4504', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263819 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j65263742433.4529', 'results_file': '/ansible/.ansible_async/j65263742433.4529', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263830 | orchestrator | 2026-04-03 10:33:28.263841 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-03 10:33:28.263852 | orchestrator | Friday 03 April 2026 10:32:32 +0000 (0:00:05.047) 0:02:39.318 ********** 2026-04-03 10:33:28.263861 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 10:33:28.263871 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 10:33:28.263881 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 10:33:28.263890 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 10:33:28.263899 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 10:33:28.263909 | orchestrator | 2026-04-03 10:33:28.263919 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-03 10:33:28.263928 | orchestrator | Friday 03 April 2026 10:32:37 +0000 (0:00:05.856) 0:02:45.175 ********** 2026-04-03 10:33:28.263937 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-03 10:33:28.263949 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j280675169914.4593', 'results_file': '/ansible/.ansible_async/j280675169914.4593', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263959 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j789749591092.4625', 'results_file': '/ansible/.ansible_async/j789749591092.4625', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263987 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j132752449003.4651', 'results_file': '/ansible/.ansible_async/j132752449003.4651', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.263998 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j736465695555.4677', 'results_file': '/ansible/.ansible_async/j736465695555.4677', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.264008 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j598854640477.4703', 'results_file': '/ansible/.ansible_async/j598854640477.4703', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-03 10:33:28.264017 | orchestrator | 2026-04-03 10:33:28.264027 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-03 10:33:28.264037 | orchestrator | Friday 03 April 2026 10:32:49 +0000 (0:00:11.130) 0:02:56.306 ********** 2026-04-03 10:33:28.264046 | orchestrator | ok: [localhost] 2026-04-03 10:33:28.264057 | orchestrator | 2026-04-03 10:33:28.264066 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-03 10:33:28.264163 | orchestrator | Friday 03 April 2026 10:32:54 +0000 (0:00:05.297) 0:03:01.604 ********** 2026-04-03 10:33:28.264185 | orchestrator | ok: [localhost] 2026-04-03 10:33:28.264200 | orchestrator | 2026-04-03 10:33:28.264212 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-03 10:33:28.264240 | orchestrator | Friday 03 April 2026 10:33:00 +0000 (0:00:06.067) 0:03:07.672 ********** 2026-04-03 10:33:28.264252 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-03 10:33:28.264264 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-03 10:33:28.264275 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-03 10:33:28.264293 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-03 10:33:28.264304 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-03 10:33:28.264315 | orchestrator | 2026-04-03 10:33:28.264325 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-03 10:33:28.264336 | orchestrator | Friday 03 April 2026 10:33:26 +0000 (0:00:25.959) 0:03:33.631 ********** 2026-04-03 10:33:28.264347 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-03 10:33:28.264358 | orchestrator |  "msg": "test: 192.168.112.134" 2026-04-03 10:33:28.264370 | orchestrator | } 2026-04-03 10:33:28.264381 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-03 10:33:28.264392 | orchestrator |  "msg": "test-1: 192.168.112.152" 2026-04-03 10:33:28.264402 | orchestrator | } 2026-04-03 10:33:28.264413 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-03 10:33:28.264424 | orchestrator |  "msg": "test-2: 192.168.112.123" 2026-04-03 10:33:28.264434 | orchestrator | } 2026-04-03 10:33:28.264445 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-03 10:33:28.264456 | orchestrator |  "msg": "test-3: 192.168.112.194" 2026-04-03 10:33:28.264466 | orchestrator | } 2026-04-03 10:33:28.264477 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-03 10:33:28.264488 | orchestrator |  "msg": "test-4: 192.168.112.177" 2026-04-03 10:33:28.264499 | orchestrator | } 2026-04-03 10:33:28.264508 | orchestrator | 2026-04-03 10:33:28.264518 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-03 10:33:28.264529 | orchestrator | localhost : ok=26  changed=8  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-03 10:33:28.264539 | orchestrator | 2026-04-03 10:33:28.264558 | orchestrator | 2026-04-03 10:33:28.264568 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-03 10:33:28.264577 | orchestrator | Friday 03 April 2026 10:33:27 +0000 (0:00:01.610) 0:03:35.241 ********** 2026-04-03 10:33:28.264587 | orchestrator | =============================================================================== 2026-04-03 10:33:28.264596 | orchestrator | Create floating ip addresses ------------------------------------------- 25.96s 2026-04-03 10:33:28.264606 | orchestrator | Wait for instance creation to complete --------------------------------- 15.86s 2026-04-03 10:33:28.264615 | orchestrator | Create test routers ---------------------------------------------------- 14.56s 2026-04-03 10:33:28.264625 | orchestrator | Add member roles to user test ------------------------------------------ 13.67s 2026-04-03 10:33:28.264634 | orchestrator | Create test subnets ---------------------------------------------------- 13.05s 2026-04-03 10:33:28.264644 | orchestrator | Create test networks --------------------------------------------------- 12.64s 2026-04-03 10:33:28.264653 | orchestrator | Wait for tags to be added ---------------------------------------------- 11.13s 2026-04-03 10:33:28.264663 | orchestrator | Add manager role to user test-admin ------------------------------------- 9.36s 2026-04-03 10:33:28.264672 | orchestrator | Create test instances --------------------------------------------------- 6.16s 2026-04-03 10:33:28.264681 | orchestrator | Attach test volume ------------------------------------------------------ 6.07s 2026-04-03 10:33:28.264691 | orchestrator | Create test domain ------------------------------------------------------ 6.06s 2026-04-03 10:33:28.264726 | orchestrator | Add tag to instances ---------------------------------------------------- 5.86s 2026-04-03 10:33:28.264735 | orchestrator | Add metadata to instances ----------------------------------------------- 5.73s 2026-04-03 10:33:28.264745 | orchestrator | Create test server group ------------------------------------------------ 5.31s 2026-04-03 10:33:28.264754 | orchestrator | Create test volume ------------------------------------------------------ 5.30s 2026-04-03 10:33:28.264764 | orchestrator | Create test project ----------------------------------------------------- 5.24s 2026-04-03 10:33:28.264773 | orchestrator | Add rule to ssh security group ------------------------------------------ 5.23s 2026-04-03 10:33:28.264783 | orchestrator | Create test-admin user -------------------------------------------------- 5.22s 2026-04-03 10:33:28.264792 | orchestrator | Create ssh security group ----------------------------------------------- 5.11s 2026-04-03 10:33:28.264801 | orchestrator | Create test keypair ----------------------------------------------------- 5.10s 2026-04-03 10:33:28.448821 | orchestrator | + server_list 2026-04-03 10:33:28.448921 | orchestrator | + openstack --os-cloud test server list 2026-04-03 10:33:32.271249 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 10:33:32.271357 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-03 10:33:32.271372 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 10:33:32.271384 | orchestrator | | 7a1dd176-cb9c-4e65-bdba-0c7a9157fa79 | test-4 | ACTIVE | test-3=192.168.112.177, 192.168.202.51 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 10:33:32.271396 | orchestrator | | 35837532-0e52-4430-aca3-5cf4359eef3c | test-3 | ACTIVE | test-2=192.168.112.194, 192.168.201.48 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 10:33:32.271412 | orchestrator | | 111e486f-351d-4ae1-aeda-9a881084f41d | test-1 | ACTIVE | test-1=192.168.112.152, 192.168.200.154 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 10:33:32.271430 | orchestrator | | 3fc0f953-94fe-41fb-b32a-9aa0c02a1c2a | test-2 | ACTIVE | test-2=192.168.112.123, 192.168.201.141 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 10:33:32.271441 | orchestrator | | 5540657c-27fc-4f92-8801-4eef456d6602 | test | ACTIVE | test-1=192.168.112.134, 192.168.200.145 | N/A (booted from volume) | SCS-1L-1 | 2026-04-03 10:33:32.271471 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-03 10:33:32.664660 | orchestrator | + openstack --os-cloud test server show test 2026-04-03 10:33:36.005350 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:36.005509 | orchestrator | | Field | Value | 2026-04-03 10:33:36.005527 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:36.005539 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 10:33:36.005551 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 10:33:36.005562 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 10:33:36.005574 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-03 10:33:36.005585 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 10:33:36.005596 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 10:33:36.005661 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 10:33:36.005675 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 10:33:36.005686 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 10:33:36.005772 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 10:33:36.005784 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 10:33:36.005795 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 10:33:36.005806 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 10:33:36.005817 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 10:33:36.005828 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 10:33:36.005839 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 10:33:36.005874 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 10:33:36.005887 | orchestrator | | accessIPv4 | | 2026-04-03 10:33:36.005898 | orchestrator | | accessIPv6 | | 2026-04-03 10:33:36.005911 | orchestrator | | addresses | test-1=192.168.112.134, 192.168.200.145 | 2026-04-03 10:33:36.005931 | orchestrator | | config_drive | | 2026-04-03 10:33:36.005961 | orchestrator | | created | 2026-04-03T06:54:42Z | 2026-04-03 10:33:36.005981 | orchestrator | | description | None | 2026-04-03 10:33:36.005999 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 10:33:36.006099 | orchestrator | | hostId | 4778386a6db89001da510e3a0d3f27a28c7070f5860caf33764b5c80 | 2026-04-03 10:33:36.006141 | orchestrator | | host_status | None | 2026-04-03 10:33:36.006165 | orchestrator | | id | 5540657c-27fc-4f92-8801-4eef456d6602 | 2026-04-03 10:33:36.006177 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 10:33:36.006189 | orchestrator | | key_name | test | 2026-04-03 10:33:36.006199 | orchestrator | | locked | False | 2026-04-03 10:33:36.006211 | orchestrator | | locked_reason | None | 2026-04-03 10:33:36.006222 | orchestrator | | name | test | 2026-04-03 10:33:36.006233 | orchestrator | | pinned_availability_zone | None | 2026-04-03 10:33:36.006674 | orchestrator | | progress | 0 | 2026-04-03 10:33:36.006741 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 10:33:36.006754 | orchestrator | | properties | hostname='test' | 2026-04-03 10:33:36.006776 | orchestrator | | security_groups | name='icmp' | 2026-04-03 10:33:36.006788 | orchestrator | | | name='ssh' | 2026-04-03 10:33:36.006799 | orchestrator | | server_groups | None | 2026-04-03 10:33:36.006810 | orchestrator | | status | ACTIVE | 2026-04-03 10:33:36.006821 | orchestrator | | tags | test | 2026-04-03 10:33:36.006832 | orchestrator | | trusted_image_certificates | None | 2026-04-03 10:33:36.006844 | orchestrator | | updated | 2026-04-03T10:32:27Z | 2026-04-03 10:33:36.006867 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 10:33:36.006879 | orchestrator | | volumes_attached | delete_on_termination='True', id='203666d4-75b6-44de-b3ce-ab6b91549d72' | 2026-04-03 10:33:36.006890 | orchestrator | | | delete_on_termination='False', id='6dac785b-3487-490f-8752-db8f1a1b6012' | 2026-04-03 10:33:36.011405 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:36.294095 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-03 10:33:39.278580 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:39.278675 | orchestrator | | Field | Value | 2026-04-03 10:33:39.278723 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:39.278734 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 10:33:39.278743 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 10:33:39.278768 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 10:33:39.278783 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-03 10:33:39.278791 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 10:33:39.278799 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 10:33:39.278822 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 10:33:39.278831 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 10:33:39.278839 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 10:33:39.278847 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 10:33:39.278855 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 10:33:39.278863 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 10:33:39.278878 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 10:33:39.278889 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 10:33:39.278897 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 10:33:39.278905 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:09.000000 | 2026-04-03 10:33:39.278919 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 10:33:39.278928 | orchestrator | | accessIPv4 | | 2026-04-03 10:33:39.278936 | orchestrator | | accessIPv6 | | 2026-04-03 10:33:39.278944 | orchestrator | | addresses | test-1=192.168.112.152, 192.168.200.154 | 2026-04-03 10:33:39.278953 | orchestrator | | config_drive | | 2026-04-03 10:33:39.278966 | orchestrator | | created | 2026-04-03T06:54:43Z | 2026-04-03 10:33:39.278978 | orchestrator | | description | None | 2026-04-03 10:33:39.278986 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 10:33:39.278994 | orchestrator | | hostId | 4778386a6db89001da510e3a0d3f27a28c7070f5860caf33764b5c80 | 2026-04-03 10:33:39.279002 | orchestrator | | host_status | None | 2026-04-03 10:33:39.279016 | orchestrator | | id | 111e486f-351d-4ae1-aeda-9a881084f41d | 2026-04-03 10:33:39.279024 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 10:33:39.279033 | orchestrator | | key_name | test | 2026-04-03 10:33:39.279041 | orchestrator | | locked | False | 2026-04-03 10:33:39.279053 | orchestrator | | locked_reason | None | 2026-04-03 10:33:39.279062 | orchestrator | | name | test-1 | 2026-04-03 10:33:39.279073 | orchestrator | | pinned_availability_zone | None | 2026-04-03 10:33:39.279081 | orchestrator | | progress | 0 | 2026-04-03 10:33:39.279089 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 10:33:39.279097 | orchestrator | | properties | hostname='test-1' | 2026-04-03 10:33:39.279111 | orchestrator | | security_groups | name='icmp' | 2026-04-03 10:33:39.279119 | orchestrator | | | name='ssh' | 2026-04-03 10:33:39.279128 | orchestrator | | server_groups | None | 2026-04-03 10:33:39.279139 | orchestrator | | status | ACTIVE | 2026-04-03 10:33:39.279148 | orchestrator | | tags | test | 2026-04-03 10:33:39.279156 | orchestrator | | trusted_image_certificates | None | 2026-04-03 10:33:39.279167 | orchestrator | | updated | 2026-04-03T10:32:28Z | 2026-04-03 10:33:39.279175 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 10:33:39.279183 | orchestrator | | volumes_attached | delete_on_termination='True', id='55623375-d358-4c47-9f49-38b013dbeef0' | 2026-04-03 10:33:39.283056 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:39.544072 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-03 10:33:42.536550 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:42.536742 | orchestrator | | Field | Value | 2026-04-03 10:33:42.536760 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:42.536804 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 10:33:42.536816 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 10:33:42.536828 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 10:33:42.536840 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-03 10:33:42.536852 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 10:33:42.536863 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 10:33:42.536896 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 10:33:42.537004 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 10:33:42.537025 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 10:33:42.537045 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 10:33:42.537058 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 10:33:42.537071 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 10:33:42.537084 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 10:33:42.537103 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 10:33:42.537116 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 10:33:42.537129 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 10:33:42.537152 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 10:33:42.537166 | orchestrator | | accessIPv4 | | 2026-04-03 10:33:42.537186 | orchestrator | | accessIPv6 | | 2026-04-03 10:33:42.537199 | orchestrator | | addresses | test-2=192.168.112.123, 192.168.201.141 | 2026-04-03 10:33:42.537212 | orchestrator | | config_drive | | 2026-04-03 10:33:42.537225 | orchestrator | | created | 2026-04-03T06:54:43Z | 2026-04-03 10:33:42.537238 | orchestrator | | description | None | 2026-04-03 10:33:42.537256 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 10:33:42.537270 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 10:33:42.537283 | orchestrator | | host_status | None | 2026-04-03 10:33:42.537305 | orchestrator | | id | 3fc0f953-94fe-41fb-b32a-9aa0c02a1c2a | 2026-04-03 10:33:42.537326 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 10:33:42.537339 | orchestrator | | key_name | test | 2026-04-03 10:33:42.537352 | orchestrator | | locked | False | 2026-04-03 10:33:42.537365 | orchestrator | | locked_reason | None | 2026-04-03 10:33:42.537378 | orchestrator | | name | test-2 | 2026-04-03 10:33:42.537391 | orchestrator | | pinned_availability_zone | None | 2026-04-03 10:33:42.537410 | orchestrator | | progress | 0 | 2026-04-03 10:33:42.537422 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 10:33:42.537433 | orchestrator | | properties | hostname='test-2' | 2026-04-03 10:33:42.537453 | orchestrator | | security_groups | name='icmp' | 2026-04-03 10:33:42.537472 | orchestrator | | | name='ssh' | 2026-04-03 10:33:42.537484 | orchestrator | | server_groups | None | 2026-04-03 10:33:42.537495 | orchestrator | | status | ACTIVE | 2026-04-03 10:33:42.537506 | orchestrator | | tags | test | 2026-04-03 10:33:42.537517 | orchestrator | | trusted_image_certificates | None | 2026-04-03 10:33:42.537528 | orchestrator | | updated | 2026-04-03T10:32:28Z | 2026-04-03 10:33:42.537544 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 10:33:42.537556 | orchestrator | | volumes_attached | delete_on_termination='True', id='91438361-d7e0-473e-b485-9f527c77ee0b' | 2026-04-03 10:33:42.539902 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:42.805501 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-03 10:33:45.774277 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:45.774425 | orchestrator | | Field | Value | 2026-04-03 10:33:45.774442 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:45.774453 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 10:33:45.774465 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 10:33:45.774476 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 10:33:45.774516 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-03 10:33:45.774528 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 10:33:45.774540 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 10:33:45.774610 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 10:33:45.774624 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 10:33:45.774635 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 10:33:45.774646 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 10:33:45.774657 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 10:33:45.774668 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 10:33:45.774679 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 10:33:45.774748 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 10:33:45.774761 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 10:33:45.774781 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:08.000000 | 2026-04-03 10:33:45.774802 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 10:33:45.774814 | orchestrator | | accessIPv4 | | 2026-04-03 10:33:45.774825 | orchestrator | | accessIPv6 | | 2026-04-03 10:33:45.774836 | orchestrator | | addresses | test-2=192.168.112.194, 192.168.201.48 | 2026-04-03 10:33:45.774848 | orchestrator | | config_drive | | 2026-04-03 10:33:45.774859 | orchestrator | | created | 2026-04-03T06:54:44Z | 2026-04-03 10:33:45.774870 | orchestrator | | description | None | 2026-04-03 10:33:45.774886 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 10:33:45.774904 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 10:33:45.774916 | orchestrator | | host_status | None | 2026-04-03 10:33:45.774936 | orchestrator | | id | 35837532-0e52-4430-aca3-5cf4359eef3c | 2026-04-03 10:33:45.774948 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 10:33:45.774959 | orchestrator | | key_name | test | 2026-04-03 10:33:45.774970 | orchestrator | | locked | False | 2026-04-03 10:33:45.774982 | orchestrator | | locked_reason | None | 2026-04-03 10:33:45.774993 | orchestrator | | name | test-3 | 2026-04-03 10:33:45.775004 | orchestrator | | pinned_availability_zone | None | 2026-04-03 10:33:45.775015 | orchestrator | | progress | 0 | 2026-04-03 10:33:45.775036 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 10:33:45.775048 | orchestrator | | properties | hostname='test-3' | 2026-04-03 10:33:45.775068 | orchestrator | | security_groups | name='icmp' | 2026-04-03 10:33:45.775081 | orchestrator | | | name='ssh' | 2026-04-03 10:33:45.775092 | orchestrator | | server_groups | None | 2026-04-03 10:33:45.775103 | orchestrator | | status | ACTIVE | 2026-04-03 10:33:45.775114 | orchestrator | | tags | test | 2026-04-03 10:33:45.775163 | orchestrator | | trusted_image_certificates | None | 2026-04-03 10:33:45.775176 | orchestrator | | updated | 2026-04-03T10:32:29Z | 2026-04-03 10:33:45.775198 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 10:33:45.775210 | orchestrator | | volumes_attached | delete_on_termination='True', id='e1f37e6f-ea0c-4f38-bf7d-7a267cd421f5' | 2026-04-03 10:33:45.779533 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:46.049641 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-03 10:33:48.988587 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:48.988787 | orchestrator | | Field | Value | 2026-04-03 10:33:48.988806 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:48.988818 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-03 10:33:48.988830 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-03 10:33:48.988841 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-03 10:33:48.988882 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-03 10:33:48.988912 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-03 10:33:48.988924 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-03 10:33:48.988957 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-03 10:33:48.988970 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-03 10:33:48.988981 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-03 10:33:48.988992 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-03 10:33:48.989003 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-03 10:33:48.989014 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-03 10:33:48.989034 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-03 10:33:48.989045 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-03 10:33:48.989062 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-03 10:33:48.989073 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-03T06:55:10.000000 | 2026-04-03 10:33:48.989093 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-03 10:33:48.989107 | orchestrator | | accessIPv4 | | 2026-04-03 10:33:48.989120 | orchestrator | | accessIPv6 | | 2026-04-03 10:33:48.989133 | orchestrator | | addresses | test-3=192.168.112.177, 192.168.202.51 | 2026-04-03 10:33:48.989146 | orchestrator | | config_drive | | 2026-04-03 10:33:48.989167 | orchestrator | | created | 2026-04-03T06:54:45Z | 2026-04-03 10:33:48.989181 | orchestrator | | description | None | 2026-04-03 10:33:48.989193 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-03 10:33:48.989212 | orchestrator | | hostId | abf806d01230e3ef47f4d8870b6cba0ecde65b7e6558d59e3a2d2e93 | 2026-04-03 10:33:48.989225 | orchestrator | | host_status | None | 2026-04-03 10:33:48.989246 | orchestrator | | id | 7a1dd176-cb9c-4e65-bdba-0c7a9157fa79 | 2026-04-03 10:33:48.989261 | orchestrator | | image | N/A (booted from volume) | 2026-04-03 10:33:48.989274 | orchestrator | | key_name | test | 2026-04-03 10:33:48.989287 | orchestrator | | locked | False | 2026-04-03 10:33:48.989300 | orchestrator | | locked_reason | None | 2026-04-03 10:33:48.989318 | orchestrator | | name | test-4 | 2026-04-03 10:33:48.989330 | orchestrator | | pinned_availability_zone | None | 2026-04-03 10:33:48.989346 | orchestrator | | progress | 0 | 2026-04-03 10:33:48.989358 | orchestrator | | project_id | 4ae4187ad30a4b248a54136a4ff95216 | 2026-04-03 10:33:48.989369 | orchestrator | | properties | hostname='test-4' | 2026-04-03 10:33:48.989387 | orchestrator | | security_groups | name='icmp' | 2026-04-03 10:33:48.989400 | orchestrator | | | name='ssh' | 2026-04-03 10:33:48.989412 | orchestrator | | server_groups | None | 2026-04-03 10:33:48.989423 | orchestrator | | status | ACTIVE | 2026-04-03 10:33:48.989442 | orchestrator | | tags | test | 2026-04-03 10:33:48.989454 | orchestrator | | trusted_image_certificates | None | 2026-04-03 10:33:48.989465 | orchestrator | | updated | 2026-04-03T10:32:30Z | 2026-04-03 10:33:48.989481 | orchestrator | | user_id | 4603698d0a414472b47d0a70545c0da9 | 2026-04-03 10:33:48.989493 | orchestrator | | volumes_attached | delete_on_termination='True', id='5b126404-6e04-46e4-a0da-faa62b4369d1' | 2026-04-03 10:33:48.998548 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-03 10:33:49.263348 | orchestrator | + server_ping 2026-04-03 10:33:49.264563 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-03 10:33:49.264821 | orchestrator | ++ tr -d '\r' 2026-04-03 10:33:52.172549 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 10:33:52.172671 | orchestrator | + ping -c3 192.168.112.123 2026-04-03 10:33:52.183912 | orchestrator | PING 192.168.112.123 (192.168.112.123) 56(84) bytes of data. 2026-04-03 10:33:52.184005 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=1 ttl=63 time=6.54 ms 2026-04-03 10:33:53.182126 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=2 ttl=63 time=2.61 ms 2026-04-03 10:33:54.183243 | orchestrator | 64 bytes from 192.168.112.123: icmp_seq=3 ttl=63 time=1.68 ms 2026-04-03 10:33:54.183413 | orchestrator | 2026-04-03 10:33:54.183447 | orchestrator | --- 192.168.112.123 ping statistics --- 2026-04-03 10:33:54.184223 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-03 10:33:54.184246 | orchestrator | rtt min/avg/max/mdev = 1.682/3.610/6.539/2.105 ms 2026-04-03 10:33:54.184790 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 10:33:54.184850 | orchestrator | + ping -c3 192.168.112.177 2026-04-03 10:33:54.197654 | orchestrator | PING 192.168.112.177 (192.168.112.177) 56(84) bytes of data. 2026-04-03 10:33:54.197770 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=1 ttl=63 time=7.92 ms 2026-04-03 10:33:55.192196 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=2 ttl=63 time=1.72 ms 2026-04-03 10:33:56.194283 | orchestrator | 64 bytes from 192.168.112.177: icmp_seq=3 ttl=63 time=1.85 ms 2026-04-03 10:33:56.194395 | orchestrator | 2026-04-03 10:33:56.194411 | orchestrator | --- 192.168.112.177 ping statistics --- 2026-04-03 10:33:56.194424 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2002ms 2026-04-03 10:33:56.194435 | orchestrator | rtt min/avg/max/mdev = 1.721/3.829/7.916/2.890 ms 2026-04-03 10:33:56.194447 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 10:33:56.194459 | orchestrator | + ping -c3 192.168.112.152 2026-04-03 10:33:56.207878 | orchestrator | PING 192.168.112.152 (192.168.112.152) 56(84) bytes of data. 2026-04-03 10:33:56.207945 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=1 ttl=63 time=9.46 ms 2026-04-03 10:33:57.203132 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=2 ttl=63 time=2.82 ms 2026-04-03 10:33:58.205392 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=3 ttl=63 time=1.82 ms 2026-04-03 10:33:58.205494 | orchestrator | 2026-04-03 10:33:58.205511 | orchestrator | --- 192.168.112.152 ping statistics --- 2026-04-03 10:33:58.205522 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-03 10:33:58.205533 | orchestrator | rtt min/avg/max/mdev = 1.819/4.700/9.459/3.389 ms 2026-04-03 10:33:58.205545 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 10:33:58.205556 | orchestrator | + ping -c3 192.168.112.194 2026-04-03 10:33:58.216876 | orchestrator | PING 192.168.112.194 (192.168.112.194) 56(84) bytes of data. 2026-04-03 10:33:58.216945 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=1 ttl=63 time=6.88 ms 2026-04-03 10:33:59.213188 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=2 ttl=63 time=2.67 ms 2026-04-03 10:34:00.212974 | orchestrator | 64 bytes from 192.168.112.194: icmp_seq=3 ttl=63 time=1.40 ms 2026-04-03 10:34:00.213076 | orchestrator | 2026-04-03 10:34:00.213092 | orchestrator | --- 192.168.112.194 ping statistics --- 2026-04-03 10:34:00.213104 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2001ms 2026-04-03 10:34:00.213115 | orchestrator | rtt min/avg/max/mdev = 1.395/3.649/6.882/2.344 ms 2026-04-03 10:34:00.214171 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-03 10:34:00.214210 | orchestrator | + ping -c3 192.168.112.134 2026-04-03 10:34:00.223496 | orchestrator | PING 192.168.112.134 (192.168.112.134) 56(84) bytes of data. 2026-04-03 10:34:00.223558 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=1 ttl=63 time=5.95 ms 2026-04-03 10:34:01.221526 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=2 ttl=63 time=2.45 ms 2026-04-03 10:34:02.221291 | orchestrator | 64 bytes from 192.168.112.134: icmp_seq=3 ttl=63 time=1.59 ms 2026-04-03 10:34:02.221386 | orchestrator | 2026-04-03 10:34:02.221407 | orchestrator | --- 192.168.112.134 ping statistics --- 2026-04-03 10:34:02.221425 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2002ms 2026-04-03 10:34:02.221444 | orchestrator | rtt min/avg/max/mdev = 1.589/3.330/5.949/1.884 ms 2026-04-03 10:34:02.221969 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-03 10:34:02.337084 | orchestrator | ok: Runtime: 0:12:03.148503 2026-04-03 10:34:02.386768 | 2026-04-03 10:34:02.387040 | PLAY RECAP 2026-04-03 10:34:02.387183 | orchestrator | ok: 32 changed: 13 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-03 10:34:02.387250 | 2026-04-03 10:34:02.693217 | RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/upgrade-stable.yml@main] 2026-04-03 10:34:02.698425 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-03 10:34:04.353979 | 2026-04-03 10:34:04.354180 | PLAY [Post output play] 2026-04-03 10:34:04.392827 | 2026-04-03 10:34:04.393023 | LOOP [stage-output : Register sources] 2026-04-03 10:34:04.472207 | 2026-04-03 10:34:04.472551 | TASK [stage-output : Check sudo] 2026-04-03 10:34:05.356998 | orchestrator | sudo: a password is required 2026-04-03 10:34:05.516788 | orchestrator | ok: Runtime: 0:00:00.013477 2026-04-03 10:34:05.532544 | 2026-04-03 10:34:05.532709 | LOOP [stage-output : Set source and destination for files and folders] 2026-04-03 10:34:05.569779 | 2026-04-03 10:34:05.570026 | TASK [stage-output : Build a list of source, dest dictionaries] 2026-04-03 10:34:05.638700 | orchestrator | ok 2026-04-03 10:34:05.651045 | 2026-04-03 10:34:05.651210 | LOOP [stage-output : Ensure target folders exist] 2026-04-03 10:34:06.104683 | orchestrator | ok: "docs" 2026-04-03 10:34:06.105292 | 2026-04-03 10:34:06.359541 | orchestrator | ok: "artifacts" 2026-04-03 10:34:06.617502 | orchestrator | ok: "logs" 2026-04-03 10:34:06.639796 | 2026-04-03 10:34:06.639988 | LOOP [stage-output : Copy files and folders to staging folder] 2026-04-03 10:34:06.682285 | 2026-04-03 10:34:06.682570 | TASK [stage-output : Make all log files readable] 2026-04-03 10:34:06.978760 | orchestrator | ok 2026-04-03 10:34:06.990642 | 2026-04-03 10:34:06.990813 | TASK [stage-output : Rename log files that match extensions_to_txt] 2026-04-03 10:34:07.038407 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:07.054414 | 2026-04-03 10:34:07.054582 | TASK [stage-output : Discover log files for compression] 2026-04-03 10:34:07.078713 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:07.091187 | 2026-04-03 10:34:07.091332 | LOOP [stage-output : Archive everything from logs] 2026-04-03 10:34:07.138712 | 2026-04-03 10:34:07.138937 | PLAY [Post cleanup play] 2026-04-03 10:34:07.147608 | 2026-04-03 10:34:07.147731 | TASK [Set cloud fact (Zuul deployment)] 2026-04-03 10:34:07.215252 | orchestrator | ok 2026-04-03 10:34:07.227405 | 2026-04-03 10:34:07.227564 | TASK [Set cloud fact (local deployment)] 2026-04-03 10:34:07.272565 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:07.289170 | 2026-04-03 10:34:07.289401 | TASK [Clean the cloud environment] 2026-04-03 10:34:07.880230 | orchestrator | 2026-04-03 10:34:07 - clean up servers 2026-04-03 10:34:08.631269 | orchestrator | 2026-04-03 10:34:08 - testbed-manager 2026-04-03 10:34:08.715145 | orchestrator | 2026-04-03 10:34:08 - testbed-node-4 2026-04-03 10:34:08.796370 | orchestrator | 2026-04-03 10:34:08 - testbed-node-1 2026-04-03 10:34:08.883602 | orchestrator | 2026-04-03 10:34:08 - testbed-node-0 2026-04-03 10:34:08.986890 | orchestrator | 2026-04-03 10:34:08 - testbed-node-2 2026-04-03 10:34:09.075838 | orchestrator | 2026-04-03 10:34:09 - testbed-node-3 2026-04-03 10:34:09.168201 | orchestrator | 2026-04-03 10:34:09 - testbed-node-5 2026-04-03 10:34:09.256091 | orchestrator | 2026-04-03 10:34:09 - clean up keypairs 2026-04-03 10:34:09.274967 | orchestrator | 2026-04-03 10:34:09 - testbed 2026-04-03 10:34:09.302236 | orchestrator | 2026-04-03 10:34:09 - wait for servers to be gone 2026-04-03 10:34:20.231766 | orchestrator | 2026-04-03 10:34:20 - clean up ports 2026-04-03 10:34:20.437943 | orchestrator | 2026-04-03 10:34:20 - 120949aa-1121-46a6-80cf-aa65efd283a7 2026-04-03 10:34:20.849003 | orchestrator | 2026-04-03 10:34:20 - 5463496e-e588-49ef-8fd3-56314e022b9d 2026-04-03 10:34:21.137261 | orchestrator | 2026-04-03 10:34:21 - 63676b28-9fae-4225-a715-e131ea9ef345 2026-04-03 10:34:21.409692 | orchestrator | 2026-04-03 10:34:21 - a378ae38-340d-4192-99a4-d3c47e74986e 2026-04-03 10:34:21.706819 | orchestrator | 2026-04-03 10:34:21 - a6018f48-b0b1-4268-bc80-fe1434c5733a 2026-04-03 10:34:21.912060 | orchestrator | 2026-04-03 10:34:21 - e6734f3f-e5c9-4025-9466-68d6a74aadd6 2026-04-03 10:34:22.332853 | orchestrator | 2026-04-03 10:34:22 - ef9c1f55-369f-4a35-b356-36587ad6b1f0 2026-04-03 10:34:22.570786 | orchestrator | 2026-04-03 10:34:22 - clean up volumes 2026-04-03 10:34:22.686397 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-0-node-base 2026-04-03 10:34:22.724572 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-2-node-base 2026-04-03 10:34:22.767386 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-4-node-base 2026-04-03 10:34:22.814584 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-5-node-base 2026-04-03 10:34:22.859095 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-1-node-base 2026-04-03 10:34:22.905210 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-3-node-base 2026-04-03 10:34:22.944764 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-manager-base 2026-04-03 10:34:22.986085 | orchestrator | 2026-04-03 10:34:22 - testbed-volume-4-node-4 2026-04-03 10:34:23.031646 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-5-node-5 2026-04-03 10:34:23.072584 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-1-node-4 2026-04-03 10:34:23.120885 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-7-node-4 2026-04-03 10:34:23.168210 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-2-node-5 2026-04-03 10:34:23.211439 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-3-node-3 2026-04-03 10:34:23.255136 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-0-node-3 2026-04-03 10:34:23.300158 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-8-node-5 2026-04-03 10:34:23.342511 | orchestrator | 2026-04-03 10:34:23 - testbed-volume-6-node-3 2026-04-03 10:34:23.385405 | orchestrator | 2026-04-03 10:34:23 - disconnect routers 2026-04-03 10:34:23.527227 | orchestrator | 2026-04-03 10:34:23 - testbed 2026-04-03 10:34:24.572610 | orchestrator | 2026-04-03 10:34:24 - clean up subnets 2026-04-03 10:34:24.634120 | orchestrator | 2026-04-03 10:34:24 - subnet-testbed-management 2026-04-03 10:34:24.796146 | orchestrator | 2026-04-03 10:34:24 - clean up networks 2026-04-03 10:34:24.986776 | orchestrator | 2026-04-03 10:34:24 - net-testbed-management 2026-04-03 10:34:25.281186 | orchestrator | 2026-04-03 10:34:25 - clean up security groups 2026-04-03 10:34:25.329488 | orchestrator | 2026-04-03 10:34:25 - testbed-management 2026-04-03 10:34:25.451716 | orchestrator | 2026-04-03 10:34:25 - testbed-node 2026-04-03 10:34:25.642565 | orchestrator | 2026-04-03 10:34:25 - clean up floating ips 2026-04-03 10:34:25.675550 | orchestrator | 2026-04-03 10:34:25 - 81.163.193.151 2026-04-03 10:34:26.060689 | orchestrator | 2026-04-03 10:34:26 - clean up routers 2026-04-03 10:34:26.644939 | orchestrator | 2026-04-03 10:34:26 - testbed 2026-04-03 10:34:27.848435 | orchestrator | ok: Runtime: 0:00:19.904242 2026-04-03 10:34:27.852828 | 2026-04-03 10:34:27.853016 | PLAY RECAP 2026-04-03 10:34:27.853152 | orchestrator | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-03 10:34:27.853216 | 2026-04-03 10:34:27.989840 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-03 10:34:27.992389 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-03 10:34:28.745228 | 2026-04-03 10:34:28.745411 | PLAY [Cleanup play] 2026-04-03 10:34:28.761501 | 2026-04-03 10:34:28.761644 | TASK [Set cloud fact (Zuul deployment)] 2026-04-03 10:34:28.820935 | orchestrator | ok 2026-04-03 10:34:28.831337 | 2026-04-03 10:34:28.831586 | TASK [Set cloud fact (local deployment)] 2026-04-03 10:34:28.867327 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:28.884219 | 2026-04-03 10:34:28.884448 | TASK [Clean the cloud environment] 2026-04-03 10:34:30.076265 | orchestrator | 2026-04-03 10:34:30 - clean up servers 2026-04-03 10:34:30.540179 | orchestrator | 2026-04-03 10:34:30 - clean up keypairs 2026-04-03 10:34:30.555188 | orchestrator | 2026-04-03 10:34:30 - wait for servers to be gone 2026-04-03 10:34:30.596316 | orchestrator | 2026-04-03 10:34:30 - clean up ports 2026-04-03 10:34:30.673920 | orchestrator | 2026-04-03 10:34:30 - clean up volumes 2026-04-03 10:34:30.734890 | orchestrator | 2026-04-03 10:34:30 - disconnect routers 2026-04-03 10:34:30.762273 | orchestrator | 2026-04-03 10:34:30 - clean up subnets 2026-04-03 10:34:30.779808 | orchestrator | 2026-04-03 10:34:30 - clean up networks 2026-04-03 10:34:30.942309 | orchestrator | 2026-04-03 10:34:30 - clean up security groups 2026-04-03 10:34:30.979133 | orchestrator | 2026-04-03 10:34:30 - clean up floating ips 2026-04-03 10:34:31.005790 | orchestrator | 2026-04-03 10:34:31 - clean up routers 2026-04-03 10:34:31.424005 | orchestrator | ok: Runtime: 0:00:01.325066 2026-04-03 10:34:31.428063 | 2026-04-03 10:34:31.428226 | PLAY RECAP 2026-04-03 10:34:31.428351 | orchestrator | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-03 10:34:31.428438 | 2026-04-03 10:34:31.570216 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-03 10:34:31.573359 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-03 10:34:32.350282 | 2026-04-03 10:34:32.350496 | PLAY [Base post-fetch] 2026-04-03 10:34:32.366350 | 2026-04-03 10:34:32.366542 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-03 10:34:32.453029 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:32.468547 | 2026-04-03 10:34:32.468762 | TASK [fetch-output : Set log path for single node] 2026-04-03 10:34:32.514956 | orchestrator | ok 2026-04-03 10:34:32.523257 | 2026-04-03 10:34:32.523414 | LOOP [fetch-output : Ensure local output dirs] 2026-04-03 10:34:33.008515 | orchestrator -> localhost | ok: "/var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/logs" 2026-04-03 10:34:33.278093 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/artifacts" 2026-04-03 10:34:33.535270 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/b8f72da348914bada7bcedc63b69f7e9/work/docs" 2026-04-03 10:34:33.569438 | 2026-04-03 10:34:33.569719 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-03 10:34:34.576346 | orchestrator | changed: .d..t...... ./ 2026-04-03 10:34:34.576739 | orchestrator | changed: All items complete 2026-04-03 10:34:34.576796 | 2026-04-03 10:34:35.344657 | orchestrator | changed: .d..t...... ./ 2026-04-03 10:34:36.128569 | orchestrator | changed: .d..t...... ./ 2026-04-03 10:34:36.165019 | 2026-04-03 10:34:36.165189 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-03 10:34:36.192130 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:36.198693 | orchestrator | skipping: Conditional result was False 2026-04-03 10:34:36.210814 | 2026-04-03 10:34:36.211076 | PLAY RECAP 2026-04-03 10:34:36.211259 | orchestrator | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-04-03 10:34:36.211300 | 2026-04-03 10:34:36.349747 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-03 10:34:36.352807 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-03 10:34:37.094738 | 2026-04-03 10:34:37.094936 | PLAY [Base post] 2026-04-03 10:34:37.109760 | 2026-04-03 10:34:37.109904 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-03 10:34:38.123081 | orchestrator | changed 2026-04-03 10:34:38.134188 | 2026-04-03 10:34:38.134320 | PLAY RECAP 2026-04-03 10:34:38.134418 | orchestrator | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-03 10:34:38.134498 | 2026-04-03 10:34:38.256905 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-03 10:34:38.259267 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-03 10:34:39.082874 | 2026-04-03 10:34:39.083054 | PLAY [Base post-logs] 2026-04-03 10:34:39.093986 | 2026-04-03 10:34:39.094134 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-03 10:34:39.548131 | localhost | changed 2026-04-03 10:34:39.565695 | 2026-04-03 10:34:39.565857 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-03 10:34:39.602771 | localhost | ok 2026-04-03 10:34:39.606309 | 2026-04-03 10:34:39.606473 | TASK [Set zuul-log-path fact] 2026-04-03 10:34:39.632310 | localhost | ok 2026-04-03 10:34:39.641589 | 2026-04-03 10:34:39.641707 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-03 10:34:39.678541 | localhost | ok 2026-04-03 10:34:39.684996 | 2026-04-03 10:34:39.685170 | TASK [upload-logs : Create log directories] 2026-04-03 10:34:40.213308 | localhost | changed 2026-04-03 10:34:40.217180 | 2026-04-03 10:34:40.217319 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-03 10:34:40.741588 | localhost -> localhost | ok: Runtime: 0:00:00.007207 2026-04-03 10:34:40.746476 | 2026-04-03 10:34:40.746610 | TASK [upload-logs : Upload logs to log server] 2026-04-03 10:34:41.326017 | localhost | Output suppressed because no_log was given 2026-04-03 10:34:41.330091 | 2026-04-03 10:34:41.330278 | LOOP [upload-logs : Compress console log and json output] 2026-04-03 10:34:41.391270 | localhost | skipping: Conditional result was False 2026-04-03 10:34:41.405915 | localhost | skipping: Conditional result was False 2026-04-03 10:34:41.413230 | 2026-04-03 10:34:41.413553 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-03 10:34:41.469088 | localhost | skipping: Conditional result was False 2026-04-03 10:34:41.469367 | 2026-04-03 10:34:41.474132 | localhost | skipping: Conditional result was False 2026-04-03 10:34:41.486030 | 2026-04-03 10:34:41.486265 | LOOP [upload-logs : Upload console log and json output]